[Xen-users] Help with Disk isn't accessible (Hotplug or Udev Issue)

["Adam Tybor" <adam.tybor@xxxxxxxxx>]

Hi,

I am a total newb to Xen.  I have run the commercial Xen Express
edition for about a day but I wanted to try running the new 3.0.4 rc2.
I have a Gentoo dom0, I have built xen from the latest testing source
archive, but none of my domU's will boot.  I have tried several domU's
all with the same result; ttylinux, fedora, and gentoo.  xm starts
creating the domU then dies while trying access the disk, it is a
loopback file disk.

Below is the output from the xend.log, udevmonitor, domU console, any
help would be appreciated.

[2006-12-18 14:48:26 xend.XendDomainInfo 22323] DEBUG (__init__:1072)
XendDomainInfo.create(['vm', ['name', 'gentoo'], ['memory', 256],
['vcpus', 1], ['on_xend_start', 'ignore'], ['on_xend_stop', 'ignore'],
['image', ['linux', ['kernel', '/boot/vmlinuz-2.6-xen'], ['root',
'/dev/xvdp ro']]], ['device', ['tap', ['uname',
'tap:aio:/tmp/domU-gentoo'], ['dev', 'xvdp'], ['mode', 'w']]]])
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072)
XendConfig.device_add: ['tap', ['uname', 'tap:aio:/tmp/domU-gentoo'],
['dev', 'xvdp'], ['mode', 'w']]
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072) XendConfig:
reading device: {}
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072)
XendConfig.init: {'PV_args': ' root=/dev/xvdp ro', 'PV_bootloader':
'', 'image': {'type': 'linux', 'root': '/dev/xvdp ro'}, 'cpus': [],
'devices': {'7207395e-ae69-2496-2d9d-6ca9892c84a4': ('tap', {'uname':
'tap:aio:/tmp/domU-gentoo', 'mode': 'w', 'dev': 'xvdp', 'uuid':
'7207395e-ae69-2496-2d9d-6ca9892c84a4'})}, 'vcpu_avail': 1,
'features': '', 'actions_after_crash': 'restart', 'platform_std_vga':
False, 'uuid': 'b8ebe84f-6dd0-c8c6-75ed-4d4d7724e404', 'PV_ramdisk':
'', 'name_label': 'gentoo', 'cpu_weight': 256, 'console_refs': [],
'online_vcpus': 1, 'cpu_cap': 0, 'on_xend_stop': 'ignore',
'memory_static_min': 256, 'memory_actual': 0, 'memory_static_max':
256, 'actions_after_shutdown': 'destroy', 'on_xend_start': 'ignore',
'memory_dynamic_max': 256, 'vcpus_number': 1, 'actions_after_suspend':
'', 'memory_dynamic_min': 256, 'vbd_refs':
['7207395e-ae69-2496-2d9d-6ca9892c84a4'], 'PV_kernel':
'/boot/vmlinuz-2.6-xen', 'shadow_memory': 0, 'HVM_boot': '',
'PV_bootloader_args': '', 'actions_after_reboot': 'restart',
'platform_serial': '', 'platform_localtime': False, 'vif_refs': [],
'platform_enable_audio': False, 'vtpm_refs': [], 'security': None,
'max_vcpu_id': 0}
[2006-12-18 14:48:26 xend.XendDomainInfo 22323] DEBUG (__init__:1072)
XendDomainInfo.constructDomain
[2006-12-18 14:48:26 xend.XendDomainInfo 22323] DEBUG (__init__:1072)
XendDomainInfo.initDomain: 15 256
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072) Balloon:
1068472 KiB free; need 262144; done.
[2006-12-18 14:48:26 xend 22323] INFO (__init__:1072) buildDomain
os=linux dom=15 vcpus=1
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072) domid          = 15
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072) memsize        = 256
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072) image
= /boot/vmlinuz-2.6-xen
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072) store_evtchn   = 1
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072) console_evtchn = 2
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072) cmdline
=  root=/dev/xvdp ro
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072) ramdisk        =
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072) vcpus          = 1
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072) features       =
[2006-12-18 14:48:26 xend.XendDomainInfo 22323] INFO (__init__:1072)
createDevice: tap : {'uname': 'tap:aio:/tmp/domU-gentoo', 'mode': 'w',
'dev': 'xvdp', 'uuid': '7207395e-ae69-2496-2d9d-6ca9892c84a4'}
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072) DevController:
writing {'backend-id': '0', 'virtual-device': '51952', 'device-type':
'disk', 'state': '1', 'backend':
'/local/domain/0/backend/tap/15/51952'} to
/local/domain/15/device/vbd/51952.
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072) DevController:
writing {'domain': 'gentoo', 'frontend':
'/local/domain/15/device/vbd/51952', 'uuid':
'7207395e-ae69-2496-2d9d-6ca9892c84a4', 'dev': 'xvdp', 'state': '1',
'params': 'aio:/tmp/domU-gentoo', 'mode': 'w', 'online': '1',
'frontend-id': '15', 'type': 'tap'} to
/local/domain/0/backend/tap/15/51952.
[2006-12-18 14:48:26 xend.XendDomainInfo 22323] DEBUG (__init__:1072)
Storing VM details: {'on_xend_stop': 'ignore', 'shadow_memory': '0',
'uuid': 'b8ebe84f-6dd0-c8c6-75ed-4d4d7724e404', 'name': 'gentoo',
'on_reboot': 'restart', 'start_time': '1166474906.54', 'on_poweroff':
'destroy', 'on_xend_start': 'ignore', 'on_crash': 'restart',
'xend/restart_count': '0', 'vcpus': '1', 'vcpu_avail': '1', 'memory':
'256', 'image': "(linux (root '/dev/xvdp ro'))", 'maxmem': '256'}
[2006-12-18 14:48:26 xend.XendDomainInfo 22323] DEBUG (__init__:1072)
Storing domain details: {'console/ring-ref': '656642', 'console/port':
'2', 'name': 'gentoo', 'console/limit': '1048576', 'vm':
'/vm/b8ebe84f-6dd0-c8c6-75ed-4d4d7724e404', 'domid': '15',
'cpu/0/availability': 'online', 'memory/target': '262144',
'store/ring-ref': '1236131', 'store/port': '1'}
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072) Adding Domain: 15
[2006-12-18 14:48:26 xend.XendDomainInfo 22323] DEBUG (__init__:1072)
Storing domain details: {'console/ring-ref': '656642', 'console/port':
'2', 'name': 'gentoo', 'console/limit': '1048576', 'vm':
'/vm/b8ebe84f-6dd0-c8c6-75ed-4d4d7724e404', 'domid': '15',
'cpu/0/availability': 'online', 'memory/target': '262144',
'store/ring-ref': '1236131', 'store/port': '1'}
[2006-12-18 14:48:26 xend.XendDomainInfo 22323] DEBUG (__init__:1072)
XendDomainInfo.handleShutdownWatch
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072) Waiting for devices vif.
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072) Waiting for devices usb.
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072) Waiting for devices vbd.
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072) Waiting for devices irq.
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072) Waiting for devices vkbd.
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072) Waiting for devices vfb.
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072) Waiting for devices pci.
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072) Waiting for
devices ioports.
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072) Waiting for devices tap.
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072) Waiting for 51952.
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072)
hotplugStatusCallback
/local/domain/0/backend/tap/15/51952/hotplug-status.
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072)
hotplugStatusCallback
/local/domain/0/backend/tap/15/51952/hotplug-status.
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072) hotplugStatusCallback 1.
[2006-12-18 14:48:26 xend 22323] DEBUG (__init__:1072) Waiting for devices vtpm.
[2006-12-18 14:48:26 xend 22323] INFO (__init__:1072) Domain gentoo
(15) unpaused.
[2006-12-18 14:48:26 xend.XendDomainInfo 22323] WARNING
(__init__:1072) Domain has crashed: name=gentoo id=15.
[2006-12-18 14:48:26 xend.XendDomainInfo 22323] DEBUG (__init__:1072)
Storing domain details: {'console/ring-ref': '656642', 'console/port':
'2', 'name': 'gentoo', 'console/limit': '1048576', 'vm':
'/vm/b8ebe84f-6dd0-c8c6-75ed-4d4d7724e404', 'domid': '15',
'cpu/0/availability': 'online', 'memory/target': '262144',
'store/ring-ref': '1236131', 'store/port': '1'}
[2006-12-18 14:48:26 xend.XendDomainInfo 22323] DEBUG (__init__:1072)
Storing domain details: {'console/ring-ref': '656642', 'console/port':
'2', 'name': 'gentoo', 'console/limit': '1048576', 'vm':
'/vm/b8ebe84f-6dd0-c8c6-75ed-4d4d7724e404', 'domid': '15',
'cpu/0/availability': 'online', 'memory/target': '262144',
'store/ring-ref': '1236131', 'store/port': '1'}
[2006-12-18 14:48:26 xend.XendDomainInfo 22323] DEBUG (__init__:1072)
XendDomainInfo.destroyDomain(15)
[2006-12-18 14:48:27 xend.XendDomainInfo 22323] DEBUG (__init__:1072)
XendDomainInfo.create(['domain', ['domid', 15], ['on_crash',
'restart'], ['memory', 256], ['uuid',
'b8ebe84f-6dd0-c8c6-75ed-4d4d7724e404'], ['maxmem', 256], ['name',
'gentoo'], ['on_poweroff', 'destroy'], ['on_reboot', 'restart'],
['localtime', 0], ['vcpus', 1], ['shadow_memory', 0], ['vcpu_avail',
1], ['cpu_weight', 256], ['cpu_cap', 0], ['features', ''],
['on_xend_start', 'ignore'], ['on_xend_stop', 'ignore'],
['start_time', 1166474906.5428669], ['cpu_time', 0.20035043699999999],
['online_vcpus', 1], ['image', ['linux', ['root', '/dev/xvdp ro']]],
['status', 0], ['memory_dynamic_min', 256], ['memory_dynamic_max',
256], ['state', '----c-'], ['store_mfn', 1236131], ['console_mfn',
656642], ['device', ['tap', ['uname', 'tap:aio:/tmp/domU-gentoo'],
['uuid', '7207395e-ae69-2496-2d9d-6ca9892c84a4'], ['mode', 'w'],
['dev', 'xvdp:disk'], ['backend', 0]]]])
[2006-12-18 14:48:27 xend 22323] DEBUG (__init__:1072)
XendConfig.device_add: ['tap', ['uname', 'tap:aio:/tmp/domU-gentoo'],
['uuid', '7207395e-ae69-2496-2d9d-6ca9892c84a4'], ['mode', 'w'],
['dev', 'xvdp:disk'], ['backend', 0]]
[2006-12-18 14:48:27 xend 22323] DEBUG (__init__:1072) XendConfig:
reading device: {}
[2006-12-18 14:48:27 xend 22323] DEBUG (__init__:1072)
XendConfig.init: {'PV_args': ' root=/dev/xvdp ro', 'PV_bootloader':
'', 'image': {'type': 'linux', 'root': '/dev/xvdp ro'}, 'cpus': [],
'devices': {'7207395e-ae69-2496-2d9d-6ca9892c84a4': ('tap', {'uname':
'tap:aio:/tmp/domU-gentoo', 'mode': 'w', 'uuid':
'7207395e-ae69-2496-2d9d-6ca9892c84a4', 'dev': 'xvdp:disk', 'backend':
0})}, 'vcpu_avail': 1, 'features': '', 'actions_after_crash':
'restart', 'platform_std_vga': False, 'uuid':
'b8ebe84f-6dd0-c8c6-75ed-4d4d7724e404', 'PV_ramdisk': '',
'name_label': 'gentoo', 'cpu_weight': 256, 'console_refs': [],
'online_vcpus': 1, 'cpu_cap': 0, 'vif_refs': [], 'on_xend_stop':
'ignore', 'memory_static_min': 256, 'start_time': 1166474906.5428669,
'memory_actual': 0, 'memory_static_max': 256,
'actions_after_shutdown': 'destroy', 'on_xend_start': 'ignore',
'memory_dynamic_max': 256, 'vcpus_number': 1, 'actions_after_suspend':
'', 'memory_dynamic_min': 256, 'vbd_refs':
['7207395e-ae69-2496-2d9d-6ca9892c84a4'], 'PV_kernel': '', 'cpu_time':
0.20035043699999999, 'shadow_memory': 0, 'HVM_boot': '',
'PV_bootloader_args': '', 'actions_after_reboot': 'restart',
'platform_serial': '', 'platform_localtime': False, 'status': 0,
'platform_enable_audio': False, 'vtpm_refs': [], 'security': None,
'max_vcpu_id': 0}
[2006-12-18 14:48:27 xend.XendDomainInfo 22323] DEBUG (__init__:1072)
XendDomainInfo.constructDomain
[2006-12-18 14:48:27 xend.XendDomainInfo 22323] DEBUG (__init__:1072)
XendDomainInfo.initDomain: 16 256
[2006-12-18 14:48:27 xend.XendDomainInfo 22323] INFO (__init__:1072)
Mounting /tmp/domU-gentoo on /dev/xvdp.
[2006-12-18 14:48:27 xend.XendDomainInfo 22323] DEBUG (__init__:1072)
create_vbd_with_vdi: {'device': '/dev/xvdp', 'image':
'/tmp/domU-gentoo', 'mode': 'RO'}
[2006-12-18 14:48:27 xend 22323] DEBUG (__init__:1072)
XendConfig.device_add: {'device': '/dev/xvdp', 'image':
'/tmp/domU-gentoo', 'mode': 'RO'}
[2006-12-18 14:48:27 xend 22323] DEBUG (__init__:1072) DevController:
writing {'backend-id': '0', 'virtual-device': '51952', 'device-type':
'disk', 'state': '1', 'backend':
'/local/domain/0/backend/tap/0/51952'} to
/local/domain/0/device/vbd/51952.
[2006-12-18 14:48:27 xend 22323] DEBUG (__init__:1072) DevController:
writing {'domain': 'Domain-0', 'frontend':
'/local/domain/0/device/vbd/51952', 'uuid':
'025632d3-016b-56fb-4124-0af3543c1c87', 'dev': '/dev/xvdp', 'state':
'1', 'params': 'qcow:/tmp/domU-gentoo', 'mode': 'r', 'online': '1',
'frontend-id': '0', 'type': 'tap'} to
/local/domain/0/backend/tap/0/51952.
[2006-12-18 14:48:27 xend 22323] DEBUG (__init__:1072) Waiting for 51952.
[2006-12-18 14:48:27 xend 22323] DEBUG (__init__:1072)
hotplugStatusCallback
/local/domain/0/backend/tap/0/51952/hotplug-status.
[2006-12-18 14:48:27 xend 22323] DEBUG (__init__:1072)
hotplugStatusCallback
/local/domain/0/backend/tap/0/51952/hotplug-status.
[2006-12-18 14:48:27 xend 22323] DEBUG (__init__:1072) hotplugStatusCallback 1.
[2006-12-18 14:48:27 xend 22323] ERROR (__init__:1072) Disk isn't accessible
[2006-12-18 14:48:27 xend.XendDomainInfo 22323] INFO (__init__:1072)
Unmounting /dev/xvdp from /dev/xvdp.
[2006-12-18 14:48:27 xend.XendDomainInfo 22323] ERROR (__init__:1072)
VM start failed
Traceback (most recent call last):
 File "//usr/lib/python/xen/xend/XendDomainInfo.py", line 385, in start
   self._initDomain()
 File "//usr/lib/python/xen/xend/XendDomainInfo.py", line 1332, in _initDomain
   self._configureBootloader()
 File "//usr/lib/python/xen/xend/XendDomainInfo.py", line 1586, in
_configureBootloader
   bootloader_args, kernel, ramdisk, args)
 File "//usr/lib/python/xen/xend/XendBootloader.py", line 40, in bootloader
   raise VmError(msg)
VmError: Disk isn't accessible
[2006-12-18 14:48:27 xend.XendDomainInfo 22323] DEBUG (__init__:1072)
XendDomainInfo.destroy: domid=16
[2006-12-18 14:48:27 xend.XendDomainInfo 22323] DEBUG (__init__:1072)
XendDomainInfo.destroyDomain(16)
[2006-12-18 14:48:27 xend.XendDomainInfo 22323] ERROR (__init__:1072)
Domain construction failed
Traceback (most recent call last):
 File "//usr/lib/python/xen/xend/XendDomainInfo.py", line 97, in create
   vm.start()
 File "//usr/lib/python/xen/xend/XendDomainInfo.py", line 385, in start
   self._initDomain()
 File "//usr/lib/python/xen/xend/XendDomainInfo.py", line 1332, in _initDomain
   self._configureBootloader()
 File "//usr/lib/python/xen/xend/XendDomainInfo.py", line 1586, in
_configureBootloader
   bootloader_args, kernel, ramdisk, args)
 File "//usr/lib/python/xen/xend/XendBootloader.py", line 40, in bootloader
   raise VmError(msg)
VmError: Disk isn't accessible
[2006-12-18 14:48:27 xend.XendDomainInfo 22323] DEBUG (__init__:1072)
XendDomainInfo.destroy: domid=None
[2006-12-18 14:48:27 xend.XendDomainInfo 22323] DEBUG (__init__:1072)
XendDomainInfo.destroyDomain(None)
[2006-12-18 14:48:27 xend.XendDomainInfo 22323] ERROR (__init__:1072)
Failed to restart domain 15.
Traceback (most recent call last):
 File "//usr/lib/python/xen/xend/XendDomainInfo.py", line 1100, in _restart
   new_dom = XendDomain.instance().domain_create(config)
 File "//usr/lib/python/xen/xend/XendDomain.py", line 856, in domain_create
   dominfo = XendDomainInfo.create(config)
 File "//usr/lib/python/xen/xend/XendDomainInfo.py", line 97, in create
   vm.start()
 File "//usr/lib/python/xen/xend/XendDomainInfo.py", line 385, in start
   self._initDomain()
 File "//usr/lib/python/xen/xend/XendDomainInfo.py", line 1332, in _initDomain
   self._configureBootloader()
 File "//usr/lib/python/xen/xend/XendDomainInfo.py", line 1586, in
_configureBootloader
   bootloader_args, kernel, ramdisk, args)
 File "//usr/lib/python/xen/xend/XendBootloader.py", line 40, in bootloader
   raise VmError(msg)
VmError: Disk isn't accessible


#devmonitor
UEVENT[1166475875.492532] add@/devices/xen-backend/tap-17-51952
UDEV  [1166475875.508526] add@/devices/xen-backend/tap-17-51952
UEVENT[1166475875.878410] remove@/devices/xen-backend/tap-17-51952
UDEV  [1166475875.910903] remove@/devices/xen-backend/tap-17-51952
UEVENT[1166475875.954446] add@/devices/xen-backend/tap-0-51952
UEVENT[1166475875.958252] add@/devices/xen/vbd-51952
UDEV  [1166475876.001588] add@/devices/xen-backend/tap-0-51952
UDEV  [1166475876.013458] add@/devices/xen/vbd-51952

#domU console
Using config file "/etc/xen/gentoo.cfg".
Started domain gentoo
Bootdata ok (command line is  root=/dev/xvdp ro)
Linux version 2.6.16.33-xen (root@payton) (gcc version 4.1.1 (Gentoo
4.1.1-r1)) #3 SMP Mon Dec 18 14:18:32 CST 2006
BIOS-provided physical RAM map:
Xen: 0000000000000000 - 0000000010800000 (usable)
No mptable found.
Built 1 zonelists
Kernel command line:  root=/dev/xvdp ro
Initializing CPU#0
PID hash table entries: 2048 (order: 11, 65536 bytes)
Xen reported: 2327.500 MHz processor.
Console: colour dummy device 80x25
Dentry cache hash table entries: 65536 (order: 7, 524288 bytes)
Inode-cache hash table entries: 32768 (order: 6, 262144 bytes)
Software IO TLB disabled
Memory: 250516k/270336k available (3076k kernel code, 11308k reserved,
1584k data, 192k init)
Calibrating delay using timer specific routine.. 4657.48 BogoMIPS (lpj=23287435)
Security Framework v1.0.0 initialized
Capability LSM initialized
Mount-cache hash table entries: 256
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 4096K
CPU: L3 cache: 4096K
CPU: Physical Processor ID: 3
CPU: Processor Core ID: 1
Brought up 1 CPUs
migration_cost=0
DMI not present or invalid.
Grant table initialized
NET: Registered protocol family 16
Brought up 1 CPUs
PCI: setting up Xen PCI frontend stub
ACPI: Subsystem revision 20060127
ACPI: Interpreter disabled.
Linux Plug and Play Support v0.97 (c) Adam Belay
pnp: PnP ACPI: disabled
xen_mem: Initialising balloon driver.
SCSI subsystem initialized
PCI: System does not support PCI
PCI: System does not support PCI
IA-32 Microcode Update Driver: v1.14-xen <tigran@xxxxxxxxxxx>
IA32 emulation $Id: sys_ia32.c,v 1.32 2002/03/24 13:02:28 ak Exp $
audit: initializing netlink socket (disabled)
audit(1166475872.579:1): initialized
VFS: Disk quotas dquot_6.5.1
Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
NTFS driver 2.1.26 [Flags: R/W].
Initializing Cryptographic API
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered (default)
io scheduler cfq registered
vga16fb: mapped to 0xffffffffff518000

_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users