[Xen-users] SUSE 10.0 - DomU hang on start / Incrementing ethX numbers...

[Tony Clark <tony.clark@xxxxxxxxxx>]

Hi there,

I am running a system with Xen3.0, Suse 10.0, Dual Xeon, 4GB ram, Megaraid and am experimenting with setting up some LVM backed xen domains.  All was going well until I started seeing the domU's hang upon startup with:

franklin:/home/tony # xm create bleem
Using config file "/etc/xen/bleem".
Error: Error creating domain: Device 769 (vbd) could not be connected. Hotplug scripts not working

after which, when the domains did start, the ethernet interface inside the domain had an increasing number (eth[1-6]) which is causing some confusion with my ifcfg-eth0 script in the domU .  The hotplug log on hang looks like this:

franklin:/etc/xen # cat /var/log/xen-hotplug.log 
xenstore-read: couldn't read path backend/vbd/8/769/physical-device
xenstore-read: couldn't read path backend/vbd/8/769/mode
xenstore-read: couldn't read path backend/vbd/8/769/type
xenstore-read: couldn't read path backend/vbd/8/769/node

I've scoured the lists for things like this and can't see anything of relevance.  My RPM set looks like this:

kernel-xen-nongpl-2.6.13-15.7
xen-tools-3.0_7608-2.1
xen-doc-html-3.0_8259-0.1
xen-tools-ioemu-3.0_7608-2.1
xen-tools-3.0_8259-0.1
kernel-xen-2.6.13-15.7
xen-3.0_7608-2.1

I'm at a bit of a loss here; I can't see how to force the eth to a particular number and feel the 2 issues (the hang and renumbering) may indeed be related hence my bundling of the issues to a single mail.  I'd appreciate any guidance on this that's out there; I'd tried going forward to the newer Xen RPMs from Kurt Garloff's repository but it caused different issues like not booting at all...

Any help would be much appreciated!

Many thanks!

Tony

From Syslog:

Jan 24 01:49:53 franklin logger: xen-vbd: vbd-11-769 up [backend/vbd/11/769]
Jan 24 01:49:54 franklin logger: /etc/xen/scripts/block: bind /dev/system/bleem XENBUS_PATH=backend/vbd/11/769
Jan 24 01:49:54 franklin logger: /etc/xen/scripts/block: Writing backend/vbd/11/769/physical-device 0xfd03 backend/vbd/11/769/node /dev/system/bleem to xenstore.
Jan 24 01:49:54 franklin logger: /etc/xen/scripts/block: Writing backend/vbd/11/769/hotplug-status connected to xenstore.
Jan 24 01:49:54 franklin logger: xen-vbd: vbd-11-770 up [backend/vbd/11/770]
Jan 24 01:49:54 franklin logger: /etc/xen/scripts/block: bind /dev/system/bleem.swap XENBUS_PATH=backend/vbd/11/770
Jan 24 01:49:54 franklin logger: /etc/xen/scripts/block: Writing backend/vbd/11/770/physical-device 0xfd04 backend/vbd/11/770/node /dev/system/bleem.swap to xenstore.
Jan 24 01:49:54 franklin logger: /etc/xen/scripts/block: Writing backend/vbd/11/770/hotplug-status connected to xenstore.
Jan 24 01:49:54 franklin logger: xen-vif: vif-11-0 up [backend/vif/11/0]
Jan 24 01:49:54 franklin logger: /etc/xen/scripts/vif-bridge: up XENBUS_PATH=backend/vif/11/0
Jan 24 01:49:54 franklin kernel: device vif11.0 entered promiscuous mode
Jan 24 01:49:54 franklin kernel: xenbr0: port 3(vif11.0) entering learning state
Jan 24 01:49:54 franklin kernel: xenbr0: topology change detected, propagating
Jan 24 01:49:54 franklin kernel: xenbr0: port 3(vif11.0) entering forwarding state
Jan 24 01:49:54 franklin logger: /etc/xen/scripts/vif-bridge: Writing backend/vif/11/0/hotplug-status connected to xenstore.
Jan 24 01:49:54 franklin logger: /etc/xen/scripts/vif-bridge: Successful vif-bridge operation for vif11.0, bridge xenbr0.
Jan 24 01:49:59 franklin ifup: No configuration found for vif11.0
Jan 24 01:50:05 franklin kernel: vif11.0: no IPv6 routers present

From xend.log:

[2006-01-24 01:49:53 xend.XendDomainInfo] DEBUG (XendDomainInfo:149) XendDomainInfo.create(['vm', ['name', 'bleem'], ['memory', '256'], ['on_poweroff', 'destroy'], ['on_reboot', 'restart'], ['on_crash', 'restart'], ['image', ['linux', ['kernel', '/boot/vmlinuz-xen'], ['root', '/dev/hda1 ro'], ['args', '3'], ['vcpus', '1'], ['vcpus', '1'], ['boot', 'c']]], ['device', ['vbd', ['uname', 'phy:/dev/system/bleem'], ['dev', 'hda1'], ['mode', 'w']]], ['device', ['vbd', ['uname', 'phy:/dev/system/bleem.swap'], ['dev', 'hda2'], ['mode', 'w']]], ['device', ['vif', ['mac', 'aa:00:00:42:fb:31'], ['bridge', 'xenbr0']]]])
[2006-01-24 01:49:53 xend.XendDomainInfo] DEBUG (XendDomainInfo:252) parseConfig: config is ['vm', ['name', 'bleem'], ['memory', '256'], ['on_poweroff', 'destroy'], ['on_reboot', 'restart'], ['on_crash', 'restart'], ['image', ['linux', ['kernel', '/boot/vmlinuz-xen'], ['root', '/dev/hda1 ro'], ['args', '3'], ['vcpus', '1'], ['vcpus', '1'], ['boot', 'c']]], ['device', ['vbd', ['uname', 'phy:/dev/system/bleem'], ['dev', 'hda1'], ['mode', 'w']]], ['device', ['vbd', ['uname', 'phy:/dev/system/bleem.swap'], ['dev', 'hda2'], ['mode', 'w']]], ['device', ['vif', ['mac', 'aa:00:00:42:fb:31'], ['bridge', 'xenbr0']]]]
[2006-01-24 01:49:53 xend.XendDomainInfo] DEBUG (XendDomainInfo:306) parseConfig: result is {'ssidref': None, 'name': 'bleem', 'bootloader': None, 'on_reboot': 'restart', 'image': ['linux', ['kernel', '/boot/vmlinuz-xen'], ['root', '/dev/hda1 ro'], ['args', '3'], ['vcpus', '1'], ['vcpus', '1'], ['boot', 'c']], 'on_poweroff': 'destroy', 'on_crash': 'restart', 'backend': [], 'vcpus': 1, 'cpu_weight': None, 'vcpu_avail': None, 'memory': 256, 'device': [('vbd', ['vbd', ['uname', 'phy:/dev/system/bleem'], ['dev', 'hda1'], ['mode', 'w']]), ('vbd', ['vbd', ['uname', 'phy:/dev/system/bleem.swap'], ['dev', 'hda2'], ['mode', 'w']]), ('vif', ['vif', ['mac', 'aa:00:00:42:fb:31'], ['bridge', 'xenbr0']])], 'maxmem': None, 'cpu': None, 'uuid': None}
[2006-01-24 01:49:53 xend.XendDomainInfo] DEBUG (XendDomainInfo:999) XendDomainInfo.construct: None 0
[2006-01-24 01:49:53 xend.XendDomainInfo] DEBUG (XendDomainInfo:1028) XendDomainInfo.initDomain: 11 1.0
[2006-01-24 01:49:53 xend] INFO (image:131) buildDomain os=linux dom=11 vcpus=1
[2006-01-24 01:49:53 xend] DEBUG (image:169) dom            = 11
[2006-01-24 01:49:53 xend] DEBUG (image:170) image          = /boot/vmlinuz-xen
[2006-01-24 01:49:53 xend] DEBUG (image:171) store_evtchn   = 1
[2006-01-24 01:49:53 xend] DEBUG (image:172) console_evtchn = 2
[2006-01-24 01:49:53 xend] DEBUG (image:173) cmdline        =  root=/dev/hda1 ro 3
[2006-01-24 01:49:53 xend] DEBUG (image:174) ramdisk        = 
[2006-01-24 01:49:53 xend] DEBUG (image:175) vcpus          = 1
[2006-01-24 01:49:53 xend] DEBUG (blkif:24) exception looking up device number for hda1: [Errno 2] No such file or directory: '/dev/hda1'
[2006-01-24 01:49:53 xend] DEBUG (DevController:256) DevController: writing {'virtual-device': '769', 'backend-id': '0', 'backend': '/local/domain/0/backend/vbd/11/769'} to /local/domain/11/device/vbd/769.
[2006-01-24 01:49:53 xend] DEBUG (DevController:258) DevController: writing {'domain': 'bleem', 'params': '/dev/system/bleem', 'frontend-id': '11', 'type': 'phy', 'dev': 'hda1', 'frontend': '/local/domain/11/device/vbd/769'} to /local/domain/0/backend/vbd/11/769.
[2006-01-24 01:49:54 xend] DEBUG (blkif:24) exception looking up device number for hda2: [Errno 2] No such file or directory: '/dev/hda2'
[2006-01-24 01:49:54 xend] DEBUG (DevController:256) DevController: writing {'virtual-device': '770', 'backend-id': '0', 'backend': '/local/domain/0/backend/vbd/11/770'} to /local/domain/11/device/vbd/770.
[2006-01-24 01:49:54 xend] DEBUG (DevController:258) DevController: writing {'domain': 'bleem', 'params': '/dev/system/bleem.swap', 'frontend-id': '11', 'type': 'phy', 'dev': 'hda2', 'frontend': '/local/domain/11/device/vbd/770'} to /local/domain/0/backend/vbd/11/770.
[2006-01-24 01:49:54 xend] DEBUG (DevController:256) DevController: writing {'backend-id': '0', 'mac': 'aa:00:00:42:fb:31', 'handle': '0', 'backend': '/local/domain/0/backend/vif/11/0'} to /local/domain/11/device/vif/0.
[2006-01-24 01:49:54 xend] DEBUG (DevController:258) DevController: writing {'bridge': 'xenbr0', 'mac': 'aa:00:00:42:fb:31', 'handle': '0', 'script': '/etc/xen/scripts/vif-bridge', 'frontend-id': '11', 'domain': 'bleem', 'frontend': '/local/domain/11/device/vif/0'} to /local/domain/0/backend/vif/11/0.
[2006-01-24 01:49:54 xend.XendDomainInfo] DEBUG (XendDomainInfo:545) Storing VM details: {'ssidref': '0', 'uuid': '874f6377-7248-0dd6-6802-2ade4519a43c', 'on_reboot': 'restart', 'image': "(linux (kernel /boot/vmlinuz-xen) (root '/dev/hda1 ro') (args 3) (vcpus 1) (vcpus 1) (boot c))", 'on_poweroff': 'destroy', 'name': 'bleem', 'vcpus': '1', 'vcpu_avail': '1', 'memory': '256', 'on_crash': 'restart', 'maxmem': '256'}
[2006-01-24 01:49:54 xend.XendDomainInfo] DEBUG (XendDomainInfo:570) Storing domain details: {'console/ring-ref': '891425', 'console/port': '2', 'name': 'bleem', 'console/limit': '1048576', 'vm': '/vm/874f6377-7248-0dd6-6802-2ade4519a43c', 'domid': '11', 'cpu/0/availability': 'online', 'memory/target': '262144', 'store/ring-ref': '891426', 'store/port': '1'}
[2006-01-24 01:49:54 xend] INFO (XendDomain:349) Domain bleem (11) unpaused.

/etc/xen/bleem:

franklin:/etc/xen # cat bleem
#  -*- mode: python; -*-
kernel = "/boot/vmlinuz-xen"
#ramdisk = "/boot/initrd-xen"
# Initial memory allocation (in megabytes) for the new domain.
memory = 256
# A name for your domain. All domains must have different names.
name = "bleem"
# Optionally define mac and/or bridge for the network interfaces.
# Random MACs are assigned if not given.
vif = [ 'bridge=xenbr0' ]

disk = [ 'phy:/dev/system/bleem,hda1,w','phy:/dev/system/bleem.swap,hda2,w' ]
# Set root device.
root = "/dev/hda1 ro"

# Sets runlevel 4.
extra = "3"
on_poweroff = 'destroy'
on_reboot   = 'restart'
on_crash    = 'restart'


tony clark
director - tony.clark@xxxxxxxxxx
--------------------------------------------------------------- 
rising sun pictures - www.rsp.com.au 
redefining visual effects delivery 
---------------------------------------------------------------
address	level 1 / 133 gouger street
adelaide south australia 5000
---------------------------------------------------------------  
adelaide ph +61 8 8400 6400 fax +61 8 8400 6401 
sydney    ph +61 2 9338 6400 fax +61 2 9338 6401
--------------------------------------------------------------- 
rising sun research - http://research.rsp.com.au 
---------------------------------------------------------------
_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users