Hello to everyone.
Here is the problem.
Everything was working ok, the server was rebooted about one week
ago and all virtual machines started without any problem, there
isn't any important update in this week and now I have such problem:
When i try to start new instance i get:
Error: Device 0 (vif) could not be connected. Hotplug scripts not
working.
But the problem isn't in bridging or such stuff. So, if i remove vif
from guest config, there will be same error, but about vdb device.
So, how is possible to me fix this? How can i understand which one
of scrips exactli "not working". I tried to add "touch /tmp/foonar"
to xen-hotplug-common.sh script in /etc/xen, but it looks like it
isn't runned by xm create at all (if i run it by hands - file
appears, but after xm create - don't).
So here is some logs like /var/log/xen/xend.log:
[2011-12-14 21:44:17 11562] DEBUG (XendDomainInfo:101)
XendDomainInfo.create(['vm', ['name', 'osmium'], ['memory', '512'],
['on_poweroff', 'destroy'],
Â['on_reboot', 'restart'], ['on_crash', 'restart'],
['on_xend_start', 'ignore'], ['on_xend_stop', 'ignore'], ['vcpus',
1], ['oos', 1], ['image', ['lin
ux', ['kernel', '/boot/vmlinuz-2.6.26-2-xen-amd64'], ['ramdisk',
'/boot/initrd.img-2.6.26-2-xen-amd64'], ['root', '/dev/xvda2 ro'],
['videoram', 4], [
'tsc_mode', 0], ['nomigrate', 0]]], ['s3_integrity', 1], ['device',
['vbd', ['uname', 'phy:/dev/xen-data/osmium-swap'], ['dev',
'xvda1'], ['mode', 'w'
]]], ['device', ['vbd', ['uname', 'phy:/dev/xen-data/osmium-disk'],
['dev', 'xvda2'], ['mode', 'w']]], ['device', ['vif', ['ip',
'193.106.92.235'], ['
mac', '00:16:3E:D9:15:D1']]]])
[2011-12-14 21:44:17 11562] DEBUG (XendDomainInfo:2508)
XendDomainInfo.constructDomain
[2011-12-14 21:44:17 11562] DEBUG (balloon:220) Balloon: 22077188
KiB free; need 16384; done.
[2011-12-14 21:44:17 11562] DEBUG (XendDomain:464) Adding Domain:
110
[2011-12-14 21:44:17 11562] DEBUG (XendDomainInfo:2818)
XendDomainInfo.initDomain: 110 256
[2011-12-14 21:44:17 11562] DEBUG (XendDomainInfo:2845)
_initDomain:shadow_memory=0x0, memory_static_max=0x20000000,
memory_static_min=0x0.
[2011-12-14 21:44:17 11562] INFO (image:182) buildDomain os=linux
dom=110 vcpus=1
[2011-12-14 21:44:17 11562] DEBUG (image:721) domidÂÂÂÂÂÂÂÂÂ = 110
[2011-12-14 21:44:17 11562] DEBUG (image:722) memsizeÂÂÂÂÂÂÂ = 512
[2011-12-14 21:44:17 11562] DEBUG (image:723) imageÂÂÂÂÂÂÂÂÂ =
/boot/vmlinuz-2.6.26-2-xen-amd64
[2011-12-14 21:44:17 11562] DEBUG (image:724) store_evtchnÂÂ = 1
[2011-12-14 21:44:17 11562] DEBUG (image:725) console_evtchn = 2
[2011-12-14 21:44:17 11562] DEBUG (image:726) cmdlineÂÂÂÂÂÂÂ =
root=/dev/xvda2 ro
[2011-12-14 21:44:17 11562] DEBUG (image:727) ramdiskÂÂÂÂÂÂÂ =
/boot/initrd.img-2.6.26-2-xen-amd64
[2011-12-14 21:44:17 11562] DEBUG (image:728) vcpusÂÂÂÂÂÂÂÂÂ = 1
[2011-12-14 21:44:17 11562] DEBUG (image:729) featuresÂÂÂÂÂÂ =
[2011-12-14 21:44:17 11562] DEBUG (image:730) flagsÂÂÂÂÂÂÂÂÂ = 0
[2011-12-14 21:44:17 11562] DEBUG (image:731) superpagesÂÂÂÂ = 0
[2011-12-14 21:44:18 11562] INFO (XendDomainInfo:2367) createDevice:
vbd : {'uuid': '82f280fa-df4f-dc5c-ff4f-8fac6e776a7f', 'bootable':
1, 'driver': '
paravirtualised', 'dev': 'xvda1', 'uname':
'phy:/dev/xen-data/osmium-swap', 'mode': 'w'}
[2011-12-14 21:44:18 11562] DEBUG (DevController:95) DevController:
writing {'virtual-device': '51713', 'device-type': 'disk',
'protocol': 'x86_64-abi
', 'backend-id': '0', 'state': '1', 'backend':
'/local/domain/0/backend/vbd/110/51713'} to
/local/domain/110/device/vbd/51713.
[2011-12-14 21:44:18 11562] DEBUG (DevController:97) DevController:
writing {'domain': 'osmium', 'frontend':
'/local/domain/110/device/vbd/51713', 'uu
id': '82f280fa-df4f-dc5c-ff4f-8fac6e776a7f', 'bootable': '1', 'dev':
'xvda1', 'state': '1', 'params': '/dev/xen-data/osmium-swap',
'mode': 'w', 'onlin
e': '1', 'frontend-id': '110', 'type': 'phy'} to
/local/domain/0/backend/vbd/110/51713.
[2011-12-14 21:44:18 11562] INFO (XendDomainInfo:2367) createDevice:
vbd : {'uuid': '4370c698-38ba-89a9-4c66-89674c05a49b', 'bootable':
0, 'driver': '
paravirtualised', 'dev': 'xvda2', 'uname':
'phy:/dev/xen-data/osmium-disk', 'mode': 'w'}
[2011-12-14 21:44:18 11562] DEBUG (DevController:95) DevController:
writing {'virtual-device': '51714', 'device-type': 'disk',
'protocol': 'x86_64-abi
', 'backend-id': '0', 'state': '1', 'backend':
'/local/domain/0/backend/vbd/110/51714'} to
/local/domain/110/device/vbd/51714.
[2011-12-14 21:44:18 11562] DEBUG (DevController:97) DevController:
writing {'domain': 'osmium', 'frontend':
'/local/domain/110/device/vbd/51714', 'uu
id': '4370c698-38ba-89a9-4c66-89674c05a49b', 'bootable': '0', 'dev':
'xvda2', 'state': '1', 'params': '/dev/xen-data/osmium-disk',
'mode': 'w', 'onlin
e': '1', 'frontend-id': '110', 'type': 'phy'} to
/local/domain/0/backend/vbd/110/51714.
[2011-12-14 21:44:18 11562] INFO (XendDomainInfo:2367) createDevice:
vif : {'ip': '193.106.92.235', 'mac': '00:16:3E:D9:15:D1', 'uuid':
'afd029dd-5a5d
-e65b-4615-03761cfdc984'}
[2011-12-14 21:44:18 11562] DEBUG (DevController:95) DevController:
writing {'mac': '00:16:3E:D9:15:D1', 'handle': '0', 'protocol':
'x86_64-abi', 'bac
kend-id': '0', 'state': '1', 'backend':
'/local/domain/0/backend/vif/110/0'} to
/local/domain/110/device/vif/0.
[2011-12-14 21:44:18 11562] DEBUG (DevController:97) DevController:
writing {'domain': 'osmium', 'handle': '0', 'uuid':
'afd029dd-5a5d-e65b-4615-03761
cfdc984', 'script': '/etc/xen/scripts/vif-bridge', 'ip':
'193.106.92.235', 'mac': '00:16:3E:D9:15:D1', 'frontend-id': '110',
'state': '1', 'online': '
1', 'frontend': '/local/domain/110/device/vif/0'} to
/local/domain/0/backend/vif/110/0.
[2011-12-14 21:44:18 11562] DEBUG (XendDomainInfo:3400) Storing VM
details: {'on_xend_stop': 'ignore', 'shadow_memory': '0', 'uuid':
'ec1368e5-94f5-3e
1a-dabe-010efdb55a95', 'on_reboot': 'restart', 'start_time':
'1323884658.28', 'on_poweroff': 'destroy', 'bootloader_args': '',
'on_xend_start': 'ignor
e', 'on_crash': 'restart', 'xend/restart_count': '0', 'vcpus': '1',
'vcpu_avail': '1', 'bootloader': '', 'image': "(linux (kernel
/boot/vmlinuz-2.6.26
-2-xen-amd64) (ramdisk /boot/initrd.img-2.6.26-2-xen-amd64) (args
'root=/dev/xvda2 ro ') (superpages 0) (tsc_mode 0) (videoram 4) (pci
()) (nomigrate
0) (notes (FEATURES
'writable_page_tables|writable_descriptor_tables|auto_translated_physmap|pae_pgdir_above_4gb|supervisor_mode_kernel')
(VIRT_BASE 1
8446744071562067968)
(GUEST_VERSION 2.6) (PADDR_OFFSET 0) (GUEST_OS linux)
(HYPERCALL_PAGE 18446744071564197888) (LOADER generic)
(SUSPEND_CANCEL 1) (ENTRY 18446744071564165120) (XEN_VERSION
xen-3.0)))", 'name': 'osmium'}
[2011-12-14 21:44:18 11562] DEBUG (XendDomainInfo:1804) Storing
domain details: {'console/ring-ref': '7282736', 'image/entry':
'18446744071564165120', 'console/port': '2', 'store/ring-ref':
'7282737', 'image/loader': 'generic', 'vm':
'/vm/ec1368e5-94f5-3e1a-dabe-010efdb55a95',
'control/platform-feature-multiprocessor-suspend': '1',
'image/guest-os': 'linux',
'image/features/writable-descriptor-tables': '1', 'image/virt-base':
'18446744071562067968', 'memory/target': '524288',
'image/guest-version': '2.6',
'image/features/supervisor-mode-kernel': '1', 'description': '',
'console/limit': '1048576', 'image/paddr-offset': '0',
'image/hypercall-page': '18446744071564197888',
'image/suspend-cancel': '1', 'cpu/0/availability': 'online',
'image/features/pae-pgdir-above-4gb': '1',
'image/features/writable-page-tables': '1', 'console/type':
'xenconsoled', 'image/features/auto-translated-physmap': '1',
'name': 'osmium', 'domid': '110', 'image/xen-version': 'xen-3.0',
'store/port': '1'}
[2011-12-14 21:44:18 11562] DEBUG (DevController:95) DevController:
writing {'protocol': 'x86_64-abi', 'state': '1', 'backend-id': '0',
'backend': '/local/domain/0/backend/console/110/0'} to
/local/domain/110/device/console/0.
[2011-12-14 21:44:18 11562] DEBUG (DevController:97) DevController:
writing {'domain': 'osmium', 'frontend':
'/local/domain/110/device/console/0', 'uuid':
'a68e0d86-dd95-591e-388b-f40dacd9dc4f', 'frontend-id': '110',
'state': '1', 'location': '2', 'online': '1', 'protocol': 'vt100'}
to /local/domain/0/backend/console/110/0.
[2011-12-14 21:44:18 11562] DEBUG (XendDomainInfo:1891)
XendDomainInfo.handleShutdownWatch
[2011-12-14 21:44:18 11562] DEBUG (DevController:139) Waiting for
devices vif2.
[2011-12-14 21:44:18 11562] DEBUG (DevController:139) Waiting for
devices vif.
[2011-12-14 21:44:18 11562] DEBUG (DevController:144) Waiting for 0.
[2011-12-14 21:44:18 11562] DEBUG (DevController:628)
hotplugStatusCallback
/local/domain/0/backend/vif/110/0/hotplug-status.
[2011-12-14 21:45:59 11562] DEBUG (XendDomainInfo:3053)
XendDomainInfo.destroy: domid=110
[2011-12-14 21:45:59 11562] DEBUG (XendDomainInfo:2411) Destroying
device model
[2011-12-14 21:45:59 11562] DEBUG (XendDomainInfo:2418) Releasing
devices
[2011-12-14 21:45:59 11562] DEBUG (XendDomainInfo:2424) Removing
vif/0
[2011-12-14 21:45:59 11562] DEBUG (XendDomainInfo:1286)
XendDomainInfo.destroyDevice: deviceClass = vif, device = vif/0
[2011-12-14 21:45:59 11562] DEBUG (XendDomainInfo:2424) Removing
vbd/51713
[2011-12-14 21:45:59 11562] DEBUG (XendDomainInfo:1286)
XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/51713
[2011-12-14 21:45:59 11562] DEBUG (XendDomainInfo:2424) Removing
vbd/51714
[2011-12-14 21:45:59 11562] DEBUG (XendDomainInfo:1286)
XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/51714
[2011-12-14 21:45:59 11562] DEBUG (XendDomainInfo:2424) Removing
console/0
[2011-12-14 21:45:59 11562] DEBUG (XendDomainInfo:1286)
XendDomainInfo.destroyDevice: deviceClass = console, device =
console/0
[2011-12-14 21:45:59 11562] DEBUG (XendDomainInfo:2416) No device
model
[2011-12-14 21:45:59 11562] DEBUG (XendDomainInfo:2418) Releasing
devices
[2011-12-14 21:45:59 11562] DEBUG (XendDomainInfo:2424) Removing
vif/0
[2011-12-14 21:45:59 11562] DEBUG (XendDomainInfo:1286)
XendDomainInfo.destroyDevice: deviceClass = vif, device = vif/0
[2011-12-14 21:45:59 11562] DEBUG (XendDomainInfo:2424) Removing
vbd/51713
[2011-12-14 21:45:59 11562] DEBUG (XendDomainInfo:1286)
XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/51713
[2011-12-14 21:45:59 11562] DEBUG (XendDomainInfo:2424) Removing
vbd/51714
[2011-12-14 21:45:59 11562] DEBUG (XendDomainInfo:1286)
XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/51714
Here is "xm info":
hostÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂ : hydrogen
releaseÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂ : 2.6.32-5-xen-amd64
versionÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂ : #1 SMP Tue Jun 14 12:46:30 UTC 2011
machineÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂ : x86_64
nr_cpusÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂ : 8
nr_nodesÂÂÂÂÂÂÂÂÂÂÂÂÂÂ : 1
cores_per_socketÂÂÂÂÂÂ : 4
threads_per_coreÂÂÂÂÂÂ : 1
cpu_mhzÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂ : 2700
hw_capsÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂ :
bfebfbff:20100800:00000000:00000940:000ce3bd:00000000:00000001:00000000
virt_capsÂÂÂÂÂÂÂÂÂÂÂÂÂ : hvm
total_memoryÂÂÂÂÂÂÂÂÂÂ : 64766
free_memoryÂÂÂÂÂÂÂÂÂÂÂ : 21559
node_to_cpuÂÂÂÂÂÂÂÂÂÂÂ : node0:0-7
node_to_memoryÂÂÂÂÂÂÂÂ : node0:21559
node_to_dma32_memÂÂÂÂÂ : node0:3257
max_node_idÂÂÂÂÂÂÂÂÂÂÂ : 0
xen_majorÂÂÂÂÂÂÂÂÂÂÂÂÂ : 4
xen_minorÂÂÂÂÂÂÂÂÂÂÂÂÂ : 0
xen_extraÂÂÂÂÂÂÂÂÂÂÂÂÂ : .1
xen_capsÂÂÂÂÂÂÂÂÂÂÂÂÂÂ : xen-3.0-x86_64 xen-3.0-x86_32p
hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64
xen_schedulerÂÂÂÂÂÂÂÂÂ : credit
xen_pagesizeÂÂÂÂÂÂÂÂÂÂ : 4096
platform_paramsÂÂÂÂÂÂÂ : virt_start=0xffff800000000000
xen_changesetÂÂÂÂÂÂÂÂÂ : unavailable
xen_commandlineÂÂÂÂÂÂÂ : /xen-4.0-amd64.gz dom0_mem=32768M
cc_compilerÂÂÂÂÂÂÂÂÂÂÂ : gcc version 4.4.5 (Debian 4.4.5-10)
cc_compile_byÂÂÂÂÂÂÂÂÂ : waldi
cc_compile_domainÂÂÂÂÂ : debian.org
cc_compile_dateÂÂÂÂÂÂÂ : Wed Jan 12 14:04:06 UTC 2011
xend_config_formatÂÂÂÂ : 4
Udev is runnig, tryed to restart it and restart xend. Os is debian
linux (oldstable) with xen 4.0.
Actually it looks like same problem, described here:
http://answerpot.com/showthread.php?282537-Error%3A+Device+51714+(vbd)+could+not+be+connected.+Hotplug+scripts+not+working.+While+creating+centOS+DomU+on+Dom0
in last post.
Os: debian linux oldstable, xen 4.0
Thanks for any advice. Really don't want to reboot the server, and
why actuallly it acting this way? What is 0 in "Waiting for 0"?
First device?
Thank you.
|