Xen project Mailing List

Re: [Xen-users] Do systems have to be IDENTICAL for live migration?

From: James Pifer <jep@xxxxxxxxxxxxxxxx>

Date: Wed, 07 Jul 2010 11:25:28 -0400

Cc: Nick Couchman <Nick.Couchman@xxxxxxxxx>

Delivery-date: Wed, 07 Jul 2010 08:32:14 -0700

List-id: Xen user discussion <xen-users.lists.xensource.com>

> Could you more clearly define "not working" - error messages, log > entries, etc.? Sometimes CPU differences can prevent live migration > from working properly, but there are other factors, too. It would be > useful to know what Xen says about why live migration is failing. Also, > could you specify exactly what CPUs are in those boxes? I don't use HP, > but I know with Dell servers the model/generation of server you're using > can have a wide range of processors in it, so just specifying the server > model/brand does not really tell anything useful. > > -Nick Hi Nick. I actually had all of this in the original post, but cut it in replies. See below. Thanks, James ïThe first system is a ProLiant DL360 G6: Proc 1:2533 MHz Execution technology:4/4 cores; 8 maximum threads Memory technology:64-bit capable Processor 1 Internal L1 Cache:128 KB Processor 1 Internal L2 Cache:1024 KB Processor 1 Internal L3 Cache:8192 KB Proc 2:2533 MHz Execution technology:4/4 cores; 8 maximum threads Memory technology:64-bit capable Processor 2 Internal L1 Cache:128 KB Processor 2 Internal L2 Cache:1024 KB Processor 2 Internal L3 Cache:8192 KB The second system is a ProLiant DL360 G5: Proc 1:2500 MHz Execution technology:4/4 cores; 4 threads Memory technology:64-bit capable Processor 1 Internal L1 Cache:128 KB Processor 1 Internal L2 Cache:12288 KB Proc 2:2500 MHz Execution technology:4/4 cores; 4 threads Memory technology:64-bit capable Processor 2 Internal L1 Cache:128 KB Processor 2 Internal L2 Cache:12288 KB When I tried to Live Migrate a VM from system one to system two I got: [2010-07-01 12:06:49 5660] DEBUG (XendDomainInfo:237) XendDomainInfo.restore(['domain', ['domid', '3'], ['cpu_weight', '256'], ['cpu_cap', '0'], ['pool_name', 'Pool-0'], ['bootloader'], ['vcpus', '2'], ['node', '8002'], ['cpus', [[], []]], ['on_poweroff', 'destroy'], ['description'], ['on_crash', 'destroy'], ['uuid', '92b1b8f4-94aa-d393-92a4-3d78262bf092'], ['bootloader_args'], ['name', 'chsimp2'], ['on_reboot', 'restart'], ['maxmem', '2048'], ['memory', '2048'], ['shadow_memory', '18'], ['vcpu_avail', '3'], ['features'], ['on_xend_start', 'ignore'], ['on_xend_stop', 'ignore'], ['start_time', '1277985922.2'], ['cpu_time', '2433.09449026'], ['online_vcpus', '2'], ['image', ['hvm', ['kernel'], ['superpages', '0'], ['videoram', '4'], ['hpet', '0'], ['stdvga', '0'], ['loader', '/usr/lib/xen/boot/hvmloader'], ['xen_platform_pci', '1'], ['rtc_timeoffset', '0'], ['pci', []], ['hap', '1'], ['localtime', '0'], ['timer_mode', '1'], ['pci_msitranslate', '1'], ['oos', '1'], ['apic', '0'], ['sdl', '0'], ['usbdevice', 'tablet'], ['vpt_align', '1'], ['extid', '0'], ['vncunused', '1'], ['boot', 'c'], ['pae', '1'], ['viridian', '0'], ['acpi', '1'], ['vnc', '1'], ['nographic', '0'], ['nomigrate', '0'], ['usb', '1'], ['tsc_mode', '0'], ['guest_os_type', 'default'], ['device_model', '/usr/lib64/xen/bin/qemu-dm'], ['pci_power_mgmt', '0'], ['xauthority', '/root/.Xauthority'], ['isa', '0'], ['notes', ['SUSPEND_CANCEL', '1']]]], ['status', '2'], ['state', '-b----'], ['store_mfn', '1044476'], ['device', ['vif', ['bridge', 'br0'], ['mac', '00:16:3e:1f:ea:77'], ['script', '/etc/xen/scripts/vif-bridge'], ['uuid', '53301d91-5283-d69d-4b7d-5beb3deee963'], ['backend', '0']]], ['device', ['console', ['protocol', 'vt100'], ['location', '4'], ['uuid', 'b02891b0-855e-fc59-9744-5685e1950c19']]], ['device', ['vbd', ['protocol', 'x86_32-abi'], ['uuid', '31c2d623-a977-4e81-5ecc-2ab09907f76e'], ['bootable', '1'], ['dev', 'hda:disk'], ['uname', 'phy:/dev/disk/by-id/scsi-200d0b29d2d002200'], ['mode', 'w'], ['backend', '0'], ['VDI']]], ['device', ['vfb', ['vncunused', '1'], ['vnc', '1'], ['uuid', 'e40219c2-a740-c910-2840-be3a2aaa9548'], ['location', '127.0.0.1:5902']]], ['change_home_server', 'False']]) [2010-07-01 12:06:49 5660] DEBUG (XendDomainInfo:2543) XendDomainInfo.constructDomain [2010-07-01 12:06:49 5660] DEBUG (balloon:239) Balloon: 31107320 KiB free; need 16384; done. [2010-07-01 12:06:49 5660] DEBUG (XendDomain:465) Adding Domain: 1 [2010-07-01 12:06:49 5660] DEBUG (XendDomainInfo:3470) Storing VM details: {'on_xend_stop': 'ignore', 'pool_name': 'Pool-0', 'shadow_memory': '18', 'uuid': '92b1b8f4-94aa-d393-92a4-3d78262bf092', 'on_reboot': 'restart', 'start_time': '1277985922.2', 'on_poweroff': 'destroy', 'bootloader_args': '', 'on_xend_start': 'ignore', 'on_crash': 'destroy', 'xend/restart_count': '0', 'vcpus': '2', 'vcpu_avail': '3', 'bootloader': '', 'image': '(hvm (kernel ) (superpages 0) (videoram 4) (hpet 0) (stdvga 0) (loader /usr/lib/xen/boot/hvmloader) (xen_platform_pci 1) (rtc_timeoffset 0) (pci ()) (hap 1) (localtime 0) (timer_mode 1) (pci_msitranslate 1) (oos 1) (apic 0) (sdl 0) (usbdevice tablet) (vpt_align 1) (extid 0) (vncunused 1) (boot c) (pae 1) (viridian 0) (acpi 1) (vnc 1) (nographic 0) (nomigrate 0) (usb 1) (tsc_mode 0) (guest_os_type default) (device_model /usr/lib64/xen/bin/qemu-dm) (pci_power_mgmt 0) (xauthority /root/.Xauthority) (isa 0) (notes (SUSPEND_CANCEL 1)))', 'name': 'chsimp2'} [2010-07-01 12:06:49 5660] INFO (XendDomainInfo:2402) createDevice: console : {'protocol': 'vt100', 'location': '4', 'uuid': 'b02891b0-855e-fc59-9744-5685e1950c19'} [2010-07-01 12:06:49 5660] DEBUG (DevController:95) DevController: writing {'state': '1', 'backend-id': '0', 'backend': '/local/domain/0/backend/console/1/0'} to /local/domain/1/device/console/0. [2010-07-01 12:06:49 5660] DEBUG (DevController:97) DevController: writing {'domain': 'chsimp2', 'frontend': '/local/domain/1/device/console/0', 'uuid': 'b02891b0-855e-fc59-9744-5685e1950c19', 'frontend-id': '1', 'state': '1', 'location': '4', 'online': '1', 'protocol': 'vt100'} to /local/domain/0/backend/console/1/0. [2010-07-01 12:06:49 5660] INFO (XendDomainInfo:2402) createDevice: vfb : {'vncunused': '1', 'other_config': {'vncunused': '1', 'vnc': '1'}, 'vnc': '1', 'uuid': 'e40219c2-a740-c910-2840-be3a2aaa9548', 'location': '127.0.0.1:5902'} [2010-07-01 12:06:49 5660] DEBUG (DevController:95) DevController: writing {'state': '1', 'backend-id': '0', 'backend': '/local/domain/0/backend/vfb/1/0'} to /local/domain/1/device/vfb/0. [2010-07-01 12:06:49 5660] DEBUG (DevController:97) DevController: writing {'vncunused': '1', 'domain': 'chsimp2', 'frontend': '/local/domain/1/device/vfb/0', 'uuid': 'e40219c2-a740-c910-2840-be3a2aaa9548', 'frontend-id': '1', 'state': '1', 'location': '127.0.0.1:5902', 'online': '1', 'vnc': '1'} to /local/domain/0/backend/vfb/1/0. [2010-07-01 12:06:49 5660] INFO (XendDomainInfo:2402) createDevice: vbd : {'protocol': 'x86_32-abi', 'uuid': '31c2d623-a977-4e81-5ecc-2ab09907f76e', 'bootable': 1, 'driver': 'paravirtualised', 'dev': 'hda:disk', 'uname': 'phy:/dev/disk/by-id/scsi-200d0b29d2d002200', 'mode': 'w', 'backend': '0'} [2010-07-01 12:06:49 5660] DEBUG (DevController:95) DevController: writing {'virtual-device': '768', 'protocol': 'x86_32-abi', 'device-type': 'disk', 'backend-id': '0', 'state': '1', 'backend': '/local/domain/0/backend/vbd/1/768'} to /local/domain/1/device/vbd/768. [2010-07-01 12:06:49 5660] DEBUG (DevController:97) DevController: writing {'domain': 'chsimp2', 'frontend': '/local/domain/1/device/vbd/768', 'uuid': '31c2d623-a977-4e81-5ecc-2ab09907f76e', 'bootable': '1', 'dev': 'hda', 'state': '1', 'params': '/dev/disk/by-id/scsi-200d0b29d2d002200', 'mode': 'w', 'online': '1', 'frontend-id': '1', 'type': 'phy'} to /local/domain/0/backend/vbd/1/768. [2010-07-01 12:06:49 5660] INFO (XendDomainInfo:2402) createDevice: vif : {'bridge': 'br0', 'mac': '00:16:3e:1f:ea:77', 'script': '/etc/xen/scripts/vif-bridge', 'uuid': '53301d91-5283-d69d-4b7d-5beb3deee963', 'backend': '0'} [2010-07-01 12:06:49 5660] DEBUG (DevController:95) DevController: writing {'backend-id': '0', 'mac': '00:16:3e:1f:ea:77', 'handle': '0', 'state': '1', 'backend': '/local/domain/0/backend/vif/1/0'} to /local/domain/1/device/vif/0. [2010-07-01 12:06:49 5660] DEBUG (DevController:97) DevController: writing {'bridge': 'br0', 'domain': 'chsimp2', 'handle': '0', 'uuid': '53301d91-5283-d69d-4b7d-5beb3deee963', 'script': '/etc/xen/scripts/vif-bridge', 'mac': '00:16:3e:1f:ea:77', 'frontend-id': '1', 'state': '1', 'online': '1', 'frontend': '/local/domain/1/device/vif/0'} to /local/domain/0/backend/vif/1/0. [2010-07-01 12:06:49 5660] DEBUG (XendDomainInfo:1835) Storing domain details: {'console/port': '4', 'description': '', 'console/limit': '1048576', 'image/suspend-cancel': '1', 'domid': '1', 'vm': '/vm/92b1b8f4-94aa-d393-92a4-3d78262bf092', 'cpu/0/availability': 'online', 'memory/target': '2097152', 'control/platform-feature-multiprocessor-suspend': '1', 'console/type': 'ioemu', 'cpu/1/availability': 'online', 'store/port': '3', 'name': 'chsimp2'} [2010-07-01 12:06:49 5660] INFO (XendCheckpoint:343) restore hvm domain 1, apic=0, pae=1 [2010-07-01 12:06:49 5660] DEBUG (image:339) No VNC passwd configured for vfb access [2010-07-01 12:06:49 5660] DEBUG (image:901) args: boot, val: c [2010-07-01 12:06:49 5660] DEBUG (image:901) args: fda, val: None [2010-07-01 12:06:49 5660] DEBUG (image:901) args: fdb, val: None [2010-07-01 12:06:49 5660] DEBUG (image:901) args: soundhw, val: None [2010-07-01 12:06:49 5660] DEBUG (image:901) args: localtime, val: 0 [2010-07-01 12:06:49 5660] DEBUG (image:901) args: serial, val: None [2010-07-01 12:06:49 5660] DEBUG (image:901) args: std-vga, val: 0 [2010-07-01 12:06:49 5660] DEBUG (image:901) args: isa, val: 0 [2010-07-01 12:06:49 5660] DEBUG (image:901) args: acpi, val: 1 [2010-07-01 12:06:49 5660] DEBUG (image:901) args: usb, val: 1 [2010-07-01 12:06:49 5660] DEBUG (image:901) args: usbdevice, val: tablet [2010-07-01 12:06:49 5660] DEBUG (image:901) args: gfx_passthru, val: None [2010-07-01 12:06:49 5660] INFO (image:833) Need to create platform device.[domid:1] [2010-07-01 12:06:49 5660] DEBUG (XendCheckpoint:361) restore:shadow=0x12, _static_max=0x80000000, _static_min=0x0, [2010-07-01 12:06:49 5660] DEBUG (XendCheckpoint:380) [xc_restore]: /usr/lib64/xen/bin/xc_restore 17 1 3 4 1 1 0 0 [2010-07-01 12:06:49 5660] INFO (XendCheckpoint:482) xc_domain_restore start: p2m_size = 100000 [2010-07-01 12:06:49 5660] INFO (XendCheckpoint:482) Reloading memory pages: 0% [2010-07-01 12:08:12 5660] INFO (XendCheckpoint:482) Read 1448 bytes of QEMU data [2010-07-01 12:08:12 5660] INFO (XendCheckpoint:482) Read 5544 bytes of QEMU data [2010-07-01 12:08:12 5660] INFO (XendCheckpoint:482) Read 9 bytes of QEMU data [2010-07-01 12:08:13 5660] INFO (XendCheckpoint:482) ERROR Internal error: Error when reading batch size [2010-07-01 12:08:13 5660] INFO (XendCheckpoint:482) ERROR Internal error: error when buffering batch, finishing [2010-07-01 12:08:13 5660] INFO (XendCheckpoint:482) [2010-07-01 12:08:13 5660] INFO (XendCheckpoint:482) Writing 7001 bytes of QEMU data [2010-07-01 12:08:13 5660] INFO (XendCheckpoint:482) ERROR Internal error: error setting the HVM context [2010-07-01 12:08:14 5660] INFO (XendCheckpoint:482) Restore exit with rc=1 [2010-07-01 12:08:14 5660] DEBUG (XendDomainInfo:3111) XendDomainInfo.destroy: domid=1 [2010-07-01 12:08:14 5660] ERROR (XendDomainInfo:3125) XendDomainInfo.destroy: domain destruction failed. Traceback (most recent call last): File "/usr/lib64/python2.6/site-packages/xen/xend/XendDomainInfo.py", line 3118, in destroy xc.domain_pause(self.domid) Error: (3, 'No such process') [2010-07-01 12:08:14 5660] DEBUG (XendDomainInfo:2451) No device model [2010-07-01 12:08:14 5660] DEBUG (XendDomainInfo:2453) Releasing devices [2010-07-01 12:08:14 5660] DEBUG (XendDomainInfo:2459) Removing vif/0 [2010-07-01 12:08:14 5660] DEBUG (XendDomainInfo:1289) XendDomainInfo.destroyDevice: deviceClass = vif, device = vif/0 [2010-07-01 12:08:14 5660] DEBUG (XendDomainInfo:2459) Removing console/0 [2010-07-01 12:08:14 5660] DEBUG (XendDomainInfo:1289) XendDomainInfo.destroyDevice: deviceClass = console, device = console/0 [2010-07-01 12:08:14 5660] DEBUG (XendDomainInfo:2459) Removing vbd/768 [2010-07-01 12:08:14 5660] DEBUG (XendDomainInfo:1289) XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/768 [2010-07-01 12:08:14 5660] DEBUG (XendDomainInfo:2459) Removing vfb/0 [2010-07-01 12:08:14 5660] DEBUG (XendDomainInfo:1289) XendDomainInfo.destroyDevice: deviceClass = vfb, device = vfb/0 [2010-07-01 12:08:14 5660] INFO (XendDomain:1108) Domain chsimp2 (92b1b8f4-94aa-d393-92a4-3d78262bf092) deleted. [2010-07-01 12:08:14 5660] ERROR (XendCheckpoint:416) /usr/lib64/xen/bin/xc_restore 17 1 3 4 1 1 0 0 failed Traceback (most recent call last): File "/usr/lib64/python2.6/site-packages/xen/xend/XendCheckpoint.py", line 384, in restore forkHelper(cmd, fd, handler.handler, True) File "/usr/lib64/python2.6/site-packages/xen/xend/XendCheckpoint.py", line 470, in forkHelper raise XendError("%s failed" % string.join(cmd)) XendError: /usr/lib64/xen/bin/xc_restore 17 1 3 4 1 1 0 0 failed [2010-07-01 12:08:14 5660] ERROR (XendDomain:1176) Restore failed Traceback (most recent call last): File "/usr/lib64/python2.6/site-packages/xen/xend/XendDomain.py", line 1160, in domain_restore_fd dominfo = XendCheckpoint.restore(self, fd, paused=paused, relocating=relocating) File "/usr/lib64/python2.6/site-packages/xen/xend/XendCheckpoint.py", line 417, in restore raise exn XendError: /usr/lib64/xen/bin/xc_restore 17 1 3 4 1 1 0 0 failed _______________________________________________ Xen-users mailing list Xen-users@xxxxxxxxxxxxxxxxxxx http://lists.xensource.com/xen-users

©2013 Xen Project, A Linux Foundation Collaborative Project. All Rights Reserved.
Linux Foundation is a registered trademark of The Linux Foundation.
Xen Project is a trademark of The Linux Foundation.