Re: [Xen-users] Live Migration Query

[Asim <linkasim@xxxxxxxxx>]

Am using the same Xen version on both machines:

These are the last few lines from the log:

XendError: /usr/lib/xen/bin/xc_restore 4 2 1 2 0 0 0 failed
[2008-05-18 15:00:19 6204] DEBUG (XendDomainInfo:216) XendDomainInfo.restore(['domain', ['domid', '3'], ['on_crash', 'restart'], ['uuid', '50534b24-3d48-1ac3-57db-4acaa14d095f'], ['bootloader_args'], ['vcpus', '1'], ['name', 'FC8.domU'], ['on_poweroff', 'destroy'], ['on_reboot', 'restart'], ['bootloader'], ['maxmem', '500'], ['memory', '500'], ['shadow_memory', '0'], ['vcpu_avail', '1'], ['cpu_weight', '256'], ['cpu_cap', '0'], ['features'], ['on_xend_start', 'ignore'], ['on_xend_stop', 'ignore'], ['start_time', '1211123864.56'], ['cpu_time', '3.783274076'], ['online_vcpus', '1'], ['image', ['linux', ['kernel', '/boot/vmlinuz-2.6.18.8-xen'], ['ramdisk', '/boot/initrd-2.6.18.8-xen.img'], ['args', 'root=/dev/sda1 ro xencons=tty bootproto=static ip=128.105.104.126 gateway=128.105.104.248 nameserver=128.105.10.1'], ['notes', ['HV_START_LOW', '-176160768'], ['FEATURES', 'writable_page_tables|writable_descriptor_tables|auto_translated_physmap|pae_pgdir_above_4gb|supervisor_mode_kernel'], ['VIRT_BASE', '-1073741824'], ['GUEST_VERSION', '2.6'], ['PADDR_OFFSET', '-1073741824'], ['GUEST_OS', 'linux'], ['HYPERCALL_PAGE', '-1072689152'], ['LOADER', 'generic'], ['SUSPEND_CANCEL', '1'], ['PAE_MODE', 'yes'], ['ENTRY', '-1072693248'], ['XEN_VERSION', 'xen-3.0']]]], ['status', '2'], ['state', '-b----'], ['device', ['vif', ['bridge', 'xenbr0'], ['mac', '00:16:3E:6F:CF:77'], ['script', 'vif-bridge'], ['uuid', '4d1ba09d-9b1a-a330-c6ae-4bee9ccd40d7'], ['backend', '0']]], ['device', ['console', ['protocol', 'vt100'], ['location', '2'], ['uuid', 'e300f882-fcd9-6d14-9257-1b4085063ec3']]], ['device', ['tap', ['uname', 'tap:aio:/store/images/fedora.fc8.img'], ['uuid', '3b5e5393-2d90-397d-b187-be0db4e34274'], ['mode', 'w'], ['dev', 'sda1:disk'], ['backend', '0'], ['bootable', '1']]], ['device', ['tap', ['uname', 'tap:aio:/store/images/fedora.swap'], ['uuid', '218011b0-dc54-4802-0f95-322e3b073932'], ['mode', 'w'], ['dev', 'sda2:disk'], ['backend', '0'], ['bootable', '0']]]])
[2008-05-18 15:00:19 6204] DEBUG (XendDomainInfo:1520) XendDomainInfo.constructDomain
[2008-05-18 15:00:19 6204] DEBUG (balloon:116) Balloon: 512900 KiB free; need 2048; done.
[2008-05-18 15:00:19 6204] DEBUG (XendDomain:434) Adding Domain: 3
[2008-05-18 15:00:19 6204] DEBUG (XendDomainInfo:2093) Storing VM details: {'on_xend_stop': 'ignore', 'shadow_memory': '0', 'uuid': '50534b24-3d48-1ac3-57db-4acaa14d095f', 'on_reboot': 'restart', 'start_time': '1211123864.56', 'on_poweroff': 'destroy', 'on_xend_start': 'ignore', 'on_crash': 'restart', 'xend/restart_count': '0', 'vcpus': '1', 'vcpu_avail': '1', 'image': "(linux (kernel /boot/vmlinuz-2.6.18.8-xen) (ramdisk /boot/initrd-2.6.18.8-xen.img) (args 'root=/dev/sda1 ro xencons=tty bootproto=static ip=128.105.104.126 gateway=128.105.104.248 nameserver=128.105.10.1') (notes (HV_START_LOW -176160768) (FEATURES 'writable_page_tables|writable_descriptor_tables|auto_translated_physmap|pae_pgdir_above_4gb|supervisor_mode_kernel') (VIRT_BASE -1073741824) (GUEST_VERSION 2.6) (PADDR_OFFSET -1073741824) (GUEST_OS linux) (HYPERCALL_PAGE -1072689152) (LOADER generic) (SUSPEND_CANCEL 1) (PAE_MODE yes) (ENTRY -1072693248) (XEN_VERSION xen-3.0)))", 'name': 'FC8.domU'}
[2008-05-18 15:00:19 6204] INFO (XendDomainInfo:1422) createDevice: console : {'protocol': 'vt100', 'location': '2', 'uuid': 'e300f882-fcd9-6d14-9257-1b4085063ec3'}
[2008-05-18 15:00:19 6204] DEBUG (DevController:118) DevController: writing {'state': '1', 'backend-id': '0', 'backend': '/local/domain/0/backend/console/3/0'} to /local/domain/3/device/console/0.
[2008-05-18 15:00:19 6204] DEBUG (DevController:120) DevController: writing {'domain': 'FC8.domU', 'frontend': '/local/domain/3/device/console/0', 'uuid': 'e300f882-fcd9-6d14-9257-1b4085063ec3', 'frontend-id': '3', 'state': '1', 'location': '2', 'online': '1', 'protocol': 'vt100'} to /local/domain/0/backend/console/3/0.
[2008-05-18 15:00:19 6204] INFO (XendDomainInfo:1422) createDevice: tap : {'uuid': '3b5e5393-2d90-397d-b187-be0db4e34274', 'bootable': 1, 'dev': 'sda1:disk', 'uname': 'tap:aio:/store/images/fedora.fc8.img', 'mode': 'w', 'backend': '0'}
[2008-05-18 15:00:19 6204] DEBUG (DevController:118) DevController: writing {'backend-id': '0', 'virtual-device': '2049', 'device-type': 'disk', 'state': '1', 'backend': '/local/domain/0/backend/tap/3/2049'} to /local/domain/3/device/vbd/2049.
[2008-05-18 15:00:19 6204] DEBUG (DevController:120) DevController: writing {'domain': 'FC8.domU', 'frontend': '/local/domain/3/device/vbd/2049', 'uuid': '3b5e5393-2d90-397d-b187-be0db4e34274', 'dev': 'sda1', 'state': '1', 'params': 'aio:/store/images/fedora.fc8.img', 'mode': 'w', 'online': '1', 'frontend-id': '3', 'type': 'tap'} to /local/domain/0/backend/tap/3/2049.
[2008-05-18 15:00:19 6204] INFO (XendDomainInfo:1422) createDevice: tap : {'uuid': '218011b0-dc54-4802-0f95-322e3b073932', 'bootable': 0, 'dev': 'sda2:disk', 'uname': 'tap:aio:/store/images/fedora.swap', 'mode': 'w', 'backend': '0'}
[2008-05-18 15:00:19 6204] DEBUG (DevController:118) DevController: writing {'backend-id': '0', 'virtual-device': '2050', 'device-type': 'disk', 'state': '1', 'backend': '/local/domain/0/backend/tap/3/2050'} to /local/domain/3/device/vbd/2050.
[2008-05-18 15:00:19 6204] DEBUG (DevController:120) DevController: writing {'domain': 'FC8.domU', 'frontend': '/local/domain/3/device/vbd/2050', 'uuid': '218011b0-dc54-4802-0f95-322e3b073932', 'dev': 'sda2', 'state': '1', 'params': 'aio:/store/images/fedora.swap', 'mode': 'w', 'online': '1', 'frontend-id': '3', 'type': 'tap'} to /local/domain/0/backend/tap/3/2050.
[2008-05-18 15:00:19 6204] INFO (XendDomainInfo:1422) createDevice: vif : {'bridge': 'xenbr0', 'mac': '00:16:3E:6F:CF:77', 'script': 'vif-bridge', 'uuid': '4d1ba09d-9b1a-a330-c6ae-4bee9ccd40d7', 'backend': '0'}
[2008-05-18 15:00:19 6204] DEBUG (DevController:118) DevController: writing {'backend-id': '0', 'mac': '00:16:3E:6F:CF:77', 'handle': '0', 'state': '1', 'backend': '/local/domain/0/backend/vif/3/0'} to /local/domain/3/device/vif/0.
[2008-05-18 15:00:19 6204] DEBUG (DevController:120) DevController: writing {'bridge': 'xenbr0', 'domain': 'FC8.domU', 'handle': '0', 'uuid': '4d1ba09d-9b1a-a330-c6ae-4bee9ccd40d7', 'script': '/etc/xen/scripts/vif-bridge', 'mac': '00:16:3E:6F:CF:77', 'frontend-id': '3', 'state': '1', 'online': '1', 'frontend': '/local/domain/3/device/vif/0'} to /local/domain/0/backend/vif/3/0.
[2008-05-18 15:00:19 6204] DEBUG (XendDomainInfo:914) Storing domain details: {'image/entry': '-1072693248', 'console/port': '2', 'image/loader': 'generic', 'vm': '/vm/50534b24-3d48-1ac3-57db-4acaa14d095f', 'control/platform-feature-multiprocessor-suspend': '1', 'image/hv-start-low': '-176160768', 'image/guest-os': 'linux', 'image/features/writable-descriptor-tables': '1', 'image/virt-base': '-1073741824', 'memory/target': '512000', 'image/guest-version': '2.6', 'image/features/supervisor-mode-kernel': '1', 'image/pae-mode': 'yes', 'console/limit': '1048576', 'image/paddr-offset': '-1073741824', 'image/hypercall-page': '-1072689152', 'image/suspend-cancel': '1', 'cpu/0/availability': 'online', 'image/features/pae-pgdir-above-4gb': '1', 'image/features/writable-page-tables': '1', 'image/features/auto-translated-physmap': '1', 'name': 'FC8.domU', 'domid': '3', 'image/xen-version': 'xen-3.0', 'store/port': '1'}
[2008-05-18 15:00:19 6204] DEBUG (XendCheckpoint:217) restore:shadow=0x0, _static_max=0x1f400000, _static_min=0x0,
[2008-05-18 15:00:19 6204] DEBUG (balloon:116) Balloon: 512900 KiB free; need 512000; done.
[2008-05-18 15:00:19 6204] DEBUG (XendCheckpoint:234) [xc_restore]: /usr/lib/xen/bin/xc_restore 25 3 1 2 0 0 0


-Asim

On Sun, May 18, 2008 at 12:20 PM, Tomasz Chmielewski <mangoo@xxxxxxxx> wrote:

Asim schrieb:

Hi,

I'm performing live migration. I see something weird happening that I cannot explain:

Once I fire xen migration at the source:

[root@src ~]# xm migrate --live FC8.domU dest
Error: /usr/lib/xen/bin/xc_save 23 3 0 0 1 failed
Usage: xm migrate <Domain> <Host>

Migrate a domain to another machine.

Options:

-h, --help           Print this help.
-l, --live           Use live migration.
-p=portnum, --port=portnum
                   Use specified port for migration.
-r=MBIT, --resource=MBIT
                   Set level of resource usage for migration.

[root@src ~]#

If I do a xm list, I can see the domain here:

[root@src ~]# xm list
Name                                        ID   Mem VCPUs      State   Time(s)
Domain-0                                     0   499     1     r-----   1517.6
FC8.domU                                     3   500     1     -b----      3.6


While at the destination, I see a hanging domU as :

[root@dest xen-images]# xm list
Name                                        ID   Mem VCPUs      State   Time(s)
Domain-0                                     0   502     1     r-----   1646.1
FC8.domU                                     3   500     0     -bp---      0.0


Can anyone help me with this save failed problem and it will also be great if anyone can explain me what exactly happened here.

Check your Xen logs (/var/log/xen/*) on both sides - probably, some incompatibility - are Xen versions on both sides the same?


--
Tomasz Chmielewski
http://wpkg.org

_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users