[Xen-users] xm migrate fails

[Martti Kuparinen <martti.kuparinen@xxxxxx>]

I know this is almost a FAQ but I haven't found a working solution...

I have big problems to make live migration to work, my dom0 is 64-bit CentOS 
5.2 with gitco's Xen 3.3.1 packages and the domU is 32-bit NetBSD 5.0_RC2. Both 
dom0's are configured like this
# grep reloc /etc/xen/xend-config.sxp | grep -v '#'
(xend-relocation-server yes)
(xend-relocation-port 8002)
(xend-relocation-address '')
(xend-relocation-hosts-allow '')

and the domU disk is mounted on both dom0s like

# ls -lh /dev/iscsi/virtualhost1
lrwxrwxrwx 1 root root 6 Mar  4 14:05 /dev/iscsi/virtualhost1 -> ../sdc

I'm able start and stop the domU on both dom0s (of course not at the same time) 
so my shared storage (Debian 5.0 + iSCSI target on top of LVM2 LVs) should be 
fine. Here's the configuration file just in case:
kernel = "/boot/netbsd/i386/netbsd-XEN3PAE_DOMU.gz"
disk = [ 'phy:/dev/iscsi/virtualhost1,0x1,w' ]
memory = 256
name = "virtualhost1"
vif = [ 'mac=00:16:3e:01:33:01, bridge=vlan2000' ]


Now, on the first host

# xm list
Name                                        ID   Mem VCPUs      State   Time(s)
Domain-0                                     0   256     4     r-----    251.8
virtualhost1                                 7   256     1     -b----      2.0

# xm migrate virtualhost1 n23 -l
Error: /usr/lib64/xen/bin/xc_save 37 7 0 0 1 failed

[2009-03-04 15:22:47 14608] DEBUG (balloon:132) Balloon: 3590372 KiB free; need 
2048; done.
[2009-03-04 15:22:47 14608] DEBUG (XendCheckpoint:103) [xc_save]: 
/usr/lib64/xen/bin/xc_save 37 7 0 0 1
[2009-03-04 15:22:47 14608] INFO (XendCheckpoint:403) xc_save: could not read 
suspend event channel
[2009-03-04 15:22:47 14608] INFO (XendCheckpoint:403) xc_save: suspend event 
channel initialization failed, using slow path
[2009-03-04 15:22:47 14608] INFO (XendCheckpoint:403) ERROR Internal error: 
Frame# in pfn-to-mfn frame list is not in pseudophys
[2009-03-04 15:22:47 14608] INFO (XendCheckpoint:403) ERROR Internal error: 
entry 0: p2m_frame_list[0] is 0x10037e, max 0x120000
[2009-03-04 15:22:47 14608] INFO (XendCheckpoint:403) ERROR Internal error: 
m2p[0x10037e] = 0x4b1
[2009-03-04 15:22:47 14608] INFO (XendCheckpoint:403) ERROR Internal error: 
p2m[0x4b1] = 0x116ecc00116ecd
[2009-03-04 15:22:47 14608] INFO (XendCheckpoint:403) ERROR Internal error: 
Failed to map/save the p2m frame list
[2009-03-04 15:22:47 14608] INFO (XendCheckpoint:403) Save exit rc=1
[2009-03-04 15:22:47 14608] ERROR (XendCheckpoint:157) Save failed on domain 
virtualhost1 (7) - resuming.
Traceback (most recent call last):
  File "/usr/lib64/python2.4/site-packages/xen/xend/XendCheckpoint.py", line 
125, in save
    forkHelper(cmd, fd, saveInputHandler, False)
  File "/usr/lib64/python2.4/site-packages/xen/xend/XendCheckpoint.py", line 
391, in forkHelper
    raise XendError("%s failed" % string.join(cmd))
XendError: /usr/lib64/xen/bin/xc_save 37 7 0 0 1 failed
[2009-03-04 15:22:47 14608] DEBUG (XendDomainInfo:2458) 
XendDomainInfo.resumeDomain(7)

At the same time on the target dom0 (n23). What is that "ERROR Internal error: 
read extended-info signature failed" message?

[2009-03-04 15:22:51 14406] DEBUG (XendDomainInfo:222) 
XendDomainInfo.restore(['domain', ['domid', '7'], ['on_crash', 'restart'], 
['uuid', 'fe5932b2-7064-b693-9dd9-8e3b0f6326b9'], ['bootloader_args'], 
['vcpus', '1'], ['name', 'virtualhost1'], ['on_poweroff', 'destroy'], 
['on_reboot', 'restart'], ['bootloader'], ['maxmem', '256'], ['memory', '256'], 
['shadow_memory', '0'], ['vcpu_avail', '1'], ['features'], ['on_xend_start', 
'ignore'], ['on_xend_stop', 'ignore'], ['start_time', '1236172861.13'], 
['cpu_time', '2.018072587'], ['online_vcpus', '1'], ['image', ['linux', 
['kernel', '/boot/netbsd/i386/netbsd-XEN3PAE_DOMU.gz'], ['notes']]], ['status', 
'2'], ['state', '-b----'], ['store_mfn', '1098045'], ['console_mfn', 
'1098044'], ['device', ['vif', ['bridge', 'vlan2000'], ['mac', 
'00:16:3e:01:33:01'], ['script', '/etc/xen/scripts/vif-bridge'], ['uuid', 
'8c6b579f-b82d-c203-8d6d-951995b451d1'], ['backend', '0']]], ['device', ['vbd', 
['protocol', 'x86_32-abi'], ['uuid', '371c60fd-73a9-eeb9-564e-ff15272d481c'], 
['dev', '0x1:disk'], ['uname', 'phy:/dev/iscsi/virtualhost1'], ['mode', 'w'], 
['backend', '0'], ['bootable', '1'], ['VDI']]], ['device', ['console', 
['protocol', 'vt100'], ['location', '2'], ['uuid', 
'7c2d880a-efe3-8680-7a3d-c2801d8fd847']]]])
[2009-03-04 15:22:51 14406] DEBUG (XendDomainInfo:2036) 
XendDomainInfo.constructDomain
[2009-03-04 15:22:51 14406] DEBUG (balloon:132) Balloon: 3851720 KiB free; need 
2048; done.
[2009-03-04 15:22:51 14406] DEBUG (XendDomain:449) Adding Domain: 4
[2009-03-04 15:22:51 14406] DEBUG (XendDomainInfo:2731) Storing VM details: 
{'on_xend_stop': 'ignore', 'shadow_memory': '0', 'uuid': 
'fe5932b2-7064-b693-9dd9-8e3b0f6326b9', 'on_reboot': 'restart', 'start_time': 
'1236172861.13', 'on_poweroff': 'destroy', 'bootloader_args': '', 
'on_xend_start': 'ignore', 'on_crash': 'restart', 'xend/restart_count': '0', 
'vcpus': '1', 'vcpu_avail': '1', 'bootloader': '', 'image': '(linux (kernel 
/boot/netbsd/i386/netbsd-XEN3PAE_DOMU.gz) (notes))', 'name': 'virtualhost1'}
[2009-03-04 15:22:51 14406] INFO (XendDomainInfo:1900) createDevice: console : 
{'protocol': 'vt100', 'location': '2', 'uuid': 
'7c2d880a-efe3-8680-7a3d-c2801d8fd847'}
[2009-03-04 15:22:51 14406] DEBUG (DevController:122) DevController: writing 
{'state': '1', 'backend-id': '0', 'backend': 
'/local/domain/0/backend/console/4/0'} to /local/domain/4/device/console/0.
[2009-03-04 15:22:51 14406] DEBUG (DevController:124) DevController: writing 
{'domain': 'virtualhost1', 'frontend': '/local/domain/4/device/console/0', 
'uuid': '7c2d880a-efe3-8680-7a3d-c2801d8fd847', 'frontend-id': '4', 'state': 
'1', 'location': '2', 'online': '1', 'protocol': 'vt100'} to 
/local/domain/0/backend/console/4/0.
[2009-03-04 15:22:51 14406] INFO (XendDomainInfo:1900) createDevice: vbd : 
{'protocol': 'x86_32-abi', 'uuid': '371c60fd-73a9-eeb9-564e-ff15272d481c', 
'bootable': 1, 'driver': 'paravirtualised', 'dev': '0x1:disk', 'uname': 
'phy:/dev/iscsi/virtualhost1', 'mode': 'w', 'backend': '0'}
[2009-03-04 15:22:51 14406] DEBUG (DevController:122) DevController: writing 
{'virtual-device': '1', 'protocol': 'x86_32-abi', 'device-type': 'disk', 
'backend-id': '0', 'state': '1', 'backend': '/local/domain/0/backend/vbd/4/1'} 
to /local/domain/4/device/vbd/1.
[2009-03-04 15:22:51 14406] DEBUG (DevController:124) DevController: writing 
{'domain': 'virtualhost1', 'frontend': '/local/domain/4/device/vbd/1', 'uuid': 
'371c60fd-73a9-eeb9-564e-ff15272d481c', 'dev': '0x1', 'state': '1', 'params': 
'/dev/iscsi/virtualhost1', 'mode': 'w', 'online': '1', 'frontend-id': '4', 
'type': 'phy'} to /local/domain/0/backend/vbd/4/1.
[2009-03-04 15:22:51 14406] INFO (XendDomainInfo:1900) createDevice: vif : 
{'bridge': 'vlan2000', 'mac': '00:16:3e:01:33:01', 'script': 
'/etc/xen/scripts/vif-bridge', 'uuid': '8c6b579f-b82d-c203-8d6d-951995b451d1', 
'backend': '0'}
[2009-03-04 15:22:51 14406] DEBUG (DevController:122) DevController: writing 
{'backend-id': '0', 'mac': '00:16:3e:01:33:01', 'handle': '0', 'state': '1', 
'backend': '/local/domain/0/backend/vif/4/0'} to /local/domain/4/device/vif/0.
[2009-03-04 15:22:51 14406] DEBUG (DevController:124) DevController: writing 
{'bridge': 'vlan2000', 'domain': 'virtualhost1', 'handle': '0', 'uuid': 
'8c6b579f-b82d-c203-8d6d-951995b451d1', 'script': 
'/etc/xen/scripts/vif-bridge', 'mac': '00:16:3e:01:33:01', 'frontend-id': '4', 
'state': '1', 'online': '1', 'frontend': '/local/domain/4/device/vif/0'} to 
/local/domain/0/backend/vif/4/0.
[2009-03-04 15:22:51 14406] DEBUG (XendDomainInfo:1359) Storing domain details: 
{'console/port': '2', 'name': 'virtualhost1', 'console/limit': '1048576', 'vm': 
'/vm/fe5932b2-7064-b693-9dd9-8e3b0f6326b9', 'domid': '4', 'cpu/0/availability': 
'online', 'memory/target': '262144', 
'control/platform-feature-multiprocessor-suspend': '1', 'console/type': 
'xenconsoled', 'store/port': '1'}
[2009-03-04 15:22:51 14406] DEBUG (XendCheckpoint:247) restore:shadow=0x0, 
_static_max=0x10000000, _static_min=0x0,
[2009-03-04 15:22:51 14406] DEBUG (balloon:132) Balloon: 3851712 KiB free; need 
262144; done.
[2009-03-04 15:22:51 14406] DEBUG (XendCheckpoint:264) [xc_restore]: 
/usr/lib64/xen/bin/xc_restore 36 4 1 2 0 0 0
[2009-03-04 15:22:51 14406] INFO (XendCheckpoint:403) xc_domain_restore start: 
p2m_size = 10000
[2009-03-04 15:22:51 14406] INFO (XendCheckpoint:403) ERROR Internal error: 
read extended-info signature failed
[2009-03-04 15:22:51 14406] INFO (XendCheckpoint:403) Restore exit with rc=1
[2009-03-04 15:22:51 14406] DEBUG (XendDomainInfo:2402) XendDomainInfo.destroy: 
domid=4
[2009-03-04 15:22:51 14406] ERROR (XendDomainInfo:2416) XendDomainInfo.destroy: 
domain destruction failed.
Traceback (most recent call last):
  File "/usr/lib64/python2.4/site-packages/xen/xend/XendDomainInfo.py", line 
2409, in destroy
    xc.domain_pause(self.domid)
Error: (3, 'No such process')
[2009-03-04 15:22:51 14406] DEBUG (XendDomainInfo:1944) No device model
[2009-03-04 15:22:51 14406] DEBUG (XendDomainInfo:1946) Releasing devices
[2009-03-04 15:22:51 14406] DEBUG (XendDomainInfo:1959) Removing vif/0
[2009-03-04 15:22:51 14406] DEBUG (XendDomainInfo:910) 
XendDomainInfo.destroyDevice: deviceClass = vif, device = vif/0
[2009-03-04 15:22:51 14406] DEBUG (XendDomainInfo:1959) Removing vbd/1
[2009-03-04 15:22:51 14406] DEBUG (XendDomainInfo:910) 
XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/1
[2009-03-04 15:22:51 14406] DEBUG (XendDomainInfo:1959) Removing console/0
[2009-03-04 15:22:51 14406] DEBUG (XendDomainInfo:910) 
XendDomainInfo.destroyDevice: deviceClass = console, device = console/0
[2009-03-04 15:22:51 14406] ERROR (XendDomain:1145) Restore failed
Traceback (most recent call last):
  File "/usr/lib64/python2.4/site-packages/xen/xend/XendDomain.py", line 1143, 
in domain_restore_fd
    return XendCheckpoint.restore(self, fd, paused=paused, 
relocating=relocating)
  File "/usr/lib64/python2.4/site-packages/xen/xend/XendCheckpoint.py", line 
268, in restore
    forkHelper(cmd, fd, handler.handler, True)
  File "/usr/lib64/python2.4/site-packages/xen/xend/XendCheckpoint.py", line 
391, in forkHelper
    raise XendError("%s failed" % string.join(cmd))
XendError: /usr/lib64/xen/bin/xc_restore 36 4 1 2 0 0 0 failed


_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users