[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Xen-users] reconnect vif after migrate



I'm not sure about how this works with ubuntu dom0/U but with pure debian stable live migration is borked in 1 of two ways, either the console will be frozen or the vif will not re-attach depending on how new your kernel is (newer kernels have the second issue). In my setup i support many different operating systems so i've had to scrap live migration due to its poor support across different distro's but if this is your only problem i would simply add the vif reattach code to the end of the migration script for now until the problem works itself out. You might want to submit a bug about this if there isn't already one.

-DDV

On Thu, Nov 24, 2011 at 7:52 AM, SMM <weshetnebu@xxxxxxxxx> wrote:
We run xen4.1 under ubuntu 11.10 on amd64 system with E5300/E7500
DomU are all ubuntu 11.10 running in PV-mode
- everything runs fine also migrate works even tried xnbd with life
disk-migration
- vif doesnot reconnect after migration (sometimes it works)
vif is in bridge mode but even if I remove it from the bridge it wont
forward any traffic

syslog DomU


> Nov 24 11:58:53 default-XenU kernel: [  116.525475] PM: freeze of devices complete after 0.461 msecs
> Nov 24 11:58:53 default-XenU kernel: [  116.525480] suspending xenstore...
> Nov 24 11:58:53 default-XenU kernel: [  116.525635] PM: late freeze of devices complete after 0.151 msecs
> Nov 24 11:58:53 default-XenU kernel: [  116.528648] PM: early restore of devices complete after 0.134 msecs
> Nov 24 11:58:53 default-XenU kernel: [  116.539153] PM: restore of devices complete after 12.230 msecs
> Nov 24 11:58:53 default-XenU kernel: [  116.542288] Setting capacity to 20480000
> Nov 24 11:58:53 default-XenU kernel: [  116.546975] Setting capacity to 20480000

Xen1  /var/log/xen/xend.log -> Xen2
[2011-11-24 12:25:12 23379] DEBUG (DevController:144) Waiting for 0.
[2011-11-24 12:25:12 23379] DEBUG (DevController:628) hotplugStatusCallback /local/domain/0/backend/vif/18/0/hotplug-status.
[2011-11-24 12:25:12 23379] DEBUG (DevController:642) hotplugStatusCallback 1.
[2011-11-24 12:25:12 23379] DEBUG (DevController:139) Waiting for devices vkbd.
[2011-11-24 12:25:12 23379] DEBUG (DevController:139) Waiting for devices ioports.
[2011-11-24 12:25:12 23379] DEBUG (DevController:139) Waiting for devices tap.
[2011-11-24 12:25:12 23379] DEBUG (DevController:139) Waiting for devices vif2.
[2011-11-24 12:25:12 23379] DEBUG (DevController:139) Waiting for devices console.
[2011-11-24 12:25:12 23379] DEBUG (DevController:144) Waiting for 0.
[2011-11-24 12:25:12 23379] DEBUG (DevController:139) Waiting for devices vscsi.
[2011-11-24 12:25:12 23379] DEBUG (DevController:139) Waiting for devices vbd.
[2011-11-24 12:25:12 23379] DEBUG (DevController:144) Waiting for 51712.
[2011-11-24 12:25:12 23379] DEBUG (DevController:628) hotplugStatusCallback /local/domain/0/backend/vbd/18/51712/hotplug-status.
[2011-11-24 12:25:12 23379] DEBUG (DevController:642) hotplugStatusCallback 1.
[2011-11-24 12:25:12 23379] DEBUG (DevController:139) Waiting for devices irq.
[2011-11-24 12:25:12 23379] DEBUG (DevController:139) Waiting for devices vfb.
[2011-11-24 12:25:12 23379] DEBUG (DevController:139) Waiting for devices pci.
[2011-11-24 12:25:12 23379] DEBUG (DevController:139) Waiting for devices vusb.
[2011-11-24 12:25:12 23379] DEBUG (DevController:139) Waiting for devices vtpm.
[2011-11-24 12:26:11 23379] DEBUG (XendCheckpoint:124) [xc_save]: /usr/lib/xen-4.1/bin/xc_save 23 18 0 0 1
[2011-11-24 12:26:11 23379] INFO (XendCheckpoint:423) xc_save: failed to get the suspend evtchn port
[2011-11-24 12:26:11 23379] INFO (XendCheckpoint:423)
[2011-11-24 12:26:31 23379] DEBUG (XendCheckpoint:394) suspend
[2011-11-24 12:26:31 23379] DEBUG (XendCheckpoint:127) In saveInputHandler suspend
[2011-11-24 12:26:31 23379] DEBUG (XendCheckpoint:129) Suspending 18 ...
[2011-11-24 12:26:31 23379] DEBUG (XendDomainInfo:524) XendDomainInfo.shutdown(suspend)
[2011-11-24 12:26:31 23379] DEBUG (XendDomainInfo:1881) XendDomainInfo.handleShutdownWatch
[2011-11-24 12:26:31 23379] DEBUG (XendDomainInfo:1881) XendDomainInfo.handleShutdownWatch
[2011-11-24 12:26:31 23379] INFO (XendCheckpoint:135) Domain 18 suspended.
[2011-11-24 12:26:31 23379] INFO (XendDomainInfo:2078) Domain has shutdown: name=migrating-default id=18 reason=suspend.
[2011-11-24 12:26:31 23379] DEBUG (XendCheckpoint:144) Written done
[2011-11-24 12:26:31 23379] DEBUG (XendDomainInfo:3071) XendDomainInfo.destroy: domid=18
[2011-11-24 12:26:31 23379] DEBUG (XendDomainInfo:2401) Destroying device model
[2011-11-24 12:26:31 23379] DEBUG (XendDomainInfo:2408) Releasing devices
[2011-11-24 12:26:31 23379] DEBUG (XendDomainInfo:2414) Removing vif/0
[2011-11-24 12:26:31 23379] DEBUG (XendDomainInfo:1276) XendDomainInfo.destroyDevice: deviceClass = vif, device = vif/0
[2011-11-24 12:26:31 23379] DEBUG (XendDomainInfo:2414) Removing console/0
[2011-11-24 12:26:31 23379] DEBUG (XendDomainInfo:1276) XendDomainInfo.destroyDevice: deviceClass = console, device = console/0
[2011-11-24 12:26:31 23379] DEBUG (XendDomainInfo:2414) Removing vbd/51712
[2011-11-24 12:26:31 23379] DEBUG (XendDomainInfo:1276) XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/51712

Xen2

> [2011-11-24 07:26:16 13708] DEBUG (XendCheckpoint:278) restore:shadow=0x0, _static_max=0xc000000, _static_min=0x0,
> [2011-11-24 07:26:16 13708] DEBUG (XendCheckpoint:305) [xc_restore]: /usr/lib/xen-4.1/bin/xc_restore 5 45 1 2 0 0 0 0
> [2011-11-24 07:26:35 13708] DEBUG (XendCheckpoint:394) store-mfn 106912
> [2011-11-24 07:26:35 13708] DEBUG (XendCheckpoint:394) console-mfn 106911
> [2011-11-24 07:26:35 13708] DEBUG (XendDomainInfo:3010) XendDomainInfo.completeRestore
> [2011-11-24 07:26:35 13708] DEBUG (XendDomainInfo:1794) Storing domain details: {'console/ring-ref': '106911', 'image/entry': '18446744071590183424', 'console/port': '2', 'store/ring-ref': '106912', 'image/loader': 'generic', 'vm': '/vm/faf41ef4-e218-3f14-7212-abc3e383bf60', 'control/platform-feature-multiprocessor-suspend': '1', 'image/hv-start-low': '18446603336221196288', 'image/guest-os': 'linux', 'image/virt-base': '18446744071562067968', 'memory/target': '196608', 'image/guest-version': '2.6', 'image/pae-mode': 'yes', 'description': '', 'console/limit': '1048576', 'image/paddr-offset': '0', 'image/hypercall-page': '18446744071578849280', 'image/suspend-cancel': '1', 'cpu/0/availability': 'online', 'image/features/pae-pgdir-above-4gb': '1', 'image/features/writable-page-tables': '0', 'console/type': 'xenconsoled', 'name': 'default', 'domid': '45', 'image/xen-version': 'xen-3.0', 'store/port': '1'}
> [2011-11-24 07:26:35 13708] DEBUG (XendDomainInfo:3023) XendDomainInfo.completeRestore done
> [2011-11-24 07:26:35 13708] DEBUG (DevController:139) Waiting for devices tap2.
> [2011-11-24 07:26:35 13708] DEBUG (XendDomainInfo:1881) XendDomainInfo.handleShutdownWatch
> [2011-11-24 07:26:35 13708] DEBUG (DevController:139) Waiting for devices vif.
> [2011-11-24 07:26:35 13708] DEBUG (DevController:144) Waiting for 0.
> [2011-11-24 07:26:35 13708] DEBUG (DevController:628) hotplugStatusCallback /local/domain/0/backend/vif/45/0/hotplug-status.
> [2011-11-24 07:26:35 13708] DEBUG (DevController:642) hotplugStatusCallback 1.
> [2011-11-24 07:26:35 13708] DEBUG (DevController:139) Waiting for devices vkbd.
> [2011-11-24 07:26:35 13708] DEBUG (DevController:139) Waiting for devices ioports.
> [2011-11-24 07:26:35 13708] DEBUG (DevController:139) Waiting for devices tap.
> [2011-11-24 07:26:35 13708] DEBUG (DevController:139) Waiting for devices vif2.
> [2011-11-24 07:26:35 13708] DEBUG (DevController:139) Waiting for devices console.
> [2011-11-24 07:26:35 13708] DEBUG (DevController:144) Waiting for 0.
> [2011-11-24 07:26:35 13708] DEBUG (DevController:139) Waiting for devices vscsi.
> [2011-11-24 07:26:35 13708] DEBUG (DevController:139) Waiting for devices vbd.
> [2011-11-24 07:26:35 13708] DEBUG (DevController:144) Waiting for 51712.
> [2011-11-24 07:26:35 13708] DEBUG (DevController:628) hotplugStatusCallback /local/domain/0/backend/vbd/45/51712/hotplug-status.
> [2011-11-24 07:26:35 13708] DEBUG (DevController:642) hotplugStatusCallback 1.
> [2011-11-24 07:26:35 13708] DEBUG (DevController:139) Waiting for devices irq.
> [2011-11-24 07:26:35 13708] DEBUG (DevController:139) Waiting for devices vfb.
> [2011-11-24 07:26:35 13708] DEBUG (DevController:139) Waiting for devices pci.
> [2011-11-24 07:26:35 13708] DEBUG (DevController:139) Waiting for devices vusb.
> [2011-11-24 07:26:35 13708] DEBUG (DevController:139) Waiting for devices vtpm.

I can continue migrating from Xen1 -> Xen2 -> Xen1 ... sometimes vif reconnect fails sometimes it works...

> xm network-detach <domain> 0
> xm network-attach <domain>

and vif works again...

somebody has any idea?

Steph




_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users

_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users

 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.