Re: [Xen-users] rebased opensuse 2.6.31 xen patches

["Jan Beulich" <JBeulich@xxxxxxxxxx>]

But the version embedded in the oops messages doesn't say so...

Jan

>>> Andrew Lyon <andrew.lyon@xxxxxxxxx> 29.10.09 13:18 >>>
Yes, I took the xen patches from
kernel-source-2.6.31.5-0.0.4.4b07dce.src.rpm and made sure the vanilla
kernel was patched to .31.5

Andy

On Thu, Oct 29, 2009 at 10:05 AM, Jan Beulich <JBeulich@xxxxxxxxxx> wrote:
> Did you try updating to .31.5? There have been quite a few TTY related
> fixes... Jan
>
>>>> Andrew Lyon <andrew.lyon@xxxxxxxxx> 29.10.09 10:06 >>>
> On Wed, Oct 28, 2009 at 7:20 PM, Boris Derzhavets 
> <bderzhavets@xxxxxxxxx>wrote:
>
>> dmesg.log for 2.31.4 ( Andy's V7 patch set applied ) under Xen 3.4.1
>> seems to be clean.
>>
>>
>> Boris.
>>
>> --- On *Mon, 10/26/09, Jan Beulich <JBeulich@xxxxxxxxxx>* wrote:
>>
>
> On my test system all of the 2.6.31 Xen kernels crash after a few minutes,
> here is a example of the crash, the kernel is tainted in this case as I need
> nvidia drivers to get my work done, but it also happens without the nvidia
> kernel module loaded or X running.
>
> Oct 29 08:48:31 ubermicro BUG: unable to handle kernel NULL pointer
> dereference at 0000000000000060
> Oct 29 08:48:31 ubermicro IP: [<ffffffff803de62c>] tty_poll+0x43/0x70
> Oct 29 08:48:31 ubermicro PGD 3d22a4067 PUD 3d20dc067 PMD 0
> Oct 29 08:48:31 ubermicro Oops: 0000 [#1] SMP
> Oct 29 08:48:31 ubermicro last sysfs file:
> /sys/devices/xen-backend/vbd-5-768/statistics/wr_sect
> Oct 29 08:48:31 ubermicro CPU 0
> Oct 29 08:48:31 ubermicro Modules linked in: ipv6 coretemp w83627hf
> w83793 hwmon_vid bnep xen_scsibk rfcomm l2cap hci_uart st nvidia(P)
> snd_hda_codec_realtek btusb snd_hda_intel snd_hda_codec snd_usb_audio
> bluetooth snd_usb_lib snd_pcm snd_timer snd_rawmidi snd_hwdep snd igb
> iTCO_wdt i2c_i801 iTCO_vendor_support sym53c8xx snd_page_alloc
> i2c_core i5k_amb [last unloaded: microcode]
> Oct 29 08:48:31 ubermicro Pid: 12443, comm: ssh Tainted: P
> 2.6.31-xen-r7 #2 X7DWA
> Oct 29 08:48:31 ubermicro RIP: e030:[<ffffffff803de62c>]
> [<ffffffff803de62c>] tty_poll+0x43/0x70
> Oct 29 08:48:31 ubermicro RSP: e02b:ffff8803d2257a08  EFLAGS: 00010286
> Oct 29 08:48:31 ubermicro RAX: 0000000000000000 RBX: ffff8803d1cee800
> RCX: ffffffff8067c616
> Oct 29 08:48:31 ubermicro RDX: ffff8800f28f1cc0 RSI: 0000000000000000
> RDI: ffffffff80896340
> Oct 29 08:48:31 ubermicro RBP: ffff8803e90a2d40 R08: ffff8803d2256000
> R09: ffffffff806dbe68
> Oct 29 08:48:31 ubermicro R10: ffff8803d18e7d40 R11: ffffffff804f47c3
> R12: ffff8800f28f1cc0
> Oct 29 08:48:31 ubermicro R13: 0000000000000000 R14: 0000000000000000
> R15: 0000000000000008
> Oct 29 08:48:31 ubermicro FS:  00007fd450def6f0(0000)
> GS:ffffc90000000000(0000) knlGS:0000000000000000
> Oct 29 08:48:31 ubermicro CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
> Oct 29 08:48:31 ubermicro CR2: 0000000000000060 CR3: 00000003d238d000
> CR4: 0000000000002660
> Oct 29 08:48:31 ubermicro DR0: 0000000000000000 DR1: 0000000000000000
> DR2: 0000000000000000
> Oct 29 08:48:31 ubermicro DR3: 0000000000000000 DR6: 00000000ffff0ff0
> DR7: 0000000000000400
> Oct 29 08:48:31 ubermicro Process ssh (pid: 12443, threadinfo
> ffff8803d2256000, task ffff8803d1f24700)
> Oct 29 08:48:31 ubermicro Stack:
> Oct 29 08:48:31 ubermicro 0000000000000000 ffff8803e90a2d40
> 0000000000000000 0000000000000100
> Oct 29 08:48:31 ubermicro <0> ffff8803d2257eb8 ffffffff802a7607
> 0000000000000000 00ff8803d78dfa00
> Oct 29 08:48:31 ubermicro <0> 0000000000000000 0000000100000000
> 0000000000000000 0000000000000000
> Oct 29 08:48:31 ubermicro Call Trace:
> Oct 29 08:48:31 ubermicro [<ffffffff802a7607>] ? do_select+0x2bc/0x4f2
> Oct 29 08:48:31 ubermicro [<ffffffff802a7b7b>] ? __pollwait+0x0/0xd8
> Oct 29 08:48:31 ubermicro [<ffffffff802a7c53>] ? pollwake+0x0/0x54
> Oct 29 08:48:31 ubermicro [<ffffffff802a7c53>] ? pollwake+0x0/0x54
> Oct 29 08:48:31 ubermicro [<ffffffff802a7c53>] ? pollwake+0x0/0x54
> Oct 29 08:48:31 ubermicro [<ffffffff802a7c53>] ? pollwake+0x0/0x54
> Oct 29 08:48:31 ubermicro [<ffffffff802a7c53>] ? pollwake+0x0/0x54
> Oct 29 08:48:31 ubermicro [<ffffffff802a7c53>] ? pollwake+0x0/0x54
> Oct 29 08:48:31 ubermicro [<ffffffff804c683f>] ? release_sock+0x19/0xbc
> Oct 29 08:48:31 ubermicro [<ffffffff804f5f06>] ? tcp_sendmsg+0x898/0x98c
> Oct 29 08:48:31 ubermicro [<ffffffff802a79f9>] ? core_sys_select+0x1bc/0x280
> Oct 29 08:48:31 ubermicro [<ffffffff80299df6>] ? do_sync_write+0xc9/0x10c
> Oct 29 08:48:31 ubermicro [<ffffffff80244fcc>] ?
> autoremove_wake_function+0x0/0x2e
> Oct 29 08:48:31 ubermicro [<ffffffff802a7b52>] ? sys_select+0x95/0xbe
> Oct 29 08:48:31 ubermicro [<ffffffff8029aaa3>] ? sys_write+0x45/0x6e
> Oct 29 08:48:31 ubermicro [<ffffffff802092f8>] ? 
> system_call_fastpath+0x16/0x1b
> Oct 29 08:48:31 ubermicro [<ffffffff80209290>] ? system_call+0x0/0x52
> Oct 29 08:48:31 ubermicro Code: 18 48 8b 9f 98 00 00 00 48 8b 70 10 48
> 89 df e8 29 fd ff ff 31 d2 85 c0 75 33 48 89 df 45 31 ed e8 04 6b 00
> 00 49 89 c4 48 8b 00 <48> 8b 40 60 48 85 c0 74 0e 4c 89 f2 48 89 ee 48
> 89 df ff d0 41
> Oct 29 08:48:31 ubermicro RIP  [<ffffffff803de62c>] tty_poll+0x43/0x70
> Oct 29 08:48:31 ubermicro RSP <ffff8803d2257a08>
> Oct 29 08:48:31 ubermicro CR2: 0000000000000060
> Oct 29 08:48:31 ubermicro ---[ end trace 43a8558611b5e890 ]---
> Oct 29 08:48:31 ubermicro BUG: unable to handle kernel NULL pointer
> dereference at 0000000000000048
> Oct 29 08:48:31 ubermicro IP: [<ffffffff803e143d>] tty_ioctl+0x825/0x874
> Oct 29 08:48:31 ubermicro PGD f0648067 PUD f297b067 PMD 0
> Oct 29 08:48:31 ubermicro Oops: 0000 [#2] SMP
> Oct 29 08:48:31 ubermicro last sysfs file:
> /sys/devices/xen-backend/vbd-5-768/statistics/wr_sect
> Oct 29 08:48:31 ubermicro CPU 0
> Oct 29 08:48:31 ubermicro Modules linked in: ipv6 coretemp w83627hf
> w83793 hwmon_vid bnep xen_scsibk rfcomm l2cap hci_uart st nvidia(P)
> snd_hda_codec_realtek btusb snd_hda_intel snd_hda_codec snd_usb_audio
> bluetooth snd_usb_lib snd_pcm snd_timer snd_rawmidi snd_hwdep snd igb
> iTCO_wdt i2c_i801 iTCO_vendor_support sym53c8xx snd_page_alloc
> i2c_core i5k_amb [last unloaded: microcode]
> Oct 29 08:48:31 ubermicro Pid: 12438, comm: bash Tainted: P      D
> 2.6.31-xen-r7 #2 X7DWA
> Oct 29 08:48:31 ubermicro RIP: e030:[<ffffffff803e143d>]
> [<ffffffff803e143d>] tty_ioctl+0x825/0x874
> Oct 29 08:48:31 ubermicro RSP: e02b:ffff8800f2aa3e78  EFLAGS: 00010282
> Oct 29 08:48:31 ubermicro RAX: 0000000000000000 RBX: ffff8803e90a2d40
> RCX: 00000000fffffffa
> Oct 29 08:48:31 ubermicro RDX: 0000000000000000 RSI: 0000000000000000
> RDI: ffffffff80896340
> Oct 29 08:48:31 ubermicro RBP: 00007fff3536a900 R08: 00000000006cd2e0
> R09: 0000000000005403
> Oct 29 08:48:31 ubermicro R10: 0000000000000000 R11: 0000000000000206
> R12: ffff8803d1cee800
> Oct 29 08:48:31 ubermicro R13: ffff8800f28f1cc0 R14: 0000000000005403
> R15: 00000000ffffffff
> Oct 29 08:48:31 ubermicro FS:  00007fb23d6196f0(0000)
> GS:ffffc90000000000(0000) knlGS:0000000000000000
> Oct 29 08:48:31 ubermicro CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
> Oct 29 08:48:31 ubermicro CR2: 0000000000000048 CR3: 00000000f2944000
> CR4: 0000000000002660
> Oct 29 08:48:31 ubermicro DR0: 0000000000000000 DR1: 0000000000000000
> DR2: 0000000000000000
> Oct 29 08:48:31 ubermicro DR3: 0000000000000000 DR6: 00000000ffff0ff0
> DR7: 0000000000000400
> Oct 29 08:48:31 ubermicro Process bash (pid: 12438, threadinfo
> ffff8800f2aa2000, task ffff8803e8048050)
> Oct 29 08:48:31 ubermicro Stack:
> Oct 29 08:48:31 ubermicro 0000000000000000 000003e80000309b
> ffff8803e90a2d40 00007fff3536a900
> Oct 29 08:48:31 ubermicro <0> 0000000000005403 00000000000000ff
> 0000000000005403 ffffffff802a5e02
> Oct 29 08:48:31 ubermicro <0> ffff8803e90a2d40 00007fff3536a900
> ffff8803d109a050 ffffffff802a6357
> Oct 29 08:48:31 ubermicro Call Trace:
> Oct 29 08:48:31 ubermicro [<ffffffff802a5e02>] ? vfs_ioctl+0x21/0x6b
> Oct 29 08:48:31 ubermicro [<ffffffff802a6357>] ? do_vfs_ioctl+0x498/0x4ed
> Oct 29 08:48:31 ubermicro [<ffffffff8022918d>] ? default_wake_function+0x0/0x9
> Oct 29 08:48:31 ubermicro [<ffffffff8029b019>] ? __fput+0x198/0x1c8
> Oct 29 08:48:31 ubermicro [<ffffffff802a63e8>] ? sys_ioctl+0x3c/0x5c
> Oct 29 08:48:31 ubermicro [<ffffffff802092f8>] ? 
> system_call_fastpath+0x16/0x1b
> Oct 29 08:48:32 ubermicro [<ffffffff80209290>] ? system_call+0x0/0x52
> Oct 29 08:48:32 ubermicro Code: 48 85 c0 74 18 44 89 f2 48 89 e9 48 89
> de 4c 89 e7 ff d0 3d fd fd ff ff 48 63 d0 75 4b 4c 89 e7 e8 f3 3c 00
> 00 49 89 c5 48 8b 00 <48> 8b 40 48 48 85 c0 74 17 48 89 de 48 89 e9 44
> 89 f2 4c 89 e7
> Oct 29 08:48:32 ubermicro RIP  [<ffffffff803e143d>] tty_ioctl+0x825/0x874
> Oct 29 08:48:32 ubermicro RSP <ffff8800f2aa3e78>
> Oct 29 08:48:32 ubermicro CR2: 0000000000000048
> Oct 29 08:48:32 ubermicro ---[ end trace 43a8558611b5e891 ]---
> Oct 29 08:48:32 ubermicro BUG: unable to handle kernel NULL pointer
> dereference at 0000000000000028
> Oct 29 08:48:32 ubermicro IP: [<ffffffff803e4f85>] tty_ldisc_hangup+0x17/0x181
> Oct 29 08:48:32 ubermicro PGD f288a067 PUD f506e067 PMD 0
> Oct 29 08:48:32 ubermicro Oops: 0000 [#3] SMP
> Oct 29 08:48:32 ubermicro last sysfs file:
> /sys/devices/xen-backend/vbd-5-768/statistics/wr_sect
> Oct 29 08:48:32 ubermicro CPU 0
> Oct 29 08:48:32 ubermicro Modules linked in: ipv6 coretemp w83627hf
> w83793 hwmon_vid bnep xen_scsibk rfcomm l2cap hci_uart st nvidia(P)
> snd_hda_codec_realtek btusb snd_hda_intel snd_hda_codec snd_usb_audio
> bluetooth snd_usb_lib snd_pcm snd_timer snd_rawmidi snd_hwdep snd igb
> iTCO_wdt i2c_i801 iTCO_vendor_support sym53c8xx snd_page_alloc
> i2c_core i5k_amb [last unloaded: microcode]
> Oct 29 08:48:32 ubermicro Pid: 12436, comm: xterm Tainted: P      D
> 2.6.31-xen-r7 #2 X7DWA
> Oct 29 08:48:32 ubermicro RIP: e030:[<ffffffff803e4f85>]
> [<ffffffff803e4f85>] tty_ldisc_hangup+0x17/0x181
> Oct 29 08:48:32 ubermicro RSP: e02b:ffff8803d1c4dde8  EFLAGS: 00010286
> Oct 29 08:48:32 ubermicro RAX: 0000000000000000 RBX: ffff8800f28f1cc0
> RCX: ffffffff8022918d
> Oct 29 08:48:32 ubermicro RDX: 0000000000000000 RSI: 0000000000000000
> RDI: ffffffff80896340
> Oct 29 08:48:32 ubermicro RBP: ffff8803d1cee800 R08: ffff8803d109a080
> R09: 0000000000000001
> Oct 29 08:48:32 ubermicro R10: ffff8803d1cee800 R11: 0000000000000000
> R12: ffff8803e944db00
> Oct 29 08:48:32 ubermicro R13: 0000000000000010 R14: 0000000000000000
> R15: 0000000000000000
> Oct 29 08:48:32 ubermicro FS:  00007fd05b5ef750(0000)
> GS:ffffc90000000000(0000) knlGS:0000000000000000
> Oct 29 08:48:32 ubermicro CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
> Oct 29 08:48:32 ubermicro CR2: 0000000000000028 CR3: 00000000f2ea6000
> CR4: 0000000000002660
> Oct 29 08:48:32 ubermicro DR0: 0000000000000000 DR1: 0000000000000000
> DR2: 0000000000000000
> Oct 29 08:48:32 ubermicro DR3: 0000000000000000 DR6: 00000000ffff0ff0
> DR7: 0000000000000400
> Oct 29 08:48:32 ubermicro Process xterm (pid: 12436, threadinfo
> ffff8803d1c4c000, task ffff8803e9a78cb0)
> Oct 29 08:48:32 ubermicro Stack:
> Oct 29 08:48:32 ubermicro ffff8803d1cee9e8 ffff8803d1cee800
> ffff8803e944db00 ffffffff803defeb
> Oct 29 08:48:32 ubermicro <0> ffff880300000001 ffff8803d630a000
> ffff8803d1cee800 ffff8803e944db00
> Oct 29 08:48:32 ubermicro <0> 0000000000000010 ffff8803d76704b8
> ffff8803d761fb00 ffffffff803e010f
> Oct 29 08:48:32 ubermicro Call Trace:
> Oct 29 08:48:32 ubermicro [<ffffffff803defeb>] ? do_tty_hangup+0x119/0x3a6
> Oct 29 08:48:32 ubermicro [<ffffffff803e010f>] ? tty_release_dev+0x1a9/0x42f
> Oct 29 08:48:32 ubermicro [<ffffffff802acf7b>] ? notify_change+0x270/0x285
> Oct 29 08:48:32 ubermicro [<ffffffff803e03a6>] ? tty_release+0x11/0x1a
> Oct 29 08:48:32 ubermicro [<ffffffff8029af81>] ? __fput+0x100/0x1c8
> Oct 29 08:48:32 ubermicro [<ffffffff802987a4>] ? filp_close+0x5e/0x66
> Oct 29 08:48:32 ubermicro [<ffffffff80299979>] ? sys_close+0xa9/0x114
> Oct 29 08:48:32 ubermicro [<ffffffff802092f8>] ? 
> system_call_fastpath+0x16/0x1b
> Oct 29 08:48:32 ubermicro [<ffffffff80209290>] ? system_call+0x0/0x52
> Oct 29 08:48:32 ubermicro Code: 48 89 ef e8 7f ff ff ff 5b 5d 41 5c 44
> 89 e8 41 5d 41 5e c3 41 54 55 48 89 fd 53 e8 34 fb ff ff 48 85 c0 48
> 89 c3 74 4c 48 8b 00 <48> 8b 40 28 48 85 c0 74 05 48 89 ef ff d0 48 89
> ef e8 20 ec ff
> Oct 29 08:48:32 ubermicro RIP  [<ffffffff803e4f85>] 
> tty_ldisc_hangup+0x17/0x181
> Oct 29 08:48:32 ubermicro RSP <ffff8803d1c4dde8>
> Oct 29 08:48:32 ubermicro CR2: 0000000000000028
> Oct 29 08:48:32 ubermicro ---[ end trace 43a8558611b5e892 ]---
> Oct 29 08:50:01 ubermicro cron[12516]: (root) CMD (test -x
> /usr/sbin/run-crons && /usr/sbin/run-crons )
> Oct 29 08:50:28 ubermicro su[12536]: Successful su for root by admin
> Oct 29 08:50:28 ubermicro su[12536]: + pts/12 admin:root
> Oct 29 08:50:28 ubermicro su[12536]: pam_unix(su:session): session
> opened for user root by admin(uid=1000)
> Oct 29 08:50:30 ubermicro BUG: unable to handle kernel paging request
> at 0000000200000b19
> Oct 29 08:50:30 ubermicro IP: [<ffffffff802d7a9b>] show_map_vma+0x2d/0x188
> Oct 29 08:50:30 ubermicro PGD f2ea9067 PUD 0
> Oct 29 08:50:30 ubermicro Oops: 0000 [#4] SMP
> Oct 29 08:50:30 ubermicro last sysfs file:
> /sys/devices/xen-backend/vbd-5-768/statistics/wr_sect
> Oct 29 08:50:30 ubermicro CPU 0
> Oct 29 08:50:30 ubermicro Modules linked in: ipv6 coretemp w83627hf
> w83793 hwmon_vid bnep xen_scsibk rfcomm l2cap hci_uart st nvidia(P)
> snd_hda_codec_realtek btusb snd_hda_intel snd_hda_codec snd_usb_audio
> bluetooth snd_usb_lib snd_pcm snd_timer snd_rawmidi snd_hwdep snd igb
> iTCO_wdt i2c_i801 iTCO_vendor_support sym53c8xx snd_page_alloc
> i2c_core i5k_amb [last unloaded: microcode]
> Oct 29 08:50:30 ubermicro Pid: 12544, comm: lsof Tainted: P      D
> 2.6.31-xen-r7 #2 X7DWA
> Oct 29 08:50:30 ubermicro RIP: e030:[<ffffffff802d7a9b>]
> [<ffffffff802d7a9b>] show_map_vma+0x2d/0x188
> Oct 29 08:50:30 ubermicro RSP: e02b:ffff8800f12bbe18  EFLAGS: 00010202
> Oct 29 08:50:30 ubermicro RAX: ffff8800f44153e0 RBX: 0000000200000b01
> RCX: 0000000000000000
> Oct 29 08:50:30 ubermicro RDX: ffff8800d088b240 RSI: ffff8800f28f2330
> RDI: ffff8800d088b240
> Oct 29 08:50:30 ubermicro RBP: ffff8800f28f2330 R08: 0000000000000002
> R09: 0000000000000000
> Oct 29 08:50:30 ubermicro R10: 0000000000000000 R11: 0000000000000000
> R12: ffff8800d088b240
> Oct 29 08:50:30 ubermicro R13: 0000000000000000 R14: 0000000000000000
> R15: 0000000000626fe0
> Oct 29 08:50:30 ubermicro FS:  00007f701a15c6f0(0000)
> GS:ffffc90000000000(0000) knlGS:0000000000000000
> Oct 29 08:50:30 ubermicro CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
> Oct 29 08:50:30 ubermicro CR2: 0000000200000b19 CR3: 00000000d133b000
> CR4: 0000000000002660
> Oct 29 08:50:30 ubermicro DR0: 0000000000000000 DR1: 0000000000000000
> DR2: 0000000000000000
> Oct 29 08:50:30 ubermicro DR3: 0000000000000000 DR6: 00000000ffff0ff0
> DR7: 0000000000000400
> Oct 29 08:50:30 ubermicro Process lsof (pid: 12544, threadinfo
> ffff8800f12ba000, task ffff8803d1f58cf0)
> Oct 29 08:50:30 ubermicro Stack:
> Oct 29 08:50:30 ubermicro 00007fff00000078 ffff880300000070
> 0000000000000000 ffffffff00000000
> Oct 29 08:50:30 ubermicro <0> ffff880300000000 0000000000000000
> ffff8800f12bbe64 ffffffff802db3a1
> Oct 29 08:50:30 ubermicro <0> ffff8800f44153e0 00000030f44153e0
> ffff8800d088b240 ffff8800f28f2330
> Oct 29 08:50:30 ubermicro Call Trace:
> Oct 29 08:50:30 ubermicro [<ffffffff802db3a1>] ? mm_for_maps+0x61/0x69
> Oct 29 08:50:30 ubermicro [<ffffffff802d7c0d>] ? show_map+0x17/0x3f
> Oct 29 08:50:30 ubermicro [<ffffffff802b1618>] ? seq_read+0x244/0x326
> Oct 29 08:50:30 ubermicro [<ffffffff8029a65c>] ? vfs_read+0xaa/0x166
> Oct 29 08:50:30 ubermicro [<ffffffff8029aa35>] ? sys_read+0x45/0x6e
> Oct 29 08:50:30 ubermicro [<ffffffff802092f8>] ? 
> system_call_fastpath+0x16/0x1b
> Oct 29 08:50:30 ubermicro [<ffffffff80209290>] ? system_call+0x0/0x52
> Oct 29 08:50:30 ubermicro Code: 45 31 db 45 31 f6 45 31 d2 41 55 41 54
> 49 89 fc 55 48 89 f5 53 48 83 ec 50 48 8b 9e 90 00 00 00 4c 8b 2e 8b
> 4e 28 48 85 db 74 22 <48> 8b 43 18 4c 8b 9e 88 00 00 00 48 8b 50 10 49
> c1 e3 0c 48 8b
> Oct 29 08:50:30 ubermicro RIP  [<ffffffff802d7a9b>] show_map_vma+0x2d/0x188
> Oct 29 08:50:30 ubermicro RSP <ffff8800f12bbe18>
> Oct 29 08:50:30 ubermicro CR2: 0000000200000b19
> Oct 29 08:50:30 ubermicro ---[ end trace 43a8558611b5e893 ]---
>

_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users