[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Xen-devel] Xen 3.0.0 (ChangeSet 8241) test results
- To: <xen-devel@xxxxxxxxxxxxxxxxxxx>
- From: "Zheng, Jeff" <jeff.zheng@xxxxxxxxx>
- Date: Fri, 9 Dec 2005 18:25:29 +0800
- Delivery-date: Fri, 09 Dec 2005 10:26:36 +0000
- List-id: Xen developer discussion <xen-devel.lists.xensource.com>
- Thread-index: AcX8quDkDLlFyD5mToqm8h2WqLzOqg==
- Thread-topic: Xen 3.0.0 (ChangeSet 8241) test results
We have tested xen 3.0.0 (ChangeSet 8241) on Intel S3E3141 SDP. It
has 4 sockets, each socket is dual core, dual thread.
In general, VMX works fine as IA32/IA32E guest on both IA32/IA32E
service OS. IA32 Windows are bootable.We can boot IA64 guest after
changing the build config file of IA64. IA64 works better on RHEL4U2
than on RHEL3
Here is the main issues that we found in the testing:
+ There is no VMX information in xen 3.0 user manual
+ Evtchn delay (may lost) issue on big SMP machine causes a black QEMU
window when startup IA32&IA32e VMX on IA32e host
+ xen0 booting fails on Xen 3.0.0 IPF version. Need to change the
build config file to make it work
+ VTI domain will hang after booting up several minutes on EL3.
+ vmx's network broken about every 10 minutes when there are 2 or more
vmx
+ Install FC2-IA32 on VMX will crash service OS
+ Cannot install IA32e guest OS from CDROM
+ Cannot Install SuSE10-IA32 guest OS from CDROM
+ The second Windows XP guest will be unstable
+ HCT stress may make Windows blue screen
+ vcpu-pin will hang service OS.
+ On IA-32e, service os and guest os have different time zone, but the
same time value.
+ In IA-32e guest on IA-32e service os, can't type numbers in text
console through the number key on the right side of the keyboard.
+ If use vnc (vnc=1 and vncviewer=1) to create a vmx and startx in
vmx.The Xwindows' response to keyboard and mouse will be very slow
and can't switch to text console.
We also have tests for binaries in
http://www.xensource.com/xen/downloads/. Basically VMX does not work
with these binaries. The main issues that we found are:
+ Most Xen3.0 binaries dosn't have vmxload and thus cannot startup
vmx, except IA32/PAE SMP tarball. We can create VMX from IA32 tarball.
+ xen0 keep rebooting on DP platform after install xen 3.0 for
rhel4u1rpm
+ Create vmx guest on PAE host cause service os reboot from PAE
tarball
+ IA32e tarball only support ext2 file system.
More details information in attached files.
Bests
Jeff
--- Begin Message ---
Following is the detail test information of out testing on Intel
S3E3141 SDP. It has 4 sockets, each socket is dual core, dual thread.
================================================
xm test result on VMX
================================================
IA32:
PASS: 64
FAIL: 26
XPASS: 0
XFAIL: 1
IA32e:
PASS: 62
FAIL: 28
XPASS: 0
XFAIL: 1
=================================================
Control Panel
=================================================
VMX boot
2.6 kernel VMX boot Pass
2.4 kernel VMX boot Pass
2 VMX runs on VMM Pass
4 VMX runs on VMM Pass
2 VMX and 2 domU runs on VMM Pass
8 VMX runs on VMM No Test
Create 8 VMs (including xenU and VMX) on one processor core Pass
1 VMX and 1 domU can be created at the same time Pass
4 VMX can be created at the same time Pass
VCPU
1 VMX whose VCPU number is 2 Failed
1 domU whose VCPU number is 2 Pass
1 VMX whose VCPU number is 3 Failed
1 domU whose VCPU number is 3 Pass
1 VMX whose VCPU number is 4 Failed
1 domU whose VCPU number is 4 Pass
1 VMX whose VCPU number is 5 Failed
1 domU whose VCPU number is 5 Pass
1 domU whose VCPU number is 8 Pass
2 VMX whose VCPU is 2 Failed
2 domU whose VCPU is 2 Pass
Schedule
2 CPU,VMX, bind CPU test Failed
2 CPU, domU, bind CPU test Pass
2 CPU, 2 VMX, bind CPU test Failed
2 CPU, 2 domU, bind CPU test Pass
Memory
1 VM with 256M memory test Pass
1 VM with 512 memory test Pass
2 VM with 256M memory test Pass
2 VM with 256M memory consuming test Pass
2 VM with 512M memory consuming test Pass
Console
domU console Local console access for “xm create ?Cc” Pass
domU console Local console access for ”xm console" Pass
VMX console Local console access for ”xm console" Pass
VMX console Local console access for “xm create” Pass
2 domU console Local console access for “xm create ?Cc” Pass
2 domU console Local console access for ”xm console" Pass
2 VMX console Local console access for “xm create” Pass
VMX local console access for “xm create” with vnc is set to 1 Pass
VMX remote console access for “xm create” with vnc is set to 1
Pass
Domain management
VMX xm reboot Failed
domU xm reboot Pass
VMX xm shutdown Failed
domU xm shutdown Pass
xm create and xm destroy Pass
VMX xm pause/xm unpause Pass
domU Save/Restore: Memory address continuity Pass
domU save SMP guest Failed
domU Save/Restore: File descriptor continuity Pass
domU save/Restore: network Pass
domU save/Restore: Keyboard continuity Pass
domU save/Restore: VMX VGA display correct Pass
VMX save/restore No test
VMX pause/unpause: Memory address continuity Pass
VMX pause/unpause: File descriptor continuity Pass
VMX pause/unpause: network Pass
VMX pause/unpause: Device enumeration continuity Pass
VMX pause/unpause: Keyboard continuity Pass
domU remote migrate: Pass
domU local migrate: Failed
VMX pause/unpause: VGA display correct after suspend/resume Pass
=======================================================
Device model
=======================================================
We tested in 5 environment:
+ IA-32e 2.6 guest on IA-32e service os.
+ IA-32 2.4 guest on IA-32e service os.
+ IA-32 2.6 guest on IA-32e service os.
+ IA-32 2.4 guest on IA-32 service os.
+ IA-32 2.6 guest on IA-32 service os.
Here is the main issue summary. I'll check all the issues to submit
new bugs or update old bugs.
Timer: + On IA-32e, service os and guest os have different time zone,
but the same time value.
+ In all environment, the result of clockdiff vmx2_hostname /
or xen0_hostname is far more
than the acceptable value in the spec.Need disscuss with
developers to confirm if the
acceptable value in the spec is reasonable.
NIC: + In all environment, I found vmx's network broken about every
10 minutes when there
are 2 or more vmx. Maybe it's caused by DNS problem.I am
checking it and will report
it if it's really a bug.
IDE: + On IA-32e.When I use a physical harddisk to create vmx. If
booting the xen0 partition,the service os reboots.
+ In all environment, when using a config file with wrong disk
parameter to create vmx, there is no error message and sometimes even
the qemu window pop
up.
VGA: + In all environment,if create vmx with
sdl=0,vnc=0,vncviewer=0 and nographic=1, there is no
output in serial port or console. But I heard it’s a
feature. Need tracking.
+ In all environment,if create vmx with
sdl=0,vnc=0,vncviewer=1 and nographic=0. Expected
result is no vncviewer pop up. But indeed there is a
vncviewer window pop up.
Others: + In IA-32e guest on IA-32e service os, can’t type numbers in
text console through the number
key on the right side of the keyboard.If in Xwindows, it
will be ok.
+ If use vnc (vnc=1 and vncviewer=1) to create a vmx and
startx in vmx.The Xwindows’response to keyboard and mouse
will be very slow and can’t
switch to text console.
========================================================
Guest OS installation
========================================================
Host OS Guest OS
RHEL4U1-IA32 FC2-IA32 fail (host
server reboot after printing "booting the kernel")
RHEL4U1-IA32 RHEL4U1-IA32 pass
RHEL4U1-IA32 RHEL3U5-IA32 pass
RHEL4U1-IA32 FC4-IA32 pass
RHEL4U1-IA32 FC3-IA32 pass
RHEL4U1-IA32 SLES9-IA32 pass
RHEL4U1-IA32 SUSE10-IA32 fail (hang
the guest, but not hang the host OS when guest load the kernel for
installation)
Following tests are all on VT platform with Intel 915 chipset.
Host OS Guest OS
RHEL4U1-IA32e FC2-IA32 fail (host
server reboot after the guest VMX installation print "booting the
kernel")
RHEL4U1-IA32e RHEL4U1-IA32 pass
RHEL4U1-IA32e RHEL3U5-IA32 pass
RHEL4U1-IA32e FC4-IA32 pass
RHEL4U1-IA32e FC3-IA32 pass
RHEL4U1-IA32e SLES9-IA32 pass
RHEL4U1-IA32e SUSE10-IA32 fail (hang
the guest, but not hang the host OS when guest load the kernel for
installation)
RHEL4U1-IA32e RHEL4U1-IA32e fail (VMX
guest hangs after printing "booting the kernel", but not hang service
OS.)
RHEL4U1-IA32e RHEL3U5-IA32e fail (VMX
guest hangs after printing "booting the kernel", but not hang service
OS.)
RHEL4U1-IA32e SLES9-IA32e fail (VMX
guest hangs after printing "booting the kernel", but not hang service
OS.)
RHEL4U1-IA32e FC4-IA32e fail (VMX
guest seems to hang with kernel panic, not hang service OS.)
RHEL4U1-IA32e SUSE10-IA32e fail (hang
the guest, but not hang the host OS when guest load the kernel for
installation)
========================================================
Windows
========================================================
IA32 Windows Guest on RHEL4U1 IA32 host:
Booting one windows guest Pass
Booting two windows XP guests Fail (The
second guest is unstable)
Booting two windows 2003 guests Pass
Network Pass
HCT Stress on windows xp Pass ?? (Guest is
still alive after running 5 hours)
IA32 Windows Guest on RHEL4U2 IA32e host:
Booting one windows guest Pass
Booting two windows XP guests Fail (The
second guest is unstable)
Booting two windows 2003 guests Pass
Network Pass
HCT Stress Fail (Met blue
screen after running HCT stress less than 1 minute)
========================================================
Stress test
========================================================
RHEL4U1 IA32 Guest on RHEL4U1 IA32 host
Crashme (1hour) Pass
Helltest (4hour) Pass (I once met a guest hang on
Grantsdale.)
cvworkload (4hour) Pass
ltpstress (2hour) Pass
RHEL4U1 IA32e Guest on RHEL4U2 IA32e host
Crashme (1hour) Pass
Helltest (4hour) Pass
cvworkload (4hour) Pass
ltpstress (2hour) Pass
=========================================================
Nightly testing
=========================================================
2.4 IA32 guest
==========================
1, one vmx with memory 128 PASS
2, one vmx with memory 256 PASS
3, one vmx with memory 512 PASS
4, one xenU create PASS
5, 2 vmx and 2 xenU coexist PASS
6, four vmx coexist PASS
7, network in VMX domain PASS
8, network in XenU domain PASS
9, one window domain FAIL
10, IDE test in VMX domain PASS
11,part LTP test in VMX domain PASS
Summary Test Report of Last Session
======================================================================
========
Total Pass Fail NoResult Finish Fatal Crash
======================================================================
========
ltp 925 226 699 0 0 0 0
======================================================================
========
ltp 925 226 699 0 0 0 0
:syscalls 676 0 676 0 0 0 0
:dio 28 28 0 0 0 0 0
:mm 21 21 0 0 0 0 0
:nptl 1 1 0 0 0 0 0
:ipc 8 8 0 0 0 0 0
:commands 11 0 11 0 0 0 0
:pty 3 3 0 0 0 0 0
:quickhit 120 118 2 0 0 0 0
:sched 3 3 0 0 0 0 0
:fs 54 44 10 0 0 0 0
======================================================================
========
Total 925 226 699 0 0 0 0
2.6 IA-32e guest
===================
1, one vmx with memory 128 PASS
2, one vmx with memory 256 PASS
3, one vmx with memory 512 PASS
4, one xenU create PASS
5, 2 vmx and 2 xenU coexist PASS
6, four vmx coexist PASS
7, network in VMX domain PASS
8, network in XenU domain PASS
9, one 2.4 IA32 VMX domain PASS
10, one 2.6 IA32 VMX domain PASS
11, IA-32 2.4 and 2.6 VMX coexist PASS
12, IA-32 and IA-32e VMX coexist PASS
13,Part LTP test in VMX domain PASS
Summary Test Report of Last Session
======================================================================
========
Total Pass Fail NoResult Finish Fatal Crash
======================================================================
========
ltp 918 868 50 0 0 0 0
======================================================================
========
ltp 918 868 50 0 0 0 0
:syscalls 674 645 29 0 0 0 0
:dio 28 26 2 0 0 0 0
:mm 21 21 0 0 0 0 0
:nptl 1 1 0 0 0 0 0
:ipc 8 8 0 0 0 0 0
:commands 6 3 3 0 0 0 0
:pty 3 3 0 0 0 0 0
:quickhit 120 119 1 0 0 0 0
:sched 3 3 0 0 0 0 0
:fs 54 39 15 0 0 0 0
======================================================================
========
Total 918 868 50 0 0 0 0
===============================================================
Test for rpms on webpage
===============================================================
Demo CD
Create VMX FAIL (No vmxloader)
Create Xenu Pass
Have submitted a p1 bug to xen bugzilla
http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=444
Tarballs
32 bit SMP:
Create VMX Pass
Create Xenu Pass
32 bit SMP PAE:
Create VMX FAIL (Cause service reboot)
Create Xenu Pass
64 bit SMP:
Create VMX FAIL (No vmxloader)
Create Xenu Pass
Another issue: it only support ext2 file system
Have submitted two bugs to xen bugzilla
http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=445
http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=446
Installerscripts
Fedora Core 4
This script will add a XenSource file in /etc/yum.repos.d, install
the Xen Hypervisor and a kernel of xen0 through yum, update grub
config to enable booting Xen
Create VMX FAIL (No vmxloader)
Create Xenu Pass
RHEL 4.1
This script get a xen-3.0-x86_32-rhel4.1.bin.tar from internet
(which contains Xen Hypervisor and a kernel of xen0) and install it,
update grub config.
Create VMX FAIL (No vmxloader)
Create Xenu Pass
RPMS
1, Only one documents for 3 difficult platform. and there have some
errors grub component. user hard to understand and install xen 3.0
successfully without enough linux knowledge.
2, No vmxloader for VMX domain in all packages. and can not create VMX
even we copy a same changset vmxloader.
3, xen0 keep rebooting on DP platform for rhel4u1.
Bests
Jeff
--- End Message ---
_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel
|