[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Xen-devel] Xen 3.0.0 (ChangeSet 8241) test results


  • To: <xen-devel@xxxxxxxxxxxxxxxxxxx>
  • From: "Zheng, Jeff" <jeff.zheng@xxxxxxxxx>
  • Date: Fri, 9 Dec 2005 18:25:29 +0800
  • Delivery-date: Fri, 09 Dec 2005 10:26:36 +0000
  • List-id: Xen developer discussion <xen-devel.lists.xensource.com>
  • Thread-index: AcX8quDkDLlFyD5mToqm8h2WqLzOqg==
  • Thread-topic: Xen 3.0.0 (ChangeSet 8241) test results

We have tested xen 3.0.0 (ChangeSet 8241) on  Intel S3E3141 SDP. It
has 4 sockets, each socket is dual core, dual thread.

In general, VMX works fine as IA32/IA32E guest on both IA32/IA32E
service OS. IA32 Windows are bootable.We can boot IA64 guest after
changing the build config file of IA64. IA64 works better on RHEL4U2
than on RHEL3

Here is the main issues that we found in the testing:
+ There is no VMX information in xen 3.0 user manual
+ Evtchn delay (may lost) issue on big SMP machine causes a black QEMU
  window when startup IA32&IA32e VMX on IA32e host 
+ xen0 booting fails on Xen 3.0.0 IPF version. Need to change the
  build config file to make it work 
+ VTI domain will hang after booting up several minutes on EL3.
+ vmx's network broken about every 10 minutes when there are 2 or more
  vmx
+ Install FC2-IA32 on VMX will crash service OS
+ Cannot install IA32e guest OS from CDROM
+ Cannot Install SuSE10-IA32 guest OS from CDROM
+ The second Windows XP guest will be unstable
+ HCT stress may make Windows blue screen
+ vcpu-pin will hang service OS.
+ On IA-32e, service os and guest os have different time zone, but the
  same time value.
+ In IA-32e guest on IA-32e service os, can't type numbers in text
  console through the number key on the right side of the keyboard.
+ If use vnc (vnc=1 and vncviewer=1) to create a vmx and startx in
  vmx.The Xwindows' response to keyboard and mouse will be very slow
  and can't switch to text console.

We also have tests for binaries in
http://www.xensource.com/xen/downloads/. Basically VMX does not work
with these binaries. The main issues that we found are:
+ Most Xen3.0 binaries dosn't have vmxload and thus cannot startup
  vmx, except IA32/PAE SMP tarball. We can create VMX from IA32 tarball.
+ xen0 keep rebooting on DP platform after install  xen 3.0 for
  rhel4u1rpm
+ Create vmx guest on PAE host cause service os reboot  from PAE
  tarball
+ IA32e tarball only support ext2 file system.

More details information in attached files.


Bests
Jeff
--- Begin Message ---
Following is the detail test information of out testing on Intel
S3E3141 SDP. It has 4 sockets, each socket is dual core, dual thread.


================================================
xm test result on VMX
================================================
IA32:
  PASS:  64
  FAIL:  26
  XPASS: 0
  XFAIL: 1

IA32e:
  PASS:  62
  FAIL:  28
  XPASS: 0
  XFAIL: 1




=================================================
Control Panel
=================================================

VMX boot
2.6 kernel VMX boot     Pass
2.4 kernel VMX boot     Pass
2 VMX runs on  VMM      Pass
4 VMX runs on  VMM      Pass
2 VMX and 2 domU runs on VMM    Pass
8 VMX runs on VMM       No Test
Create 8 VMs (including xenU and VMX) on one processor core     Pass
1 VMX and 1 domU can be created at the same time        Pass
4 VMX can be created at the same time   Pass

VCPU
1 VMX whose VCPU number is 2    Failed
1 domU whose VCPU number is 2   Pass
1 VMX whose VCPU number is 3    Failed
1 domU whose VCPU number is 3   Pass
1 VMX whose VCPU number is 4    Failed
1 domU whose VCPU number is 4   Pass
1 VMX whose VCPU number is 5    Failed
1 domU whose VCPU number is 5   Pass
1 domU whose VCPU number is 8   Pass
2 VMX whose VCPU is 2   Failed
2 domU whose VCPU is 2  Pass

Schedule
2 CPU,VMX, bind CPU test        Failed
2 CPU, domU, bind CPU test      Pass
2 CPU, 2 VMX, bind CPU test     Failed
2 CPU, 2 domU, bind CPU test    Pass

Memory
1 VM with 256M memory test      Pass
1 VM with 512  memory test      Pass
2 VM with 256M memory test      Pass
2 VM with 256M memory consuming test    Pass
2 VM with 512M memory consuming test    Pass

Console
domU console  Local console access for “xm create ?Cc”  Pass
domU console  Local console access for ”xm console"     Pass
VMX console  Local console access for ”xm console"      Pass
VMX console  Local console access for “xm create”       Pass
2 domU console  Local console access for “xm create ?Cc”        Pass
2 domU console  Local console access for ”xm console"   Pass
2 VMX console  Local console access for “xm create”     Pass
VMX local console access for “xm create” with vnc is set to 1   Pass
VMX remote console access for “xm create” with vnc is set to 1  
Pass

Domain management
VMX xm reboot   Failed
domU xm reboot  Pass
VMX xm shutdown Failed
domU xm shutdown        Pass
xm create and xm destroy        Pass
VMX xm pause/xm unpause Pass
domU Save/Restore: Memory  address continuity   Pass
domU save SMP guest     Failed
domU Save/Restore: File descriptor continuity   Pass
domU save/Restore: network      Pass
domU save/Restore: Keyboard continuity  Pass
domU save/Restore: VMX VGA display correct      Pass
VMX save/restore        No test
VMX pause/unpause: Memory  address continuity   Pass
VMX pause/unpause: File descriptor continuity   Pass
VMX pause/unpause: network      Pass
VMX pause/unpause: Device enumeration continuity        Pass
VMX pause/unpause: Keyboard continuity  Pass
domU remote migrate:    Pass
domU local migrate:     Failed
VMX pause/unpause: VGA display correct after suspend/resume     Pass

=======================================================
Device model
=======================================================

We tested in 5 environment:
+ IA-32e 2.6 guest on IA-32e service os.
+ IA-32 2.4 guest on IA-32e service os.
+ IA-32 2.6 guest on IA-32e service os.
+ IA-32 2.4 guest on IA-32 service os.
+ IA-32 2.6 guest on IA-32 service os.

Here is the main issue summary. I'll check all the issues to submit
new bugs or update old bugs.

Timer:  + On IA-32e, service os and guest os have different time zone,
but the same time value.
        + In all environment, the result of clockdiff vmx2_hostname /
or xen0_hostname is far more
          than the acceptable value in the spec.Need disscuss with
developers to confirm if the
          acceptable value in the spec is reasonable.

NIC:    + In all environment, I found vmx's network broken about every
10 minutes when there
          are 2 or more vmx. Maybe it's caused by DNS problem.I am
checking it and will report
          it if it's really a bug.

IDE:    + On IA-32e.When I use a physical harddisk to create vmx. If
        booting the xen0 partition,the service os reboots.
        + In all environment, when using a config file with wrong disk
        parameter to create vmx, there is no error message and sometimes even 
the qemu window pop
          up. 

VGA:    + In all environment,if create vmx with
        sdl=0,vnc=0,vncviewer=0 and nographic=1, there is no
          output in serial port or console. But I heard it’s a
          feature. Need tracking.
        + In all environment,if create vmx with
        sdl=0,vnc=0,vncviewer=1 and nographic=0. Expected
         result is no vncviewer pop up. But indeed there is a
         vncviewer window pop up.

Others: + In IA-32e guest on IA-32e service os, can’t type numbers in
        text console through the number
        key on the right side of the keyboard.If in Xwindows, it
        will be ok.
        + If use vnc (vnc=1 and vncviewer=1) to create a vmx and
        startx in vmx.The Xwindows’response to keyboard and mouse 
        will be very slow and can’t
switch to text console.
         
========================================================
Guest OS installation
========================================================

Host OS                 Guest OS                
RHEL4U1-IA32                    FC2-IA32                fail    (host
server reboot after printing "booting the kernel")
RHEL4U1-IA32                    RHEL4U1-IA32            pass
RHEL4U1-IA32                    RHEL3U5-IA32            pass
RHEL4U1-IA32                    FC4-IA32                pass
RHEL4U1-IA32                    FC3-IA32                pass
RHEL4U1-IA32                    SLES9-IA32              pass
RHEL4U1-IA32                    SUSE10-IA32             fail    (hang
the guest, but not hang the host OS when guest load the kernel for
installation)

Following tests are all on VT platform with Intel 915 chipset.

Host OS                 Guest OS                
RHEL4U1-IA32e                   FC2-IA32                fail    (host
server reboot after the guest VMX installation print "booting the
kernel")
RHEL4U1-IA32e                   RHEL4U1-IA32            pass
RHEL4U1-IA32e                   RHEL3U5-IA32            pass
RHEL4U1-IA32e                   FC4-IA32                pass
RHEL4U1-IA32e                   FC3-IA32                pass
RHEL4U1-IA32e                   SLES9-IA32              pass
RHEL4U1-IA32e                   SUSE10-IA32             fail    (hang
the guest, but not hang the host OS when guest load the kernel for
installation)

RHEL4U1-IA32e                   RHEL4U1-IA32e           fail    (VMX
guest hangs after printing "booting the kernel", but not hang service
OS.)
RHEL4U1-IA32e                   RHEL3U5-IA32e           fail    (VMX
guest hangs after printing "booting the kernel", but not hang service
OS.)
RHEL4U1-IA32e                   SLES9-IA32e             fail    (VMX
guest hangs after printing "booting the kernel", but not hang service
OS.)
RHEL4U1-IA32e                   FC4-IA32e               fail    (VMX
guest seems to hang with kernel panic, not hang service OS.)
RHEL4U1-IA32e                   SUSE10-IA32e            fail    (hang
the guest, but not hang the host OS when guest load the kernel for
installation)


========================================================
Windows
========================================================
  IA32 Windows Guest on RHEL4U1 IA32 host:
   Booting one windows guest                   Pass
   Booting two windows XP guests               Fail       (The
second guest is unstable)
   Booting two windows 2003 guests             Pass
    Network                                     Pass
     HCT Stress on windows xp                    Pass ??    (Guest is
still alive after running 5 hours)
  IA32 Windows Guest on RHEL4U2 IA32e host:
   Booting one windows guest                   Pass
   Booting two windows XP guests               Fail       (The
second guest is unstable)
   Booting two windows 2003 guests             Pass
    Network                                     Pass
     HCT Stress                                  Fail       (Met blue
screen after running HCT stress less than 1 minute)


========================================================
Stress test
========================================================
  RHEL4U1 IA32 Guest on RHEL4U1 IA32 host
    Crashme  (1hour)              Pass
    Helltest  (4hour)             Pass  (I once met a guest hang on
Grantsdale.)
    cvworkload (4hour)            Pass
    ltpstress (2hour)             Pass
  RHEL4U1 IA32e Guest on RHEL4U2 IA32e host
    Crashme  (1hour)              Pass
    Helltest (4hour)              Pass
    cvworkload (4hour)            Pass
    ltpstress (2hour)             Pass

=========================================================
Nightly testing
=========================================================
2.4 IA32 guest
==========================

1, one vmx with memory 128        PASS
2, one vmx with memory 256        PASS
3, one vmx with memory 512        PASS
4, one xenU create                PASS
5, 2 vmx and 2 xenU coexist       PASS
6, four vmx coexist               PASS
7, network in VMX domain          PASS
8, network in XenU domain         PASS
9, one window domain              FAIL
10, IDE test in VMX domain        PASS
11,part LTP test in VMX domain    PASS

 Summary Test Report of Last Session
======================================================================
========
              Total   Pass    Fail   NoResult Finish  Fatal  Crash
======================================================================
========
ltp           925     226     699      0       0       0       0
======================================================================
========
ltp           925     226     699      0       0       0       0
 :syscalls    676      0      676      0       0       0       0
 :dio          28      28      0       0       0       0       0
 :mm           21      21      0       0       0       0       0
 :nptl         1       1       0       0       0       0       0
 :ipc          8       8       0       0       0       0       0
 :commands     11      0       11      0       0       0       0
 :pty          3       3       0       0       0       0       0
 :quickhit    120     118      2       0       0       0       0
 :sched        3       3       0       0       0       0       0
 :fs           54      44      10      0       0       0       0
======================================================================
========
Total         925     226     699      0       0       0       0

2.6 IA-32e guest
===================

1, one vmx with memory 128        PASS
2, one vmx with memory 256        PASS
3, one vmx with memory 512        PASS
4, one xenU create                PASS
5, 2 vmx and 2 xenU coexist       PASS
6, four vmx coexist               PASS
7, network in VMX domain          PASS
8, network in XenU domain         PASS
9, one 2.4 IA32 VMX domain        PASS
10, one 2.6 IA32 VMX domain       PASS
11, IA-32 2.4 and 2.6 VMX coexist PASS
12, IA-32 and IA-32e VMX coexist  PASS
13,Part LTP test in VMX domain    PASS

Summary Test Report of Last Session
======================================================================
========
              Total   Pass    Fail   NoResult Finish  Fatal  Crash
======================================================================
========
ltp           918     868      50      0       0       0       0
======================================================================
========
ltp           918     868      50      0       0       0       0
 :syscalls    674     645      29      0       0       0       0
 :dio          28      26      2       0       0       0       0
 :mm           21      21      0       0       0       0       0
 :nptl         1       1       0       0       0       0       0
 :ipc          8       8       0       0       0       0       0
 :commands     6       3       3       0       0       0       0
 :pty          3       3       0       0       0       0       0
 :quickhit    120     119      1       0       0       0       0
 :sched        3       3       0       0       0       0       0
 :fs           54      39      15      0       0       0       0
======================================================================
========
Total         918     868      50      0       0       0       0


===============================================================
Test for rpms on webpage
===============================================================

Demo CD
  Create VMX   FAIL   (No vmxloader)
 Create Xenu  Pass
  Have submitted a p1 bug to xen bugzilla 
  http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=444

Tarballs
 
 32 bit SMP:
 Create VMX   Pass  
 Create Xenu  Pass

 32 bit SMP PAE:
 Create VMX   FAIL   (Cause service reboot)
 Create Xenu  Pass

 64 bit SMP:
 Create VMX   FAIL   (No vmxloader)
 Create Xenu  Pass
  Another issue: it only support ext2 file system
  Have submitted two bugs to xen bugzilla 
  http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=445
  http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=446


Installerscripts
 Fedora Core 4
 This script will add a XenSource file in /etc/yum.repos.d, install
the Xen Hypervisor and a kernel of xen0 through yum, update grub
config to enable booting Xen
 Create VMX   FAIL   (No vmxloader)
 Create Xenu  Pass 
 
  RHEL 4.1
  This script get a xen-3.0-x86_32-rhel4.1.bin.tar from internet
(which contains Xen Hypervisor and a kernel of xen0)  and install it,
update grub config.
 Create VMX   FAIL   (No vmxloader)
 Create Xenu  Pass 

RPMS
1, Only one documents for 3 difficult platform. and there have some
errors grub component. user hard to understand and install xen 3.0
successfully without enough linux knowledge.
2, No vmxloader for VMX domain in all packages. and can not create VMX
even we copy a same changset vmxloader.
3, xen0 keep rebooting on DP platform for rhel4u1.



Bests
Jeff

--- End Message ---
_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel

 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.