[Xen-devel] Full testing agianst xen unstable 14201

["Zhao, Yunfeng" <yunfeng.zhao@xxxxxxxxx>]

Hi all
Intel QA team did a full testing agianst xen unstable 14201 last week.
In the testing we ran all our tests for device model,control panel, guest installation, and xen function on x86p,x86_64 and IPF.

Here is the testing report:
###########################################################################
Summary:
Totally we found 13 issues that exist on xen unstable 14201 (12 for x86, 1 for IPF):
x86:
1. Mouse is out of control in XWin, if HVM kernel >2.6.15. 
http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=921
2. VNIF cannot co-live with Qemu NIC.
http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=922
3. IA32E HVM timer is fast in FC5.
http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=923
4. VBD failed operation in SMP IA32E HVM.
http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=831
5. VNIF would make SMP IA32E HVM response slow
http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=924
6. pae smp xp guest on pae host save&restore twice fail
http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=925
7. xm restore fail after reboot dom0
http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=892
8.usb tablet driver will not be used after xm restore for a windows guest
http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=926
9.x11perf fails on VMX guests
http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=927
10. IA32E/PAE: 32bit Vista RTM network doesn't work.
http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=840
11.time latency is a negative number on window guest when vcpu > 1
http://losvmm-bridge.sh.intel.com/bugzilla/show_bug.cgi?id=991
12. Xen0 Crash after run case ia32e_smp_vista many times
http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=899
IPF:
13. Windows 2003 installation failed in SMP VTI domain --IPF
http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=928


#####################################################################
Detailed test reports:
Functional tests:
        Summary Test Report of Last Session
=====================================================================
                      Total   Pass    Fail    NoResult   Crash
=====================================================================
regression             95      74      16        3        2
device_model          149      78      39       32        0
control_panel          73      52      20        0        1
Restart                16      15      0         0        1
installation           58      49      3         5        1
gtest                 173      94      74        3        2
=====================================================================
regression             95      74      16        3        2
 :functional_PAE_gPA   40      31      7         1        1
 :abat_32_g32          1       1       0         0        0
 :abat_64_gPAE         1       1       0         0        0
 :abat_PAE_gPAE        1       1       0         0        0
 :functional_64_gPAE   50      38      9         2        1
 :abat_PAE_g32         1       1       0         0        0
 :abat_64_g32          1       1       0         0        0
device_model          149      78      39       32        0
 :nic_PAE_gPAE         24      4       7        13        0
 :ide_64_gPAE          28      22      6         0        0
 :abat_32_g32          3       2       0         1        0
 :abat_64_gPAE         3       2       0         1        0
 :abat_PAE_gPAE        3       2       0         1        0
 :abat_PAE_g32         3       2       0         1        0
 :timer_64_gPAE        8       6       2         0        0
 :pv_64_gPAE           7       4       3         0        0
 :abat_64_g32          3       2       0         1        0
 :nic_64_gPAE          24      4       7        13        0
 :timer_PAE_gPAE       8       6       2         0        0
 :pv_PAE_gPAE          7       1       5         1        0
 :ide_PAE_gPAE         28      21      7         0        0
control_panel          73      52      20        0        1
 :functional32_64_gP   8       6       1         0        1
 :abat_32_g32          4       2       2         0        0
 :abat_64_gPAE         4       4       0         0        0
 :abat_PAE_gPAE        4       4       0         0        0
 :abat_PAE_g32         4       4       0         0        0
 :functionalpae_64_g   12      8       4         0        0
 :abat_64_g32          4       4       0         0        0
 :functional64_64_gP   14      7       7         0        0
 :functionalpae_PAE_   12      6       6         0        0
 :functional32_PAE_g   7       7       0         0        0
Restart                16      15      0         0        1
 :Guest32_PAE_gPAE     1       0       0         0        1
 :BootTo32pae_32_gPA   0       0       0         0        0
 :GuestPAE_PAE_gPAE    1       1       0         0        0
 :Guest32_32_gPAE      1       1       0         0        0
 :BootTo32pae_PAE_g3   1       1       0         0        0
 :BootTo32_32_gPAE     1       1       0         0        0
 :Guest32_64_gPAE      1       1       0         0        0
 :BootTo32pae_PAE_gP   1       1       0         0        0
 :GuestPAE_64_gPAE     1       1       0         0        0
 :Clean_PAE_gPAE       1       1       0         0        0
 :Clean_64_gPAE        1       1       0         0        0
 :BootTo64_64_gPAE     1       1       0         0        0
 :SendReport_64_gPAE   1       1       0         0        0
 :GuestPAE_64_g32      1       1       0         0        0
 :BackupReport_64_gP   1       1       0         0        0
 :Guest32_PAE_g32      1       1       0         0        0
               Summary Test Report of Last Session
=====================================================================
                      Total   Pass    Fail    NoResult   Crash
=====================================================================
 :BootTo32pae_32_g32   0       0       0         0        0
 :BootTo32_64_gPAE     0       0       0         0        0
 :BootTo64_PAE_gPAE    0       0       0         0        0
 :GuestPAE_PAE_g32     1       1       0         0        0
installation           58      49      3         5        1
 :function64_64_gPAE   7       6       1         0        0
 :function32_64_gPAE   14      14      0         0        0
 :functionpae_64_gPA   15      12      0         2        1
 :function32_32_gPAE   7       4       1         2        0
 :functionpae_PAE_gP   1       0       0         1        0
 :function32_PAE_gPA   14      13      1         0        0
gtest                 173      94      74        3        2
 :function64_64_gPAE   1       0       0         0        1
 :functionpae_64_gPA   40      28      12        0        0
 :function32_32_gPAE   40      10      30        0        0
 :abat_32_g32          1       0       0         1        0
 :abat_64_gPAE         4       2       1         1        0
 :abat_PAE_gPAE        2       1       1         0        0
 :abat_PAE_g32         2       1       0         1        0
 :abat_64_g32          2       1       1         0        0
 :function32_64_gPAE   40      25      15        0        0
 :function32_PAE_gPA   40      26      14        0        0
 :functionpae_PAE_gP   1       0       0         0        1
=====================================================================
Total                 564     362     152       43        7

DeviceModel:
Environment:
-----------------
Machine: Paxivelle
Changeset: 14201
Guest Memory: 512M or 2G
Host Memory: 512M
Xen0: Fedora Core 5
-----------------

Detailed testing report:
-------------------
====
IA32 UP HVM (RHEL4u2 with 2.6.16 kernel):
====
cpuinfo -- PASS
Memory -- PASS

Timer -- PASS (accurate)
Interrupts -- PASS

Network:
Qemu NIC -- PASS
SCP from HVM to Xen0  -  2.1MB/s
SCP from Xen0 to HVM  -  4.9MB/s
SCP 1G file  - PASS

Keyboard -- PASS
Keyboard (Number Keys) -- FAIL in text terminal
Mouse in Text terminal  -- PASS
Mouse in X -- Fail. 
XWin display  - PASS

VNF driver  -- PASS
VNIF + QEMU NIF -- FAIL

VBD driver -- PASS
VBD build kernel -- PASS

===
SMP (RHEL4u2 with official kernel):
===
cpuinfo - PASS
Memory  - PASS

Timer   - PASS
Interrupts - PASS

NETWORK   - PASS
SCP from HVM to Xen0  -  5.3MB/s
SCP from Xen0 to HVM  -  >10MB/s
SCP 1G file  - PASS  (7.6MB/s)

Keyboard -- PASS
Keyboard (Number Keys) -- FAIL in text terminal
Mouse in Text terminal  -- PASS
Mouse in X   --  PASS.

XWin display -- PASS
XWin application -- PASS

4 IDE disks  --  PASS
4 NIC cards  --  PASS

VNF driver- PASS
VNIF scp - 14MB/s
VNIF + IOEMU NIF  - FAIL

VBD driver- PASS
VBD with kernel build - PASS


====
UP IA32E (64bit) HVM (FC5 guest):
====

CPUINFO - PASS
Memory  - PASS

Timer - FAIL  (fast)
Interrupts - PASS

NETWORK   - PASS
SCP from HVM to other machine  -  2.6MB/s
SCP from Xen0 to HVM  -  8.6MB/s
SCP 1G file  - PASS

Keyboard (Number Keys)  -  Fail (Pass in X env)
Mouse in X   -  Fail.
XWin display  - PASS

VNF driver- PASS

VBD driver- PASS
VBD build linux kernel - PASS

SMP IA32E (64bit) HVM (FC5):
-----------------
CPUINFO - PASS
Memory  - PASS
Timer - FAIL  (fast)
Interrupts - PASS

NETWORK   - PASS
SCP from HVM to other machine  -  2.6MB/s
SCP from Xen0 to HVM  -  11.6MB/s
SCP 1G file  - PASS

Keyboard (Number Keys)  - Fail (Pass in X env)
Mouse in X   - Fail.
XWin display  - PASS

VNF driver- FAIL
VBD driver- PASS
VBD build linux kernel - FAIL (won't build & return)

Control Panel:
New Bugs Reported:
1. create an hvm guest with vcpus=0 will cause dom0 crash
2. ia32e smp xp guest on ia32e host will lose response after several times’ save&restore
3. pae smp xp guest on pae host save&restore twice fail
4. A file containing a saved guest restore many times may fail
5. save&restore 6G guest fail
6. create two smp hvm guests with multiple vcpus together may fail


Old Bugs Updated:
1. setting vcpus=16 in 2 logical CPU, VMX can not start
2. xm restore fail after reboot dom0
3. usb tablet driver will not be used after xm restore for a windows guest
4. if there is no sufficient disk space, "xm save" will fail without any notification


Best wishes,
Intel Xen QA Team

Attachment: funtional_test.txt
Description: funtional_test.txt

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel