[Xen-devel] Full testing agianst xen usntable 14201

["Zhao, Yunfeng" <yunfeng.zhao@xxxxxxxxx>]

Hi all
Intel QA team did a full testing agianst xen unstable 14201 this week.
In the testing we ran all our tests for device model,control panel, guest installation, and xen function on x86p,x86_64 and IPF.

Here is the testing report:
###########################################################################
Summary:
Totally 12 new issues have been found (11 for x86, 1 for IPF):
x86:
1. Mouse is out of control in XWin, if HVM kernel >2.6.15. 
2. VNIF cannot co-live with Qemu NIC.
3. IA32E HVM timer is fast in FC5.
4. VBD failed operation in SMP IA32E HVM.
5. VNIF would make SMP IA32E HVM response slow
6. create an hvm guest with vcpus=0 will cause dom0 crash
7. ia32e smp xp guest on ia32e host will lose response after several times’ save&restore
8. pae smp xp guest on pae host save&restore twice fail
9. A file containing a saved guest restore many times may fail
10. save&restore 6G guest fail
11. create two smp hvm guests with multiple vcpus together may fail
IPF:
12. Windows 2003 installation failed in SMP VTI domain

# We will pick up some issues above to report to xensource bugzilla.

#####################################################################
Detailed test reports:
Functional tests:
        Summary Test Report of Last Session
=====================================================================
                      Total   Pass    Fail    NoResult   Crash
=====================================================================
regression             95      74      16        3        2
device_model          149      78      39       32        0
control_panel          73      52      20        0        1
Restart                16      15      0         0        1
installation           58      49      3         5        1
gtest                 173      94      74        3        2
=====================================================================
regression             95      74      16        3        2
 :functional_PAE_gPA   40      31      7         1        1
 :abat_32_g32          1       1       0         0        0
 :abat_64_gPAE         1       1       0         0        0
 :abat_PAE_gPAE        1       1       0         0        0
 :functional_64_gPAE   50      38      9         2        1
 :abat_PAE_g32         1       1       0         0        0
 :abat_64_g32          1       1       0         0        0
device_model          149      78      39       32        0
 :nic_PAE_gPAE         24      4       7        13        0
 :ide_64_gPAE          28      22      6         0        0
 :abat_32_g32          3       2       0         1        0
 :abat_64_gPAE         3       2       0         1        0
 :abat_PAE_gPAE        3       2       0         1        0
 :abat_PAE_g32         3       2       0         1        0
 :timer_64_gPAE        8       6       2         0        0
 :pv_64_gPAE           7       4       3         0        0
 :abat_64_g32          3       2       0         1        0
 :nic_64_gPAE          24      4       7        13        0
 :timer_PAE_gPAE       8       6       2         0        0
 :pv_PAE_gPAE          7       1       5         1        0
 :ide_PAE_gPAE         28      21      7         0        0
control_panel          73      52      20        0        1
 :functional32_64_gP   8       6       1         0        1
 :abat_32_g32          4       2       2         0        0
 :abat_64_gPAE         4       4       0         0        0
 :abat_PAE_gPAE        4       4       0         0        0
 :abat_PAE_g32         4       4       0         0        0
 :functionalpae_64_g   12      8       4         0        0
 :abat_64_g32          4       4       0         0        0
 :functional64_64_gP   14      7       7         0        0
 :functionalpae_PAE_   12      6       6         0        0
 :functional32_PAE_g   7       7       0         0        0
Restart                16      15      0         0        1
 :Guest32_PAE_gPAE     1       0       0         0        1
 :BootTo32pae_32_gPA   0       0       0         0        0
 :GuestPAE_PAE_gPAE    1       1       0         0        0
 :Guest32_32_gPAE      1       1       0         0        0
 :BootTo32pae_PAE_g3   1       1       0         0        0
 :BootTo32_32_gPAE     1       1       0         0        0
 :Guest32_64_gPAE      1       1       0         0        0
 :BootTo32pae_PAE_gP   1       1       0         0        0
 :GuestPAE_64_gPAE     1       1       0         0        0
 :Clean_PAE_gPAE       1       1       0         0        0
 :Clean_64_gPAE        1       1       0         0        0
 :BootTo64_64_gPAE     1       1       0         0        0
 :SendReport_64_gPAE   1       1       0         0        0
 :GuestPAE_64_g32      1       1       0         0        0
 :BackupReport_64_gP   1       1       0         0        0
 :Guest32_PAE_g32      1       1       0         0        0
               Summary Test Report of Last Session
=====================================================================
                      Total   Pass    Fail    NoResult   Crash
=====================================================================
 :BootTo32pae_32_g32   0       0       0         0        0
 :BootTo32_64_gPAE     0       0       0         0        0
 :BootTo64_PAE_gPAE    0       0       0         0        0
 :GuestPAE_PAE_g32     1       1       0         0        0
installation           58      49      3         5        1
 :function64_64_gPAE   7       6       1         0        0
 :function32_64_gPAE   14      14      0         0        0
 :functionpae_64_gPA   15      12      0         2        1
 :function32_32_gPAE   7       4       1         2        0
 :functionpae_PAE_gP   1       0       0         1        0
 :function32_PAE_gPA   14      13      1         0        0
gtest                 173      94      74        3        2
 :function64_64_gPAE   1       0       0         0        1
 :functionpae_64_gPA   40      28      12        0        0
 :function32_32_gPAE   40      10      30        0        0
 :abat_32_g32          1       0       0         1        0
 :abat_64_gPAE         4       2       1         1        0
 :abat_PAE_gPAE        2       1       1         0        0
 :abat_PAE_g32         2       1       0         1        0
 :abat_64_g32          2       1       1         0        0
 :function32_64_gPAE   40      25      15        0        0
 :function32_PAE_gPA   40      26      14        0        0
 :functionpae_PAE_gP   1       0       0         0        1
=====================================================================
Total                 564     362     152       43        7

DeviceModel:
Environment:
-----------------
Machine: Paxivelle
Changeset: 14201
Guest Memory: 512M or 2G
Host Memory: 512M
Xen0: Fedora Core 5
-----------------

Detailed testing report:
-------------------
====
IA32 UP HVM (RHEL4u2 with 2.6.16 kernel):
====
cpuinfo -- PASS
Memory -- PASS

Timer -- PASS (accurate)
Interrupts -- PASS

Network:
Qemu NIC -- PASS
SCP from HVM to Xen0  -  2.1MB/s
SCP from Xen0 to HVM  -  4.9MB/s
SCP 1G file  - PASS

Keyboard -- PASS
Keyboard (Number Keys) -- FAIL in text terminal
Mouse in Text terminal  -- PASS
Mouse in X -- Fail. 
XWin display  - PASS

VNF driver  -- PASS
VNIF + QEMU NIF -- FAIL

VBD driver -- PASS
VBD build kernel -- PASS

===
SMP (RHEL4u2 with official kernel):
===
cpuinfo - PASS
Memory  - PASS

Timer   - PASS
Interrupts - PASS

NETWORK   - PASS
SCP from HVM to Xen0  -  5.3MB/s
SCP from Xen0 to HVM  -  >10MB/s
SCP 1G file  - PASS  (7.6MB/s)

Keyboard -- PASS
Keyboard (Number Keys) -- FAIL in text terminal
Mouse in Text terminal  -- PASS
Mouse in X   --  PASS.

XWin display -- PASS
XWin application -- PASS

4 IDE disks  --  PASS
4 NIC cards  --  PASS

VNF driver- PASS
VNIF scp - 14MB/s
VNIF + IOEMU NIF  - FAIL

VBD driver- PASS
VBD with kernel build - PASS


====
UP IA32E (64bit) HVM (FC5 guest):
====

CPUINFO - PASS
Memory  - PASS

Timer - FAIL  (fast)
Interrupts - PASS

NETWORK   - PASS
SCP from HVM to other machine  -  2.6MB/s
SCP from Xen0 to HVM  -  8.6MB/s
SCP 1G file  - PASS

Keyboard (Number Keys)  -  Fail (Pass in X env)
Mouse in X   -  Fail.
XWin display  - PASS

VNF driver- PASS

VBD driver- PASS
VBD build linux kernel - PASS

SMP IA32E (64bit) HVM (FC5):
-----------------
CPUINFO - PASS
Memory  - PASS
Timer - FAIL  (fast)
Interrupts - PASS

NETWORK   - PASS
SCP from HVM to other machine  -  2.6MB/s
SCP from Xen0 to HVM  -  11.6MB/s
SCP 1G file  - PASS

Keyboard (Number Keys)  - Fail (Pass in X env)
Mouse in X   - Fail.
XWin display  - PASS

VNF driver- FAIL
VBD driver- PASS
VBD build linux kernel - FAIL (won't build & return)

Control Panel:
New Bugs Reported:
1. create an hvm guest with vcpus=0 will cause dom0 crash
2. ia32e smp xp guest on ia32e host will lose response after several times’ save&restore
3. pae smp xp guest on pae host save&restore twice fail
4. A file containing a saved guest restore many times may fail
5. save&restore 6G guest fail
6. create two smp hvm guests with multiple vcpus together may fail


Old Bugs Updated:
1. setting vcpus=16 in 2 logical CPU, VMX can not start
2. xm restore fail after reboot dom0
3. usb tablet driver will not be used after xm restore for a windows guest
4. if there is no sufficient disk space, "xm save" will fail without any notification


Best wishes,
Intel Xen QA Team

Attachment: funtional_test.txt
Description: funtional_test.txt

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel