[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

RE: [Xen-users] Re: question about xen regression test tools


  • To: "James Bulpin" <james@xxxxxxxxxxxxx>
  • From: "Shi, Alex" <alex.shi@xxxxxxxxx>
  • Date: Mon, 27 Mar 2006 11:01:00 +0800
  • Cc: Xen User List <xen-users@xxxxxxxxxxxxxxxxxxx>
  • Delivery-date: Mon, 27 Mar 2006 03:03:10 +0000
  • List-id: Xen user discussion <xen-users.lists.xensource.com>
  • Thread-index: AcZPlneAn5DuRJ8KREixG0CGf6gP6QBtAv3g
  • Thread-topic: [Xen-users] Re: question about xen regression test tools

We use 3 boxes to test IA32/IA32pae/IA32e and send our test results to 
xen-devel, pls see attached file. 

Up to now these tests mainly focus on booting different guest OS. Because xen 
becomes more and more stable, we need to have more tests on guest OS(Now we use 
LTP). xenRT is excellent for this.

Thanks and best regards
Alex shi



James Bulpin wrote:
> Why don't you share your interest in testing and your results and
> infrastructure with the list?
> 
> Shi, Alex wrote:
>> I have found you use many boxes to do xen regress test, but most of
>> I can not find related comments. Would you like to share those info
>> with me? - thanks in advance  
>> 
>> host
>> 0  albaron
>> 1  atitlan
>> 2  baker
>> 3  bernina
>> 4  blanca
>> 5  bogga
>> 6  boonda
>> 7  dammasto Dell PE1850 2xXeon (EM64T,HT) 4GB SCSI (MPT Fusion)
>> e1000 8  dummy 9  dummyhos
>> 10  forbes Dell PE1850 2xXeon (EM64T,HT) 4GB SCSI (MPT Fusion) e1000
>> 11  gallenst 12  gheeta 1xEM64T (HT) 4GB SATA D915 Yukon
>> 13  ghosts Dell SC1425 2xEM64T (HT) 4GB SATA e1000
>> 14  gorga 1xEM64T (HT) 4GB SATA D915 Yukon
>> 15  grappa 1xEM64T (HT) 4GB SATA D915 Yukon
>> 16  grondo 1xEM64T (HT) 4GB SATA D915 Yukon
>> 17  hubbard
>> 18  humbolt
>> 19  humphrey
>> 20  humpreys
>> 21  hunter
>> 22  k2
>> 23  kamet
>> 24  leone
>> 25  nowshak 2xOpteron 4GB SCSI (MPT Fusion)
>> 26  peclet Dell PE1850 2xXeon (EM64T,HT) 4GB SCSI (MPT Fusion) e1000
>> 27  planb 2xOpteron 8GB SCSI (MPT Fusion) TG3
>> 28  pong 2xOpteron 8GB SCSI (MPT Fusion) TG3
>> 29  romba
>> 30  sabinyo
>> 31  trivor
>> 
>> 
>> 
>> Thanks and best regards
>> Alex shi
>> 
>> 
>> 
>> -----Original Message-----
>> From: xen-users-bounces@xxxxxxxxxxxxxxxxxxx
>> [mailto:xen-users-bounces@xxxxxxxxxxxxxxxxxxx] On Behalf Of James
>> Bulpin  
>> Sent: 2006年3月23日 23:37
>> To: Shi, Alex
>> Cc: Xen User List
>> Subject: Re: [Xen-users] Re: question about xen regression test tools
>> 
>> Shi, Alex wrote:
>> 
>>> I found the "updpingpong" case was not run recently. Does it have
>>> some problem? 
>> 
>> 
>> It's not been written yet.
>> 
>> Please keep list discussions on the list.
>> 
>> James
>> 
>> 
>>> Thanks and best regards
>>> Alex shi
>>> 
>>> 
>>> 
>>> -----Original Message-----
>>> From: xen-users-bounces@xxxxxxxxxxxxxxxxxxx
>>> [mailto:xen-users-bounces@xxxxxxxxxxxxxxxxxxx] On Behalf Of James
>>> Bulpin Sent: 2006年3月22日 11:21 To: Shi, Alex 
>>> Cc: xen-users@xxxxxxxxxxxxxxxxxxx
>>> Subject: [Xen-users] Re: question about xen regression test tools
>>> 
>>> Alex,
>>> 
>>> ttcpbw uses a variant of the ttcp+ tool (see
>>> http://www.cl.cam.ac.uk/Research/SRG/netos/netx/code/ttcp.c)
>>> 
>>> specjbb is SPEC JBB (www.spec.org)
>>> 
>>> postmark 1.5c is what we use
>>> 
>>> vm86 is an internal test
>>> 
>>> We use memtest 0.0.4 but I've disabled it for now as I don't trust
>>> it. 
>>> 
>>> James
>>> 
>>> Shi, Alex wrote:
>>> 
>>> 
>>>> 
>>>> 
>>>> I am very interesting to the xen regression test tools. like
>>>> memtest, dbench, osdb, etc. etc. 
>>>> But I can not find some tools via google. like vm86, ttcpbw,
>>>> specjbb, and postmark  (just find a postmark-1_5.c file from
>>>> http://linuxcompressed.sourceforge.net/statistics/) and the
>>>> memtest test suite is very old. it is just 0.0.4 version.  
>>>> So, Anyone like to tell me where I can find them? and share more
>>>> detailed info of the test result on xenU or VMX domain of these
>>>> test suites?  
>>>> 
>>>> Any hints will be very appreciated!
>>>> 
>>>> 
>>>> Thanks and best regards
>>>> Alex shi
>>> 
>>> 
>>> _______________________________________________
>>> Xen-users mailing list
>>> Xen-users@xxxxxxxxxxxxxxxxxxx
>>> http://lists.xensource.com/xen-users
>> 
>> 
>> _______________________________________________
>> Xen-users mailing list
>> Xen-users@xxxxxxxxxxxxxxxxxxx
>> http://lists.xensource.com/xen-users
--- Begin Message ---

We have tested latest xen on VT platform with Intel 915/E8500 chipset.Here is 
the test summary.
 

issues:

        - No blocking issue.

IA-32:
    Build&Boot SMP xen0 without problem
    Can bootup unmodified IA-32 2.4/2.6 linux in VMX domain
    Can bootup unmodified IA-32 WindowsXP SP1/SP2 in VMX domain
    Can bootup VMX & XenU with different memory 
size(VMX:128MB,256MB,512MB.XenU:256MB)
    A selected subset of LTP runs well in VMX domain(2.6)
    A selected subset of xm-test runs well

 
IA-32_PAE:
    Build&Boot SMP xen0 without problem
    Can bootup unmodified IA-32 2.6 linux in VMX domain
    Can bootup unmodified IA-32 WindowXP SP1 in VMX domain
    Can bootup VMX & XenU with different memory 
size(VMX:256MB,512MB,1500MB.XenU:256MB)
    A selected subset of LTP runs well in VMX domain(2.6)
    A selected subset of xm-test runs well
    

IA-32e: 
    Build&Boot SMP xen0 without problem
    Can bootup unmodified IA-32(2.4,2.6)/IA-32e(2.6) linux in VMX domain
    Can bootup unmodified IA-32 WindowXP SP1 in VMX domain
    Can bootup IA-32PAE 2.6 linux in VMX domain
    Can bootup VMX & xenU with different memory 
size.(VMX:128MB,256MB,512MB,4096MB.XenU:256MB)
    A selected subset of LTP runs well in VMX domain(2.6)
    A selected subset of xm-test runs well

   
    


for details
------------------------------------------------------------

Platform: IA-32
Service OS: FC3, IA-32, SMP
Hardware: Grandstale
Default guest OS: IA-32, 2.6 kernel 

1, one vmx with memory 128M                     PASS
2, one vmx with memory 256M                     PASS
3, one vmx with memory 512M                     PASS
4, one xenU create                              PASS
5, 2 vmx and 2 xenU coexist                     PASS
6, four vmx coexist                             PASS
7, network in VMX domain                        PASS
8, network in XenU domain                       PASS
9, one window domain                            PASS
10,1 xp1 and 1 xp2 windows domains coexist      PASS
11,XenU migration                               PASS
12,subset LTP test in VMX domain                PASS


=========================================================================
Xm-test execution summary:
  PASS:  46
  FAIL:  3
  XPASS: 1
  XFAIL: 2


Details:

XFAIL: 02_network_local_ping_pos 
         ping loopback failed for size 65507. ping eth0 failed for size 65507.

 FAIL: 01_enforce_dom0_cpus_basic_pos 
         /proc/cpuinfo says xend didn't enforce dom0_cpus (2 != 1)


==============================================================================



LTP test result on IA-32

                     Summary Test Report of Last Session
==============================================================================
                Total     Pass      Fail     NoResult     Crash
==============================================================================
ltp             194       194        0          0          0
==============================================================================
ltp             194       194        0          0          0
mm                21        21        0          0          0
dio               28        28        0          0          0
nptl              1         1         0          0          0
math              10        10        0          0          0
ipc               8         8         0          0          0
pty               3         3         0          0          0
quickhit         120       120        0          0          0
sched             3         3         0          0          0
==============================================================================
Total           194       194        0          0          0



Platform: IA-32_PAE
Service OS: RHEL4U1, IA-32_PAE, SMP
Hardware: Grandstal
Default guest OS: IA-32, 2.6 kernel, no pae support

1, one vmx with memory 256M                     PASS
2, one vmx with memory 512M                     PASS
3, one vmx with memory 1.5GB                    PASS
4, one xenU with memory 256M                    PASS
5, network in VMX domain                        PASS
6, network in XenU domain                       PASS
7, one xp1 window domain                        PASS
8, xm-test                                      PASS
9, XenU migration                               PASS
10,LTP in VMX                                   PASS

=============================================================================
Xm-test execution summary:
  PASS:  46
  FAIL:  3
  XPASS: 1
  XFAIL: 2


Details:

XFAIL: 02_network_local_ping_pos 
         ping loopback failed for size 65507. ping eth0 failed for size 65507.

 FAIL: 01_enforce_dom0_cpus_basic_pos 
         /proc/cpuinfo says xend didn't enforce dom0_cpus (2 != 1)

==============================================================================



LTP test result on PAE host

                     Summary Test Report of Last Session
==============================================================================
                Total     Pass      Fail     NoResult     Crash
==============================================================================
ltp             194       194        0          0          0
==============================================================================
ltp             194       194        0          0          0
mm                21        21        0          0          0
dio               28        28        0          0          0
nptl              1         1         0          0          0
math              10        10        0          0          0
ipc               8         8         0          0          0
pty               3         3         0          0          0
quickhit         120       120        0          0          0
sched             3         3         0          0          0
==============================================================================
Total           194       194        0          0          0




Platform: IA-32e
Service OS: RHEL4U2, IA-32e, SMP
Hardware: Paxville
Default guest OS: IA-32e, 2.6 kernel


1, one vmx with memory 128M                     PASS
2, one vmx with memory 256M                     PASS
3, one vmx with memory 512M                     PASS
4, one vmx with memory 4096M                    PASS
5, one xenU with memory 256M                    PASS
6, 2 vmx and 2 xenU coexist                     PASS
7, four vmx coexist                             PASS
8, network in VMX domain                        PASS
9, network in XenU domain                       PASS
10, one 2.4 IA32 VMX domain                     PASS
11, one 2.6 IA32 VMX domain                     PASS
12, IA-32 2.4 and 2.6 VMX coexist               PASS
13, IA-32 and IA-32e VMX coexist                PASS
14, LTP in VMX                                  PASS
15, one xp1 window domain                       PASS
16, IA-32PAE 2.6 linux domain                   PASS
17, xm-test                                     PASS


================================================================
Xm-test execution summary:
  PASS:  45
  FAIL:  4
  XPASS: 1
  XFAIL: 2


Details:

XFAIL: 02_network_local_ping_pos 
         ping loopback failed for size 65507. ping eth0 failed for size 65507.

 FAIL: 01_enforce_dom0_cpus_basic_pos 
         /proc/cpuinfo says xend didn't enforce dom0_cpus (16 != 1)
=================================================================


LTP test on IA-32e
               Summary Test Report of Last Session
==============================================================================
=                Total     Pass      Fail     NoResult     Crash
==============================================================================
=ltp             195       195        0          0          0
==============================================================================
=ltp             195       195        0          0          0
mm                21        21        0          0          0
dio               28        28        0          0          0
nptl              1         1         0          0          0
math              10        10        0          0          0
ipc               8         8         0          0          0
pty               3         3         0          0          0
quickhit         121       121        0          0          0
sched             3         3         0          0          0
==============================================================================
=Total           195       195        0          0          0


Thanks and best regards
Alex shi

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel

--- End Message ---
_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users

 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.