[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
RE: [Xen-users] Re: question about xen regression test tools
- To: "James Bulpin" <james@xxxxxxxxxxxxx>
- From: "Shi, Alex" <alex.shi@xxxxxxxxx>
- Date: Mon, 27 Mar 2006 11:01:00 +0800
- Cc: Xen User List <xen-users@xxxxxxxxxxxxxxxxxxx>
- Delivery-date: Mon, 27 Mar 2006 03:03:10 +0000
- List-id: Xen user discussion <xen-users.lists.xensource.com>
- Thread-index: AcZPlneAn5DuRJ8KREixG0CGf6gP6QBtAv3g
- Thread-topic: [Xen-users] Re: question about xen regression test tools
We use 3 boxes to test IA32/IA32pae/IA32e and send our test results to
xen-devel, pls see attached file.
Up to now these tests mainly focus on booting different guest OS. Because xen
becomes more and more stable, we need to have more tests on guest OS(Now we use
LTP). xenRT is excellent for this.
Thanks and best regards
Alex shi
James Bulpin wrote:
> Why don't you share your interest in testing and your results and
> infrastructure with the list?
>
> Shi, Alex wrote:
>> I have found you use many boxes to do xen regress test, but most of
>> I can not find related comments. Would you like to share those info
>> with me? - thanks in advance
>>
>> host
>> 0 albaron
>> 1 atitlan
>> 2 baker
>> 3 bernina
>> 4 blanca
>> 5 bogga
>> 6 boonda
>> 7 dammasto Dell PE1850 2xXeon (EM64T,HT) 4GB SCSI (MPT Fusion)
>> e1000 8 dummy 9 dummyhos
>> 10 forbes Dell PE1850 2xXeon (EM64T,HT) 4GB SCSI (MPT Fusion) e1000
>> 11 gallenst 12 gheeta 1xEM64T (HT) 4GB SATA D915 Yukon
>> 13 ghosts Dell SC1425 2xEM64T (HT) 4GB SATA e1000
>> 14 gorga 1xEM64T (HT) 4GB SATA D915 Yukon
>> 15 grappa 1xEM64T (HT) 4GB SATA D915 Yukon
>> 16 grondo 1xEM64T (HT) 4GB SATA D915 Yukon
>> 17 hubbard
>> 18 humbolt
>> 19 humphrey
>> 20 humpreys
>> 21 hunter
>> 22 k2
>> 23 kamet
>> 24 leone
>> 25 nowshak 2xOpteron 4GB SCSI (MPT Fusion)
>> 26 peclet Dell PE1850 2xXeon (EM64T,HT) 4GB SCSI (MPT Fusion) e1000
>> 27 planb 2xOpteron 8GB SCSI (MPT Fusion) TG3
>> 28 pong 2xOpteron 8GB SCSI (MPT Fusion) TG3
>> 29 romba
>> 30 sabinyo
>> 31 trivor
>>
>>
>>
>> Thanks and best regards
>> Alex shi
>>
>>
>>
>> -----Original Message-----
>> From: xen-users-bounces@xxxxxxxxxxxxxxxxxxx
>> [mailto:xen-users-bounces@xxxxxxxxxxxxxxxxxxx] On Behalf Of James
>> Bulpin
>> Sent: 2006年3月23日 23:37
>> To: Shi, Alex
>> Cc: Xen User List
>> Subject: Re: [Xen-users] Re: question about xen regression test tools
>>
>> Shi, Alex wrote:
>>
>>> I found the "updpingpong" case was not run recently. Does it have
>>> some problem?
>>
>>
>> It's not been written yet.
>>
>> Please keep list discussions on the list.
>>
>> James
>>
>>
>>> Thanks and best regards
>>> Alex shi
>>>
>>>
>>>
>>> -----Original Message-----
>>> From: xen-users-bounces@xxxxxxxxxxxxxxxxxxx
>>> [mailto:xen-users-bounces@xxxxxxxxxxxxxxxxxxx] On Behalf Of James
>>> Bulpin Sent: 2006年3月22日 11:21 To: Shi, Alex
>>> Cc: xen-users@xxxxxxxxxxxxxxxxxxx
>>> Subject: [Xen-users] Re: question about xen regression test tools
>>>
>>> Alex,
>>>
>>> ttcpbw uses a variant of the ttcp+ tool (see
>>> http://www.cl.cam.ac.uk/Research/SRG/netos/netx/code/ttcp.c)
>>>
>>> specjbb is SPEC JBB (www.spec.org)
>>>
>>> postmark 1.5c is what we use
>>>
>>> vm86 is an internal test
>>>
>>> We use memtest 0.0.4 but I've disabled it for now as I don't trust
>>> it.
>>>
>>> James
>>>
>>> Shi, Alex wrote:
>>>
>>>
>>>>
>>>>
>>>> I am very interesting to the xen regression test tools. like
>>>> memtest, dbench, osdb, etc. etc.
>>>> But I can not find some tools via google. like vm86, ttcpbw,
>>>> specjbb, and postmark (just find a postmark-1_5.c file from
>>>> http://linuxcompressed.sourceforge.net/statistics/) and the
>>>> memtest test suite is very old. it is just 0.0.4 version.
>>>> So, Anyone like to tell me where I can find them? and share more
>>>> detailed info of the test result on xenU or VMX domain of these
>>>> test suites?
>>>>
>>>> Any hints will be very appreciated!
>>>>
>>>>
>>>> Thanks and best regards
>>>> Alex shi
>>>
>>>
>>> _______________________________________________
>>> Xen-users mailing list
>>> Xen-users@xxxxxxxxxxxxxxxxxxx
>>> http://lists.xensource.com/xen-users
>>
>>
>> _______________________________________________
>> Xen-users mailing list
>> Xen-users@xxxxxxxxxxxxxxxxxxx
>> http://lists.xensource.com/xen-users
--- Begin Message ---
We have tested latest xen on VT platform with Intel 915/E8500 chipset.Here is
the test summary.
issues:
- No blocking issue.
IA-32:
Build&Boot SMP xen0 without problem
Can bootup unmodified IA-32 2.4/2.6 linux in VMX domain
Can bootup unmodified IA-32 WindowsXP SP1/SP2 in VMX domain
Can bootup VMX & XenU with different memory
size(VMX:128MB,256MB,512MB.XenU:256MB)
A selected subset of LTP runs well in VMX domain(2.6)
A selected subset of xm-test runs well
IA-32_PAE:
Build&Boot SMP xen0 without problem
Can bootup unmodified IA-32 2.6 linux in VMX domain
Can bootup unmodified IA-32 WindowXP SP1 in VMX domain
Can bootup VMX & XenU with different memory
size(VMX:256MB,512MB,1500MB.XenU:256MB)
A selected subset of LTP runs well in VMX domain(2.6)
A selected subset of xm-test runs well
IA-32e:
Build&Boot SMP xen0 without problem
Can bootup unmodified IA-32(2.4,2.6)/IA-32e(2.6) linux in VMX domain
Can bootup unmodified IA-32 WindowXP SP1 in VMX domain
Can bootup IA-32PAE 2.6 linux in VMX domain
Can bootup VMX & xenU with different memory
size.(VMX:128MB,256MB,512MB,4096MB.XenU:256MB)
A selected subset of LTP runs well in VMX domain(2.6)
A selected subset of xm-test runs well
for details
------------------------------------------------------------
Platform: IA-32
Service OS: FC3, IA-32, SMP
Hardware: Grandstale
Default guest OS: IA-32, 2.6 kernel
1, one vmx with memory 128M PASS
2, one vmx with memory 256M PASS
3, one vmx with memory 512M PASS
4, one xenU create PASS
5, 2 vmx and 2 xenU coexist PASS
6, four vmx coexist PASS
7, network in VMX domain PASS
8, network in XenU domain PASS
9, one window domain PASS
10,1 xp1 and 1 xp2 windows domains coexist PASS
11,XenU migration PASS
12,subset LTP test in VMX domain PASS
=========================================================================
Xm-test execution summary:
PASS: 46
FAIL: 3
XPASS: 1
XFAIL: 2
Details:
XFAIL: 02_network_local_ping_pos
ping loopback failed for size 65507. ping eth0 failed for size 65507.
FAIL: 01_enforce_dom0_cpus_basic_pos
/proc/cpuinfo says xend didn't enforce dom0_cpus (2 != 1)
==============================================================================
LTP test result on IA-32
Summary Test Report of Last Session
==============================================================================
Total Pass Fail NoResult Crash
==============================================================================
ltp 194 194 0 0 0
==============================================================================
ltp 194 194 0 0 0
mm 21 21 0 0 0
dio 28 28 0 0 0
nptl 1 1 0 0 0
math 10 10 0 0 0
ipc 8 8 0 0 0
pty 3 3 0 0 0
quickhit 120 120 0 0 0
sched 3 3 0 0 0
==============================================================================
Total 194 194 0 0 0
Platform: IA-32_PAE
Service OS: RHEL4U1, IA-32_PAE, SMP
Hardware: Grandstal
Default guest OS: IA-32, 2.6 kernel, no pae support
1, one vmx with memory 256M PASS
2, one vmx with memory 512M PASS
3, one vmx with memory 1.5GB PASS
4, one xenU with memory 256M PASS
5, network in VMX domain PASS
6, network in XenU domain PASS
7, one xp1 window domain PASS
8, xm-test PASS
9, XenU migration PASS
10,LTP in VMX PASS
=============================================================================
Xm-test execution summary:
PASS: 46
FAIL: 3
XPASS: 1
XFAIL: 2
Details:
XFAIL: 02_network_local_ping_pos
ping loopback failed for size 65507. ping eth0 failed for size 65507.
FAIL: 01_enforce_dom0_cpus_basic_pos
/proc/cpuinfo says xend didn't enforce dom0_cpus (2 != 1)
==============================================================================
LTP test result on PAE host
Summary Test Report of Last Session
==============================================================================
Total Pass Fail NoResult Crash
==============================================================================
ltp 194 194 0 0 0
==============================================================================
ltp 194 194 0 0 0
mm 21 21 0 0 0
dio 28 28 0 0 0
nptl 1 1 0 0 0
math 10 10 0 0 0
ipc 8 8 0 0 0
pty 3 3 0 0 0
quickhit 120 120 0 0 0
sched 3 3 0 0 0
==============================================================================
Total 194 194 0 0 0
Platform: IA-32e
Service OS: RHEL4U2, IA-32e, SMP
Hardware: Paxville
Default guest OS: IA-32e, 2.6 kernel
1, one vmx with memory 128M PASS
2, one vmx with memory 256M PASS
3, one vmx with memory 512M PASS
4, one vmx with memory 4096M PASS
5, one xenU with memory 256M PASS
6, 2 vmx and 2 xenU coexist PASS
7, four vmx coexist PASS
8, network in VMX domain PASS
9, network in XenU domain PASS
10, one 2.4 IA32 VMX domain PASS
11, one 2.6 IA32 VMX domain PASS
12, IA-32 2.4 and 2.6 VMX coexist PASS
13, IA-32 and IA-32e VMX coexist PASS
14, LTP in VMX PASS
15, one xp1 window domain PASS
16, IA-32PAE 2.6 linux domain PASS
17, xm-test PASS
================================================================
Xm-test execution summary:
PASS: 45
FAIL: 4
XPASS: 1
XFAIL: 2
Details:
XFAIL: 02_network_local_ping_pos
ping loopback failed for size 65507. ping eth0 failed for size 65507.
FAIL: 01_enforce_dom0_cpus_basic_pos
/proc/cpuinfo says xend didn't enforce dom0_cpus (16 != 1)
=================================================================
LTP test on IA-32e
Summary Test Report of Last Session
==============================================================================
= Total Pass Fail NoResult Crash
==============================================================================
=ltp 195 195 0 0 0
==============================================================================
=ltp 195 195 0 0 0
mm 21 21 0 0 0
dio 28 28 0 0 0
nptl 1 1 0 0 0
math 10 10 0 0 0
ipc 8 8 0 0 0
pty 3 3 0 0 0
quickhit 121 121 0 0 0
sched 3 3 0 0 0
==============================================================================
=Total 195 195 0 0 0
Thanks and best regards
Alex shi
_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel
--- End Message ---
_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users
|
