[Xen-users] RE: [ofa-general] Infiniband performance

["Robert Dunkley" <Robert@xxxxxxxxx>]

Hi Jan,

I asked almost the exact same question as you about 6 months ago and someone 
provided some Gen4 results for me (But I can't seem to find them in email), 
they were a fair bit better than Gen3. 

With IPOIB, you want connected mode and a large 32Kb+ MTU for max bandwidth, 
1Gbyte/sec or more should be possible with Gen 4.

Here are some of my original test results on my Opteron System with Gen3 cards:

#qperf 192.168.10.160 tcp_bw tcp_lat
 tcp_bw:
     bw  =  866 MB/sec
 tcp_lat:
     latency  =  30.8 us


# qperf 192.168.10.160 rc_bi_bw
rc_bi_bw:
    bw  =  1.71 GB/sec


The second result is bi directional, Gen4 on PCI-E V2 should get quite a lot 
better.


Rob

-----Original Message-----
From: Jan Ruffing [mailto:ruffing@xxxxxxxxxx] 
Sent: 11 December 2008 16:18
To: Robert Dunkley
Cc: Gilad Shainer; general@xxxxxxxxxxxxxxxxxxxxx
Subject: Re: [ofa-general] Infiniband performance

Robert Dunkley wrote:
> The newer gen4 20Gb cards get about 14-15Gbit/sec because of their better 
> lower latency processing and support for higher bandwidth PCI-E 2.0 (PCI-E is 
> not 100% efficient so a 20Gbit PCIE connect will hold back a 20Gbit IC).
>
>   
Thank you.
What TCP bandwidth did you get with the gen4 cards?

Jan

-- 
Jan Ruffing
Software Developer

Motama GmbH
Lortzingstraße 10 · 66111 Saarbrücken · Germany
tel +49 681 940 85 50 · fax +49 681 940 85 49
ruffing@xxxxxxxxxx · www.motama.com

Companies register · district council Saarbrücken · HRB 15249
CEOs · Dr.-Ing. Marco Lohse, Michael Repplinger

This e-mail may contain confidential and/or privileged information. 
If you are not the intended recipient (or have received this e-mail 
in error) please notify the sender immediately and destroy this 
e-mail. Any unauthorized copying, disclosure or distribution of the 
material in this e-mail is strictly forbidden.


The SAQ Group

Registered Office: 18 Chapel Street, Petersfield, Hampshire GU32 3DZ
SAQ is the trading name of SEMTEC Limited. Registered in England & Wales
Company Number: 06481952

http://www.saqnet.co.uk AS29219

SAQ Group Delivers high quality, honestly priced communication and I.T. 
services to UK Business.

Broadband : Domains : Email : Hosting : CoLo : Servers : Racks : Transit : 
Backups : Managed Networks : Remote Support.

ISPA Member

Find us in http://www.thebestof.co.uk/petersfield


_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users