[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Xen-users] 10Gbit ethernet NIC gives slow throughput

  • To: Pasi Kärkkäinen <pasik@xxxxxx>
  • From: fabi.a169@xxxxxxxxx
  • Date: Mon, 22 Dec 2008 18:48:21 +0100
  • Cc: xen-users@xxxxxxxxxxxxxxxxxxx
  • Delivery-date: Mon, 22 Dec 2008 09:50:36 -0800
  • Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; b=n2AhfbOJwjyES2kk0eCynlVW1lnv+Lx+DTGpa8fbNLDIygid7NEBNl5TLoecEWQLsv BpF+4qyeXGR/JCIAwpotaadXACZDHfgBcDDfCm/n859XhpqFOvybMXzvnFX3+ZF778EK VsyH298/I/SMRgXl507m7AxUR0+lDDE//1E9s=
  • List-id: Xen user discussion <xen-users.lists.xensource.com>

Pasi Kärkkäinen wrote:
On Mon, Dec 22, 2008 at 05:36:40PM +0100, fabi.a169@xxxxxxxxx wrote:

I would like to use a server having myricom 10gbit ethernet interfaces
(driver myri10ge) for Xen. But between dom0s (no domU running), I get only a
throughput of about 2.3Gbit/s (I use Xen 3.2 with the 2.6.18 kernel and
debian in dom0), whether xend is running or not.  However, on linux kernel
with the same version but without xen patch, I get more than 6Gbit/s.
Clearly, with Xen, the CPU is not the bottleneck, beeing used at much less
than 100%.

Does anybody have experiences with Xen and 10Gbit ethernet ?

With Xen, are you using bridged networking?
The default network configuration in Xen creates virtual ethernet interface 
'eth0', which is bridged to the real NIC (which is renamed to peth0).

So, when making comparisons, make sure you're using the actual physical interface.
Dunno if there's something to optimize in the bridge-setup.. have you done
all the normal optimizations? txqueuelen for all interfaces (including vif
interfaces), tcp window sizes etc.

-- Pasi

I don't even use the brigdes, for example without starting xend. Also, when I measure throughput on the loopback interface, I get the same throughput bounded to 2.29 Gbps. There should be something bounding everything to this value, maybe related to the vcpus. If I send for example 2 flows in parallel, I get the double of this throughput.

Xen-users mailing list



Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.