[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Xen-users] Xen and networking.

  • To: xen-users@xxxxxxxxxxxxxxxxxxx
  • From: tmac <tmacmd@xxxxxxxxx>
  • Date: Fri, 28 Dec 2007 15:28:07 -0500
  • Delivery-date: Fri, 28 Dec 2007 12:28:37 -0800
  • Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition; b=Y6qFmxui8+9iTJMUXocBVWCg4R5ap5mxLGnHdCNb+VPJ0T2y4HP6P2ydkjarnsnAVOFnduNp0ulRpvOUCSVpqGC9QSH48MWC/qVGTKUNpVOcVegs3ocjS1qc3MjIEwFVa4r/d5AeV6rC+lw8P7PQGKRWjNILjZwbmLUn3xyxN+Q=
  • List-id: Xen user discussion <xen-users.lists.xensource.com>

I have a beefy machine
(Intel dual-quad core, 16GB memory 2 x GigE)

I have loaded RHEL5.1-xen on the hardware and have created two logical systems:
4 cpus, 7.5 GB memory 1 x Gige

Following RHEL guidelines, I have it set up so that eth0->xenbr0 and
Each of the two RHEL5.1 guests uses one of the interfaces and this is
verified at the
switch by seeing the unique MAC addresses.

If I do a crude test from one guest over nfs,
dd if=/dev/zero of=/nfs/test bs=32768 count=32768

This yields almost always 95-100MB/sec

When I run two simultaneously, I cannot seem to get above 25MB/sec from each.
It starts off with a large burst like each can do 100MB/sec, but then
in a couple
of seconds, tapers off to the 15-40MB/sec until the dd finishes.

Things I have tried (installed on the host and the guests)

 net.core.rmem_max = 16777216
 net.core.wmem_max = 16777216
 net.ipv4.tcp_rmem = 4096 87380 16777216
 net.ipv4.tcp_wmem = 4096 65536 16777216

 net.ipv4.tcp_no_metrics_save = 1
 net.ipv4.tcp_moderate_rcvbuf = 1
 # recommended to increase this for 1000 BT or higher
 net.core.netdev_max_backlog = 2500
 sysctl -w net.ipv4.tcp_congestion_control=cubic

Any ideas?


RedHat Certified Engineer #804006984323821 (RHEL4)
RedHat Certified Engineer #805007643429572 (RHEL5)

Principal Consultant, RABA Technologies

Xen-users mailing list



Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.