[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Xen-users] Increasing throughput on xen bridges


  • To: carlopmart <carlopmart@xxxxxxxxx>
  • From: tmac <tmacmd@xxxxxxxxx>
  • Date: Sun, 6 Jan 2008 10:42:55 -0500
  • Cc: xen-users@xxxxxxxxxxxxxxxxxxx
  • Delivery-date: Sun, 06 Jan 2008 07:43:50 -0800
  • Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=OEq75tC0VvuNIY0Ca8mA4pZC6fZXXaQjZ38ht0kJUsM+5aOHxDUUBsosRr1ZzzO87nMqagskic9H71ced8bcLa4ULXW+/aNPVPZ09pRaiXJPkmakireC1GGqy8WLks2lQANcRsMzRuYS8PQ1wQH55o6wnBj3wup5CiGr4aZ3ssU=
  • List-id: Xen user discussion <xen-users.lists.xensource.com>

>From experience, RHEL3 is real bad at performance in general (NFS)

At the lab I work in, my first recommendation was to move to RHEL4U2.
There was almost a 2x performance increase across the network.

As for tuning, I did the following (it only works for 2.6+ kernels though)
on both my Host and guests (all rhel5.1)

The following NFS mount options:
hard,intr,vers=3,tcp,wsize=32768,wsize=32768,timeo=600

Here are the changes to the /etc/sysctl.conf file on the Guests
(for the host, the last line, sunrpc, is not available, so remove it)

net.core.netdev_max_backlog = 3000
net.core.rmem_default = 256960
net.core.rmem_max = 16777216
net.core.wmem_default = 256960
net.core.wmem_max = 16777216
net.core.rmem_default = 65536
net.core.wmem_default = 65536
net.core.rmem_max = 8388608
net.core.wmem_max = 8388608
net.ipv4.tcp_rmem = 4096 87380 4194304
net.ipv4.tcp_wmem = 4096 16384 4194304
net.ipv4.tcp_mem = 4096 4096 4096
sunrpc.tcp_slot_table_entries = 128

Also, add "/sbin/sysctl -p" as the first entry in /etc/init.d/netfs to
make sure that the setrtings get read before any NFS mounts take
place.

For the record, I get 95-102MB/sec each with a simple DD

On Jan 6, 2008 5:36 AM, carlopmart <carlopmart@xxxxxxxxx> wrote:
> Hi all,
>
>   I have a rhel 5.1 xen server with two rhel 3 ES hvm guests installed. Both
> rhel3 guests use an internal xen bridge (xenbr1) which it isn't binded to any
> physical interface host. On this bridge throughput it is very very poor, only
> 2.5 Mbs. How can I increase this throughput???
>
> Many thanks.
> --
> CL Martinez
> carlopmart {at} gmail {d0t} com
>
> _______________________________________________
> Xen-users mailing list
> Xen-users@xxxxxxxxxxxxxxxxxxx
> http://lists.xensource.com/xen-users
>



-- 
--tmac

RedHat Certified Engineer #804006984323821 (RHEL4)
RedHat Certified Engineer #805007643429572 (RHEL5)

Principal Consultant, RABA Technologies
240-373-3926 (office) 301-688-4705 (Lab)
           214-279-3926 (eFAX)

_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users


 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.