PE2950/RHEL5 and slow bonding!

[Daniel Huntley]

I  use bonding on all my linux (Centos) servers that have 2 x gigabit
nics.

 

I'm using mode=4 which is LACP (802.3ad)

 

If you're switches support it, most modern switches support it (we're
using Cisco), give it a go. Peformance is exactly what I would expect
from a bonded gigabit interface.

 

Be aware that the interfaces on the switch need to be setup in an
etherchannel and configured for 802.3ad so  if your not sure how to do
it talk to your network admin. It's a very simple configuration.


Dan

 

 

From: linux-poweredge-bounces at dell.com
[mailto:linux-poweredge-bounces at dell.com] On Behalf Of
Thomas_Chenault at dell.com
Sent: Thursday, 24 April 2008 3:32 AM
To: linux-poweredge at lists.us.dell.com
Subject: RE: PE2950/RHEL5 and slow bonding!

 

The configuration described below defaults bonding to balance-rr mode
because no mode is specified. When using balance-rr mode, the link
partner, generally an Ethernet switch, must also be configured to
aggregate the connected ports. It should also be noted that balance-rr
mode is generally counterproductive for protocols carried over TCP as it
tends to result in packets being received out of order.

 

The selection of a bonding mode can be somewhat workload-specific. In
general, if the bonded interface will serve several clients then
balance-alb is a reasonable choice. Using balance-alb mode also has the
advantage of not requiring any special switch configuration.

 

The complete bonding documentation is provided in the Linux kernel
source in Documentation/networking/bonding.txt. Recent RedHat versions
install this file to /usr/share/doc/kernel-doc-*/
Documentation/networking/bonding.txt when the kernel-doc package is
installed.

 

 

Thomas

 

________________________________

From: linux-poweredge-bounces at dell.com
[mailto:linux-poweredge-bounces at dell.com] On Behalf Of Brian McGrew
Sent: Wednesday, April 23, 2008 10:41 AM
To: linux-poweredge-Lists
Subject: PE2950/RHEL5 and slow bonding!

 

Good morning all...

I've got a 2950 with RHEL5 installed in a stock configuration.  I've got
dual on-board Broadcom cards so I've bonded eth0 and eth1 into bond0 for
better performance.  The problem is, that bonded interface is slower
than molasses in January!  It's terrible.  I get about 4x better
performance if I just use a single 1GB eth0 connection.  What the
heck???

Somebody please shed some light on this for me!!!   This is a data
server with about 2TB of files on it, I need all the performance I can
get.  I will say this however, for a short time I had Win2K3 Enterprise
on here and sing the Broadcom tools I bonded (teamed) the NICS and it
was very, very fast.  I think I just missed something!?!?!

My configuration is as follows, I'll take all the advice I can get here!

14_ uname -a
Linux mvppvt125 2.6.18-8.el5 #1 SMP Fri Jan 26 14:15:14 EST 2007 x86_64
x86_64 x86_64 GNU/Linux

11_ more /etc/sysconfig/network-scripts/ifcfg-eth0 
DEVICE=eth0
ONBOOT=yes
BOOTPROTO=none
USERCTL=no
MASTER=bond0
SLAVE=yes

12_ more /etc/sysconfig/network-scripts/ifcfg-eth1
DEVICE=eth1
ONBOOT=yes
BOOTPROTO=none
USERCTL=no
MASTER=bond0
SLAVE=yes

13_ more /etc/sysconfig/network-scripts/ifcfg-bond0 
DEVICE=bond0
IPADDR=10.0.0.125
NETMASK=255.255.255.0
NETWORK=10.0.0.0
BROADCAST=10.0.0.255
ONBOOT=yes
BOOTPROTO=none
USERCTL=no

2_ more /etc/modprobe.conf 
alias scsi_hostadapter megaraid_sas
alias scsi_hostadapter1 usb-storage
alias eth0 bnx2
alias eth1 bnx2
alias bond0 bonding
options bonding miimon=100

3_ cat /proc/net/bonding/bond0 
Ethernet Channel Bonding Driver: v3.0.3 (March 23, 2006)

Bonding Mode: load balancing (round-robin)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0

Slave Interface: eth0
MII Status: up
Link Failure Count: 0
Permanent HW addr: 00:1e:c9:28:a9:a9

Slave Interface: eth1
MII Status: up
Link Failure Count: 0
Permanent HW addr: 00:1e:c9:28:a9:ab

19_ -- ethtool bond0
Settings for bond0:
No data available

5_ -- ethtool eth0
Settings for eth0:
    Supported ports: [ TP ]
    Supported link modes:   10baseT/Half 10baseT/Full 
                            100baseT/Half 100baseT/Full 
                            1000baseT/Full 
    Supports auto-negotiation: Yes
    Advertised link modes:  10baseT/Half 10baseT/Full 
                            100baseT/Half 100baseT/Full 
                            1000baseT/Full 
    Advertised auto-negotiation: Yes
    Speed: 1000Mb/s
    Duplex: Full
    Port: Twisted Pair
    PHYAD: 1
    Transceiver: internal
    Auto-negotiation: on
    Supports Wake-on: g
    Wake-on: d
    Link detected: yes

6_ -- ethtool eth1
Settings for eth1:
    Supported ports: [ TP ]
    Supported link modes:   10baseT/Half 10baseT/Full 
                            100baseT/Half 100baseT/Full 
                            1000baseT/Full 
    Supports auto-negotiation: Yes
    Advertised link modes:  10baseT/Half 10baseT/Full 
                            100baseT/Half 100baseT/Full 
                            1000baseT/Full 
    Advertised auto-negotiation: Yes
    Speed: 1000Mb/s
    Duplex: Full
    Port: Twisted Pair
    PHYAD: 1
    Transceiver: internal
    Auto-negotiation: on
    Supports Wake-on: g
    Wake-on: d
    Link detected: yes





------ End of Forwarded Message

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.us.dell.com/pipermail/linux-poweredge/attachments/20080511/ec3bd274/attachment.htm