PE2950/RHEL5 and slow bonding!

[Thomas_Chenault at Dell.com]

The configuration described below defaults bonding to balance-rr mode
because no mode is specified. When using balance-rr mode, the link
partner, generally an Ethernet switch, must also be configured to
aggregate the connected ports. It should also be noted that balance-rr
mode is generally counterproductive for protocols carried over TCP as it
tends to result in packets being received out of order.

 

The selection of a bonding mode can be somewhat workload-specific. In
general, if the bonded interface will serve several clients then
balance-alb is a reasonable choice. Using balance-alb mode also has the
advantage of not requiring any special switch configuration.

 

The complete bonding documentation is provided in the Linux kernel
source in Documentation/networking/bonding.txt. Recent RedHat versions
install this file to /usr/share/doc/kernel-doc-*/
Documentation/networking/bonding.txt when the kernel-doc package is
installed.

 

 

Thomas

 

________________________________

From: linux-poweredge-bounces at dell.com
[mailto:linux-poweredge-bounces at dell.com] On Behalf Of Brian McGrew
Sent: Wednesday, April 23, 2008 10:41 AM
To: linux-poweredge-Lists
Subject: PE2950/RHEL5 and slow bonding!

 

Good morning all...

I've got a 2950 with RHEL5 installed in a stock configuration.  I've got
dual on-board Broadcom cards so I've bonded eth0 and eth1 into bond0 for
better performance.  The problem is, that bonded interface is slower
than molasses in January!  It's terrible.  I get about 4x better
performance if I just use a single 1GB eth0 connection.  What the
heck???

Somebody please shed some light on this for me!!!   This is a data
server with about 2TB of files on it, I need all the performance I can
get.  I will say this however, for a short time I had Win2K3 Enterprise
on here and sing the Broadcom tools I bonded (teamed) the NICS and it
was very, very fast.  I think I just missed something!?!?!

My configuration is as follows, I'll take all the advice I can get here!

14_ uname -a
Linux mvppvt125 2.6.18-8.el5 #1 SMP Fri Jan 26 14:15:14 EST 2007 x86_64
x86_64 x86_64 GNU/Linux

11_ more /etc/sysconfig/network-scripts/ifcfg-eth0 
DEVICE=eth0
ONBOOT=yes
BOOTPROTO=none
USERCTL=no
MASTER=bond0
SLAVE=yes

12_ more /etc/sysconfig/network-scripts/ifcfg-eth1
DEVICE=eth1
ONBOOT=yes
BOOTPROTO=none
USERCTL=no
MASTER=bond0
SLAVE=yes

13_ more /etc/sysconfig/network-scripts/ifcfg-bond0 
DEVICE=bond0
IPADDR=10.0.0.125
NETMASK=255.255.255.0
NETWORK=10.0.0.0
BROADCAST=10.0.0.255
ONBOOT=yes
BOOTPROTO=none
USERCTL=no

2_ more /etc/modprobe.conf 
alias scsi_hostadapter megaraid_sas
alias scsi_hostadapter1 usb-storage
alias eth0 bnx2
alias eth1 bnx2
alias bond0 bonding
options bonding miimon=100

3_ cat /proc/net/bonding/bond0 
Ethernet Channel Bonding Driver: v3.0.3 (March 23, 2006)

Bonding Mode: load balancing (round-robin)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0

Slave Interface: eth0
MII Status: up
Link Failure Count: 0
Permanent HW addr: 00:1e:c9:28:a9:a9

Slave Interface: eth1
MII Status: up
Link Failure Count: 0
Permanent HW addr: 00:1e:c9:28:a9:ab

19_ -- ethtool bond0
Settings for bond0:
No data available

5_ -- ethtool eth0
Settings for eth0:
    Supported ports: [ TP ]
    Supported link modes:   10baseT/Half 10baseT/Full 
                            100baseT/Half 100baseT/Full 
                            1000baseT/Full 
    Supports auto-negotiation: Yes
    Advertised link modes:  10baseT/Half 10baseT/Full 
                            100baseT/Half 100baseT/Full 
                            1000baseT/Full 
    Advertised auto-negotiation: Yes
    Speed: 1000Mb/s
    Duplex: Full
    Port: Twisted Pair
    PHYAD: 1
    Transceiver: internal
    Auto-negotiation: on
    Supports Wake-on: g
    Wake-on: d
    Link detected: yes

6_ -- ethtool eth1
Settings for eth1:
    Supported ports: [ TP ]
    Supported link modes:   10baseT/Half 10baseT/Full 
                            100baseT/Half 100baseT/Full 
                            1000baseT/Full 
    Supports auto-negotiation: Yes
    Advertised link modes:  10baseT/Half 10baseT/Full 
                            100baseT/Half 100baseT/Full 
                            1000baseT/Full 
    Advertised auto-negotiation: Yes
    Speed: 1000Mb/s
    Duplex: Full
    Port: Twisted Pair
    PHYAD: 1
    Transceiver: internal
    Auto-negotiation: on
    Supports Wake-on: g
    Wake-on: d
    Link detected: yes





------ End of Forwarded Message

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.us.dell.com/pipermail/linux-poweredge/attachments/20080423/32012695/attachment-0001.htm