1955 blades in 1855 rack won't enable NICs

[Irwan Hadi]

I just experienced this issue with our Redhat ES 4 X64, also running
on a PE 1955 blade

Linux 2.6.9-42.0.10.ELsmp #1 SMP Fri Feb 16 17:13:42 EST 2007 x86_64
x86_64 x86_64 GNU/Linux

This blade is connected to embedded Cisco switch.
The fix is I need to disable "spanning-tree portfast" on the Cisco switch.

Somehow enabling spanning-tree portfast caused the network interface
to "skip" handshake at reboot, and makes it inaccessible.

Although disabling spanning-tree portfast will delay network
connectivity when the server is rebooted for up to 10 seconds, but
this better than the need to manually restart the network service.
I'm not planning to restart the server too often anyway.

Hope this helps.


On 22 Mar 2007 21:00:13 +0100, Ingvar Hagelund <ingvar at linpro.no> wrote:
> Stacked two 1955 blades in a 1855 rack. Updated PSUs and
> firmware. Blades boot up nice, but won't connect to the switch. At
> all. This goes for both eth0 and eth1, so nic ordering should not be a
> problem.
>
> [root at storm ~]# uname -r
> 2.6.9-42.ELsmp
>
> [root at storm ~]# cat /etc/redhat-release
> Red Hat Enterprise Linux AS release 4 (Nahant Update 4)
>
> [root at storm ~]# dmesg | grep bnx
> Broadcom NetXtreme II Gigabit Ethernet Driver bnx2 v1.4.38 (February 10, 2006)
> bnx2: eth0: using MSI
>
> [root at storm ~]# ip link set dev eth0 up && echo ok
> ok
>
> [root at storm ~]# ethtool eth0
> Settings for eth0:
>         Supported ports: [ FIBRE ]
>         Supported link modes:   1000baseT/Full
>         Supports auto-negotiation: Yes
>         Advertised link modes:  1000baseT/Full
>         Advertised auto-negotiation: Yes
>         Speed: Unknown! (65535)
>         Duplex: Unknown! (255)
>         Port: FIBRE
>         PHYAD: 2
>         Transceiver: internal
>         Auto-negotiation: on
>         Supports Wake-on: d
>         Wake-on: d
>         Link detected: no
>
> [root at storm ~]# ethtool eth1
> Settings for eth1:
>         Supported ports: [ FIBRE ]
>         Supported link modes:   1000baseT/Full
>         Supports auto-negotiation: Yes
>         Advertised link modes:  1000baseT/Full
>         Advertised auto-negotiation: Yes
>         Speed: Unknown! (65535)
>         Duplex: Unknown! (255)
>         Port: FIBRE
>         PHYAD: 2
>         Transceiver: internal
>         Auto-negotiation: on
>         Supports Wake-on: d
>         Wake-on: d
>         Link detected: no
>
> Here is the switch status. The 1955 blades are port g9 and g10.
>
> console> show interfaces status
>                                              Flow Link          Back   Mdix
> Port     Type         Duplex  Speed Neg      ctrl State       Pressure Mode
> ........ ............ ......  ..... ........ .... ........... ........ .......
> g1       1G-Fiber     Full    1000  Disabled Off  Up          Disabled Off
> g2       1G-Fiber     Full    1000  Disabled Off  Up          Disabled Off
> g3       1G-Fiber     Full    1000  Disabled Off  Up          Disabled Off
> g4       1G-Fiber     Full    1000  Disabled Off  Up          Disabled Off
> g5       1G-Fiber     Full    1000  Disabled Off  Up          Disabled Off
> g6       1G-Fiber     Full    1000  Disabled Off  Up          Disabled Off
> g7       1G-Fiber     Full    1000  Disabled Off  Up          Disabled Off
> g8       1G-Fiber     Full    1000  Disabled Off  Up          Disabled Off
> g9       1G-Fiber       --      --     --     --  Down           --     --
> g10      1G-Fiber       --      --     --     --  Down           --     --
> g11      1G-Copper    Full    1000  Enabled  Off  Up          Disabled Off
> g12      1G-Copper    Full    100   Enabled  Off  Up          Disabled On
> g13      1G-Copper      --      --     --     --  Down           --     --
> g14      1G-Copper      --      --     --     --  Down           --     --
> g15      1G-Copper      --      --     --     --  Down           --     --
> g16      1G-Copper      --      --     --     --  Down           --     --
>
> (...)
>
> Could switch firmware version be a problem?
>
> console> show version
> SW version      1.0.0.24 ( date  23-Sep-2004 time  19:31:17 )
> Boot version    1.0.0.12 ( date  18-Aug-2004 time  13:54:42 )
> HW version    00.00.02
>
> Ingvar
>
> --
> Når alt annet feiler: Symlink
>
> _______________________________________________
> Linux-PowerEdge mailing list
> Linux-PowerEdge at dell.com
> http://lists.us.dell.com/mailman/listinfo/linux-poweredge
> Please read the FAQ at http://lists.us.dell.com/faq
>