[Linux-PowerEdge] OpenManage + Broadcom NIC "Device or resource busy"

Thibaut Pouzet thibaut.pouzet at lyra-network.com
Thu Nov 15 03:49:09 CST 2012


Hi all,

Some context first : I use openmanage on a PowerEdge 1950 equipped with 
a Broadcom NetXtreme II BCM5708 NIC; and the OS is CentOS 6.3 (Final).
When I try to change some properties of the NIC, like the MTU, the NIC 
just stops working properly :

sudo ip addr ls eth1 # Nominal, mtu 1500, state UP
sudo ifconfig eth1 mtu 1496
RTNETLINK answers : Device or resource busy
sudo ip addr ls eth1 # state DOWN
sudo ifdown eth1
sudo ifup eth1
RTNETLINK answers : Device or resource busy
sudo dmesg | tail -20
Nov 12 16:36:01 xx kernel: bnx2: fw sync timeout, reset code = 503000d
Nov 12 16:36:01 xx kernel: bnx2 0000:09:00.0: eth1: <--- start MCP 
states dump --->
Nov 12 16:36:01 xx kernel: bnx2 0000:09:00.0: eth1: DEBUG: 
MCP_STATE_P0[00000106] MCP_STATE_P1[a1ebbc32]
Nov 12 16:36:01 xx kernel: bnx2 0000:09:00.0: eth1: DEBUG: MCP 
mode[0000b800] state[80004000] evt_mask[00000500]
Nov 12 16:36:01 xx kernel: bnx2 0000:09:00.0: eth1: DEBUG: pc[08006ac8] 
pc[08006ad4] instr[00401021]
Nov 12 16:36:01 xx kernel: bnx2 0000:09:00.0: eth1: DEBUG: shmem states:
Nov 12 16:36:01 xx kernel: bnx2 0000:09:00.0: eth1: DEBUG: 
drv_mb[0503000d] fw_mb[0000000c] link_status[00000020] 
drv_pulse_mb[00000000]
Nov 12 16:36:01 xx kernel: bnx2 0000:09:00.0: eth1: DEBUG: 
dev_info_signature[44564905] reset_type[01005254] condition[00000106]
Nov 12 16:36:01 xx kernel: bnx2 0000:09:00.0: eth1: DEBUG: 000003cc: 
44444444 44444444 44444444 00000a28
Nov 12 16:36:01 xx kernel: bnx2 0000:09:00.0: eth1: DEBUG: 000003dc: 
0004ffff 00000000 00000000 00000000
Nov 12 16:36:01 xx kernel: bnx2 0000:09:00.0: eth1: DEBUG: 000003ec: 
00000000 00000000 00000000 008a769d
Nov 12 16:36:01 xx kernel: bnx2 0000:09:00.0: eth1: DEBUG: 0x3fc[0000ffff]
Nov 12 16:36:01 xx kernel: bnx2 0000:09:00.0: eth1: <--- end MCP states 
dump --->

When I descovered this issue, the server was running openmanage 6.5, and 
the driver of the NIC was bnx2 v2.2.1. I upgraded to openmanage 7.1 and 
bnx2 v2.2.3e and the problem persists.

I can get the interface up again only through a reboot of the server... 
The solution that I adopted so far is to completely remove openmanage 
from the server. I can now change the NIC's properties without getting 
in trouble anymore... However this is not an long-term acceptable 
solution for me and I really would like to use openmanage and be able to 
change the NIC's properties.

I parsed the mailing and did not found any similar problem so I am 
asking you : does anyone have any tips on this issue ?

Below some more information on the system :

sudo lspci
00:00.0 Host bridge: Intel Corporation 5000X Chipset Memory Controller 
Hub (rev 12)
00:02.0 PCI bridge: Intel Corporation 5000 Series Chipset PCI Express x4 
Port 2 (rev 12)
00:03.0 PCI bridge: Intel Corporation 5000 Series Chipset PCI Express x4 
Port 3 (rev 12)
00:04.0 PCI bridge: Intel Corporation 5000 Series Chipset PCI Express x8 
Port 4-5 (rev 12)
00:05.0 PCI bridge: Intel Corporation 5000 Series Chipset PCI Express x4 
Port 5 (rev 12)
00:06.0 PCI bridge: Intel Corporation 5000 Series Chipset PCI Express x8 
Port 6-7 (rev 12)
00:07.0 PCI bridge: Intel Corporation 5000 Series Chipset PCI Express x4 
Port 7 (rev 12)
00:10.0 Host bridge: Intel Corporation 5000 Series Chipset FSB Registers 
(rev 12)
00:10.1 Host bridge: Intel Corporation 5000 Series Chipset FSB Registers 
(rev 12)
00:10.2 Host bridge: Intel Corporation 5000 Series Chipset FSB Registers 
(rev 12)
00:11.0 Host bridge: Intel Corporation 5000 Series Chipset Reserved 
Registers (rev 12)
00:13.0 Host bridge: Intel Corporation 5000 Series Chipset Reserved 
Registers (rev 12)
00:15.0 Host bridge: Intel Corporation 5000 Series Chipset FBD Registers 
(rev 12)
00:16.0 Host bridge: Intel Corporation 5000 Series Chipset FBD Registers 
(rev 12)
00:1c.0 PCI bridge: Intel Corporation 631xESB/632xESB/3100 Chipset PCI 
Express Root Port 1 (rev 09)
00:1d.0 USB controller: Intel Corporation 631xESB/632xESB/3100 Chipset 
UHCI USB Controller #1 (rev 09)
00:1d.1 USB controller: Intel Corporation 631xESB/632xESB/3100 Chipset 
UHCI USB Controller #2 (rev 09)
00:1d.2 USB controller: Intel Corporation 631xESB/632xESB/3100 Chipset 
UHCI USB Controller #3 (rev 09)
00:1d.7 USB controller: Intel Corporation 631xESB/632xESB/3100 Chipset 
EHCI USB2 Controller (rev 09)
00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev d9)
00:1f.0 ISA bridge: Intel Corporation 631xESB/632xESB/3100 Chipset LPC 
Interface Controller (rev 09)
00:1f.1 IDE interface: Intel Corporation 631xESB/632xESB IDE Controller 
(rev 09)
01:00.0 PCI bridge: Intel Corporation 80333 Segment-A PCI Express-to-PCI 
Express Bridge
01:00.2 PCI bridge: Intel Corporation 80333 Segment-B PCI Express-to-PCI 
Express Bridge
02:0e.0 RAID bus controller: Dell PowerEdge Expandable RAID controller 5
04:00.0 PCI bridge: Broadcom EPB PCI-Express to PCI-X Bridge (rev c2)
05:00.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM5708 
Gigabit Ethernet (rev 11)
06:00.0 PCI bridge: Intel Corporation 6311ESB/6321ESB PCI Express 
Upstream Port (rev 01)
06:00.3 PCI bridge: Intel Corporation 6311ESB/6321ESB PCI Express to 
PCI-X Bridge (rev 01)
07:00.0 PCI bridge: Intel Corporation 6311ESB/6321ESB PCI Express 
Downstream Port E1 (rev 01)
07:01.0 PCI bridge: Intel Corporation 6311ESB/6321ESB PCI Express 
Downstream Port E2 (rev 01)
08:00.0 PCI bridge: Broadcom EPB PCI-Express to PCI-X Bridge (rev c2)
09:00.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM5708 
Gigabit Ethernet (rev 11)
10:0d.0 VGA compatible controller: Advanced Micro Devices [AMD] nee ATI 
ES1000 (rev 02)

sudo dmidecode | less
System Information
Manufacturer: Dell Inc. Product Name: PowerEdge 1950


modinfo bnx2
filename: /lib/modules/2.6.32-279.14.1.el6.x86_64/kernel/drivers/net/bnx2.ko
version:        2.2.3e
license:        GPL
description:    Broadcom NetXtreme II BCM5706/5708/5709/5716 Driver
author:         Michael Chan <mchan at broadcom.com>
srcversion:     5D515DF6F607DBF9B5C4186
alias:          pci:v000014E4d0000163Csv*sd*bc*sc*i*
alias:          pci:v000014E4d0000163Bsv*sd*bc*sc*i*
alias:          pci:v000014E4d0000163Asv*sd*bc*sc*i*
alias:          pci:v000014E4d00001639sv*sd*bc*sc*i*
alias:          pci:v000014E4d000016ACsv*sd*bc*sc*i*
alias:          pci:v000014E4d000016AAsv*sd*bc*sc*i*
alias: pci:v000014E4d000016AAsv0000103Csd00003102bc*sc*i*
alias:          pci:v000014E4d0000164Csv*sd*bc*sc*i*
alias:          pci:v000014E4d0000164Asv*sd*bc*sc*i*
alias: pci:v000014E4d0000164Asv0000103Csd00003106bc*sc*i*
alias: pci:v000014E4d0000164Asv0000103Csd00003101bc*sc*i*
depends:
vermagic:       2.6.32-279.11.1.el6.x86_64 SMP mod_unload modversions
parm:           disable_msi:Disable Message Signaled Interrupt (MSI) (int)
parm:           stop_on_tx_timeout:For debugging purposes, prevent a 
chip  reset when a tx timeout occurs (int)

uname -a
Linux xx.lyra-network.com 2.6.32-279.14.1.el6.x86_64 #1 SMP Tue Nov 6 
23:43:09 UTC 2012 x86_64 x86_64 x86_64 GNU/Linux

cat /etc/redhat-release
CentOS release 6.3 (Final)

Regards,

Thibaut Pouzet.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.us.dell.com/pipermail/linux-poweredge/attachments/20121115/fa562a81/attachment.html 


More information about the Linux-PowerEdge mailing list