[Poweredgec-tools] C6220 / SAS 2008 / JBOD and BIOS issues

Michael_Stumpf at Dell.com Michael_Stumpf at Dell.com
Mon Sep 16 14:40:05 CDT 2013


Have you tried looking at persistent block device naming?

https://wiki.archlinux.org/index.php/Persistent_block_device_naming

There are some tools mentioned I've not seen before, but you might have easy access to (lsblk).

However, you don't need those - there are mechanisms built directly in that you can access:

/dev/disk/by-id:
total 0
drwxr-xr-x 2 root root 160 Jul 20 02:48 ./
drwxr-xr-x 4 root root  80 Jul 20 02:48 ../
lrwxrwxrwx 1 root root   9 Jul 20 02:48 scsi-350000393081b1b4c -> ../../sde
lrwxrwxrwx 1 root root   9 Jul 20 02:48 scsi-350000393081b1be4 -> ../../sdb
lrwxrwxrwx 1 root root   9 Jul 20 02:48 scsi-350000393081b8540 -> ../../sda
lrwxrwxrwx 1 root root   9 Jul 20 02:48 scsi-350000393081b8bb0 -> ../../sdd
lrwxrwxrwx 1 root root   9 Jul 20 02:48 scsi-350000393081b8cac -> ../../sdc
lrwxrwxrwx 1 root root   9 Jul 20 02:48 scsi-350000393081b9964 -> ../../sdf

/dev/disk/by-path:
total 0
drwxr-xr-x 2 root root 160 Jul 20 02:48 ./
drwxr-xr-x 4 root root  80 Jul 20 02:48 ../
lrwxrwxrwx 1 root root   9 Jul 20 02:48 pci-0000:82:00.0-sas-0x500a0d100054e760:1:0-0x50000393081b1b4e:26 -> ../../sde
lrwxrwxrwx 1 root root   9 Jul 20 02:48 pci-0000:82:00.0-sas-0x500a0d100054e760:1:0-0x50000393081b1be6:23 -> ../../sdb
lrwxrwxrwx 1 root root   9 Jul 20 02:48 pci-0000:82:00.0-sas-0x500a0d100054e760:1:0-0x50000393081b8542:22 -> ../../sda
lrwxrwxrwx 1 root root   9 Jul 20 02:48 pci-0000:82:00.0-sas-0x500a0d100054e760:1:0-0x50000393081b8bb2:25 -> ../../sdd
lrwxrwxrwx 1 root root   9 Jul 20 02:48 pci-0000:82:00.0-sas-0x500a0d100054e760:1:0-0x50000393081b8cae:24 -> ../../sdc
lrwxrwxrwx 1 root root   9 Jul 20 02:48 pci-0000:82:00.0-sas-0x500a0d100054e760:1:0-0x50000393081b9966:27 -> ../../sdf

There's a lot of information packed in there.  the "ldstate" tool that we publish consumes, digests, and spiders out to collect all kinds of useful things:

[192.168.9.15 root at dcs-linpe35 ~]# ldstate info

Adapters:

   onboard.0  onboard
   sas2008.0  SAS 2008 3G v0.1  (fw:11.00.00.00 | driver:14.00.00.00)

Logical drives:


Physical drives:

   sas2008.0    2:6    rdy  29C  600gb  SAS          sda  MBF2600RC (DA05) [EA03PB101PBL]
   sas2008.0    2:7    rdy  29C  600gb  SAS          sdb  MBF2600RC (DA05) [EA03PB101NL7]
   sas2008.0    2:8    rdy  28C  600gb  SAS          sdc  MBF2600RC (DA05) [EA03PB101PD9]
   sas2008.0    2:9    rdy  28C  600gb  SAS          sdd  MBF2600RC (DA05) [EA03PB101PC5]
   sas2008.0    2:10   rdy  29C  600gb  SAS          sde  MBF2600RC (DA05) [EA03PB101NKJ]
   sas2008.0    2:11  FAIL  29C  600gb  SAS          sdf  MBF2600RC (DA05) [EA03PB101PFJ]

Also in CSV for easy script consumption  (and -hrcsv for human-readable CSV)

[192.168.9.15 root at dcs-linpe35 ~]# ldstate info --csv
adp,onboard,0,onboard,,
adp,sas2008,0,SAS 2008 3G v0.1,11.00.00.00,14.00.00.00
pd,sas2008,0,2,6,rdy,29C,600gb,SAS,,,,sda,MBF2600RC (DA05) [EA03PB101PBL]
pd,sas2008,0,2,7,rdy,29C,600gb,SAS,,,,sdb,MBF2600RC (DA05) [EA03PB101NL7]
pd,sas2008,0,2,8,rdy,28C,600gb,SAS,,,,sdc,MBF2600RC (DA05) [EA03PB101PD9]
pd,sas2008,0,2,9,rdy,28C,600gb,SAS,,,,sdd,MBF2600RC (DA05) [EA03PB101PC5]
pd,sas2008,0,2,10,rdy,29C,600gb,SAS,,,,sde,MBF2600RC (DA05) [EA03PB101NKJ]
pd,sas2008,0,2,11,FAIL,29C,600gb,SAS,,,,sdf,MBF2600RC (DA05) [EA03PB101PFJ]

"ldstate keyval" shows all info available:

            adpbiosver : 7.21.00.00
              adpfwver : 11.00.00.00
                adpnum : 0
               adptype : sas2008
                 pdenc : 2
          pdformfactor : 2.5
                  pdfw : DA05
                pdguid : 50000393081b1b4c
               pdmodel : MBF2600RC
           pdosmapping : sde
            pdoverheat : no
                pdppid : PH05R6CX7557111M1D6HA01
            pdprotocol : SAS
                 pdrpm : 10025 rpm
             pdsasaddr : 5000039-3-081b-1b4e
              pdserial : EA03PB101NKJ
                pdslot : 10
       pdsmartstateraw : OK
               pdstate : ready
            pdstateraw : Ready (RDY)
                  pdsz : 572325
                pdtemp : 28C
              toolname : sas2ircu
               toolver : 13.00.00.00

Does this give you what you need?  I still need to test a bit prior to publishing the latest version of ldstate that has all of this; but I'll send it to you as a 1-off if you need it now.




Michael Stumpf
System Management & Tools
Dell | PowerEdge C

From: poweredgec-tools-bounces On Behalf Of Eric Raymond
Sent: Monday, September 16, 2013 12:24 PM
To: poweredgec-tools
Subject: [Poweredgec-tools] C6220 / SAS 2008 / JBOD and BIOS issues

I seem to keep running into issues with SAS iR controllers when configured for JBOD.  /dev/sdc and sda are flipped, not consistently, and causes issues with grub being loaded from the correct drive.  I have tried a variety of configurations to help work around this issue, using the sas2ircu bootencl and altbootencl, but doesnt seem to help.  I have changed our kickstarts to use driveordering for the mbr, and even tried to just install grub on every disk, but to no avail.

Is there a way to make this consistent in the BIOS or using the utilities?

Thanks,

Eric
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.us.dell.com/pipermail/poweredgec-tools/attachments/20130916/e826e594/attachment-0001.html 


More information about the Poweredgec-tools mailing list