[Poweredgec-tools] C6220 / SAS 2008 / JBOD and BIOS issues

Eric Raymond eric.raymond at flurry.com
Wed Sep 18 11:53:44 CDT 2013


Thanks for the info Michael. Unfortunately, we already are using persistent
block naming, and the OS is always installed correctly, its something with
the LSI card trying to locate the mbr/grub disk.  We fixed this issue by
setting boot support to "bios enabled only", and all systems are
consistently booting now.




On Mon, Sep 16, 2013 at 12:40 PM, <Michael_Stumpf at dell.com> wrote:

> Have you tried looking at persistent block device naming?
>
> https://wiki.archlinux.org/index.php/Persistent_block_device_naming
>
> There are some tools mentioned I've not seen before, but you might have
> easy access to (lsblk).
>
> However, you don't need those - there are mechanisms built directly in
> that you can access:
>
> /dev/disk/by-id:
> total 0
> drwxr-xr-x 2 root root 160 Jul 20 02:48 ./
> drwxr-xr-x 4 root root  80 Jul 20 02:48 ../
> lrwxrwxrwx 1 root root   9 Jul 20 02:48 scsi-350000393081b1b4c -> ../../sde
> lrwxrwxrwx 1 root root   9 Jul 20 02:48 scsi-350000393081b1be4 -> ../../sdb
> lrwxrwxrwx 1 root root   9 Jul 20 02:48 scsi-350000393081b8540 -> ../../sda
> lrwxrwxrwx 1 root root   9 Jul 20 02:48 scsi-350000393081b8bb0 -> ../../sdd
> lrwxrwxrwx 1 root root   9 Jul 20 02:48 scsi-350000393081b8cac -> ../../sdc
> lrwxrwxrwx 1 root root   9 Jul 20 02:48 scsi-350000393081b9964 -> ../../sdf
>
> /dev/disk/by-path:
> total 0
> drwxr-xr-x 2 root root 160 Jul 20 02:48 ./
> drwxr-xr-x 4 root root  80 Jul 20 02:48 ../
> lrwxrwxrwx 1 root root   9 Jul 20 02:48
> pci-0000:82:00.0-sas-0x500a0d100054e760:1:0-0x50000393081b1b4e:26 ->
> ../../sde
> lrwxrwxrwx 1 root root   9 Jul 20 02:48
> pci-0000:82:00.0-sas-0x500a0d100054e760:1:0-0x50000393081b1be6:23 ->
> ../../sdb
> lrwxrwxrwx 1 root root   9 Jul 20 02:48
> pci-0000:82:00.0-sas-0x500a0d100054e760:1:0-0x50000393081b8542:22 ->
> ../../sda
> lrwxrwxrwx 1 root root   9 Jul 20 02:48
> pci-0000:82:00.0-sas-0x500a0d100054e760:1:0-0x50000393081b8bb2:25 ->
> ../../sdd
> lrwxrwxrwx 1 root root   9 Jul 20 02:48
> pci-0000:82:00.0-sas-0x500a0d100054e760:1:0-0x50000393081b8cae:24 ->
> ../../sdc
> lrwxrwxrwx 1 root root   9 Jul 20 02:48
> pci-0000:82:00.0-sas-0x500a0d100054e760:1:0-0x50000393081b9966:27 ->
> ../../sdf
>
> There's a lot of information packed in there.  the "ldstate" tool that we
> publish consumes, digests, and spiders out to collect all kinds of useful
> things:
>
> [192.168.9.15 root at dcs-linpe35 ~]# ldstate info
>
> Adapters:
>
>    onboard.0  onboard
>    sas2008.0  SAS 2008 3G v0.1  (fw:11.00.00.00 | driver:14.00.00.00)
>
> Logical drives:
>
>
> Physical drives:
>
>    sas2008.0    2:6    rdy  29C  600gb  SAS          sda  MBF2600RC (DA05)
> [EA03PB101PBL]
>    sas2008.0    2:7    rdy  29C  600gb  SAS          sdb  MBF2600RC (DA05)
> [EA03PB101NL7]
>    sas2008.0    2:8    rdy  28C  600gb  SAS          sdc  MBF2600RC (DA05)
> [EA03PB101PD9]
>    sas2008.0    2:9    rdy  28C  600gb  SAS          sdd  MBF2600RC (DA05)
> [EA03PB101PC5]
>    sas2008.0    2:10   rdy  29C  600gb  SAS          sde  MBF2600RC (DA05)
> [EA03PB101NKJ]
>    sas2008.0    2:11  FAIL  29C  600gb  SAS          sdf  MBF2600RC (DA05)
> [EA03PB101PFJ]
>
> Also in CSV for easy script consumption  (and -hrcsv for human-readable
> CSV)
>
> [192.168.9.15 root at dcs-linpe35 ~]# ldstate info --csv
> adp,onboard,0,onboard,,
> adp,sas2008,0,SAS 2008 3G v0.1,11.00.00.00,14.00.00.00
> pd,sas2008,0,2,6,rdy,29C,600gb,SAS,,,,sda,MBF2600RC (DA05) [EA03PB101PBL]
> pd,sas2008,0,2,7,rdy,29C,600gb,SAS,,,,sdb,MBF2600RC (DA05) [EA03PB101NL7]
> pd,sas2008,0,2,8,rdy,28C,600gb,SAS,,,,sdc,MBF2600RC (DA05) [EA03PB101PD9]
> pd,sas2008,0,2,9,rdy,28C,600gb,SAS,,,,sdd,MBF2600RC (DA05) [EA03PB101PC5]
> pd,sas2008,0,2,10,rdy,29C,600gb,SAS,,,,sde,MBF2600RC (DA05) [EA03PB101NKJ]
> pd,sas2008,0,2,11,FAIL,29C,600gb,SAS,,,,sdf,MBF2600RC (DA05) [EA03PB101PFJ]
>
> "ldstate keyval" shows all info available:
>
>             adpbiosver : 7.21.00.00
>               adpfwver : 11.00.00.00
>                 adpnum : 0
>                adptype : sas2008
>                  pdenc : 2
>           pdformfactor : 2.5
>                   pdfw : DA05
>                 pdguid : 50000393081b1b4c
>                pdmodel : MBF2600RC
>            pdosmapping : sde
>             pdoverheat : no
>                 pdppid : PH05R6CX7557111M1D6HA01
>             pdprotocol : SAS
>                  pdrpm : 10025 rpm
>              pdsasaddr : 5000039-3-081b-1b4e
>               pdserial : EA03PB101NKJ
>                 pdslot : 10
>        pdsmartstateraw : OK
>                pdstate : ready
>             pdstateraw : Ready (RDY)
>                   pdsz : 572325
>                 pdtemp : 28C
>               toolname : sas2ircu
>                toolver : 13.00.00.00
>
> Does this give you what you need?  I still need to test a bit prior to
> publishing the latest version of ldstate that has all of this; but I'll
> send it to you as a 1-off if you need it now.
>
>
>
>
> Michael Stumpf
> System Management & Tools
> Dell | PowerEdge C
>
> From: poweredgec-tools-bounces On Behalf Of Eric Raymond
> Sent: Monday, September 16, 2013 12:24 PM
> To: poweredgec-tools
> Subject: [Poweredgec-tools] C6220 / SAS 2008 / JBOD and BIOS issues
>
> I seem to keep running into issues with SAS iR controllers when configured
> for JBOD.  /dev/sdc and sda are flipped, not consistently, and causes
> issues with grub being loaded from the correct drive.  I have tried a
> variety of configurations to help work around this issue, using the
> sas2ircu bootencl and altbootencl, but doesnt seem to help.  I have changed
> our kickstarts to use driveordering for the mbr, and even tried to just
> install grub on every disk, but to no avail.
>
> Is there a way to make this consistent in the BIOS or using the utilities?
>
> Thanks,
>
> Eric
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.us.dell.com/pipermail/poweredgec-tools/attachments/20130918/b143eb37/attachment.html 


More information about the Poweredgec-tools mailing list