VG deletion problem (Oracle + ASM + RAC + EMC + POWERPATH...)

Florent Gilain florent.gilain at direct-energie.com
Wed Jan 24 13:02:36 CST 2007


Here is what i did for the moment :

[root at s-oracle1 ~]# vgscan
  Reading all physical volumes.  This may take a while...
  Found volume group "VolGroup01" using metadata type lvm2
  Found volume group "VolGroup00" using metadata type lvm2
[root at s-oracle1 ~]# vgremove -v -t VolGroup01
  Test mode: Metadata will NOT be updated.
    Using volume group(s) on command line
    Finding volume group "VolGroup01"
  Volume group "VolGroup01" still contains 1 logical volume(s)
    Test mode: Wiping internal cache
    Wiping internal VG cache
[root at s-oracle1 ~]# lvdisplay
  --- Logical volume ---
  LV Name                /dev/VolGroup01/LogVol00
  VG Name                VolGroup01
  LV UUID                rVcbgS-2AwR-ePqK-sXC5-QAeO-uJsi-QTqg7J
  LV Write Access        read/write
  LV Status              NOT available
  LV Size                230,32 GB
  Current LE             58963
  Segments               1
  Allocation             inherit
  Read ahead sectors     0
   
  --- Logical volume ---
  LV Name                /dev/VolGroup00/LogVol00
  VG Name                VolGroup00
  LV UUID                sXm6pE-yTi1-VxdQ-Xd2E-qRen-9Zam-ySqQMK
  LV Write Access        read/write
  LV Status              available
  # open                 1
  LV Size                29,41 GB
  Current LE             941
  Segments               4
  Allocation             inherit
  Read ahead sectors     0
  Block device           253:0
   
  --- Logical volume ---
  LV Name                /dev/VolGroup00/LogVol05
  VG Name                VolGroup00
  LV UUID                0ux4mn-JudK-ZQbA-14hT-knw1-eqxR-xSu3tq
  LV Write Access        read/write
  LV Status              available
  # open                 1
  LV Size                4,00 GB
  Current LE             128
  Segments               1
  Allocation             inherit
  Read ahead sectors     0
  Block device           253:1
   
  --- Logical volume ---
  LV Name                /dev/VolGroup00/LogVol03
  VG Name                VolGroup00
  LV UUID                eQdBLg-yEbK-6WeV-KHy0-1Hm3-B805-zKnl9P
  LV Write Access        read/write
  LV Status              available
  # open                 1
  LV Size                4,00 GB
  Current LE             128
  Segments               1
  Allocation             inherit
  Read ahead sectors     0
  Block device           253:2
   
  --- Logical volume ---
  LV Name                /dev/VolGroup00/LogVol02
  VG Name                VolGroup00
  LV UUID                wqpULI-n3EQ-MBHH-hGLG-WXka-wKEH-juQfDd
  LV Write Access        read/write
  LV Status              available
  # open                 1
  LV Size                8,00 GB
  Current LE             256
  Segments               1
  Allocation             inherit
  Read ahead sectors     0
  Block device           253:3
   
  --- Logical volume ---
  LV Name                /dev/VolGroup00/LogVol04
  VG Name                VolGroup00
  LV UUID                igGUzv-Yp2X-JrWX-O3V4-zkqe-Hd34-UI8nOA
  LV Write Access        read/write
  LV Status              available
  # open                 1
  LV Size                4,00 GB
  Current LE             128
  Segments               1
  Allocation             inherit
  Read ahead sectors     0
  Block device           253:4
   
  --- Logical volume ---
  LV Name                /dev/VolGroup00/LogVol01
  VG Name                VolGroup00
  LV UUID                bcEgUC-9MlC-VfzJ-Zexp-vhxK-392p-heXDIq
  LV Write Access        read/write
  LV Status              available
  # open                 1
  LV Size                8,09 GB
  Current LE             259
  Segments               1
  Allocation             inherit
  Read ahead sectors     0
  Block device           253:5
   
  --- Logical volume ---
  LV Name                /dev/VolGroup00/LogVol06
  VG Name                VolGroup00
  LV UUID                XGclFM-1WXk-PhJg-nzVm-gqCa-tEg8-cpmh3K
  LV Write Access        read/write
  LV Status              available
  # open                 1
  LV Size                9,97 GB
  Current LE             319
  Segments               1
  Allocation             inherit
  Read ahead sectors     0
  Block device           253:6
   
[root at s-oracle1 ~]# vgremove -v -t VolGroup01
  Test mode: Metadata will NOT be updated.
    Using volume group(s) on command line
    Finding volume group "VolGroup01"
  Volume group "VolGroup01" still contains 1 logical volume(s)
    Test mode: Wiping internal cache
    Wiping internal VG cache

[root at s-oracle1 ~]# lvremove -t -v /dev/VolGroup01/LogVol00
  Test mode: Metadata will NOT be updated.
    Using logical volume(s) on command line
    Test mode: Skipping archiving of volume group.
    Found volume group "VolGroup01"
    Found volume group "VolGroup01"
    Releasing logical volume "LogVol00"
    Test mode: Skipping volume group backup.
  Logical volume "LogVol00" successfully removed
    Test mode: Wiping internal cache
    Wiping internal VG cache
[root at s-oracle1 ~]# lvremove -v /dev/VolGroup01/LogVol00
    Using logical volume(s) on command line
    Archiving volume group "VolGroup01" metadata (seqno 2).
    Found volume group "VolGroup01"
    Found volume group "VolGroup01"
    Releasing logical volume "LogVol00"
    Creating volume group backup "/etc/lvm/backup/VolGroup01" (seqno 3).
  Logical volume "LogVol00" successfully removed
[root at s-oracle1 ~]# vgremove -v -t VolGroup01
  Test mode: Metadata will NOT be updated.
    Using volume group(s) on command line
    Finding volume group "VolGroup01"
    Test mode: Skipping archiving of volume group.
    Removing physical volume "/dev/emcpowera2" from volume group "VolGroup01"
  Volume group "VolGroup01" successfully removed
    Test mode: Wiping internal cache
    Wiping internal VG cache
[root at s-oracle1 ~]# vgremove -v VolGroup01
    Using volume group(s) on command line
    Finding volume group "VolGroup01"
    Archiving volume group "VolGroup01" metadata (seqno 3).
    Removing physical volume "/dev/emcpowera2" from volume group "VolGroup01"
  Volume group "VolGroup01" successfully removed
[root at s-oracle1 ~]# vgdisplay
  --- Volume group ---
  VG Name               VolGroup00
  System ID             
  Format                lvm2
  Metadata Areas        2
  Metadata Sequence No  15
  VG Access             read/write
  VG Status             resizable
  MAX LV                0
  Cur LV                7
  Open LV               7
  Max PV                0
  Cur PV                2
  Act PV                2
  VG Size               67,47 GB
  PE Size               32,00 MB
  Total PE              2159
  Alloc PE / Size       2159 / 67,47 GB
  Free  PE / Size       0 / 0   
  VG UUID               qSyfEe-JrM2-lhCT-nbZJ-FOO0-VW1Q-Y47Cu0

But is it ok now ? Did i missed something more to do to finish this cleanup before adding a new volume group containing my 2 new internal hard disks ?

Florent 

-----Message d'origine-----
De : linux-poweredge-bounces at dell.com [mailto:linux-poweredge-bounces at dell.com] De la part de Florent Gilain
Envoyé : mercredi 24 janvier 2007 17:31
À : linux-poweredge at lists.us.dell.com
Objet : VG deletion problem (Oracle + ASM + RAC + EMC + POWERPATH...)

Hello all,

1) I already asked some informations about a similar problem few months ago; but i leaved this problem at this moment so, i restart trying to resolve it now..

2) My setup :

Oracle 10GR2 RAC standard Edition using ASM for Oracle storage SAN with 2*PE2950 under RHEL4ES (s-oracle1 and s-oracle2) connected with fiber to a DELL EMC CX300 and Brocade Fiber switchs.

Each Oracle node is allowed to access 2 LUNS on the CX300 : /dev/emcpowera and /dev/emcpowerb

Here is the setup of the RAW Devices partitions used by Oracle using ASM on theses LUN :

[root at s-oracle1 ~]# cat /etc/sysconfig/rawdevices # This file and interface are deprecated.
# Applications needing raw device access should open regular # block devices with O_DIRECT.
# raw device bindings
# format:  <rawdev> <major> <minor>
#          <rawdev> <blockdev>
# example: /dev/raw/raw1 /dev/sda1
#          /dev/raw/raw2 8 5
#OCR
/dev/raw/raw1 /dev/emcpowerb1
# VOTING
/dev/raw/raw2 /dev/emcpowerb2
# ASM
#    dbf+log+ctrl
/dev/raw/raw3 /dev/emcpowerb3
#    Archivelog + backup rman
/dev/raw/raw4 /dev/emcpowera1

[root at s-oracle1 ~]# df -h
Sys. de fich.         Tail. Occ. Disp. %Occ. Monté sur
/dev/mapper/VolGroup00-LogVol00
                       29G   11G   18G  38% /
/dev/sda3             190M   20M  161M  11% /boot
none                  3,9G     0  3,9G   0% /dev/shm
/dev/mapper/VolGroup00-LogVol05
                      4,0G  1,1G  2,7G  30% /home
/dev/mapper/VolGroup00-LogVol03
                      4,0G   43M  3,7G   2% /tmp
/dev/mapper/VolGroup00-LogVol02
                      7,9G  3,1G  4,4G  42% /usr
/dev/mapper/VolGroup00-LogVol04
                      4,0G  237M  3,6G   7% /var
/dev/mapper/VolGroup00-LogVol06
                      9,9G  4,9G  4,5G  53% /oracle

[root at s-oracle1 ~]# vgdisplay
  --- Volume group ---
  VG Name               VolGroup01
  System ID             
  Format                lvm2
  Metadata Areas        1
  Metadata Sequence No  2
  VG Access             read/write
  VG Status             resizable
  MAX LV                256
  Cur LV                1
  Open LV               0
  Max PV                256
  Cur PV                1
  Act PV                1
  VG Size               230,32 GB
  PE Size               4,00 MB
  Total PE              58963
  Alloc PE / Size       58963 / 230,32 GB
  Free  PE / Size       0 / 0   
  VG UUID               C0XIOj-TPdy-WRRh-JpCY-ISMj-Wf3b-iaEOrG
   
  --- Volume group ---
  VG Name               VolGroup00
  System ID             
  Format                lvm2
  Metadata Areas        2
  Metadata Sequence No  15
  VG Access             read/write
  VG Status             resizable
  MAX LV                0
  Cur LV                7
  Open LV               7
  Max PV                0
  Cur PV                2
  Act PV                2
  VG Size               67,47 GB
  PE Size               32,00 MB
  Total PE              2159
  Alloc PE / Size       2159 / 67,47 GB
  Free  PE / Size       0 / 0   
  VG UUID               qSyfEe-JrM2-lhCT-nbZJ-FOO0-VW1Q-Y47Cu0

[root at s-oracle1 ~]# ls /dev/emc*
/dev/emcpower  /dev/emcpowera  /dev/emcpowera1  /dev/emcpowera2  /dev/emcpowerb  /dev/emcpowerb1  /dev/emcpowerb2  /dev/emcpowerb3

[root at s-oracle1 ~]# parted /dev/emcpowera GNU Parted 1.6.19 Copyright (C) 1998 - 2004 Free Software Foundation, Inc.
This program is free software, covered by the GNU General Public License.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the GNU General Public License for more details.

On utilise /dev/emcpowera
(parted)                                                                  
(parted) help                                                             
  check MINEURE                 faire une vérification simple du système de fichiers
  cp [PÉRIPHÉRIQUE-SOURCE] MINEURE-SOURCE MINEURE-DEST
        copier le système de fichiers vers une autre partition
  help [COMMANDE]               afficher l'aide générale ou de l'aide sur la COMMANDE
  mklabel LABEL-TYPE            créer une nouvelle étiquette de disque (table de partition)
  mkfs MINEURE TYPE-SF             créer un système de fichiers de TYPE-SF sur la partititon MINEURE
  mkpart TYPE-PAR [TYPE-SF] DÉPART FIN      créer une partition
  mkpartfs TYPE-PAR TYPE-SF DÉPART FIN      créer une partition avec un système de fichiers
  move MINEURE DÉPART FIN       déplacer une partition MINEURE
  name MINEURE NOM              nommer une partition MINEURE NOM
  print [MINEUR]                afficher la table de partitions ou une partition
  quit                          terminer le programme
  rescue DÉPART FIN             restaurer les partitions perdues entre DÉPART et FIN
  resize MINEURE DÉPART FIN     modifier la taille du système de fichiers MINEURE
  rm MINEURE                    détruire la partition MINEURE
  select PÉRIPHÉRIQUE           sélectionner le périphérique à éditer
  set MINEURE FANION ÉTAT       modifier le FANION sur la partition MINEURE
(parted) print                                                            
Géométrie du disque pour /dev/emcpowera: 0.000-521971,250 mégaoctets Type d'étiquette de disque: msdos
Mineur   Départ      Fin     Type      Sys.fichiersFanions
1          0,031 286110,747  primaire              
(parted)                                   

3) My Problem :

At a moment, as i'm not a Linux expert and was new to SAN, i was thinking i could use the rest of the free space of the LUN /dev/emcpowera to create a new "normal" file system (ext3...where i could copy rman backup files to send them on a remote backup server) that would be accessible from both servers at the same time (shame on me...). It corresponds, i think, to the /dev/emcpowera2 partition...

Now, my question is : What should i do to remove any trace of that second partition creation ? (and so, remove any trace to the VolGroup01) because i finally decided to add 2 new disks inside the s-oracle1 server (not in the SAN) dedicaced to RMAN backups on a bnormal FS...

Thanks a lot

PS : i hope i've been clear enough...
NB : VolGroup01 isn't displayed on second server when using vgdisplay command

Florent







_______________________________________________
Linux-PowerEdge mailing list
Linux-PowerEdge at dell.com
http://lists.us.dell.com/mailman/listinfo/linux-poweredge
Please read the FAQ at http://lists.us.dell.com/faq




More information about the Linux-PowerEdge mailing list