Help problem with RHEL4 LVM + EMC PowerPath : Found duplicate PV...

Florent Gilain florent.gilain at direct-energie.com
Tue Oct 31 09:08:38 CST 2006


Hi all,

Here is the situation :

I have 2 PE2950 (oracle RAC 10G cluster nodes called s-oracle1 and
s-oracle2) connected using HBA cards, to an EMC CX300 using PowerPath
software from EMC.

Now, i want to create a mount point on each node lets say /emcspaceora1 (on
first server...) and /emcspaceora2 (on second server...).
So i ran "system-config-lvm" to get the GUI to create a new VG group and add
a new LV into it. All has worked ok on the first server, but it got a nerror
while doing the same thing on the second server..

Here is the information :

I have a RAID5 from CX300, seen as /dev/emcpowera device on each nodes.
I created 3 partitions onto it :

- partition 1 is shared between 2 nodes (oracle rman backups space)
- partition 2 should only be mounted on s-oracle1 (/emcspaceora1 mountpoint)
- partition 3 should only be mounted on s-oracle2 (/emcspaceora2 mountpoint)

[root at s-oracle1 emcspaceora1]# fdisk /dev/emcpowera

Le nombre de cylindres pour ce disque est initialisé à 66541.
Il n'y a rien d'incorrect avec cela, mais c'est plus grand que 1024,
et cela pourrait causer des problèmes en fonction pour certaines
configurations:
1) logiciels qui sont exécutés à l'amorçage (i.e., vieilles versions de
LILO)
2) logiciels d'amorçage et de partitionnement pour d'autres SE
   (i.e., DOS FDISK, OS/2 FDISK)

Commande (m pour l'aide): p

Disque /dev/emcpowera: 547.3 Go, 547326525440 octets
255 têtes, 63 secteurs/piste, 66541 cylindres
Unités = cylindres de 16065 * 512 = 8225280 octets

 Périphérique Boot      Start         End      Blocks   Id  System
/dev/emcpowera1               1       36474   292977373+  83  Linux
/dev/emcpowera2           36475       48633    97667167+  83  Linux
/dev/emcpowera3           48634       60792    97667167+  83  Linux

[root at s-oracle1 emcspaceora1]# vgdisplay
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdb2 not
/dev/emcpowera2
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdd2 not
/dev/sdb2
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdf2 not
/dev/sdd2
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdh2 not
/dev/sdf2
  --- Volume group ---
  VG Name               VolGroup00
  System ID             
  Format                lvm2
  Metadata Areas        2
  Metadata Sequence No  15
  VG Access             read/write
  VG Status             resizable
  MAX LV                0
  Cur LV                7
  Open LV               7
  Max PV                0
  Cur PV                2
  Act PV                2
  VG Size               67,47 GB
  PE Size               32,00 MB
  Total PE              2159
  Alloc PE / Size       2159 / 67,47 GB
  Free  PE / Size       0 / 0   
  VG UUID               qSyfEe-JrM2-lhCT-nbZJ-FOO0-VW1Q-Y47Cu0

[root at s-oracle1 emcspaceora1]# lvdisplay
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdb2 not
/dev/emcpowera2
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdd2 not
/dev/sdb2
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdf2 not
/dev/sdd2
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdh2 not
/dev/sdf2
  --- Logical volume ---
  LV Name                /dev/VolGroup00/LogVol00
  VG Name                VolGroup00
  LV UUID                sXm6pE-yTi1-VxdQ-Xd2E-qRen-9Zam-ySqQMK
  LV Write Access        read/write
  LV Status              available
  # open                 1
  LV Size                29,41 GB
  Current LE             941
  Segments               4
  Allocation             inherit
  Read ahead sectors     0
  Block device           253:0
   
  --- Logical volume ---
  LV Name                /dev/VolGroup00/LogVol05
  VG Name                VolGroup00
  LV UUID                0ux4mn-JudK-ZQbA-14hT-knw1-eqxR-xSu3tq
  LV Write Access        read/write
  LV Status              available
  # open                 1
  LV Size                4,00 GB
  Current LE             128
  Segments               1
  Allocation             inherit
  Read ahead sectors     0
  Block device           253:1
   
  --- Logical volume ---
  LV Name                /dev/VolGroup00/LogVol03
  VG Name                VolGroup00
  LV UUID                eQdBLg-yEbK-6WeV-KHy0-1Hm3-B805-zKnl9P
  LV Write Access        read/write
  LV Status              available
  # open                 1
  LV Size                4,00 GB
  Current LE             128
  Segments               1
  Allocation             inherit
  Read ahead sectors     0
  Block device           253:2
   
  --- Logical volume ---
  LV Name                /dev/VolGroup00/LogVol02
  VG Name                VolGroup00
  LV UUID                wqpULI-n3EQ-MBHH-hGLG-WXka-wKEH-juQfDd
  LV Write Access        read/write
  LV Status              available
  # open                 1
  LV Size                8,00 GB
  Current LE             256
  Segments               1
  Allocation             inherit
  Read ahead sectors     0
  Block device           253:3
   
  --- Logical volume ---
  LV Name                /dev/VolGroup00/LogVol04
  VG Name                VolGroup00
  LV UUID                igGUzv-Yp2X-JrWX-O3V4-zkqe-Hd34-UI8nOA
  LV Write Access        read/write
  LV Status              available
  # open                 1
  LV Size                4,00 GB
  Current LE             128
  Segments               1
  Allocation             inherit
  Read ahead sectors     0
  Block device           253:4
   
  --- Logical volume ---
  LV Name                /dev/VolGroup00/LogVol01
  VG Name                VolGroup00
  LV UUID                bcEgUC-9MlC-VfzJ-Zexp-vhxK-392p-heXDIq
  LV Write Access        read/write
  LV Status              available
  # open                 1
  LV Size                8,09 GB
  Current LE             259
  Segments               1
  Allocation             inherit
  Read ahead sectors     0
  Block device           253:5
   
  --- Logical volume ---
  LV Name                /dev/VolGroup00/LogVol06
  VG Name                VolGroup00
  LV UUID                XGclFM-1WXk-PhJg-nzVm-gqCa-tEg8-cpmh3K
  LV Write Access        read/write
  LV Status              available
  # open                 1
  LV Size                9,97 GB
  Current LE             319
  Segments               1
  Allocation             inherit
  Read ahead sectors     0
  Block device           253:6

[root at s-oracle1 emcspaceora1]# pvdisplay
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdb2 not
/dev/emcpowera2
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdd2 not
/dev/sdb2
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdf2 not
/dev/sdd2
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdh2 not
/dev/sdf2
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/emcpowera2
not /dev/sdh2
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdb2 not
/dev/emcpowera2
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdd2 not
/dev/sdb2
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdf2 not
/dev/sdd2
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdh2 not
/dev/sdf2
  --- Physical volume ---
  PV Name               /dev/sda5
  VG Name               VolGroup00
  PV Size               63,47 GB / not usable 0   
  Allocatable           yes (but full)
  PE Size (KByte)       32768
  Total PE              2031
  Free PE               0
  Allocated PE          2031
  PV UUID               lyKvsk-W540-2Jf4-xmcd-7Hjn-a26F-zCGY6T
   
  --- Physical volume ---
  PV Name               /dev/sda2
  VG Name               VolGroup00
  PV Size               4,00 GB / not usable 0   
  Allocatable           yes (but full)
  PE Size (KByte)       32768
  Total PE              128
  Free PE               0
  Allocated PE          128
  PV UUID               0UGIR2-iZf6-MaGK-dZJW-RuMY-e4DU-FVOynH
   
  --- NEW Physical volume ---
  PV Name               /dev/sdh2
  VG Name               
  PV Size               93,14 GB
  Allocatable           NO
  PE Size (KByte)       0
  Total PE              0
  Free PE               0
  Allocated PE          0
  PV UUID               LbpGyr-R4uv-sZiv-Uwqn-JQMY-oZbC-PTCpgu

=========================================================================
=========================================================================

[root at s-oracle2 /]# vgdisplay
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdb2 not
/dev/emcpowera2
  Found duplicate PV w52GsGNkEShZfnUZ2XyBg9gOnSkiZhy6: using /dev/sdb3 not
/dev/emcpowera3
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdd2 not
/dev/sdb2
  Found duplicate PV w52GsGNkEShZfnUZ2XyBg9gOnSkiZhy6: using /dev/sdd3 not
/dev/sdb3
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdf2 not
/dev/sdd2
  Found duplicate PV w52GsGNkEShZfnUZ2XyBg9gOnSkiZhy6: using /dev/sdf3 not
/dev/sdd3
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdh2 not
/dev/sdf2
  Found duplicate PV w52GsGNkEShZfnUZ2XyBg9gOnSkiZhy6: using /dev/sdh3 not
/dev/sdf3
  --- Volume group ---
  VG Name               VolGroup00
  System ID             
  Format                lvm2
  Metadata Areas        2
  Metadata Sequence No  15
  VG Access             read/write
  VG Status             resizable
  MAX LV                0
  Cur LV                7
  Open LV               7
  Max PV                0
  Cur PV                2
  Act PV                2
  VG Size               67,47 GB
  PE Size               32,00 MB
  Total PE              2159
  Alloc PE / Size       2159 / 67,47 GB
  Free  PE / Size       0 / 0   
  VG UUID               fPPy7d-799E-UgJZ-E6l4-PNyT-sBxr-yNaaw6

[root at s-oracle2 /]# lvdisplay
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdb2 not
/dev/emcpowera2
  Found duplicate PV w52GsGNkEShZfnUZ2XyBg9gOnSkiZhy6: using /dev/sdb3 not
/dev/emcpowera3
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdd2 not
/dev/sdb2
  Found duplicate PV w52GsGNkEShZfnUZ2XyBg9gOnSkiZhy6: using /dev/sdd3 not
/dev/sdb3
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdf2 not
/dev/sdd2
  Found duplicate PV w52GsGNkEShZfnUZ2XyBg9gOnSkiZhy6: using /dev/sdf3 not
/dev/sdd3
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdh2 not
/dev/sdf2
  Found duplicate PV w52GsGNkEShZfnUZ2XyBg9gOnSkiZhy6: using /dev/sdh3 not
/dev/sdf3
  --- Logical volume ---
  LV Name                /dev/VolGroup00/LogVol00
  VG Name                VolGroup00
  LV UUID                JjgnTZ-j9g1-0zO0-CL10-9431-iC2C-2U8U67
  LV Write Access        read/write
  LV Status              available
  # open                 1
  LV Size                29,41 GB
  Current LE             941
  Segments               4
  Allocation             inherit
  Read ahead sectors     0
  Block device           253:0
   
  --- Logical volume ---
  LV Name                /dev/VolGroup00/LogVol05
  VG Name                VolGroup00
  LV UUID                NrPAsJ-My6r-nEMP-1EKh-ZXys-WeCs-2KLuDV
  LV Write Access        read/write
  LV Status              available
  # open                 1
  LV Size                4,00 GB
  Current LE             128
  Segments               1
  Allocation             inherit
  Read ahead sectors     0
  Block device           253:1
   
  --- Logical volume ---
  LV Name                /dev/VolGroup00/LogVol03
  VG Name                VolGroup00
  LV UUID                Bxt00Q-dSyV-UJYm-9Si9-saBK-e0pd-i4efQ6
  LV Write Access        read/write
  LV Status              available
  # open                 1
  LV Size                4,00 GB
  Current LE             128
  Segments               1
  Allocation             inherit
  Read ahead sectors     0
  Block device           253:2
   
  --- Logical volume ---
  LV Name                /dev/VolGroup00/LogVol02
  VG Name                VolGroup00
  LV UUID                0s4NBg-UuBp-mtQm-rn0y-ZC7q-6qnY-v9jAw7
  LV Write Access        read/write
  LV Status              available
  # open                 1
  LV Size                8,00 GB
  Current LE             256
  Segments               1
  Allocation             inherit
  Read ahead sectors     0
  Block device           253:3
   
  --- Logical volume ---
  LV Name                /dev/VolGroup00/LogVol04
  VG Name                VolGroup00
  LV UUID                VaDDnj-7S3c-Nog7-VC3d-shcf-0e7e-RNVUpj
  LV Write Access        read/write
  LV Status              available
  # open                 1
  LV Size                4,00 GB
  Current LE             128
  Segments               1
  Allocation             inherit
  Read ahead sectors     0
  Block device           253:4
   
  --- Logical volume ---
  LV Name                /dev/VolGroup00/LogVol01
  VG Name                VolGroup00
  LV UUID                cwEd3Z-dl5h-jxdJ-bVN1-3dO6-rtVZ-US31Jo
  LV Write Access        read/write
  LV Status              available
  # open                 1
  LV Size                8,09 GB
  Current LE             259
  Segments               1
  Allocation             inherit
  Read ahead sectors     0
  Block device           253:5
   
  --- Logical volume ---
  LV Name                /dev/VolGroup00/LogVol06
  VG Name                VolGroup00
  LV UUID                gx528b-Mxhw-FJ0t-6nO0-5UdW-e0tU-EwD3oh
  LV Write Access        read/write
  LV Status              available
  # open                 1
  LV Size                9,97 GB
  Current LE             319
  Segments               1
  Allocation             inherit
  Read ahead sectors     0
  Block device           253:6

[root at s-oracle2 /]# pvdisplay
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdb2 not
/dev/emcpowera2
  Found duplicate PV w52GsGNkEShZfnUZ2XyBg9gOnSkiZhy6: using /dev/sdb3 not
/dev/emcpowera3
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdd2 not
/dev/sdb2
  Found duplicate PV w52GsGNkEShZfnUZ2XyBg9gOnSkiZhy6: using /dev/sdd3 not
/dev/sdb3
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdf2 not
/dev/sdd2
  Found duplicate PV w52GsGNkEShZfnUZ2XyBg9gOnSkiZhy6: using /dev/sdf3 not
/dev/sdd3
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdh2 not
/dev/sdf2
  Found duplicate PV w52GsGNkEShZfnUZ2XyBg9gOnSkiZhy6: using /dev/sdh3 not
/dev/sdf3
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/emcpowera2
not /dev/sdh2
  Found duplicate PV w52GsGNkEShZfnUZ2XyBg9gOnSkiZhy6: using /dev/emcpowera3
not /dev/sdh3
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdb2 not
/dev/emcpowera2
  Found duplicate PV w52GsGNkEShZfnUZ2XyBg9gOnSkiZhy6: using /dev/sdb3 not
/dev/emcpowera3
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdd2 not
/dev/sdb2
  Found duplicate PV w52GsGNkEShZfnUZ2XyBg9gOnSkiZhy6: using /dev/sdd3 not
/dev/sdb3
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdf2 not
/dev/sdd2
  Found duplicate PV w52GsGNkEShZfnUZ2XyBg9gOnSkiZhy6: using /dev/sdf3 not
/dev/sdd3
  Found duplicate PV LbpGyrR4uvsZivUwqnJQMYoZbCPTCpgu: using /dev/sdh2 not
/dev/sdf2
  Found duplicate PV w52GsGNkEShZfnUZ2XyBg9gOnSkiZhy6: using /dev/sdh3 not
/dev/sdf3
  --- Physical volume ---
  PV Name               /dev/sda5
  VG Name               VolGroup00
  PV Size               63,47 GB / not usable 0   
  Allocatable           yes (but full)
  PE Size (KByte)       32768
  Total PE              2031
  Free PE               0
  Allocated PE          2031
  PV UUID               1hK8yp-iLYe-MDPd-nv1L-2RB7-k2WA-8F40DZ
   
  --- Physical volume ---
  PV Name               /dev/sda2
  VG Name               VolGroup00
  PV Size               4,00 GB / not usable 0   
  Allocatable           yes (but full)
  PE Size (KByte)       32768
  Total PE              128
  Free PE               0
  Allocated PE          128
  PV UUID               EHlwEV-eAz6-2QMc-H6CI-5BOR-FodD-HvrEYT
   
  --- NEW Physical volume ---
  PV Name               /dev/sdh2
  VG Name               
  PV Size               93,14 GB
  Allocatable           NO
  PE Size (KByte)       0
  Total PE              0
  Free PE               0
  Allocated PE          0
  PV UUID               LbpGyr-R4uv-sZiv-Uwqn-JQMY-oZbC-PTCpgu
   
  --- NEW Physical volume ---
  PV Name               /dev/sdh3
  VG Name               
  PV Size               93,14 GB
  Allocatable           NO
  PE Size (KByte)       0
  Total PE              0
  Free PE               0
  Allocated PE          0
  PV UUID               w52GsG-NkES-hZfn-UZ2X-yBg9-gOnS-kiZhy6

Any idea on how to correct that ?

Thanks

Florent






More information about the Linux-PowerEdge mailing list