DID devices don't match

I installed a 5-node cluster, and my DID devices aren't all matching up correctly...particularly one node on d16 and then the 4 LUNs noted in bold at the bottom...

Exactly what does the cluster use to identify the same LUN across nodes?

tx2spfld80:/global/.devices/node@1/devices/pseudo# scdidadm -L

1tx2spfld80:/dev/rdsk/c0t0d0/dev/did/rdsk/d1

2tx2spfld80:/dev/rdsk/c0t1d0/dev/did/rdsk/d2

3tx2spfld80:/dev/rdsk/c0t2d0/dev/did/rdsk/d3

4tx2spfld80:/dev/rdsk/c0t3d0/dev/did/rdsk/d4

5tx2spfld80:/dev/rdsk/c1t0d0/dev/did/rdsk/d5

6tx2spfld80:/dev/rdsk/c4t5006016239A01064d0 /dev/did/rdsk/d6

6tx2spfld80:/dev/rdsk/c2t5006016039A01064d0 /dev/did/rdsk/d6

6tx2spfld80:/dev/rdsk/c2t5006016A39A01064d0 /dev/did/rdsk/d6

6tx2spfld80:/dev/rdsk/c4t5006016839A01064d0 /dev/did/rdsk/d6

7tx2spfld83:/dev/rdsk/c2t5006016A39A01015d0 /dev/did/rdsk/d7

.....

15tx2spfld83:/dev/rdsk/c4t5006016839A01064d2 /dev/did/rdsk/d15

15tx2spfld83:/dev/rdsk/c4t5006016239A01064d2 /dev/did/rdsk/d15

15tx2spfld83:/dev/rdsk/c2t5006016A39A01064d2 /dev/did/rdsk/d15

15tx2spfld83:/dev/rdsk/c2t5006016039A01064d2 /dev/did/rdsk/d15

15tx2spfld81:/dev/rdsk/c4t5006016839A01064d2 /dev/did/rdsk/d15

15tx2spfld81:/dev/rdsk/c4t5006016239A01064d2 /dev/did/rdsk/d15

15tx2spfld81:/dev/rdsk/c2t5006016A39A01064d2 /dev/did/rdsk/d15

15tx2spfld81:/dev/rdsk/c2t5006016039A01064d2 /dev/did/rdsk/d15

15tx2spfld80:/dev/rdsk/c2t5006016039A01064d6 /dev/did/rdsk/d15

15tx2spfld80:/dev/rdsk/c2t5006016A39A01064d6 /dev/did/rdsk/d15

15tx2spfld80:/dev/rdsk/c4t5006016239A01064d6 /dev/did/rdsk/d15

15tx2spfld80:/dev/rdsk/c4t5006016839A01064d6 /dev/did/rdsk/d15

15tx2spfld82:/dev/rdsk/c2t5006016039A01064d2 /dev/did/rdsk/d15

15tx2spfld82:/dev/rdsk/c2t5006016A39A01064d2 /dev/did/rdsk/d15

15tx2spfld82:/dev/rdsk/c4t5006016839A01064d2 /dev/did/rdsk/d15

15tx2spfld82:/dev/rdsk/c4t5006016239A01064d2 /dev/did/rdsk/d15

15tx2spfld84:/dev/rdsk/c4t5006016239A01064d2 /dev/did/rdsk/d15

15tx2spfld84:/dev/rdsk/c4t5006016839A01064d2 /dev/did/rdsk/d15

15tx2spfld84:/dev/rdsk/c2t5006016A39A01064d2 /dev/did/rdsk/d15

15tx2spfld84:/dev/rdsk/c2t5006016039A01064d2 /dev/did/rdsk/d15

16tx2spfld83:/dev/rdsk/c4t5006016839A01064d1 /dev/did/rdsk/d16

16tx2spfld83:/dev/rdsk/c4t5006016239A01064d1 /dev/did/rdsk/d16

16tx2spfld83:/dev/rdsk/c2t5006016A39A01064d1 /dev/did/rdsk/d16

16tx2spfld83:/dev/rdsk/c2t5006016039A01064d1 /dev/did/rdsk/d16

16tx2spfld81:/dev/rdsk/c4t5006016839A01064d1 /dev/did/rdsk/d16

16tx2spfld81:/dev/rdsk/c4t5006016239A01064d1 /dev/did/rdsk/d16

16tx2spfld81:/dev/rdsk/c2t5006016A39A01064d1 /dev/did/rdsk/d16

16tx2spfld81:/dev/rdsk/c2t5006016039A01064d1 /dev/did/rdsk/d16

16tx2spfld80:/dev/rdsk/c2t5006016039A01064d5 /dev/did/rdsk/d16

16tx2spfld80:/dev/rdsk/c2t5006016A39A01064d5 /dev/did/rdsk/d16

16tx2spfld80:/dev/rdsk/c4t5006016239A01064d5 /dev/did/rdsk/d16

16tx2spfld80:/dev/rdsk/c4t5006016839A01064d5 /dev/did/rdsk/d16

16tx2spfld82:/dev/rdsk/c2t5006016039A01064d1 /dev/did/rdsk/d16

16tx2spfld82:/dev/rdsk/c2t5006016A39A01064d1 /dev/did/rdsk/d16

16tx2spfld82:/dev/rdsk/c4t5006016839A01064d1 /dev/did/rdsk/d16

16tx2spfld82:/dev/rdsk/c4t5006016239A01064d1 /dev/did/rdsk/d16

16tx2spfld84:/dev/rdsk/c4t5006016239A01064d1 /dev/did/rdsk/d16

16tx2spfld84:/dev/rdsk/c4t5006016839A01064d1 /dev/did/rdsk/d16

16tx2spfld84:/dev/rdsk/c2t5006016A39A01064d1 /dev/did/rdsk/d16

16tx2spfld84:/dev/rdsk/c2t5006016039A01064d1 /dev/did/rdsk/d16

.....

20tx2spfld81:/dev/rdsk/c0t0d0/dev/did/rdsk/d20

21tx2spfld81:/dev/rdsk/c0t1d0/dev/did/rdsk/d21

22tx2spfld81:/dev/rdsk/c0t2d0/dev/did/rdsk/d22

23tx2spfld81:/dev/rdsk/c0t3d0/dev/did/rdsk/d23

24tx2spfld81:/dev/rdsk/c1t0d0/dev/did/rdsk/d24

25tx2spfld81:/dev/rdsk/c4t5006016839A01064d0 /dev/did/rdsk/d25

25tx2spfld81:/dev/rdsk/c2t5006016A39A01064d0 /dev/did/rdsk/d25

25tx2spfld81:/dev/rdsk/c2t5006016039A01064d0 /dev/did/rdsk/d25

25tx2spfld81:/dev/rdsk/c4t5006016239A01064d0 /dev/did/rdsk/d25

26tx2spfld82:/dev/rdsk/c0t0d0/dev/did/rdsk/d26

27tx2spfld82:/dev/rdsk/c0t1d0/dev/did/rdsk/d27

28tx2spfld82:/dev/rdsk/c0t2d0/dev/did/rdsk/d28

29tx2spfld82:/dev/rdsk/c0t3d0/dev/did/rdsk/d29

30tx2spfld82:/dev/rdsk/c1t0d0/dev/did/rdsk/d30

31tx2spfld82:/dev/rdsk/c4t5006016239A01064d0 /dev/did/rdsk/d31

31tx2spfld82:/dev/rdsk/c2t5006016039A01064d0 /dev/did/rdsk/d31

31tx2spfld82:/dev/rdsk/c2t5006016A39A01064d0 /dev/did/rdsk/d31

31tx2spfld82:/dev/rdsk/c4t5006016839A01064d0 /dev/did/rdsk/d31

32tx2spfld83:/dev/rdsk/c0t0d0/dev/did/rdsk/d32

33tx2spfld83:/dev/rdsk/c0t1d0/dev/did/rdsk/d33

34tx2spfld83:/dev/rdsk/c0t2d0/dev/did/rdsk/d34

35tx2spfld83:/dev/rdsk/c0t3d0/dev/did/rdsk/d35

36tx2spfld83:/dev/rdsk/c1t0d0/dev/did/rdsk/d36

37tx2spfld83:/dev/rdsk/c4t5006016839A01064d0 /dev/did/rdsk/d37

37tx2spfld83:/dev/rdsk/c2t5006016A39A01064d0 /dev/did/rdsk/d37

37tx2spfld83:/dev/rdsk/c2t5006016039A01064d0 /dev/did/rdsk/d37

37tx2spfld83:/dev/rdsk/c4t5006016239A01064d0 /dev/did/rdsk/d37

38tx2spfld84:/dev/rdsk/c0t0d0/dev/did/rdsk/d38

39tx2spfld84:/dev/rdsk/c0t1d0/dev/did/rdsk/d39

40tx2spfld84:/dev/rdsk/c0t2d0/dev/did/rdsk/d40

41tx2spfld84:/dev/rdsk/c0t3d0/dev/did/rdsk/d41

42tx2spfld84:/dev/rdsk/c1t0d0/dev/did/rdsk/d42

43tx2spfld84:/dev/rdsk/c4t5006016239A01064d0 /dev/did/rdsk/d43

43tx2spfld84:/dev/rdsk/c4t5006016839A01064d0 /dev/did/rdsk/d43

43tx2spfld84:/dev/rdsk/c2t5006016A39A01064d0 /dev/did/rdsk/d43

43tx2spfld84:/dev/rdsk/c2t5006016039A01064d0 /dev/did/rdsk/d43

[5903 byte] By [aliasroksa] at [2007-11-26 21:44:25]
# 1

Doesn't look like you've configured MPxIO properly. e.g.

6 tx2spfld80:/dev/rdsk/c4t5006016239A01064d0 /dev/did/rdsk/d6

6 tx2spfld80:/dev/rdsk/c2t5006016039A01064d0 /dev/did/rdsk/d6

6 tx2spfld80:/dev/rdsk/c2t5006016A39A01064d0 /dev/did/rdsk/d6

6 tx2spfld80:/dev/rdsk/c4t5006016839A01064d0 /dev/did/rdsk/d6

There should only be one entry for any one LUN per node.

I believe it uses some serial number information from the LUN that it obtains via a SCSI inquiry. I seem to remember there is a scdidadm command that will return this information.

Tim

Tim.Reada at 2007-7-10 3:32:11 > top of Java-index,Solaris Operating System,Solaris Essentials - General Technical Questions...
# 2
I'm using EMC storage and PowerPath, so MPxIO isn't configured....
aliasroksa at 2007-7-10 3:32:11 > top of Java-index,Solaris Operating System,Solaris Essentials - General Technical Questions...
# 3

Ah, well unfortunately, I don't know anything about PP. I'm surprised it presents multiple (visible) paths to storage. You'll need to check with EMC about how this is suppose to be set up. Bear in mind to, that it appears that the minimum supported version is PP v4.3.

(Just curious) Apart from probably having paid for the PP license, was there any particular reason you chose that configuration and not MPxIO?

Tim

Tim.Reada at 2007-7-10 3:32:11 > top of Java-index,Solaris Operating System,Solaris Essentials - General Technical Questions...
# 4
It's a standard storage policy within our organization.I have a two node cluster that didn't have this problem...and it uses PP...very weird...
aliasroksa at 2007-7-10 3:32:11 > top of Java-index,Solaris Operating System,Solaris Essentials - General Technical Questions...