SAN disks don't show up?

We have a Sun Ultra 20 running Solaris 10 x86 with a QLogic 2340 HBA in it that's attached to a QLogic SANbox switch with a number of JBOD drives on the far side. We can't seem to see the drives using the standard commands. Here's what we've done/seen:

-) We've done a reconfigure reboot (reboot -- -r).

-) The qlogic driver, qla2300, is loaded:

# modinfo | grep FC

89 ffffffffef8160009aa8-1 fctl (SunFC Transport v20050104-1.41)

134 ffffffffef974000 9d850 1801 qla2300 (QLogic FC Driver v4.18)

146 ffffffffefa170009670 791 fcip (SunFC FCIP v20050104-1.42)

147 fffffffffbbe905854b0 801 fcsm (Sun FC SAN Management v20050104)

-) We can run the QLogic command line tool, scli, and see the HBA and drives just fine.

-) When we run "prtconf -v" we can see the WWNs for the drives in the list of devices. So the machine could see them at one time.

-) In the directories /dev/fc and /dev/cfg we can see the paths to the HBA:

# ls -l /dev/fc /dev/cfg

/dev/cfg:

total 3

lrwxrwxrwx1 root58 Oct 21 09:23 c3 -> ../../devices/<a href="mailto:pci&#64;0" target="_blank">pci@0</a>,0/pci10de,<a href="mailto:5c&#64;9" target="_blank">5c@9</a>/pci1077,<a href="mailto:100&#64;9" target="_blank">100@9</a>/<a href="mailto:fp&#64;0" target="_blank">fp@0</a>,0:fc

drwxr-xr-x2 root 512 Oct 20 17:48 usb0/

drwxr-xr-x2 root 512 Oct 20 17:48 usb1/

/dev/fc:

total 1

lrwxrwxrwx1 root62 Oct 21 09:23 fp0 -> ../../devices/<a href="mailto:pci&#64;0" target="_blank">pci@0</a>,0/pci10de,<a href="mailto:5c&#64;9" target="_blank">5c@9</a>/pci1077,<a href="mailto:100&#64;9" target="_blank">100@9</a>/<a href="mailto:fp&#64;0" target="_blank">fp@0</a>,0:devctl

-) But we can't configure the drives with the cfgadm commands. cfgadm -al shows only the USB ports and nothing else. Other cfgadm commands return depressing results. For example:

# cfgadm -al -o show_SCSI_LUN

cfgadm: Configuration administration not supported

-) The luxadm commands don't seem to work either:

# luxadm probe

ERROR: No Fibre Channel Adapters found.

# luxadm -e dump_map /dev/cfg/c3

Error: Invalid pathname (/dev/cfg/c3)

-) The format command only sees the local drives, not the fibre attached ones.

What are we doing wrong? Is there some step to enable Solaris 10 to see the drives?

Thanks.

Karl

[2625 byte] By [pettyk] at [2007-11-25 23:00:49]
# 1

I don't think that reboot -- -r command works on Solaris x86, the -r switch is for telling obp boot command how to load the default device, Ultra 20 uses a BIOS and doesn't support this switch, as root do:

# touch /reconfigure

# reboot

With the luxadm and cfgadm commands you need to use the Sun FC SUNWqlc drivers, the Qlogic drivers are different.

mlennon at 2007-7-5 17:50:10 > top of Java-index,Storage Forums,Storage General Discussion...
# 2

Turns out it was something stupid that I forgot to run:

devfsadm -C

That fixed our problem. We can see all of the disks just fine now.

Thanks, m-lennon, for pointing out the issue with trying to use the luxadm and cfgadm commands with the qlogic versus sun FC drivers. I didn't know it made a difference. Thanks.

Karl

pettyk at 2007-7-5 17:50:10 > top of Java-index,Storage Forums,Storage General Discussion...