HAStorage Plus Problem / can only mount on one cluster node
I have a problem while adding a HAStoragePlus resource to a resource group:
root@mynodez:/var/adm # scrgadm -a -j news_staging_storage -g news_staging_rg \
> -t SUNW.HAStoragePlus -x FilesystemMountpoints=/shares/zones/news_staging \
> -x AffinityOn=true
mynodep - Failed to analyze the device special file associated with file system mount point /shares/zones/news_staging: No such file or directory.
VALIDATE on resource news_staging_storage, resource group news_staging_rg, exited with non-zero exit status.
Validation of resource news_staging_storage in resource group news_staging_rg on node mynodep failed.
root@mynodez:/var/adm #
I tried to mount this filesystem manualy, it works on this node, but not on the other
cluster node (I have switched the sharede storage to the other node before tryinig it ;-) )
I did not find any differences on this two nodes except the failing mount on one of them.
root@mynodep:~ # mount /shares/zones/news_staging
mount: /dev/md/news_stagingds/dsk/d100 or /shares/zones/news_staging, no such file or directory
root@mynodep:~ # ls -l /shares/zones/news_staging
total 0
root@mynodep:~ # ls -l /dev/md/news_stagingds/dsk/d100
lrwxrwxrwx1 rootroot 44 Oct 20 15:09 /dev/md/news_stagingds/dsk/d100 -> ../../../../../devices/pseudo/md@0:1,100,blk
root@mynodep:~ # grep news /etc/vfstab
/dev/md/news_stagingds/dsk/d100 /dev/md/news_stagingds/rdsk/d100 /shares/zones/news_staging ufs2no logging
root@mynodep:~ # metaset
Set name = news_stagingds, Set number = 1
HostOwner
mynodepYes
mynodez
Mediator Host(s)Aliases
mynodep
mynodez
Drive Dbase
d5Yes
d10Yes
root@mynodep:~ # scstat -D
-- Device Group Servers --
Device GroupPrimary Secondary
-
Device group servers: news_stagingdsmynodep mynodez
-- Device Group Status --
Device GroupStatus
Device group status:news_stagingdsOnline
-- Multi-owner Device Groups --
Device GroupOnline Status
-
root@mynodep:~ #
Any Idea what's wrong here. I have currently a missconfigured interconnect, both are in the same VLAN, but I
assume this should not be the reason for this behaviour as I am able to switch the shared storage from one node to the other.
Fritz
[2471 byte] By [
Tom_Tiger] at [2007-11-26 10:58:20]
# 4
I have an error in /var/adm/messages on the node wher I could, and still can not mount the filesystem:
Oct 23 16:16:07 mynodep Cluster.CCR: [ID 404526 daemon.error] scgdevs: Filesystem /global/.devices/node@1 is not available in /etc/mnttab.
Oct 23 16:16:54 mynodep Cluster.Framework: [ID 801593 daemon.notice] stdout: obtaining access to all attached disks
Oct 23 16:17:10 mynodep Cluster.CCR: [ID 674994 daemon.error] /usr/cluster/bin/scgdevs: Filesystem /global/.devices/node@1 is not available in /etc/mnttab.
this is the log from the failing node
root@mynodep:~ # devfsadm -Cv
devfsadm[29819]: verbose: removing file: /dev/md/shared/1/dsk/d21
devfsadm[29819]: verbose: removing file: /dev/md/shared/1/dsk/d22
devfsadm[29819]: verbose: removing file: /dev/md/shared/1/dsk/d20
devfsadm[29819]: verbose: removing file: /dev/md/shared/1/rdsk/d21
devfsadm[29819]: verbose: removing file: /dev/md/shared/1/rdsk/d22
devfsadm[29819]: verbose: removing file: /dev/md/shared/1/rdsk/d20
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d4s0
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d4s1
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d4s2
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d4s3
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d4s4
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d4s5
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d4s6
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d4s7
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d3s0
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d3s1
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d3s2
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d3s3
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d3s4
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d3s5
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d3s6
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d3s7
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d2s0
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d2s1
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d2s2
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d2s3
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d2s4
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d2s5
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d2s6
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d2s7
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d1s0
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d1s1
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d1s2
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d1s3
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d1s4
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d1s5
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d1s6
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d1s7
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d0s0
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d0s1
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d0s2
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d0s3
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d0s4
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d0s5
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d0s6
devfsadm[29819]: verbose: removing file: /dev/dsk/c2t50060E80042B0701d0s7
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d4s0
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d4s1
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d4s2
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d4s3
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d4s4
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d4s5
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d4s6
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d4s7
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d3s0
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d3s1
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d3s2
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d3s3
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d3s4
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d3s5
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d3s6
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d3s7
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d2s0
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d2s1
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d2s2
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d2s3
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d2s4
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d2s5
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d2s6
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d2s7
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d1s0
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d1s1
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d1s2
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d1s3
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d1s4
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d1s5
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d1s6
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d1s7
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d0s0
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d0s1
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d0s2
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d0s3
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d0s4
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d0s5
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d0s6
devfsadm[29819]: verbose: removing file: /dev/dsk/c3t50060E80042B0711d0s7
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d4s0
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d4s1
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d4s2
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d4s3
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d4s4
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d4s5
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d4s6
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d4s7
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d3s0
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d3s1
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d3s2
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d3s3
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d3s4
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d3s5
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d3s6
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d3s7
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d2s0
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d2s1
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d2s2
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d2s3
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d2s4
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d2s5
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d2s6
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d2s7
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d1s0
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d1s1
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d1s2
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d1s3
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d1s4
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d1s5
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d1s6
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d1s7
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d0s0
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d0s1
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d0s2
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d0s3
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d0s4
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d0s5
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d0s6
devfsadm[29819]: verbose: removing file: /dev/rdsk/c2t50060E80042B0701d0s7
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d4s0
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d4s1
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d4s2
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d4s3
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d4s4
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d4s5
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d4s6
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d4s7
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d3s0
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d3s1
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d3s2
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d3s3
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d3s4
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d3s5
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d3s6
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d3s7
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d2s0
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d2s1
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d2s2
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d2s3
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d2s4
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d2s5
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d2s6
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d2s7
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d1s0
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d1s1
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d1s2
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d1s3
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d1s4
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d1s5
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d1s6
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d1s7
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d0s0
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d0s1
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d0s2
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d0s3
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d0s4
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d0s5
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d0s6
devfsadm[29819]: verbose: removing file: /dev/rdsk/c3t50060E80042B0711d0s7
root@mynodep:~ # scdidadm -C
root@mynodep:~ # scdidadm -cr
root@mynodep:~ # scgdevs
root@mynodep:~ # scstat -D
-- Device Group Servers --
Device GroupPrimary Secondary
-
Device group servers: news_stagingdsmynodep mynodez
-- Device Group Status --
Device GroupStatus
Device group status:news_stagingdsOnline
-- Multi-owner Device Groups --
Device GroupOnline Status
-
root@mynodep:~ # !mou
mount /shares/zones/news_staging
mount: /dev/md/news_stagingds/dsk/d100 or /shares/zones/news_staging, no such file or directory
root@mynodep:~ #
root@mynodep:~ # tail /var/adm/messages
Oct 23 16:15:57 mynodep Cluster.Framework: [ID 801593 daemon.notice] stdout: obtaining access to all attached disks
Oct 23 16:16:07 mynodep Cluster.CCR: [ID 404526 daemon.error] scgdevs: Filesystem /global/.devices/node@1 is not available in /etc/mnttab.
Oct 23 16:16:54 mynodep Cluster.Framework: [ID 801593 daemon.notice] stdout: obtaining access to all attached disks
Oct 23 16:17:10 mynodep Cluster.CCR: [ID 674994 daemon.error] /usr/cluster/bin/scgdevs: Filesystem /global/.devices/node@1 is not available in /etc/mnttab.
root@mynodep:~ #
on the other node I have jsut the following entries in /var/adm/messages
Oct 23 16:15:58 mynodez Cluster.Framework: [ID 801593 daemon.notice] stdout: obtaining access to all attached disks
Oct 23 16:16:13 mynodez ip: [ID 903730 kern.warning] WARNING: IP: Hardware address '00:00:00:00:00:02' trying to be our address 172.016.193.002!
Oct 23 16:16:54 mynodez Cluster.Framework: [ID 801593 daemon.notice] stdout: obtaining access to all attached disks
Oct 23 16:17:05 mynodez Cluster.devices.did: [ID 580048 daemon.notice] Could not open /dev/rdsk/c1t0d0s2 to verify device id.
Oct 23 16:17:05 mynodez Cluster.devices.did: [ID 370357 daemon.notice] Device busy
Oct 23 16:17:10 mynodez Cluster.devices.did: [ID 466922 daemon.notice] obtaining access to all attached disks
root@mynodez:~ #
