mountgfsys service is offline after node reboot
In a lab cluster I restarted a node that is attached to a SCSI RAID (using 'reboot' command). After it came back up the cluster file system is not visible and mountgfsys service is in offline state and stuck in start method? What could be wrong?
# svcs -xv
svc:/system/cluster/mountgfsys:default (Suncluster mountgfsys service)
State: offline since Wed 04 Apr 2007 01:36:11 PM EDT
Reason: Start method is running.
See: http://sun.com/msg/SMF-8000-C4
See: /var/svc/log/system-cluster-mountgfsys:default.log
Impact: 18 dependent services are not running:
svc:/system/cluster/clusterdata:default
svc:/system/cluster/cl-svc-enable:default
svc:/system/cluster/spm:default
svc:/system/cluster/cl-svc-cluster-milestone:default
svc:/system/cluster/scdpm:default
svc:/system/cluster/rpc-pmf:default
svc:/system/cluster/rgm:default
svc:/system/cluster/scsymon-srv:default
svc:/application/management/cacao:default
svc:/system/cluster/rpc-fed:default
svc:/system/cluster/pnm:default
svc:/system/cluster/cl-event:default
svc:/system/cluster/cl-eventlog:default
svc:/system/cluster/cl-ccra:default
svc:/milestone/multi-user-server:default
svc:/system/zones:default
svc:/system/cluster/gdevsync:default
svc:/milestone/multi-user:default
# cat /var/svc/log/system-cluster-mountgfsys:default.log
[ Feb 23 15:29:03 Disabled. ]
[ Feb 23 15:29:03 Rereading configuration. ]
[ Feb 23 15:56:44 Rereading configuration. ]
[ Feb 23 15:56:55 Enabled. ]
[ Feb 23 15:57:23 Executing start method ("/usr/cluster/lib/svc/method/MOUNTGFSYS start") ]
[ Feb 23 15:57:25 Method "start" exited with status 0 ]
[ Feb 26 10:53:40 Executing start method ("/usr/cluster/lib/svc/method/MOUNTGFSYS start") ]
[ Feb 26 10:53:44 Method "start" exited with status 0 ]
[ Feb 27 13:00:16 Stopping because service disabled. ]
[ Feb 27 13:00:16 Executing stop method ("/usr/cluster/lib/svc/method/MOUNTGFSYS stop") ]
[ Feb 27 13:00:16 Method "stop" exited with status 0 ]
[ Feb 27 13:03:16 Executing start method ("/usr/cluster/lib/svc/method/MOUNTGFSYS start") ]
[ Feb 27 13:03:18 Method "start" exited with status 0 ]
[ Feb 28 13:40:29 Executing start method ("/usr/cluster/lib/svc/method/MOUNTGFSYS start") ]
[ Feb 28 13:40:31 Method "start" exited with status 0 ]
[ Mar 1 12:04:25 Executing start method ("/usr/cluster/lib/svc/method/MOUNTGFSYS start") ]
[ Mar 1 12:04:27 Method "start" exited with status 0 ]
[ Mar 1 13:38:19 Stopping because service disabled. ]
[ Mar 1 13:38:19 Executing stop method ("/usr/cluster/lib/svc/method/MOUNTGFSYS stop") ]
[ Mar 1 13:38:19 Method "stop" exited with status 0 ]
[ Mar 1 13:41:34 Executing start method ("/usr/cluster/lib/svc/method/MOUNTGFSYS start") ]
[ Mar 1 13:41:37 Method "start" exited with status 0 ]
[ Apr 2 12:13:37 Stopping because service disabled. ]
[ Apr 2 12:13:37 Executing stop method ("/usr/cluster/lib/svc/method/MOUNTGFSYS stop") ]
[ Apr 2 12:13:37 Method "stop" exited with status 0 ]
[ Apr 2 13:04:36 Executing start method ("/usr/cluster/lib/svc/method/MOUNTGFSYS start") ]
[ Apr 2 13:04:38 Method "start" exited with status 0 ]
[ Apr 2 13:14:02 Stopping because service disabled. ]
[ Apr 2 13:14:02 Executing stop method ("/usr/cluster/lib/svc/method/MOUNTGFSYS stop") ]
[ Apr 2 13:14:02 Method "stop" exited with status 0 ]
[ Apr 2 13:18:48 Executing start method ("/usr/cluster/lib/svc/method/MOUNTGFSYS start") ]
[ Apr 2 13:18:51 Method "start" exited with status 0 ]
[ Apr 4 13:36:11 Executing start method ("/usr/cluster/lib/svc/method/MOUNTGFSYS start") ]
# ptree root
8/lib/svc/bin/svc.startd
293/bin/sh /usr/cluster/lib/svc/method/MOUNTGFSYS start
374/usr/cluster/lib/sc/clconfig -g
330/usr/lib/saf/sac -t 300
341/usr/lib/saf/ttymon
1792 /usr/lib/saf/ttymon -g -d /dev/console -l console -T sun -m ldterm,ttcompat -h
10/lib/svc/bin/svc.configd
115/usr/lib/sysevent/syseventd
129/usr/lib/picl/picld
131/usr/sbin/nscd
165/usr/lib/inet/in.mpathd -a
172/usr/lib/snmp/snmpdx -y -c /etc/snmp/conf
181/usr/sfw/sbin/snmpd
219devfsadmd
221/usr/lib/inet/xntpd
226/usr/cluster/lib/sc/qd_userd
248/usr/cluster/lib/sc/failfastd
251/usr/cluster/lib/sc/clexecd
252/usr/cluster/lib/sc/clexecd
294/usr/sbin/cron
327/usr/lib/dmi/dmispd
# pstack 374
374:/usr/cluster/lib/sc/clconfig -g
00000000 ? (0, 0, 0, 0, 0, 0)
