The wrong netmask was given for LogicalHostname resource.

We are running Sun Cluster Server 3.0 on Solaris 8. We have experienced the problems when switching between both machines. The /etc/netmasks has been setup properly and we have three resource groups configured on this cluster.

Some logical hostname are working fine except that two logical hostname are always using class A's netmask instead of classless netmask.

Does anyone know how to fix this problem?

Jeff

[439 byte] By [Jeff_C] at [2007-11-26 10:26:11]
# 1

To ask the obvious: What is different about the LogicalHostname which has the

right netmask? Perhaps that is correlated to the netmask on the *physical* interface?

If there is nothing obvious, post the full ifconfig -a and /etc/netmasks on all your cluster

nodes. Perhaps someone can figure out the problem.

-ashu

ashu15 at 2007-7-7 2:29:33 > top of Java-index,Solaris Operating System,Solaris Essentials - General Technical Questions...
# 2

Running ifconfig -a on both services

balrog#ifconfig -a

lo0: flags=1000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4> mtu 8232 index 1

inet 127.0.0.1 netmask ff000000

lo0:1: flags=1008849<UP,LOOPBACK,RUNNING,MULTICAST,PRIVATE,IPv4> mtu 8232 index 1inet 172.16.193.1 netmask ffffffff

bge0: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 2

inet 147.132.179.30 netmask ffffff80 broadcast 147.132.179.127

ether 0:3:ba:c1:d:d9

bge0:2: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 2

inet 147.132.179.27 netmask ffffff80 broadcast 147.132.179.127

bge1: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 3

inet 147.132.114.150 netmask ffffff80 broadcast 147.132.114.255

ether 0:3:ba:c1:d:d9

bge1:2: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 3

inet 147.132.114.147 netmask ffffff80 broadcast 147.132.114.255

bge3: flags=1008843<UP,BROADCAST,RUNNING,MULTICAST,PRIVATE,IPv4> mtu 1500 index 4inet 172.16.0.129 netmask ffffff80 broadcast 172.16.0.255

ether 0:3:ba:c1:d:d9

bge3:2: flags=1008843<UP,BROADCAST,RUNNING,MULTICAST,PRIVATE,IPv4> mtu 1500 index 4

inet 172.16.194.6 netmask fffffffc broadcast 172.16.194.7

bge2: flags=1008843<UP,BROADCAST,RUNNING,MULTICAST,PRIVATE,IPv4> mtu 1500 index 5inet 172.16.1.1 netmask ffffff80 broadcast 172.16.1.127

ether 0:3:ba:c1:d:d9

alice#ifconfig -a

lo0: flags=1000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4> mtu 8232 index 1

inet 127.0.0.1 netmask ff000000

lo0:1: flags=1008849<UP,LOOPBACK,RUNNING,MULTICAST,PRIVATE,IPv4> mtu 8232 index 1inet 172.16.193.2 netmask ffffffff

bge0: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 2

inet 147.132.179.42 netmask ffffff80 broadcast 147.132.179.127

ether 0:3:ba:c0:59:4d

bge0:1: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 2

inet 147.132.179.13 netmask ffff0000 broadcast 147.132.255.255

bge1: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 3

inet 147.132.114.162 netmask ffffff80 broadcast 147.132.114.255

ether 0:3:ba:c0:59:4d

bge1:1: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 3

inet 147.132.114.196 netmask ffff0000 broadcast 147.132.255.255

bge3: flags=1008843<UP,BROADCAST,RUNNING,MULTICAST,PRIVATE,IPv4> mtu 1500 index 4inet 172.16.0.130 netmask ffffff80 broadcast 172.16.0.255

ether 0:3:ba:c0:59:4d

bge3:1: flags=1008843<UP,BROADCAST,RUNNING,MULTICAST,PRIVATE,IPv4> mtu 1500 index 4

inet 172.16.194.5 netmask fffffffc broadcast 172.16.194.7

bge2: flags=1008843<UP,BROADCAST,RUNNING,MULTICAST,PRIVATE,IPv4> mtu 1500 index 5inet 172.16.1.2 netmask ffffff80 broadcast 172.16.1.127

ether 0:3:ba:c0:59:4d

With /etc/netmasks, both are same as below:

root # cat /etc/netmasks

#

# The netmasks file associates Internet Protocol (IP) address

# masks with IP network numbers.

#

#network-number netmask

#

# The term network-number refers to a number obtained from the Internet Network

# Information Center. Currently this number is restricted to being a class

# A, B, or C network number. In the future we should be able to support

# arbitrary network numbers per the Classless Internet Domain Routing

# guidelines.

#

# Both the network-number and the netmasks are specified in

# "decimal dot" notation, e.g:

#

#128.32.0.0 255.255.255.0

#

147.132.0.0255.255.255.128

I think both servers have the unique netmask for 147.132.0.0 networks.

However, when cluster servers created logical interfaces such as bge1:2 , bge0:2, it always considers it as a class B network -255.255.0.0.

BTW, for balrog, I have to update it using ifconfig so it looks fine. In fact, whenever we swap nodes, we are always having this problem.

Jeff

Jeff_C at 2007-7-7 2:29:33 > top of Java-index,Solaris Operating System,Solaris Essentials - General Technical Questions...
# 3

I wouldn't say I'm a networking expert, but the subnets/netmasks look wrong to me.

You have one subnet 147.132.179.0/4 (147.132.179.0 - 147.132.179.127) and another 147.132.114.128/4 (147.132.114.128 - 147.132.114.255). Therefore the netmasks should be:

147.132.179.0 255.255.255.128

147.132.114.128 255.255.255.128

I think.

Tim

TimRead at 2007-7-7 2:29:33 > top of Java-index,Solaris Operating System,Solaris Essentials - General Technical Questions...
# 4
That's problem while we are having. Once we switched cluster group each time, I have to manually update the netmask to 255.255.255.128. I looked into the Sun cluster server manual. Unfortunately, I cannot find any docs related to submask setting.
Jeff_C at 2007-7-7 2:29:33 > top of Java-index,Solaris Operating System,Solaris Essentials - General Technical Questions...
# 5
But are those entries in /etc/netmasks on both cluster nodes? Are your nsswitch.conf files set up for files for netmasks on both nodes?Tim
TimRead at 2007-7-7 2:29:33 > top of Java-index,Solaris Operating System,Solaris Essentials - General Technical Questions...
# 6

I found one point would be problem from the following line of /etc/nsswitch.conf.

cat /etc/nsswitch.conf

netmasks:cluster [ NOTFOUND=return] files

I am just wondering where I can find out the netmasks from cluster settings. From the current configuration, it is definitely using cluster instead of files. That is, the /etc/netmasks file cannot be referenced.

Tim, any ideas?

Regards

Jeff.

Jeff_C at 2007-7-7 2:29:33 > top of Java-index,Solaris Operating System,Solaris Essentials - General Technical Questions...
# 7
No that doesn't sound right. You want:netmasks: cluster files [ NOTFOUND=return]
TimRead at 2007-7-7 2:29:33 > top of Java-index,Solaris Operating System,Solaris Essentials - General Technical Questions...
# 8
Can I change it intonetmask: files?
Jeff_C at 2007-7-7 2:29:33 > top of Java-index,Solaris Operating System,Solaris Essentials - General Technical Questions...
# 9
No, it needs to stay as cluster files.Tim
TimRead at 2007-7-7 2:29:33 > top of Java-index,Solaris Operating System,Solaris Essentials - General Technical Questions...
# 10
Tim,Where can I find out the settting of netmask in the cluster? It should exist somewhere, shouldn't it? If this setting is incorrect, can I correct it?Thanks
Jeff_C at 2007-7-7 2:29:33 > top of Java-index,Solaris Operating System,Solaris Essentials - General Technical Questions...
# 11

You mean from the entry in netmasks, as in 'cluster files'?

If so, I think it comes from the CCR and is only internal cluster objects (AFAIK). I think it is a guarantee that the framework gets the information it needs.

In short, you can't change it.

Regards,

Tim

Message was edited by:

Tim.Read

TimRead at 2007-7-7 2:29:33 > top of Java-index,Solaris Operating System,Solaris Essentials - General Technical Questions...