GRID Infrastructure Installation Failed with
[INS-41112] Specified network interface doesn't maintain connectivity across cluster nodes
#####
Running "runcluvfy" to check node connectivity
[oracle@tnc1 grid]$ ./runcluvfy.sh comp nodecon -n tnc1,tnc2 -verbose
Verifying node connectivity
Checking node connectivity...
Checking hosts config file...
Node Name Status
------------------------------------ ------------------------
tnc2 passed
tnc1 passed
Verification of the hosts config file successful
Interface information for node "tnc2"
Name IP Address Subnet Gateway Def. Gateway HW Address MTU
------ --------------- --------------- --------------- --------------- ----------------- ------
eth0 192.168.1.40 192.168.1.0 0.0.0.0 10.0.0.1 08:00:27:02:C7:6D 1500
eth1 10.10.10.190 10.10.10.0 0.0.0.0 10.0.0.1 08:00:27:21:C4:4E 1500
eth2 10.0.0.20 10.0.0.0 0.0.0.0 10.0.0.1 08:00:27:97:81:0F 1500
Interface information for node "tnc1"
Name IP Address Subnet Gateway Def. Gateway HW Address MTU
------ --------------- --------------- --------------- --------------- ----------------- ------
eth0 192.168.1.30 192.168.1.0 0.0.0.0 10.0.0.1 08:00:27:99:B2:23 1500
eth1 10.10.10.180 10.10.10.0 0.0.0.0 10.0.0.1 08:00:27:72:BD:E7 1500
eth2 10.0.0.21 10.0.0.0 0.0.0.0 10.0.0.1 08:00:27:23:03:AA 1500
Check: Node connectivity of subnet "192.168.1.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
tnc2[192.168.1.40] tnc1[192.168.1.30] yes
Result: Node connectivity passed for subnet "192.168.1.0" with node(s) tnc2,tnc1
Check: TCP connectivity of subnet "192.168.1.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
tnc1:192.168.1.30 tnc2:192.168.1.40 failed
ERROR:
PRVF-7617 : Node connectivity between "tnc1 : 192.168.1.30" and "tnc2 : 192.168.1.40" failed
Result: TCP connectivity check failed for subnet "192.168.1.0"
Check: Node connectivity of subnet "10.10.10.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
tnc2[10.10.10.190] tnc1[10.10.10.180] yes
Result: Node connectivity passed for subnet "10.10.10.0" with node(s) tnc2,tnc1
Check: TCP connectivity of subnet "10.10.10.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
tnc1:10.10.10.180 tnc2:10.10.10.190 failed
ERROR:
PRVF-7617 : Node connectivity between "tnc1 : 10.10.10.180" and "tnc2 : 10.10.10.190" failed
Result: TCP connectivity check failed for subnet "10.10.10.0"
Check: Node connectivity of subnet "10.0.0.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
tnc2[10.0.0.20] tnc1[10.0.0.21] yes
Result: Node connectivity passed for subnet "10.0.0.0" with node(s) tnc2,tnc1
Check: TCP connectivity of subnet "10.0.0.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
tnc1:10.0.0.21 tnc2:10.0.0.20 failed
ERROR:
PRVF-7617 : Node connectivity between "tnc1 : 10.0.0.21" and "tnc2 : 10.0.0.20" failed
Result: TCP connectivity check failed for subnet "10.0.0.0"
Interfaces found on subnet "10.0.0.0" that are likely candidates for VIP are:
tnc2 eth2:10.0.0.20
tnc1 eth2:10.0.0.21
WARNING:
Could not find a suitable set of interfaces for the private interconnect
Checking subnet mask consistency...
Subnet mask consistency check passed for subnet "192.168.1.0".
Subnet mask consistency check passed for subnet "10.10.10.0".
Subnet mask consistency check passed for subnet "10.0.0.0".
Subnet mask consistency check passed.
Result: Node connectivity check failed
Verification of node connectivity was unsuccessful.
Checks did not pass for the following node(s):
tnc1
###### Work Around: ##
After alot of investigation I found, Firewall is enabled on the Node's of the cluster
[root@tnc1 ~]# service iptables -help
Usage: iptables {start|stop|reload|restart|condrestart|status|panic|save}
[root@tnc1 ~]# service iptables status
Table: filter
Chain INPUT (policy ACCEPT)
num target prot opt source destination
1 ACCEPT all -- 0.0.0.0/0 0.0.0.0/0 state RELATED,ESTABLISHED
2 ACCEPT icmp -- 0.0.0.0/0 0.0.0.0/0
3 ACCEPT all -- 0.0.0.0/0 0.0.0.0/0
4 ACCEPT tcp -- 0.0.0.0/0 0.0.0.0/0 state NEW tcp dpt:22
5 REJECT all -- 0.0.0.0/0 0.0.0.0/0 reject-with icmp-host-prohibited
Chain FORWARD (policy ACCEPT)
num target prot opt source destination
1 REJECT all -- 0.0.0.0/0 0.0.0.0/0 reject-with icmp-host-prohibited
Chain OUTPUT (policy ACCEPT)
num target prot opt source destination
num target prot opt source destination
###
Disable Firewall as follows
[root@tnc1 ~]# service iptables stop
iptables: Setting chains to policy ACCEPT: filter [ OK ]
iptables: Flushing firewall rules: [ OK ]
iptables: Unloading modules: [ OK ]
[root@tnc1 ~]# chkconfig iptables off
[root@tnc1 ~]#
[root@tnc1 ~]# service iptables status
iptables: Firewall is not running.
###############
After ##
[oracle@tnc1 grid]$ ./runcluvfy.sh comp nodecon -n tnc1,tnc2 -verbose
Verifying node connectivity
Checking node connectivity...
Checking hosts config file...
Node Name Status
------------------------------------ ------------------------
tnc2 passed
tnc1 passed
Verification of the hosts config file successful
Interface information for node "tnc2"
Name IP Address Subnet Gateway Def. Gateway HW Address MTU
------ --------------- --------------- --------------- --------------- ----------------- ------
eth0 192.168.1.40 192.168.1.0 0.0.0.0 10.0.0.1 08:00:27:02:C7:6D 1500
eth1 10.10.10.190 10.10.10.0 0.0.0.0 10.0.0.1 08:00:27:21:C4:4E 1500
eth2 10.0.0.20 10.0.0.0 0.0.0.0 10.0.0.1 08:00:27:97:81:0F 1500
Interface information for node "tnc1"
Name IP Address Subnet Gateway Def. Gateway HW Address MTU
------ --------------- --------------- --------------- --------------- ----------------- ------
eth0 192.168.1.30 192.168.1.0 0.0.0.0 10.0.0.1 08:00:27:99:B2:23 1500
eth1 10.10.10.180 10.10.10.0 0.0.0.0 10.0.0.1 08:00:27:72:BD:E7 1500
eth2 10.0.0.21 10.0.0.0 0.0.0.0 10.0.0.1 08:00:27:23:03:AA 1500
Check: Node connectivity of subnet "192.168.1.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
tnc2[192.168.1.40] tnc1[192.168.1.30] yes
Result: Node connectivity passed for subnet "192.168.1.0" with node(s) tnc2,tnc1
Check: TCP connectivity of subnet "192.168.1.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
tnc1:192.168.1.30 tnc2:192.168.1.40 passed
Result: TCP connectivity check passed for subnet "192.168.1.0"
Check: Node connectivity of subnet "10.10.10.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
tnc2[10.10.10.190] tnc1[10.10.10.180] yes
Result: Node connectivity passed for subnet "10.10.10.0" with node(s) tnc2,tnc1
Check: TCP connectivity of subnet "10.10.10.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
tnc1:10.10.10.180 tnc2:10.10.10.190 passed
Result: TCP connectivity check passed for subnet "10.10.10.0"
Check: Node connectivity of subnet "10.0.0.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
tnc2[10.0.0.20] tnc1[10.0.0.21] yes
Result: Node connectivity passed for subnet "10.0.0.0" with node(s) tnc2,tnc1
Check: TCP connectivity of subnet "10.0.0.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
tnc1:10.0.0.21 tnc2:10.0.0.20 passed
Result: TCP connectivity check passed for subnet "10.0.0.0"
Interfaces found on subnet "10.0.0.0" that are likely candidates for VIP are:
tnc2 eth2:10.0.0.20
tnc1 eth2:10.0.0.21
Interfaces found on subnet "192.168.1.0" that are likely candidates for a private interconnect are:
tnc2 eth0:192.168.1.40
tnc1 eth0:192.168.1.30
Interfaces found on subnet "10.10.10.0" that are likely candidates for a private interconnect are:
tnc2 eth1:10.10.10.190
tnc1 eth1:10.10.10.180
Checking subnet mask consistency...
Subnet mask consistency check passed for subnet "192.168.1.0".
Subnet mask consistency check passed for subnet "10.10.10.0".
Subnet mask consistency check passed for subnet "10.0.0.0".
Subnet mask consistency check passed.
Result: Node connectivity check passed
Verification of node connectivity was successful.
### Issue is resolved ..
..Nikhil Tatineni--
--nikhiltatineni.dba@gmail.com--
