Friday, February 19, 2016

Oracle RAC Health Checks 12c

Checking number of Nodes in Cluster 
[root@tnc2 ~]# olsnodes -n -t
tnc1 1 Pinned
tnc2 2 Pinned

[oracle@tnc1 ~]$ grid_env
Checking CRS is running on nodes of cluster 
[oracle@tnc1 ~]$ crsctl check cluster -all
**************************************************************
tnc1:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
tnc2:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online

Checking Health of Votingfiles
[oracle@tnc1 ~]$ crsctl query css votedisk
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
 1. ONLINE   5698ff87d2b34fcbbfcd11d196502de2 (/dev/sdb1) [GRID]
 2. ONLINE   2e1aaeb02ef64fccbf68362031ad082c (/dev/sdc1) [GRID]
 3. ONLINE   9edd296a50024f46bf09deafe402a18e (/dev/sdd1) [GRID]

Checking Health of OCR Files
[root@tnc2 ~]# ocrcheck
Status of Oracle Cluster Registry is as follows :
Version                  :          4
Total space (kbytes)     :     409568
Used space (kbytes)      :       1676
Available space (kbytes) :     407892
ID                       :  143829273
Device/File Name         :      +GRID
                                    Device/File integrity check succeeded
                                    Device/File not configured
                                    Device/File not configured
                                    Device/File not configured
                                    Device/File not configured
Cluster registry integrity check succeeded
Logical corruption check succeeded

Location of OLR: Oracle Local Registry
[root@tnc2 ~]# ocrcheck -local
Status of Oracle Local Registry is as follows :
Version                  :          4
Total space (kbytes)     :     409568
Used space (kbytes)      :        976
Available space (kbytes) :     408592
ID                       : 1993164640
Device/File Name         : /u01/app/12.1.0.2/grid/cdata/tnc2.olr
                                    Device/File integrity check succeeded
Local registry integrity check succeeded
Logical corruption check succeeded

Status of resources running in a cluster
[root@tnc2 ~]# crsctl status resource -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details       
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.FRA.dg
               ONLINE  ONLINE       tnc1                     STABLE
               ONLINE  ONLINE       tnc2                     STABLE
ora.GRID.dg
               ONLINE  ONLINE       tnc1                     STABLE
               ONLINE  ONLINE       tnc2                     STABLE
ora.LISTENER.lsnr
               ONLINE  ONLINE       tnc1                     STABLE
               ONLINE  ONLINE       tnc2                     STABLE
ora.SDXH.dg
               ONLINE  ONLINE       tnc1                     STABLE
               ONLINE  ONLINE       tnc2                     STABLE
ora.asm
               ONLINE  ONLINE       tnc1                     Started,STABLE
               ONLINE  ONLINE       tnc2                     Started,STABLE
ora.net1.network
               ONLINE  ONLINE       tnc1                     STABLE
               ONLINE  ONLINE       tnc2                     STABLE
ora.ons
               ONLINE  ONLINE       tnc1                     STABLE
               ONLINE  ONLINE       tnc2                     STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       tnc1                     STABLE
ora.MGMTLSNR
      1        ONLINE  ONLINE       tnc1                     169.254.248.60 10.10
                                                             .10.180,STABLE
ora.cvu
      1        ONLINE  ONLINE       tnc1                     STABLE
ora.mgmtdb
      1        ONLINE  ONLINE       tnc1                     Open,STABLE
ora.oc4j
      1        ONLINE  ONLINE       tnc1                     STABLE
ora.p1tncd.db
      1        ONLINE  ONLINE       tnc2                     Open,STABLE
      2        ONLINE  ONLINE       tnc1                     Open,STABLE
ora.p1tncd.srvnsp.svc
      1        ONLINE  ONLINE       tnc1                     STABLE
      2        ONLINE  ONLINE       tnc2                     STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       tnc1                     STABLE
ora.tnc1.vip
      1        ONLINE  ONLINE       tnc1                     STABLE
ora.tnc2.vip
      1        ONLINE  ONLINE       tnc2                     STABLE
--------------------------------------------------------------------------------

check status of scan_listener
[root@tnc2 cdata]# srvctl status scan_listener
SCAN Listener LISTENER_SCAN1 is enabled
SCAN listener LISTENER_SCAN1 is running on node tnc1
[root@tnc2 cdata]# 

[root@tnc2 cdata]# srvctl config scan
SCAN name: tnc-scan.localdomain, Network: 1
Subnet IPv4: 192.168.1.0/255.255.255.0/eth0, static

Check Local Listener services 
[oracle@tnc2 cdata]# lsnrctl services  LISTENER
LSNRCTL for Linux: Version 12.1.0.2.0 - Production on 19-FEB-2016 16:55:45
Copyright (c) 1991, 2014, Oracle.  All rights reserved.
Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=IPC)(KEY=LISTENER)))
Services Summary...
Service "+ASM" has 1 instance(s).
  Instance "+ASM2", status READY, has 1 handler(s) for this service...
    Handler(s):
      "DEDICATED" established:0 refused:0 state:ready
         LOCAL SERVER
Service "cbn" has 1 instance(s).
  Instance "p1tncd2", status READY, has 1 handler(s) for this service...
    Handler(s):
      "DEDICATED" established:0 refused:0 state:ready
         LOCAL SERVER
Service "p1tncd" has 1 instance(s).
  Instance "p1tncd2", status READY, has 1 handler(s) for this service...
    Handler(s):
      "DEDICATED" established:0 refused:0 state:ready
         LOCAL SERVER
Service "p1tncdXDB" has 1 instance(s).
  Instance "p1tncd2", status READY, has 1 handler(s) for this service...
    Handler(s):
      "D000" established:0 refused:0 current:0 max:1022 state:ready
         DISPATCHER <machine: tnc2.localdomain, pid: 19320>
         (ADDRESS=(PROTOCOL=tcp)(HOST=tnc2.localdomain)(PORT=34347))
Service "srvnsp" has 1 instance(s).
  Instance "p1tncd2", status READY, has 1 handler(s) for this service...
    Handler(s):
      "DEDICATED" established:0 refused:0 state:ready
         LOCAL SERVER
The command completed successfully

--Nikhil Tatineni--
--12 RAC Cluster--

Querys to monitor RAC

following few  Query's will help to find out culprits-  Query to check long running transaction from last 8 hours  Col Sid Fo...