Database In Memory : RAC ORAchk 12.1.0.4

## orachk scans and validates across the varoius layers of stack, It helps us to reconfigure environment and finds out potential risks for RAC Environment. This can be configured in the way to send email notifications when it detect problems

[oracle@tnc1 utl]$ ./orachk

This version of orachk was released on 07-Feb-2016 and its older than 120 days. No new version of orachk is available in RAT_UPGRADE_LOC. It is highly recommended that you download the latest version of orachk from my oracle support to ensure the highest level of accuracy of the data contained within the report.

Do you want to download latest version from my oracle support? [y/n][y]n

Do you want to continue running this version? [y/n][y]y

Running older version...

CRS stack is running and CRS_HOME is not set. Do you want to set CRS_HOME to /u01/app/11.2.0.4/grid?[y/n][y]y

Checking ssh user equivalency settings on all nodes in cluster

Node tnc2 is configured for ssh user equivalency for oracle user

Searching for running databases . . . . .

List of running databases registered in OCR

1. mipd09

2. None of above

Select databases from list for checking best practices. For multiple databases, select 1 for All or comma separated number like 1,2 etc [1-2][1].1

. . . .

Checking Status of Oracle Software Stack - Clusterware, ASM, RDBMS

. . . . . . . . . . . . . . .. . . . . . . . . . . .. . . . . .

-------------------------------------------------------------------------------------------------------

Oracle Stack Status

-------------------------------------------------------------------------------------------------------

Host Name CRS Installed RDBMS Installed CRS UP ASM UP RDBMS UP DB Instance Name

-------------------------------------------------------------------------------------------------------

tnc1 Yes Yes Yes Yes Yes mipd091

tnc2 Yes Yes Yes Yes Yes mipd092

-------------------------------------------------------------------------------------------------------

Copying plug-ins

. . . . . . . . . .

172 of the included audit checks require root privileged data collection . If sudo is not configured or the root password is not available, audit checks which require root privileged data collection can be skipped.

1. Enter 1 if you will enter root password for each host when prompted

2. Enter 2 if you have sudo configured for oracle user to execute root_orachk.sh script

3. Enter 3 to skip the root privileged collections

4. Enter 4 to exit and work with the SA to configure sudo or to arrange for root access and run the tool later.

Please indicate your selection from one of the above options for root access[1-4][1]:- 1

*** Checking Best Practice Recommendations (PASS/WARNING/FAIL) ***

Collections and audit checks log file is

/u01/stage/utl/orachk_tnc1_mipd09_072516_215651/log/orachk.log

Running orachk in serial mode because expect(/usr/bin/expect) is not available to supply root passwords on remote nodes

NOTICE: Installing the expect utility (/usr/bin/expect) will allow orachk to gather root passwords at the beginning of the process and execute orachk on all nodes in parallel speeding up the entire process. For more info - http://www.nist.gov/el/msid/expect.cfm. Expect is available for all major platforms. See User Guide for more details.

Checking for prompts in /home/oracle/.bash_profile on tnc1 for oracle user...

Checking for prompts in /home/oracle/.bash_profile on tnc2 for oracle user...

. .

=======================================================

Node name - tnc1

=============================================================

. . . . .

Collecting - ASM Disk Groups

Collecting - ASM Disk I/O stats

Collecting - ASM Diskgroup Attributes

Collecting - ASM disk partnership imbalance

Collecting - ASM diskgroup attributes

Collecting - ASM diskgroup usable free space

Collecting - ASM initialization parameters

Collecting - Active sessions load balance for mipd09 database

Collecting - Archived Destination Status for mipd09 database

Collecting - Cluster Interconnect Config for mipd09 database

Collecting - Database Archive Destinations for mipd09 database

Collecting - Database Files for mipd09 database

Collecting - Database Instance Settings for mipd09 database

Collecting - Database Parameters for mipd09 database

Collecting - Database Properties for mipd09 database

Collecting - Database Registry for mipd09 database

Collecting - Database Sequences for mipd09 database

Collecting - Database Undocumented Parameters for mipd09 database

Collecting - Database Workload Services for mipd09 database

Collecting - Dataguard Status for mipd09 database

Collecting - Files not opened by ASM

Collecting - Log Sequence Numbers for mipd09 database

Collecting - Percentage of asm disk Imbalance

Collecting - Process for shipping Redo to standby for mipd09 database

Collecting - RDBMS Feature Usage for mipd09 database

Collecting - Redo Log information for mipd09 database

Collecting - Standby redo log creation status before switchover for mipd09 database

Collecting - /proc/cmdline

Collecting - /proc/modules

Collecting - CPU Information

Collecting - CRS active version

Collecting - CRS oifcfg

Collecting - CRS software version

Collecting - CSS Reboot time

Collecting - CSS disktimout

Collecting - Cluster interconnect (clusterware)

Collecting - Clusterware OCR healthcheck

Collecting - Clusterware Resource Status

Collecting - DiskFree Information

Collecting - DiskMount Information

Collecting - Huge pages configuration

Collecting - Interconnect network card speed

Collecting - Kernel parameters

Collecting - Linux module config.

Collecting - Maximum number of semaphore sets on system

Collecting - Maximum number of semaphores on system

Collecting - Maximum number of semaphores per semaphore set

Collecting - Memory Information

Collecting - NUMA Configuration

Collecting - Network Interface Configuration

Collecting - Network Performance

Collecting - Network Service Switch

Collecting - OS Packages

Collecting - OS version

Collecting - Operating system release information and kernel version

Collecting - Oracle Executable Attributes

Collecting - Patches for Grid Infrastructure

Collecting - Patches for RDBMS Home

Collecting - Shared memory segments

Collecting - Table of file system defaults

Collecting - Verify ioctl to advm [ACFS]

Collecting - Voting disks (clusterware)

Collecting - number of semaphore operations per semop system call

Preparing to run root privileged commands tnc1. Please enter root password when prompted.

root@tnc1's password:

Collecting - ACFS Volumes status

Collecting - ACFS and ASM driver version comparison [ACFS]

Collecting - Broadcast Requirements for Networks

Collecting - CRS Opatch version

Collecting - CRS user time zone check

Collecting - Custom rc init scripts (rc.local)

Collecting - Disk Information

Collecting - Generic ACFS health [ACFS]

Collecting - Grid Infastructure user shell limits configuration

Collecting - Health of the mounted ACFS file systems [ACFS]

Collecting - Health of unmounted ACFS file systems [ACFS]

Collecting - Interconnect interface config

Collecting - Network interface stats

Collecting - OCFS2 disks

/home/oracle/root_orachk.sh: line 80: /sbin/mounted.ocfs2: No such file or directory

Collecting - OLR Integrity

Collecting - Root user limits

Collecting - Verify no database server kernel out of memory errors

Collecting - Volume list for unmount ACFS file system [ACFS]

Collecting - ocsf status

/home/oracle/root_orachk.sh: line 105: /etc/init.d/o2cb: No such file or directory

Collecting - root time zone check

Collecting - slabinfo

Collecting - umask setting for GI owner

Data collections completed. Checking best practices on tnc1.

--------------------------------------------------------------------------------------

WARNING => Cluster Health Monitor (CHM) repository does not provide recommended level of retention

FAIL => Database DB_CREATE_FILE_DEST and DB_RECOVERY_FILE_DEST are NOT in different diskgroups for mipd09

INFO => Important Automatic Storage Management (ASM) Notes and Technical White Papers

INFO => Oracle Data Pump Best practices.

FAIL => Bash is vulnerable to code injection (CVE-2014-6271)

WARNING => os kernel version value not met the minimum requirement

WARNING => free physical memory is not at sufficient level on system

INFO => Important Storage Minimum Requirements for Grid & Database Homes

FAIL => DB_UNIQUE_NAME on primary has not been modified from the default, confirm that database name is unique across your Oracle enterprise. for mipd09

INFO => Most recent ADR incidents for /u01/app/oracle/product/11.2.0.4/db_1

WARNING => Consider unsetting database Parameter DB_FILE_MULTIBLOCK_READ_COUNT for mipd09

INFO => Direct NFS Client is NOT enabled for mipd09

INFO => Oracle GoldenGate failure prevention best practices

WARNING => Local archive destination does not alternate destination configured for mipd09

WARNING => OCR is NOT being backed up daily

WARNING => Package libaio-devel-0.3.106-x86_64 is recommended but NOT installed

WARNING => Package libaio-devel-0.3.106-3.2-i386 is recommended but NOT installed

WARNING => Package libaio-devel-0.3.106-3.2-x86_64 is recommended but NOT installed

WARNING => Package unixODBC-devel-2.2.11-x86_64 is recommended but NOT installed

WARNING => Package sysstat-7.0.2-x86_64 is recommended but NOT installed

INFO => Some data or temp files are not autoextensible for mipd09

INFO => oracleasm (asmlib) module is not loaded

INFO => Number of SCAN listeners is NOT equal to the recommended number of 3.

WARNING => OSWatcher is not running as is recommended.

INFO => Jumbo frames (MTU >= 9000) are not configured for interconnect

FAIL => Database parameter DB_BLOCK_CHECKSUM is NOT set to recommended value on mipd091 instance

FAIL => Database parameter DB_LOST_WRITE_PROTECT is NOT set to recommended value on mipd091 instance

WARNING => CSS log file size has not been increased from default (50 MB) .

WARNING => Database parameter DB_BLOCK_CHECKING on PRIMARY is NOT set to the recommended value. for mipd09

FAIL => Flashback on PRIMARY is not configured for mipd09

INFO => Operational Best Practices

INFO => Database Consolidation Best Practices

INFO => Computer failure prevention best practices

INFO => Data corruption prevention best practices

INFO => Logical corruption prevention best practices

INFO => Database/Cluster/Site failure prevention best practices

INFO => Client failover operational best practices

WARNING => fast_start_mttr_target should be greater than or equal to 300. on mipd091 instance

INFO => IMPORTANT: Oracle Database Patch 17478514 PSU is NOT applied to RDBMS Home /u01/app/oracle/product/11.2.0.4/db_1

INFO => Information about hanganalyze and systemstate dump

WARNING => Value of remote_listener parameter is not able to tnsping for mipd09

FAIL => Table AUD$[FGA_LOG$] should use Automatic Segment Space Management for mipd09

INFO => Database failure prevention best practices

FAIL => Primary database is NOT protected with Data Guard (standby database) for real-time data protection and availability for mipd09

WARNING => avahi-daemon process is running

WARNING => loopback address is NOT configured as recommended in /etc/hosts

INFO => Parallel Execution Health-Checks and Diagnostics Reports for mipd09

WARNING => vm.min_free_kbytes should be set as recommended.

WARNING => OS parameter vm.swappiness is NOT set to the recommended value

FAIL => control_file_record_keep_time is set to zero for mipd09

FAIL => FRA space management problem file types are present without an RMAN backup completion within the last 7 days. for mipd09

INFO => Oracle recovery manager(rman) best practices

WARNING => RMAN controlfile autobackup should be set to ON for mipd09

WARNING => Linux Disk I/O Scheduler should be configured to Deadline

INFO => Consider increasing the COREDUMPSIZE size

WARNING => Consider investigating changes to the schema objects such as DDLs or new object creation for mipd09

WARNING => Consider investigating the frequency of SGA resize operations and take corrective action for mipd09

Best Practice checking completed.Checking recommended patches on tnc1.

---------------------------------------------------------------------------------

Collecting patch inventory on CRS HOME /u01/app/11.2.0.4/grid

Collecting patch inventory on ORACLE_HOME /u01/app/oracle/product/11.2.0.4/db_1

---------------------------------------------------------------------------------

1 Recommended CRS patches for 112040 from /u01/app/11.2.0.4/grid on tnc1

---------------------------------------------------------------------------------

Patch# CRS ASM RDBMS RDBMS_HOME Patch-Description

---------------------------------------------------------------------------------

22191577 no no /u01/app/oracle/product/11.2.0.4/db_1GRID INFRASTRUCTURE PATCH SET UPDATE 11.2.0.4.160119 (JAN2016)

---------------------------------------------------------------------------------

1 Recommended RDBMS patches for 112040 from /u01/app/oracle/product/11.2.0.4/db_1 on tnc1

---------------------------------------------------------------------------------

Patch# RDBMS ASM type Patch-Description

---------------------------------------------------------------------------------

22191577 no merge GRID INFRASTRUCTURE PATCH SET UPDATE 11.2.0.4.160119 (JAN2016)

---------------------------------------------------------------------------------

Clusterware patches summary report

---------------------------------------------------------------------------------

Total patches Applied on CRS Applied on RDBMS Applied on ASM

---------------------------------------------------------------------------------

1 0 0 0

---------------------------------------------------------------------------------

RDBMS homes patches summary report

---------------------------------------------------------------------------------

Total patches Applied on RDBMS Applied on ASM ORACLE_HOME

---------------------------------------------------------------------------------

1 0 0 /u01/app/oracle/product/11.2.0.4/db_1

---------------------------------------------------------------------------------

=============================================================

Node name - tnc2

=============================================================

. . . . .

Collecting - /proc/cmdline

Collecting - /proc/modules

Collecting - CPU Information

Collecting - CRS active version

Collecting - CRS oifcfg

Collecting - CRS software version

Collecting - Cluster interconnect (clusterware)

Collecting - DiskFree Information

Collecting - DiskMount Information

Collecting - Huge pages configuration

Collecting - Interconnect network card speed

Collecting - Kernel parameters

Collecting - Linux module config.

Collecting - Maximum number of semaphore sets on system

Collecting - Maximum number of semaphores on system

Collecting - Maximum number of semaphores per semaphore set

Collecting - Memory Information

Collecting - NUMA Configuration

Collecting - Network Interface Configuration

Collecting - Network Performance

Collecting - Network Service Switch

Collecting - OS Packages

Collecting - OS version

Collecting - Operating system release information and kernel version

Collecting - Oracle Executable Attributes

Collecting - Patches for Grid Infrastructure

Collecting - Patches for RDBMS Home

Collecting - Shared memory segments

Collecting - Table of file system defaults

Collecting - Verify ioctl to advm [ACFS]

Collecting - number of semaphore operations per semop system call

Preparing to run root privileged commands tnc2. Please enter root password when prompted.

root@tnc2's password:

Collecting - ACFS Volumes status

Collecting - ACFS and ASM driver version comparison [ACFS]

Collecting - Broadcast Requirements for Networks

Collecting - CRS Opatch version

Collecting - CRS user time zone check

Collecting - Disk Information

Collecting - Generic ACFS health [ACFS]

Collecting - Grid Infastructure user shell limits configuration

Collecting - Health of the mounted ACFS file systems [ACFS]

Collecting - Health of unmounted ACFS file systems [ACFS]

Collecting - Interconnect interface config

Collecting - Network interface stats

Collecting - OCFS2 disks

/home/oracle/root_orachk.sh: line 75: /sbin/mounted.ocfs2: No such file or directory

Collecting - OLR Integrity

Collecting - Root user limits

Collecting - Verify no database server kernel out of memory errors

Collecting - Volume list for unmount ACFS file system [ACFS]

Collecting - ocsf status

/home/oracle/root_orachk.sh: line 100: /etc/init.d/o2cb: No such file or directory

Collecting - root time zone check

Collecting - slabinfo

Collecting - umask setting for GI owner

Data collections completed. Checking best practices on tnc2.

--------------------------------------------------------------------------------------

FAIL => Bash is vulnerable to code injection (CVE-2014-6271)

WARNING => system is not started with runlevel 3 or 5

WARNING => os kernel version value not met the minimum requirement

WARNING => free physical memory is not at sufficient level on system

INFO => Important Storage Minimum Requirements for Grid & Database Homes

FAIL => Hidden ASM initialization parameters should not be set per best practice recommendations

INFO => Hidden database initialization parameters should not be set per best practice recommendations for mipd09

INFO => Most recent ADR incidents for /u01/app/oracle/product/11.2.0.4/db_1

WARNING => Non-default database Services are not configured for mipd09

INFO => $CRS_HOME/log/hostname/client directory has too many older log files.

WARNING => The number of async IO descriptors is too low (/proc/sys/fs/aio-max-nr)

INFO => core_dump_dest has too many older core dump files for mipd09

WARNING => Package libaio-devel-0.3.106-x86_64 is recommended but NOT installed

WARNING => Package libaio-devel-0.3.106-3.2-i386 is recommended but NOT installed

WARNING => Package libaio-devel-0.3.106-3.2-x86_64 is recommended but NOT installed

WARNING => Package unixODBC-devel-2.2.11-x86_64 is recommended but NOT installed

WARNING => Package sysstat-7.0.2-x86_64 is recommended but NOT installed

INFO => oracleasm (asmlib) module is not loaded

WARNING => /tmp is not on a dedicated filesystem

WARNING => ACFS driver is not online[ACFS]

WARNING => Linux Swap Configuration does NOT meet Recommendation

WARNING => Free space in /tmp directory does NOT meet recommendation of minimum 1GB

WARNING => ACFS registry is not online [ACFS]

WARNING => kernel.shmmax parameter is NOT configured according to recommendation

WARNING => ip_local_port_range is NOT configured according to recommendation

INFO => Public interface is not configured in OCR

INFO => Number of SCAN listeners is NOT equal to the recommended number of 3.

WARNING => ASM shared_pool_size is < recommended value

WARNING => crsd Log Ownership is NOT Correct (should be root root)

WARNING => crsd/orarootagent_root Log Ownership is NOT Correct (should be root root)

WARNING => ohasd/orarootagent_root Log Ownership is NOT Correct (should be root root)

WARNING => ohasd Log Ownership is NOT Correct (should be root root)

WARNING => OSWatcher is not running as is recommended.

INFO => Jumbo frames (MTU >= 9000) are not configured for interconnect

FAIL => Database parameter DB_BLOCK_CHECKSUM is NOT set to recommended value on mipd092 instance

FAIL => Database parameter DB_LOST_WRITE_PROTECT is NOT set to recommended value on mipd092 instance

WARNING => fast_start_mttr_target should be greater than or equal to 300. on mipd092 instance

WARNING => Local listener init parameter is not set to local node VIP for mipd09

WARNING => Server-side TNSNAMES.ora alias resolves using SCAN EZ syntax for mipd09

WARNING => Remote listener is not set to SCAN name for mipd09

WARNING => avahi-daemon process is running

WARNING => Redo log write time is more than 500 milliseconds for mipd09

WARNING => loopback address is NOT configured as recommended in /etc/hosts

WARNING => TFA Collector is either not installed or not running

WARNING => System clock is not synchronized to hardware clock at system shutdown

WARNING => OS parameter vm.swappiness is NOT set to the recommended value

FAIL => ASM_DISKSTRING parameter is either null or set to /dev/*

WARNING => Linux Disk I/O Scheduler should be configured to Deadline

WARNING => ADVM Volume(s) should not be configured with redundancy as UNPROT when the underlying ASM Disk Group(s) have a redundancy of MIRROR or HIGH.

INFO => Consider increasing the COREDUMPSIZE size

FAIL => Online (hot) patches are applied to ORACLE_HOME. for mipd09

WARNING => ASM memory_target is not set to recommended value

Best Practice checking completed.Checking recommended patches on tnc2.

---------------------------------------------------------------------------------

Collecting patch inventory on CRS HOME /u01/app/11.2.0.4/grid

Collecting patch inventory on ORACLE_HOME /u01/app/oracle/product/11.2.0.4/db_1

---------------------------------------------------------------------------------

1 Recommended CRS patches for 112040 from /u01/app/11.2.0.4/grid on tnc2

---------------------------------------------------------------------------------

Patch# CRS ASM RDBMS RDBMS_HOME Patch-Description

---------------------------------------------------------------------------------

22191577 no no /u01/app/oracle/product/11.2.0.4/db_1GRID INFRASTRUCTURE PATCH SET UPDATE 11.2.0.4.160119 (JAN2016)

---------------------------------------------------------------------------------

1 Recommended RDBMS patches for 112040 from /u01/app/oracle/product/11.2.0.4/db_1 on tnc2

---------------------------------------------------------------------------------

Patch# RDBMS ASM type Patch-Description

---------------------------------------------------------------------------------

22191577 no merge GRID INFRASTRUCTURE PATCH SET UPDATE 11.2.0.4.160119 (JAN2016)

---------------------------------------------------------------------------------

Clusterware patches summary report

---------------------------------------------------------------------------------

Total patches Applied on CRS Applied on RDBMS Applied on ASM

---------------------------------------------------------------------------------

1 0 0 0

---------------------------------------------------------------------------------

RDBMS homes patches summary report

---------------------------------------------------------------------------------

Total patches Applied on RDBMS Applied on ASM ORACLE_HOME

---------------------------------------------------------------------------------

1 0 0 /u01/app/oracle/product/11.2.0.4/db_1

---------------------------------------------------------------------------------

CLUSTERWIDE CHECKS

---------------------------------------------------------------------------------

WARNING => DNS server config file does not match across database servers

WARNING => RDBMS software version does not match across cluster.

WARNI[oracle@tnc1 utl]$ ls -ltr

total 67680

-rw-r--r-- 1 oracle oinstall 2888 Feb 8 00:30 user_defined_checks.xsd

-rw-r--r-- 1 oracle oinstall 40052 Feb 8 00:30 sample_user_defined_checks.xml

-rwxr-xr-x 1 oracle oinstall 2653265 Feb 8 00:30 orachk

-rw-r--r-- 1 oracle oinstall 4690680 Feb 8 00:30 CollectionManager_App.sql

-rw-r--r-- 1 oracle oinstall 425 Feb 8 00:31 UserGuide.txt

-rw-r--r-- 1 oracle oinstall 3869 Feb 8 00:31 readme.txt

-rw-r--r-- 1 oracle oinstall 5613338 Feb 8 00:31 rules.dat

-rw-r--r-- 1 oracle oinstall 44243042 Feb 8 00:31 collections.dat

-rw-r--r-- 1 oracle oinstall 2077055 Feb 8 12:13 Audit_Checks_Report_Orachk.html

-rw-r--r-- 1 oracle oinstall 9860069 Jul 17 22:01 orachk.zip

[oracle@tnc1 utl]$

[oracle@tnc1 utl]$ ./orachk