Friday, March 4, 2016

GoldenGate ERROR OGG-01224

Found All ogg process are abended on Goldengate Home
started the manager and again it is abended 
View report file of the mgr

GGSCI (tnc1.localdomain) 4> info all
Program     Status      Group       Lag at Chkpt  Time Since Chkpt
MANAGER     STOPPED                                           
EXTRACT     ABENDED     ECBN        00:00:09      00:32:52    
REPLICAT    ABENDED     RCBN        00:00:00      00:50:36    

GGSCI (tnc1.localdomain) 19> view report mgr
***********************************************************************
                 Oracle GoldenGate Manager for Oracle
      Version 12.2.0.1.1 OGGCORE_12.2.0.1.0_PLATFORMS_151211.1401
   Linux, x64, 64bit (optimized), Oracle 12c on Dec 11 2015 16:10:04
2016-03-04 10:43:08  WARNING OGG-01877  Missing explicit accessrule for server collector.
2016-03-04 10:43:08  INFO    OGG-00960  Access granted (rule #5).
Source Context :
  SourceModule            : [mgr.main]
  SourceID                : [/scratch/aime/adestore/views/aime_adc4150408/oggcore/OpenSys/src/app/mgr/mgr.c]
  SourceFunction          : [init_functions]
  SourceLine              : [1600]
  ThreadBacktrace         : [12] elements
                          : [/u02/goldengate/12.1/libgglog.so(CMessageContext::AddThreadContext()+0x1b) [0x2b54d81560
bb]]
                          : [/u02/goldengate/12.1/libgglog.so(CMessageFactory::CreateMessage(CSourceContext*, unsigne
d int, ...)+0x134) [0x2b54d8150254]]
                          : [/u02/goldengate/12.1/libgglog.so(_MSG_ERR_TCP_GENERIC(CSourceContext*, char const*, CMes
sageFactory::MessageDisposition)+0x30) [0x2b54d81327b7]]
                          : [./mgr(init_functions(int, char**)+0xa51) [0x5dd101]]
                          : [./mgr(main_loop(int, char**)+0x33) [0x5dfb63]]
                          : [./mgr [0x5e0043]]
                          : [./mgr(ggs::gglib::MultiThreading::MainThread::ExecMain()+0x66) [0x53a386]]
                          : [./mgr(ggs::gglib::MultiThreading::Thread::RunThread(ggs::gglib::MultiThreading::Thread::
ThreadArgs*)+0x147) [0x53e757]]
                          : [./mgr(ggs::gglib::MultiThreading::MainThread::Run(int, char**)+0x12d) [0x53ed6d]]
                          : [./mgr(main+0x3b) [0x5e06cb]]
                          : [/lib64/libc.so.6(__libc_start_main+0xf4) [0x3aeee1d994]]
                          : [./mgr(__gxx_personality_v0+0x389) [0x4d0e89]]
2016-03-04 10:43:08  ERROR   OGG-01224  Address already in use.
2016-03-04 10:43:08  ERROR   OGG-01668  PROCESS ABENDING.

Manager is abended with ERROR OGG-01224

Analysis: 
some other process is holding the manager and its port number

[root@tnc1 ~]# ps -ef | grep mgr
root     12049 11901  0 10:45 pts/2    00:00:00 grep mgr
oracle   25378     1  0 09:57 ?        00:00:01 ./mgr PARAMFILE /u02/goldengate/12.1/dirprm/mgr.prm REPORTFILE /u02/goldengate/12.1/dirrpt/MGR.rpt PROCESSID MGR USESUBDIRS

[root@tnc1 ~]# netstat -nap | grep 7809
tcp        0      0 0.0.0.0:7809                0.0.0.0:*                   LISTEN      25378/./mgr         

Resolution: 
Killed the manager and restarted abended Extract process 

[root@tnc1 ~]# kill -9 25378
[root@tnc1 ~]# ps -ef | grep mgr

root     12102 11901  0 10:45 pts/2    00:00:00 grep mgr

GGSCI (tnc1.localdomain) 5> start mgr ! 
Manager started.
GGSCI (tnc1.localdomain) 6> info mgr
Manager is running (IP port tnc1.localdomain.7809, Process ID 13523).

--Nikhil Tatineni--
--12c GoldenGate--

Querys to monitor RAC

following few  Query's will help to find out culprits-  Query to check long running transaction from last 8 hours  Col Sid Fo...