This is an old revision of the document!
Overview
Oracle Golden gate for Big data is a separate software than the standard Oracle Golden Gate, so you need to download it from the edelivery or the oracle site.
Installation
Unzip
[oracle@edvmr1p0 ~]$ mkdir /u01/app/oggtrg [oracle@edvmr1p0 ~]$ cd /u01/app/oggtrg [oracle@edvmr1p0 oggtrg]$ pwd /u01/app/oggtrg [oracle@edvmr1p0 oggtrg]$ unzip /stage/V839824-01.zip <- Unzip the binaries Archive: /stage/V839824-01.zip inflating: ggs_Adapters_Linux_x64.tar inflating: OGG_BigData_12.3.0.1.0_Release_Notes.pdf inflating: OGG_BigData_12.3.0.1_README.txt [oracle@edvmr1p0 oggtrg]$ tar xvf ggs_Adapters_Linux_x64.tar <- Unzip the handlers AdapterExamples/ .....................................
Configure Source
The source is standard Oracle Golen Gate 12c and it just extract from a schema: oggsrc and send data to the replicat in a normal / standard way:
Configuration
GGSCI (edvmr1p0) 10> info all Program Status Group Lag at Chkpt Time Since Chkpt MANAGER RUNNING EXTRACT RUNNING DPUMP 00:00:00 00:00:06 EXTRACT RUNNING PRIEX 00:00:10 00:00:06 GGSCI (edvmr1p0) 11> view param mgr PORT 7809 DynamicPortList 20000-20099 ACCESSRULE, PROG SERVER, ALLOW PurgeOldExtracts ./dirdat/*, UseCheckPoints, MinKeepHours 2 Autostart Extract * AUTORESTART Extract *, WaitMinutes 1, Retries 3 GGSCI (edvmr1p0) 12> view param DPUMP Extract dpump SETENV (ORACLE_SID='orcl') SETENV (ORACLE_HOME='/u01/app/oracle/product/12.1.0.2/db_1') UserIdAlias oggadmin rmthost localhost, mgrport 7909 rmttrail ./dirdat/dp Table oggsrc.*; GGSCI (edvmr1p0) 13> view param PRIEX Extract priex SETENV (ORACLE_SID='orcl') SETENV (ORACLE_HOME='/u01/app/oracle/product/12.1.0.2/db_1') UserIdAlias oggadmin TranlogOptions IntegratedParams (max_sga_size 256) Exttrail ./dirdat/in LOGALLSUPCOLS UPDATERECORDFORMAT COMPACT GETUPDATEBEFORES Table oggsrc.*;
Configure Destination
The destination will accept the data from the source (standard Oracle Golden Gate) and send it to ActiveMQ via Java Handler
Configure Manager
Configure Oracle Golden Gate for Big Data
[oracle@edvmr1p0 oggtrg]$ ggsci Oracle GoldenGate Command Interpreter Version 12.2.0.1.160823 OGGCORE_OGGADP.12.2.0.1.0_PLATFORMS_161019.1437 Linux, x64, 64bit (optimized), Generic on Oct 19 2016 16:01:40 Operating system character set identified as UTF-8. Copyright (C) 1995, 2016, Oracle and/or its affiliates. All rights reserved. GGSCI (edvmr1p0) 1> create subdirs Creating subdirectories under current directory /u01/app/oggtrg Parameter files /u01/app/oggtrg/dirprm: created Report files /u01/app/oggtrg/dirrpt: created Checkpoint files /u01/app/oggtrg/dirchk: created Process status files /u01/app/oggtrg/dirpcs: created SQL script files /u01/app/oggtrg/dirsql: created Database definitions files /u01/app/oggtrg/dirdef: created Extract data files /u01/app/oggtrg/dirdat: created Temporary files /u01/app/oggtrg/dirtmp: created Credential store files /u01/app/oggtrg/dircrd: created Masterkey wallet files /u01/app/oggtrg/dirwlt: created Dump files /u01/app/oggtrg/dirdmp: created GGSCI (edvmr1p0) 2> edit param mgr GGSCI (edvmr1p0) 3> start mgr Manager started. GGSCI (edvmr1p0) 4> info all Program Status Group Lag at Chkpt Time Since Chkpt MANAGER RUNNING GGSCI (edvmr1p0) 5> view param mgr Port 7909 DynamicPortList 20100-20199 PurgeOldExtracts ./dirdat/pe*, UseCheckPoints, MinKeepHours 2 Autostart Replicat R* AUTORESTART Replicat *, WaitMinutes 1, Retries 3
Configure Replicat
Add Replicat
GGSCI (edvmr1p0) 3> edit param jmsrep REPLICAT JMSREP getEnv (JAVA_HOME) getEnv (LD_LIBRARY_PATH) getEnv (PATH) TARGETDB LIBFILE libggjava.so SET property=dirprm/jmsrep.properties MAP oggsrc.*, TARGET oggsrc.*; GGSCI (edvmr1p0) 4> add replicat jmsrep, exttrail ./dirdat/dp REPLICAT added.
Create the Java Adapter Properties file: jmsrep.properties
Edit jmsrep.properties
vi /u01/app/oggtrg/dirprm/jmsrep.properties ## gg.handlerlist=jms ## JNDI settings java.naming.provider.url=tcp://localhost:61616 java.naming.factory.initial=org.apache.activemq.jndi.ActiveMQInitialContextFactory ## gg.handler.jms.type=jms gg.handler.jms.destinationType=queue gg.handler.jms.destination=dynamicQueues/ggdemo.queueA gg.handler.jms.connectionFactory=ConnectionFactory gg.handler.jms.mode=op gg.handler.jms.format=xml2 gg.log.level=debug gg.log=log4j goldengate.userexit.timestamp=utc goldengate.userexit.nochkpt=true jvm.bootoptions=-Djava.class.path=.:ggjava/ggjava.jar:dirprm:/opt/activemq/activemq-all-5.14.3.jar:/opt/activemq/lib/optional/log4j-1.2.17.jar:/opt/activemq/lib/optional/slf4j-log4j12-1.7.13.jar -Dlog4j.configuration=log4j.properties -Xmx512m -Xmx64m :wq