oracle_goldengate_bigdata_install_config

This is an old revision of the document!


Oracle Golden gate for Big data is a separate software than the standard Oracle Golden Gate, so you need to download it from the edelivery or the oracle site.

Unzip

[oracle@edvmr1p0 ~]$ mkdir /u01/app/oggtrg
[oracle@edvmr1p0 ~]$ cd /u01/app/oggtrg
[oracle@edvmr1p0 oggtrg]$ pwd
/u01/app/oggtrg
[oracle@edvmr1p0 oggtrg]$ unzip /stage/V839824-01.zip              <- Unzip the binaries
Archive:  /stage/V839824-01.zip
  inflating: ggs_Adapters_Linux_x64.tar  
  inflating: OGG_BigData_12.3.0.1.0_Release_Notes.pdf  
  inflating: OGG_BigData_12.3.0.1_README.txt  

[oracle@edvmr1p0 oggtrg]$ tar xvf ggs_Adapters_Linux_x64.tar       <- Unzip the handlers
AdapterExamples/
.....................................

The source is standard Oracle Golen Gate 12c and it just extract from a schema: oggsrc and send data to the replicat in a normal / standard way:

Configuration

GGSCI (edvmr1p0) 10> info all

Program     Status      Group       Lag at Chkpt  Time Since Chkpt

MANAGER     RUNNING                                           
EXTRACT     RUNNING     DPUMP       00:00:00      00:00:06    
EXTRACT     RUNNING     PRIEX       00:00:10      00:00:06    


GGSCI (edvmr1p0) 11> view param mgr

PORT 7809
DynamicPortList 20000-20099
ACCESSRULE, PROG SERVER, ALLOW
PurgeOldExtracts ./dirdat/*, UseCheckPoints, MinKeepHours 2
Autostart Extract *
AUTORESTART Extract *, WaitMinutes 1, Retries 3



GGSCI (edvmr1p0) 12> view param DPUMP

Extract dpump
SETENV (ORACLE_SID='orcl')
SETENV (ORACLE_HOME='/u01/app/oracle/product/12.1.0.2/db_1')
UserIdAlias oggadmin
rmthost localhost, mgrport 7909
rmttrail ./dirdat/dp
Table oggsrc.*;


GGSCI (edvmr1p0) 13> view param PRIEX

Extract priex
SETENV (ORACLE_SID='orcl')
SETENV (ORACLE_HOME='/u01/app/oracle/product/12.1.0.2/db_1')
UserIdAlias oggadmin
TranlogOptions IntegratedParams (max_sga_size 256)
Exttrail ./dirdat/in
LOGALLSUPCOLS
UPDATERECORDFORMAT COMPACT
GETUPDATEBEFORES
Table oggsrc.*;

Commands to be executed

start mgr
dblogin useridalias oggadmin
register extract priex database
add extract priex, integrated tranlog, begin now
add exttrail ./dirdat/in, extract priex, megabytes 10
add extract dpump, exttrailsource ./dirdat/in
add rmttrail ./dirdat/dp, extract dpump, megabytes 10
start priex
start dpump

The destination will accept the data from the source (standard Oracle Golden Gate) and send it to ActiveMQ via Java Handler

Configure Oracle Golden Gate for Big Data

[oracle@edvmr1p0 oggtrg]$ ggsci

Oracle GoldenGate Command Interpreter
Version 12.2.0.1.160823 OGGCORE_OGGADP.12.2.0.1.0_PLATFORMS_161019.1437
Linux, x64, 64bit (optimized), Generic on Oct 19 2016 16:01:40
Operating system character set identified as UTF-8.

Copyright (C) 1995, 2016, Oracle and/or its affiliates. All rights reserved.



GGSCI (edvmr1p0) 1> create subdirs

Creating subdirectories under current directory /u01/app/oggtrg

Parameter files                /u01/app/oggtrg/dirprm: created
Report files                   /u01/app/oggtrg/dirrpt: created
Checkpoint files               /u01/app/oggtrg/dirchk: created
Process status files           /u01/app/oggtrg/dirpcs: created
SQL script files               /u01/app/oggtrg/dirsql: created
Database definitions files     /u01/app/oggtrg/dirdef: created
Extract data files             /u01/app/oggtrg/dirdat: created
Temporary files                /u01/app/oggtrg/dirtmp: created
Credential store files         /u01/app/oggtrg/dircrd: created
Masterkey wallet files         /u01/app/oggtrg/dirwlt: created
Dump files                     /u01/app/oggtrg/dirdmp: created


GGSCI (edvmr1p0) 2> edit param mgr



GGSCI (edvmr1p0) 3> start mgr
Manager started.


GGSCI (edvmr1p0) 4> info all

Program     Status      Group       Lag at Chkpt  Time Since Chkpt

MANAGER     RUNNING                                           


GGSCI (edvmr1p0) 5> view param mgr

Port 7909
DynamicPortList 20100-20199
PurgeOldExtracts ./dirdat/pe*, UseCheckPoints, MinKeepHours 2
Autostart Replicat R*
AUTORESTART Replicat *, WaitMinutes 1, Retries 3

Add Replicat

GGSCI (edvmr1p0) 3> edit param jmsrep

REPLICAT JMSREP
getEnv (JAVA_HOME)
getEnv (LD_LIBRARY_PATH)
getEnv (PATH)
TARGETDB LIBFILE libggjava.so SET property=dirprm/jmsrep.properties
MAP oggsrc.*, TARGET oggsrc.*;


GGSCI (edvmr1p0) 4> add replicat jmsrep, exttrail ./dirdat/dp
REPLICAT added.

Create the Java Adapter Properties file: jmsrep.properties

Edit jmsrep.properties

vi /u01/app/oggtrg/dirprm/jmsrep.properties

##
gg.handlerlist=jms
## JNDI settings
java.naming.provider.url=tcp://localhost:61616
java.naming.factory.initial=org.apache.activemq.jndi.ActiveMQInitialContextFactory
##
gg.handler.jms.type=jms
gg.handler.jms.destinationType=queue
gg.handler.jms.destination=dynamicQueues/ggdemo.queueA
gg.handler.jms.connectionFactory=ConnectionFactory
gg.handler.jms.mode=op
gg.handler.jms.format=xml2
gg.log.level=debug
gg.log=log4j
goldengate.userexit.timestamp=utc
goldengate.userexit.nochkpt=true
jvm.bootoptions=-Djava.class.path=.:ggjava/ggjava.jar:dirprm:/opt/activemq/activemq-all-5.14.3.jar:/opt/activemq/lib/optional/log4j-1.2.17.jar:/opt/activemq/lib/optional/slf4j-log4j12-1.7.13.jar -Dlog4j.configuration=log4j.properties -Xmx512m -Xmx64m
:wq
  • oracle_goldengate_bigdata_install_config.1605102962.txt.gz
  • Last modified: 2020/11/11 13:56
  • by andonovj