Scribd
Upload
282 views9 pages

1. Phần Mềm Cài Đặt: 2.1. Install Oracle Goldengate For Oracle

1. Software including Oracle GoldenGate, JDK 1.8 and Kafka 2.7.0 were installed. 2. The source database was configured for supplemental logging, archivelog mode and the GoldenGate administrator user was created. An extract was created to capture changes to a table. 3. GoldenGate for BigData was installed along with configuring Kafka. Manager, replicat and custom properties files were created to replicate data from the extract to Kafka topics.

Uploaded by

Cường Vũ
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
282 views9 pages

1. Phần Mềm Cài Đặt: 2.1. Install Oracle Goldengate For Oracle

1. Software including Oracle GoldenGate, JDK 1.8 and Kafka 2.7.0 were installed. 2. The source database was configured for supplemental logging, archivelog mode and the GoldenGate administrator user was created. An extract was created to capture changes to a table. 3. GoldenGate for BigData was installed along with configuring Kafka. Manager, replicat and custom properties files were created to replicate data from the extract to Kafka topics.

Uploaded by

Cường Vũ
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 9

1.

    Phần mềm cài đặt


 

·       Oracle GoldenGate for BigData

·       Oracle GoldenGate for Oracle

·       JDK 1.8

·       Kafka 2.7.0 (https://kafka.apache.org/downloads)

2.    Cấu hình GoldenGate trên database nguồn


2.1.         Install Oracle GoldenGate for Oracle
[oracle@oracle-sonct2 ~]$ cd /u01/soft

[oracle@oracle-sonct2 soft]$ unzip V983658-01.zip

[oracle@oracle-sonct2 ~]$ cd /u01/soft/fbo_ggs_Linux_x64_shiphome/Disk1/

[oracle@oracle-sonct2 Disk1]$ ./runInstaller

2.2.         Cấu hình manager


GGSCI (oracle-sonct2) 2> edit param mgr

PORT 7809

LAGREPORTMINUTES 60

LAGCRITICALMINUTES 20
 

GGSCI (oracle-sonct2) 3> start mgr

GGSCI (oracle-sonct2) 4> info all

Program     Status      Group       Lag at Chkpt  Time Since Chkpt

MANAGER     RUNNING   

2.3.         Cấu hình database nguồn


SQL> select
NAME,SUPPLEMENTAL_LOG_DATA_MIN,SUPPLEMENTAL_LOG_DATA_PK,SUPPLEMENTAL
_LOG_DATA_UI,SUPPLEMENTAL_LOG_DATA_FK,SUPPLEMENTAL_LOG_DATA_ALL from
v$database;

NAME      SUPPLEME SUP SUP SUP SUP

--------- -------- --- --- --- ---

TESTDB    NO       NO  NO  NO  NO

SQL> ALTER DATABASE ADD SUPPLEMENTAL LOG DATA;

SQL> alter database add SUPPLEMENTAL  LOG DATA (primary key) columns;

SQL> alter database add SUPPLEMENTAL  LOG DATA (Foreign key) columns;

SQL> alter database add SUPPLEMENTAL  LOG DATA (all) columns;

SQL> alter database add SUPPLEMENTAL  LOG DATA (unique index) columns;

SQL> select
NAME,SUPPLEMENTAL_LOG_DATA_MIN,SUPPLEMENTAL_LOG_DATA_PK,SUPPLEMENTAL
_LOG_DATA_UI,SUPPLEMENTAL_LOG_DATA_FK,SUPPLEMENTAL_LOG_DATA_ALL from
v$database;

NAME      SUPPLEME SUP SUP SUP SUP

--------- -------- --- --- --- ---

TESTDB    YES      YES YES YES YES

SQL> select NAME,LOG_MODE,FORCE_LOGGING from v$database;

NAME      LOG_MODE     FORCE_LOGGING

--------- ------------ ---------------------------------------

TESTDB    NOARCHIVELOG NO

SQL> show parameter recover;

NAME                                 TYPE        VALUE

------------------------------------ ----------- ------------------------------

db_recovery_file_dest                string

db_recovery_file_dest_size           big integer 0

SQL> alter system set db_recovery_file_dest_size=10G scope=both;

SQL> alter system set db_recovery_file_dest='/u01/app/oracle/fast_recovery_area'


scope=both;

SQL> shutdown immediate

SQL> startup mount

SQL> alter database archivelog;


SQL> alter database force logging;

SQL> alter database open;

SQL> select NAME,LOG_MODE,FORCE_LOGGING from v$database;

NAME      LOG_MODE     FORCE_LOGGING

--------- ------------ ---------------------------------------

TESTDB    ARCHIVELOG   YES

SQL> alter system set enable_goldengate_replication=true scope=both;

2.4.         Cấu hình user ggadmin


SQL> create user c##GGADMIN identified by xxx;

SQL> grant dba to c##ggadmin container=all;

SQL> exec DBMS_GOLDENGATE_AUTH.GRANT_ADMIN_PRIVILEGE('C##GGADMIN',


container => 'all');

2.5.          Cấu hình extract


GGSCI (staging-02) 1> GGSCI (oracle-sonct2) 3> dblogin userid c##ggadmin@pdbtest,
password xxx

GGSCI (oracle-sonct2 as ggadmin@testdb/PDBTEST) 5> add trandata testuser.test_table

GGSCI (oracle-sonct2) 2> dblogin userid c##ggadmin, password xxx


GGSCI (oracle-sonct2 as c##ggadmin@testdb/CDB$ROOT) 4> REGISTER EXTRACT ex1,
DATABASE CONTAINER (pdbtest)

GGSCI (oracle-sonct2 as ggadmin@testdb/CDB$ROOT) 6> edit param ex1

EXTRACT ex1

USERID ggadmin@PDBTEST, PASSWORD xxx

DBOPTIONS ALLOWUNUSEDCOLUMN

EXTTRAIL ./dirdat/ea

TABLE TESTUSER.TEST_TABLE;

GGSCI (oracle-sonct2 as c##ggadmin@testdb/CDB$ROOT) 5> ADD EXTRACT ex1,


INTEGRATED TRANLOG, BEGIN NOW

GGSCI (oracle-sonct2 as c##ggadmin@testdb/CDB$ROOT) 16> ADD EXTTRAIL


./dirdat/ea, EXTRACT ex1, MEGABYTES 1024

GGSCI (oracle-sonct2 as c##ggadmin@testdb/CDB$ROOT) 18> start ex1

GGSCI (oracle-sonct2 as c##ggadmin@testdb/CDB$ROOT) 19> info all

Program     Status      Group       Lag at Chkpt  Time Since Chkpt

MANAGER     RUNNING                                          

EXTRACT     RUNNING     EX1         00:00:00      00:03:44 

 
3.    Cấu hình GoldenGate for Kafka
3.1.         Install Oracle GoldenGate for bigdata
[oracle@oracle-sonct2 ~]$ cd /u01/soft

[oracle@oracle-sonct2 soft]$ unzip V983760-01.zip

[oracle@oracle-sonct2 soft]$ tar -xvf OGG_BigData_Linux_x64_19.1.0.0.1.tar -C


/u01/app/ogg/kafka/

3.2.         Install JDK 1.8


[oracle@oracle-sonct2 app]$ cd /u01/soft

[oracle@oracle-sonct2 soft]$ tar -zxvf jdk-8u271-linux-x64.tar.gz -C /u01/app/ogg/jdk/

Thêm biến môi trường vào .bash_profile

export JAVA_HOME=/u01/app/ogg/jdk/jdk1.8.0_271

export PATH=$JAVA_HOME/bin:$PATH

export
LD_LIBRARY_PATH=$JAVA_HOME/jre/lib/amd64:$JAVA_HOME/jre/lib/amd64/server:
$LD_LIBRARY_PATH

3.3.         Install Kafka


[oracle@oracle-sonct2 ~]$ cd /u01/soft

[oracle@oracle-sonct2 soft]$ tar -xzvf kafka_2.13-2.7.0.tgz -C /u01/app/ogg

Thêm biến môi trường vào .bash_profile

export KAFKA_HOME=/u01/app/ogg/kafka_2.13-2.7.0
export PATH=$KAFKA_HOME/bin:$JAVA_HOME/bin:$PATH

3.4.         Khởi tạo subdirs cho goldengate


[oracle@oracle-sonct2 ~]$ cd /u01/app/ogg/kafka/

[oracle@oracle-sonct2 kafka]$ ./ggsci

GGSCI (oracle-sonct2) 1> create subdirs

Creating subdirectories under current directory /u01/app/ogg/kafka

Parameter file                 /u01/app/ogg/kafka/dirprm: created.

Report file                    /u01/app/ogg/kafka/dirrpt: created.

Checkpoint file                /u01/app/ogg/kafka/dirchk: created.

Process status files           /u01/app/ogg/kafka/dirpcs: created.

SQL script files               /u01/app/ogg/kafka/dirsql: created.

Database definitions files     /u01/app/ogg/kafka/dirdef: created.

Extract data files             /u01/app/ogg/kafka/dirdat: created.

Temporary files                /u01/app/ogg/kafka/dirtmp: created.

Credential store files         /u01/app/ogg/kafka/dircrd: created.

Masterkey wallet files         /u01/app/ogg/kafka/dirwlt: created.

Dump files                     /u01/app/ogg/kafka/dirdmp: created.

 
3.5.         Cấu hình manager
GGSCI (oracle-sonct2) 2> edit param mgr

PORT 7810

LAGREPORTMINUTES 60

LAGCRITICALMINUTES 20

GGSCI (oracle-sonct2) 4> start mgr

Manager started.

GGSCI (oracle-sonct2) 6> info all

Program     Status      Group       Lag at Chkpt  Time Since Chkpt

MANAGER     RUNNING   

3.6.         Cấu hình kết nối kafka


[oracle@oracle-sonct2 ~]$ cd /u01/app/ogg/kafka/dirprm/

[oracle@oracle-sonct2 dirprm]$ vi kafka.props

kafka.props.txt
28 Dec 2020, 05:59 PM

[oracle@oracle-sonct2 dirprm]$ vi custom_kafka_producer.properties


custom_kafka_producer.properties.txt
28 Dec 2020, 05:59 PM

3.7.         Cấu hình replicat


GGSCI (oracle-sonct2) 1> edit param RX1

 REPLICAT RX1

TARGETDB LIBFILE libggjava.so SET property=dirprm/kafka.props

GROUPTRANSOPS 10000

MAP PDBTEST.TESTUSER.TEST_TABLE, TARGET TESTUSER.TEST_TABLE;

GGSCI (oracle-sonct2) 3> add replicat RX1, exttrail /u01/app/ogg/oracle/dirdat/ea

GGSCI (oracle-sonct2) 5> start RX1

GGSCI (oracle-sonct2) 6> info all

You might also like