Scribd
Upload
445 views10 pages

Fast Reader Best Practices For Greenplum Migrate From Oracle

migrate from Oracle into Greenplum with high performance

Uploaded by

dba_guy
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
445 views10 pages

Fast Reader Best Practices For Greenplum Migrate From Oracle

migrate from Oracle into Greenplum with high performance

Uploaded by

dba_guy
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 10

Best Practices for High-Speed Data Transfer and

Migration from Oracle into Greenplum using


WisdomForce FastReader

©2009 WisdomForce Technologies, Inc. All rights reserved.


All trademarks and registered trademarks are the property of their respective owners
Best Practices for High-Speed Data Transfer and Migration from Oracle to Greenplum using FastReader

Table of Contents

Overview ............................................................................................................................. 2
Chapter 1: Loading data into Greenplum with version up to 3.1. ................................... 3
Chapter 2: Loading data into Greenplum version 3.2 and above. ................................... 6
2.1 Using escaped non enclosed format. .................................................................................. 7
2.2 Using escaped enclosed format. ......................................................................................... 8

1
Best Practices for High-Speed Data Transfer and Migration from Oracle to Greenplum using FastReader

Overview
WisdomForce FastReader™ (www.wisdomforce.com) is high performance data
transfer and migration software for high volumes of Oracle data. FastReader supports
direct path and parallel extraction and unloads large Oracle databases in a fraction of the
usual time into ASCII flat files or pipe.

Greenplum Database (www.greenplum.com) is a software solution built to support the


next generation of data warehousing and large-scale analytics processing. It utilizes a
shared-nothing MPP (massively parallel processing) architecture optimized for business
intelligence and analytical processing.

This document describes important points for unloading data from Oracle using
FastReader and loading into Greenplum. When Greenplum is chosen as a destination in
FastReader and configured, the load scripts for the Greenplum loader are generated
during the extraction.

The guide discusses how to extract the data and migrate into Greenplum using
WisdomForce FastReader.

2
Best Practices for High-Speed Data Transfer and Migration from Oracle to Greenplum using FastReader

Chapter 1: Loading data into Greenplum with version up to 3.1.

In order to load data into Greenplum 3.1 and below database you should to choose
GREENPLUM/BIZGRES as your destination database in FastReader GUI, as shown
below:

From the main screen choose “Runtime Settings” and then choose sub panel
“Greenplum/Bizgres Load Settings”. In the “Greenplum version used” drop down list
choose “3.1 and below”. Now, enter the full path to your Greenplum appropriate loader,
as shown below:

3
Best Practices for High-Speed Data Transfer and Migration from Oracle to Greenplum using FastReader

Note: Greenplum 3.1 and below version supports only escaped non enclosed formats.

The [RUN] section in unload.ini FastReader configuration file should contain the
following parameters and values:

date_format="YYYY-MM-DD HH24:MI:SS"
timestamp_format="YYYY-MM-DD HH24:MI:SS.FF6"
replace_new_line_with_space=false
trailing_column_separator=false
enclose_numbers=false
enclose_dates=false
optionally_enclosed_by=
escape_enclosure="\"

You can choose value other than this standard value for escape_enclosure field.

All other settings should have FastReader’s default values.

To set the configuration settings from FastReader GUI click “Format Settings” from
“Runtime Settings” menu and configure the settings as shown below:

4
Best Practices for High-Speed Data Transfer and Migration from Oracle to Greenplum using FastReader

FastReader will generate loading script in a file named TABLE_NAME.sql with


following parameters:

WITH DELIMITER AS ';' NULL AS '' ESCAPE AS '\';

Note: You should generate your FastReader output files on the Greenplum/Bizgres
server.

5
Best Practices for High-Speed Data Transfer and Migration from Oracle to Greenplum using FastReader

Chapter 2: Loading data into Greenplum version 3.2 and above.

In FastReader GUI choose GREENPLUM/BIZGRES as your destination database, as


shown below:

From the main screen choose “Runtime Settings” and then choose sub panel
“Greenplum/Bizgres Load Settings”. In the “Greenplum version used” drop down list
choose “3.1 and below”. Now, enter the full path to your Greenplum appropriate loader,
as shown below:

6
Best Practices for High-Speed Data Transfer and Migration from Oracle to Greenplum using FastReader

Note: Greenplum 3.2 and above version supports both escaped non enclosed and escaped
enclosed formats.

2.1 Using escaped non enclosed format.

The [RUN] section in unload.ini FastReader configuration file should contain the
following parameters and values:

date_format="YYYY-MM-DD HH24:MI:SS"
timestamp_format="YYYY-MM-DD HH24:MI:SS.FF6"

replace_new_line_with_space=false
trailing_column_separator=false

enclose_numbers=false
enclose_dates=false
optionally_enclosed_by=
escape_enclosure="\"

You can choose value other than this standard value for escape_enclosure field.

All other settings should have FastReader’s default values.

To set the configuration settings from FastReader GUI click “Format Settings” from
“Runtime Settings” menu and configure the settings as shown below:

7
Best Practices for High-Speed Data Transfer and Migration from Oracle to Greenplum using FastReader

FastReader will generate loading script in a file named TABLE_NAME.ctl with


following parameters:

FORMAT: text
DELIMITER: ';'
ESCAPE: '\'

Note: You should generate your FastReader output files on the Greenplum/Bizgres
server.

2.2 Using escaped enclosed format.

The [RUN] section in unload.ini FastReader configuration file should contain the
following parameters and values:

date_format="YYYY-MM-DD HH24:MI:SS"
timestamp_format="YYYY-MM-DD HH24:MI:SS.FF6"
replace_new_line_with_space=false
trailing_column_separator=false
enclose_numbers=true
enclose_dates=true

You can choose values other than these standard values for optionally_enclosed_by and
escape_enclosure fields.

8
Best Practices for High-Speed Data Transfer and Migration from Oracle to Greenplum using FastReader

optionally_enclosed_by="""
escape_enclosure="\"

All other settings should have FastReader’s default values.

To set the configuration settings from FastReader GUI click “Format Settings” from
“Runtime Settings” menu and configure the settings as shown below:

FastReader will generate loading script in a file named TABLE_NAME.ctl with


following parameters:

FORMAT: csv
DELIMITER: ';'
QUOTE: '"'
ESCAPE: '\'

Note: You should generate your FastReader output files on the Greenplum/Bizgres
server.

You might also like