Scribd
Upload
255 views15 pages

Module 1: Introduction To Application Utilities

After completing this module, learners should be able to identify Application Utilities, describe how they interface with Teradata, state advantages over other access methods, and match Teradata Warehouse Builder operators to corresponding utilities. The document provides an overview of Application Utilities like BTEQ, FastLoad, FastExport, their environments, development advantages, transferring large amounts of data, and using utilities with INSERT/SELECT, DELETE ALL, and INMOD/OUTMOD routines. It also summarizes Teradata Warehouse Builder and provides an Application Utility checklist and overall summary.

Uploaded by

ranusofi
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
255 views15 pages

Module 1: Introduction To Application Utilities

After completing this module, learners should be able to identify Application Utilities, describe how they interface with Teradata, state advantages over other access methods, and match Teradata Warehouse Builder operators to corresponding utilities. The document provides an overview of Application Utilities like BTEQ, FastLoad, FastExport, their environments, development advantages, transferring large amounts of data, and using utilities with INSERT/SELECT, DELETE ALL, and INMOD/OUTMOD routines. It also summarizes Teradata Warehouse Builder and provides an Application Utility checklist and overall summary.

Uploaded by

ranusofi
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
You are on page 1/ 15

Module 1: Introduction to Application Utilities

After completing this module, you should be able to: Identify the Application Utilities. Describe how the Application Utilities interface with the Teradata database. State the advantage of using a utility over other access methods. Match Teradata Warehouse Builder operators with the corresponding Teradata utility.

Application Utilities
Host or Server
BTEQ /
Teradata SQL CLI Routines
Support Environment Support Environment Support Environment

FastLoad

MultiLoad
CLI Routines CLI Routines

FastExport
CLI Routines

TPump
CLI Routines

Teradata Warehouse Builder (operators)


CLI Routines

Operating System

Teradata Database

Application Utility Environments


NCR Server BTEQ FastLoad MultiLoad FastExport TPump Call Level Interface Micro TDP TCP / IP Server O.S. Mainframe Host BTEQ FastLoad MultiLoad FastExport TPump Call Level Interface

TDP 0

TDP 1

Host O.S.

Gateway

Channel Driver PE BYNET

U N I X

P D E
AMP 0

PE

AMP 1

AMP 2

AMP 3

AMP 4

AMP 5

AMP 6

AMP 7

Application Development
More Input Modification Routines (INMODs) Flexibility
APPLICATION

Call-Level Interface COBOL, C, PL/I Preprocessors

Less Easy

UTILITIES

Ease of Use

Difficult

Selection of the right vehicle can be crucial to the success of the application: How difficult is it to implement? How difficult is it to maintain? Use the application utilities wherever possible: Offer the least complexity. Take full advantage of parallel processing.

Transferring Large Amounts of Data

Both Directions

HOST to Teradata

Teradata to HOST

Both Directions

BTEQ
Import/Export

FastLoad

MultiLoad

TPump

FastExport

Teradata Warehouse Builder

TDP/Gateway Host or Server Teradata Database Parsing Engine Parsing Engine

Message Passing Layer


SQL INSERT/SELECT DELETE ALL SQL INSERT/SELECT DELETE ALL SQL INSERT/SELECT DELETE ALL SQL INSERT/SELECT DELETE ALL

Block

Block

Block

Block

INSERT/SELECT: The Fast Path


INSERT INTO New_Table SELECT * FROM Old_Table ;
Parsing Engine Parsing Engine

Message Passing Layer


SQL INSERT/SELECT SQL INSERT/SELECT SQL INSERT/SELECT SQL INSERT/SELECT

Block

Block

Block

Block

INSERT / SELECT achieves highest performance if:

Target table is empty, AND Source and target tables have same Primary Index.
Advantages of using optimized INSERT / SELECT:

One WRITE to the Transient Journal instantaneous rollback for aborted


Insert/Select statements. Data copied and written to disk a block at a time. No data redistribution over the BYNET.

Multi-Statement INSERT/SELECT Example

INSERT INTO SELECT

FROM GROUP BY ; INSERT INTO SELECT

Summary_Table store, region, SUM(sales), COUNT(sale_item) Region_1 1, 2 Summary_Table store, region, SUM(sales), COUNT(sale_item) Region_2 1, 2 ... Summary_Table store, region, SUM(sales), COUNT(sale_item) Region_N 1, 2

Region_1

Region_2

Region_N

SPOOL Optimized INSERT/SELECT

FROM GROUP BY

Empty Target Table

; INSERT INTO SELECT

FROM GROUP BY ;

DELETE (ALL): The Fast Path


DELETE FROM Old_Table ALL;
Parsing Engine Parsing Engine

Message Passing Layer


SQL DELETE ALL SQL DELETE ALL SQL DELETE ALL SQL DELETE ALL

Block

Free

Block

Free

Block

Free

Block

Free

DELETE achieves its highest performance with use of the ALL option. High performance is achievable because of:

Not using the Transient Journal. Doing DELETEs at the cylinder index / master index level.

Using an INMOD Routine


An INMOD is a user-written program that acts as a data filter to the utility.

An INMOD routine can perform various functions: Validate a data record. Read data directly from one or more database system data sets, allowing the creation of a composite input data record, and avoiding the need for an intermediate tape or disk. Select specific records for input to the Teradata Database. Perform data conversions not supported by the application utilities. Add or change data fields in the records.
Oracle User Written INMOD IMS
FASTLOAD, MULTILOAD, TPUMP. . .

Teradata

An OUTMOD is a user-written program that does post-processing of the data before giving the data to the the utility.

Teradata Warehouse Builder


Teradata Warehouse Builder (TWB) can load data into and export data from any accessible database object in the Teradata RDBMS or other data store for which there exists an access operator or an access module. It is effectively a parallel ETL utility. Characteristics of TWB include: High performance

Parallel Extract, Transform and Load operators eliminate sequential



bottlenecks. Data Streams eliminate the overhead of intermediate (persistent) storage. Scalable End-to-end parallelism

Easy to use Single SQL-like scripting language Script converter for easy migration Access to various data sources
Extensible

Open TWB API enable Third Party and user application integration, e.g.,
transformations.

Teradata Warehouse Builder Operators


TWB Operator LOAD Teradata Utility FastLoad Description A consumer-type operator that uses the Teradata
FastLoad protocol. Supports Error limits and Checkpoint/ Restart. Both support Multi-Value Compression and PPI.

UPDATE

MultiLoad

Utilizes the Teradata MultiLoad protocol to enable job based table updates. This allows highly scalable and parallel inserts and updates to a pre-existing table.

EXPORT
STREAM DataConnector

FastExport
TPump N/A

A producer operator that emulates the FastExport utility.


Uses multiple sessions to perform DML transactions in near real-time. This operator emulates the Data Connector API. Reads external data files, writes data to external data files, reads an unspecified number of data files. Reads data from an ODBC Provider.

ODBC

N/A

To learn more about Teradata Warehouse Builder, take the Teradata Warehouse Builder WBT Course located at ... http://www.ncru.learnzone.ncr.com/learning/td/twb/

Application Utility Checklist


Feature BTEQ FastLoad FastExport MultiLoad TPump

DDL Functions
DML Functions Multiple DML Multiple Tables Multiple Sessions Protocol Used Conditional Expressions Arithmetic Calculations

Data Conversion
Error Files Error Limits User-written Routines

Application Utility Summary


BTEQ supports SELECT, INSERT, UPDATE, DELETE. FastLoad, MultiLoad, and TPump transfer data from the host to Teradata.

FastExport transfers data from Teradata to the host. BTEQ INSERT/SELECT and DELETE (ALL) can provide a fast effective
method to perform some tasks.

Utilities offer the least complex solutions for an application, and can take
advantage of parallel processing.

Utilities permit the use of INMODs and/or OUTMODs for pre- or postprocessing data.

There is often more than one way to set up your application, but there may be
one that is fastest or most effective.

Teradata Warehouse Builder (TWB) can load data into and export data from
any accessible database object in the Teradata RDBMS or other data store for which there exists an access operator.

Review Questions
Answer True or False. 1. True or False. 2. True or False. 3. True or False. With MultiLoad, you can import and export data. In Teradata mode, a BTEQ DELETE ALL function does not use the Transient Journal. An INSERT/SELECT of 1,000,000 million rows into an empty table is only slightly faster than an INSERT/SELECT of 1,000,000 rows into a table with 1 row.

Match the Teradata Warehouse Builder operator with the corresponding Teradata utility.

1. ___ UPDATE
2. ___ STREAM 3. ___ LOAD 4. ___ EXPORT

A. MultiLoad
B. FastLoad C. FastExport D. TPump

Module 1: Review Question Answers


Answer True or False. 1. True or False. 2. True or False. 3. True or False. With MultiLoad, you can import and export data. In Teradata mode, a BTEQ DELETE ALL function does not use the Transient Journal. An INSERT/SELECT of 1,000,000 million rows into an empty table is only slightly faster than an INSERT/SELECT of 1,000,000 rows into a table with 1 row.

Match the Teradata Warehouse Builder operator with the corresponding Teradata utility.

1. _A_ UPDATE
2. _D_ STREAM 3. _B_ LOAD 4. _C_ EXPORT

A. MultiLoad
B. FastLoad C. FastExport D. TPump

You might also like