PWX 910 Teradata PT UserGuide
PWX 910 Teradata PT UserGuide
0)
User Guide
Informatica PowerExchange for Teradata Parallel Transporter API User Guide Version 9.1.0 March 2011 Copyright (c) 2006-2011 Informatica. All rights reserved. This software and documentation contain proprietary information of Informatica Corporation and are provided under a license agreement containing restrictions on use and disclosure and are also protected by copyright law. Reverse engineering of the software is prohibited. No part of this document may be reproduced or transmitted in any form, by any means (electronic, photocopying, recording or otherwise) without prior consent of Informatica Corporation. This Software may be protected by U.S. and/or international Patents and other Patents Pending. Use, duplication, or disclosure of the Software by the U.S. Government is subject to the restrictions set forth in the applicable software license agreement and as provided in DFARS 227.7202-1(a) and 227.7702-3(a) (1995), DFARS 252.227-7013(1)(ii) (OCT 1988), FAR 12.212(a) (1995), FAR 52.227-19, or FAR 52.227-14 (ALT III), as applicable. The information in this product or documentation is subject to change without notice. If you find any problems in this product or documentation, please report them to us in writing. Informatica, Informatica Platform, Informatica Data Services, PowerCenter, PowerCenterRT, PowerCenter Connect, PowerCenter Data Analyzer, PowerExchange, PowerMart, Metadata Manager, Informatica Data Quality, Informatica Data Explorer, Informatica B2B Data Transformation, Informatica B2B Data Exchange, Informatica On Demand, Informatica Identity Resolution, Informatica Application Information Lifecycle Management, Informatica Complex Event Processing, Ultra Messaging and Informatica Master Data Management are trademarks or registered trademarks of Informatica Corporation in the United States and in jurisdictions throughout the world. All other company and product names may be trade names or trademarks of their respective owners. Portions of this software and/or documentation are subject to copyright held by third parties, including without limitation: Copyright DataDirect Technologies. All rights reserved. Copyright Sun Microsystems. All rights reserved. Copyright RSA Security Inc. All Rights Reserved. Copyright Ordinal Technology Corp. All rights reserved.Copyright Aandacht c.v. All rights reserved. Copyright Genivia, Inc. All rights reserved. Copyright 2007 Isomorphic Software. All rights reserved. Copyright Meta Integration Technology, Inc. All rights reserved. Copyright Oracle. All rights reserved. Copyright Adobe Systems Incorporated. All rights reserved. Copyright DataArt, Inc. All rights reserved. Copyright ComponentSource. All rights reserved. Copyright Microsoft Corporation. All rights reserved. Copyright Rogue Wave Software, Inc. All rights reserved. Copyright Teradata Corporation. All rights reserved. Copyright Yahoo! Inc. All rights reserved. Copyright Glyph & Cog, LLC. All rights reserved. Copyright Thinkmap, Inc. All rights reserved. Copyright Clearpace Software Limited. All rights reserved. Copyright Information Builders, Inc. All rights reserved. Copyright OSS Nokalva, Inc. All rights reserved. Copyright Edifecs, Inc. All rights reserved. This product includes software developed by the Apache Software Foundation (http://www.apache.org/), and other software which is licensed under the Apache License, Version 2.0 (the "License"). You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0. Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. This product includes software which was developed by Mozilla (http://www.mozilla.org/), software copyright The JBoss Group, LLC, all rights reserved; software copyright 1999-2006 by Bruno Lowagie and Paulo Soares and other software which is licensed under the GNU Lesser General Public License Agreement, which may be found at http:// www.gnu.org/licenses/lgpl.html. The materials are provided free of charge by Informatica, "as-is", without warranty of any kind, either express or implied, including but not limited to the implied warranties of merchantability and fitness for a particular purpose. The product includes ACE(TM) and TAO(TM) software copyrighted by Douglas C. Schmidt and his research group at Washington University, University of California, Irvine, and Vanderbilt University, Copyright () 1993-2006, all rights reserved. This product includes software developed by the OpenSSL Project for use in the OpenSSL Toolkit (copyright The OpenSSL Project. All Rights Reserved) and redistribution of this software is subject to terms available at http://www.openssl.org. This product includes Curl software which is Copyright 1996-2007, Daniel Stenberg, <[email protected]>. All Rights Reserved. Permissions and limitations regarding this software are subject to terms available at http://curl.haxx.se/docs/copyright.html. Permission to use, copy, modify, and distribute this software for any purpose with or without fee is hereby granted, provided that the above copyright notice and this permission notice appear in all copies. The product includes software copyright 2001-2005 () MetaStuff, Ltd. All Rights Reserved. Permissions and limitations regarding this software are subject to terms available at http://www.dom4j.org/ license.html. The product includes software copyright 2004-2007, The Dojo Foundation. All Rights Reserved. Permissions and limitations regarding this software are subject to terms available at http:// svn.dojotoolkit.org/dojo/trunk/LICENSE. This product includes ICU software which is copyright International Business Machines Corporation and others. All rights reserved. Permissions and limitations regarding this software are subject to terms available at http://source.icu-project.org/repos/icu/icu/trunk/license.html. This product includes software copyright 1996-2006 Per Bothner. All rights reserved. Your right to use such materials is set forth in the license which may be found at http:// www.gnu.org/software/ kawa/Software-License.html. This product includes OSSP UUID software which is Copyright 2002 Ralf S. Engelschall, Copyright 2002 The OSSP Project Copyright 2002 Cable & Wireless Deutschland. Permissions and limitations regarding this software are subject to terms available at http://www.opensource.org/licenses/mit-license.php. This product includes software developed by Boost (http://www.boost.org/) or under the Boost software license. Permissions and limitations regarding this software are subject to terms available at http:/ /www.boost.org/LICENSE_1_0.txt. This product includes software copyright 1997-2007 University of Cambridge. Permissions and limitations regarding this software are subject to terms available at http:// www.pcre.org/license.txt. This product includes software copyright 2007 The Eclipse Foundation. All Rights Reserved. Permissions and limitations regarding this software are subject to terms available at http:// www.eclipse.org/org/documents/epl-v10.php. This product includes software licensed under the terms at http://www.tcl.tk/software/tcltk/license.html, http://www.bosrup.com/web/overlib/?License, http://www.stlport.org/doc/ license.html, http://www.asm.ow2.org/license.html, http://www.cryptix.org/LICENSE.TXT, http://hsqldb.org/web/hsqlLicense.html, http://httpunit.sourceforge.net/doc/ license.html, http://jung.sourceforge.net/license.txt , http://www.gzip.org/zlib/zlib_license.html, http://www.openldap.org/software/release/license.html, http://www.libssh2.org, http://slf4j.org/license.html, http://www.sente.ch/software/OpenSourceLicense.html, http://fusesource.com/downloads/license-agreements/fuse-message-broker-v-5-3-licenseagreement, http://antlr.org/license.html, http://aopalliance.sourceforge.net/, http://www.bouncycastle.org/licence.html, http://www.jgraph.com/jgraphdownload.html, http:// www.jgraph.com/jgraphdownload.html, http://www.jcraft.com/jsch/LICENSE.txt and http://jotm.objectweb.org/bsd_license.html. This product includes software licensed under the Academic Free License (http://www.opensource.org/licenses/afl-3.0.php), the Common Development and Distribution License (http://www.opensource.org/licenses/cddl1.php) the Common Public License (http://www.opensource.org/licenses/cpl1.0.php) and the BSD License (http:// www.opensource.org/licenses/bsd-license.php). This product includes software copyright 2003-2006 Joe WaInes, 2006-2007 XStream Committers. All rights reserved. Permissions and limitations regarding this software are subject to terms available at http://xstream.codehaus.org/license.html. This product includes software developed by the Indiana University Extreme! Lab. For further information please visit http://www.extreme.indiana.edu/.
This Software is protected by U.S. Patent Numbers 5,794,246; 6,014,670; 6,016,501; 6,029,178; 6,032,158; 6,035,307; 6,044,374; 6,092,086; 6,208,990; 6,339,775; 6,640,226; 6,789,096; 6,820,077; 6,823,373; 6,850,947; 6,895,471; 7,117,215; 7,162,643; 7,254,590; 7,281,001; 7,421,458; 7,496,588; 7,523,121; 7,584,422; 7,720,842; 7,721,270; and 7,774,791, international Patents and other Patents Pending. DISCLAIMER: Informatica Corporation provides this documentation "as is" without warranty of any kind, either express or implied, including, but not limited to, the implied warranties of non-infringement, merchantability, or use for a particular purpose. Informatica Corporation does not warrant that this software or documentation is error free. The information provided in this software or documentation may include technical inaccuracies or typographical errors. The information in this software and documentation is subject to change at any time without notice. NOTICES This Informatica product (the Software) includes certain drivers (the DataDirect Drivers) from DataDirect Technologies, an operating company of Progress Software Corporation (DataDirect) which are subject to the following terms and conditions: 1. THE DATADIRECT DRIVERS ARE PROVIDED AS IS WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NON-INFRINGEMENT. 2. IN NO EVENT WILL DATADIRECT OR ITS THIRD PARTY SUPPLIERS BE LIABLE TO THE END-USER CUSTOMER FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, CONSEQUENTIAL OR OTHER DAMAGES ARISING OUT OF THE USE OF THE ODBC DRIVERS, WHETHER OR NOT INFORMED OF THE POSSIBILITIES OF DAMAGES IN ADVANCE. THESE LIMITATIONS APPLY TO ALL CAUSES OF ACTION, INCLUDING, WITHOUT LIMITATION, BREACH OF CONTRACT, BREACH OF WARRANTY, NEGLIGENCE, STRICT LIABILITY, MISREPRESENTATION AND OTHER TORTS. Part Number: PWX-TPU-91000-0001
Table of Contents
Preface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iii
Informatica Resources. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iii Informatica Customer Portal. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iii Informatica Documentation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iii Informatica Web Site. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iii Informatica How-To Library. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iii Informatica Knowledge Base. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iv Informatica Multimedia Knowledge Base. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iv Informatica Global Customer Support. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iv
Table of Contents
Index. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
ii
Table of Contents
Preface
The PowerExchange for Teradata Parallel Transporter API User Guide provides information about extracting data from and loading data to Teradata using Teradata Parallel Transporter API (Teradata PT API). It is written for database administrators and developers who are responsible for extracting data from and loading data to Teradata. This guide assumes you have knowledge of Teradata PT, Teradata databases, and PowerCenter.
Informatica Resources
Informatica Customer Portal
As an Informatica customer, you can access the Informatica Customer Portal site at http://mysupport.informatica.com. The site contains product information, user group information, newsletters, access to the Informatica customer support case management system (ATLAS), the Informatica How-To Library, the Informatica Knowledge Base, the Informatica Multimedia Knowledge Base, Informatica Product Documentation, and access to the Informatica user community.
Informatica Documentation
The Informatica Documentation team takes every effort to create accurate, usable documentation. If you have questions, comments, or ideas about this documentation, contact the Informatica Documentation team through email at [email protected]. We will use your feedback to improve our documentation. Let us know if we can contact you regarding your comments. The Documentation team updates documentation as needed. To get the latest documentation for your product, navigate to Product Documentation from http://mysupport.informatica.com.
iii
Standard Rate France: 0805 804632 Germany: 01805 702702 Netherlands: 030 6022 797
iv
Preface
CHAPTER 1
CHAPTER 2
Prerequisites
Before you install PowerExchange for Teradata Parallel Transporter API, complete the following tasks:
Install or upgrade PowerCenter. Install Teradata. Install Teradata Parallel Transporter. Install the following utilities on the machines where the PowerCenter Repository Service and PowerCenter
Note: If you install PowerExchange for Teradata Parallel Transporter API using Teradata Parallel Transporter version 12 and then upgrade to Teradata Parallel Transporter version 13, you must reinstall PowerExchange for Teradata Parallel Transporter API.
Verify that you have read and write permissions on the following directories: <PowerCenter <PowerCenter <PowerCenter <PowerCenter Installation Installation Installation Installation Directory>\server\bin Directory>\server\bin\native Directory>\server\bin\RecoverySQL Directory>\client\bin
The installer must be able to add and overwrite files in these directories.
On Windows EMT 64-bit, you must install the Microsoft Visual C++ 2005 Redistributable Package (x64) if the
machine does not have Visual C++ 2005 installed. You can download the Microsoft Visual C++ 2005 Redistributable Package (x64) from the Microsoft download center.
After you install and configure PowerExchange for Teradata Parallel Transporter API, you can create connections to access Teradata PT API. Create connection objects in the Workflow Manager so the PowerCenter Integration Service can connect to Teradata PT API.
Also, set the shared library environment variable based on the operating system. The following table describes the shared library variables for each operating system:
Operating System Windows Solaris Linux AIX HP-UX Value PATH LD_LIBRARY_PATH LD_LIBRARY_PATH LIBPATH SHLIB_PATH
For HP-UX:
Using a Bourne shell: $ SHLIB_PATH=${SHLIB_PATH}:${JAVA_HOME}/lib: ${JRE_HOME}/lib; export SHLIB_PATH Using a C shell: $ setenv SHLIB_PATH ${SHLIB_PATH}:${JAVA_HOME}/lib: ${JRE_HOME}/lib
For AIX:
Using a Bourne shell: $ LIBPATH=${LIBPATH}:${JAVA_HOME}/lib: ${JRE_HOME}/lib; export LIBPATH Using a C shell: $ setenv LIBPATH ${LIBPATH}:${JAVA_HOME}/lib: ${JRE_HOME}/lib
the repository. Also allows the PowerCenter Integration Service to run Teradata PT API sessions.
When you unzip or untar the installation file, the following online help files are extracted:
powercenterhelp.chm. The PowerCenter master help file that contains links to PowerExchange for Teradata
To install the client component: 1. On the PowerCenter Client machine, back up powercenterhelp.chm in the help directory in the following location:
<PowerCenter Installation Directory>\client\bin\help\en
To back up the file, rename it to Original_powercenterhelp.chm. 2. Copy powercenterhelp.chm and teradata.chm to the help directory on the PowerCenter Client machine.
Select the language to use during installation and click OK. The Welcome window introduces the PowerExchange for Teradata Parallel Transporter API installation.
5.
Click Next. The installation program displays a warning about stopping Informatica Services.
6.
7.
Enter the absolute path to the PowerCenter installation directory. Click Browse to find the directory or use the default directory. The default directory is C:\Informatica\9.0.1.
8.
Click Next. The Teradata PT Version window asks you to choose the Teradata PT API version.
9.
Choose the correct version of Teradata PT API and click Next. The Pre-Installation Summary window summarizes the installation information.
10.
Review the installation information and click Install to continue. The installer shows the progress of the installation. When the installation is complete, the Installation Summary window displays the status of the installation.
11.
Click Done. You can view the log files generated by the installer to get more information about the installation tasks performed by the installer.
12.
HOME is the user home directory. 6. 7. Choose the correct version of Teradata PT API on the Teradata PT Version panel and press Enter. Review the information on the Pre-Installation Summary panel and press Enter to continue. Or, enter back to go back and modify the options. 8. After you press Enter, the installer copies the Service component files to the installation directory.
<PowerCenter Installation Directory>/server/bin/
The plug-in file for PowerExchange for Teradata Parallel Transporter API is TeradataPT.xml. When you install the Service component, the installer copies TeradataPT.xml to the following directory:
<PowerCenter Installation Directory>\server\bin\native
After you register the plug-in, two new connection object types, Teradata PT Connection and Teradata Dual Load Connection are available. PowerExchange for Teradata PT API uses Teradata PT Connection. Teradata Dual Load Connection is applicable if you install PowerCenter Dual Load Option for Teradata. Note: If you do not have the correct privileges to register the plug-in, contact the user who manages the PowerCenter Repository Service.
Release Information
PowerExchange for Teradata Parallel Transporter API includes new features and behavior changes.
Teradata target when the PowerCenter Integration Service runs on SUSE Linux Enterprise Server 11 if you use Teradata Parallel Transporter 13.10.
SunOS x64 support. You can extract data from a Teradata source or load data to a Teradata target when the
Teradata Parallel Transporter API as a session property. A query band expression is a set of name-value pairs that identify a querys originating source
New Teradata Parallel Transporter version. PowerExchange for Teradata Parallel Transporter API supports
API target from a source. You can provide the number of instances in the session properties.
Staged Loading. You can pause active loading to a Teradata PT API target in a session. You can acquire data
from several sources with subsequent runs of the session. Run the session without staged loading to load data from all sources at once to the Teradata PT API target.
Windows 2008 R2 support. You can extract data from a Teradata source or load data to a Teradata target
Effective in version 8.6, PowerExchange for Teradata Parallel Transporter API uses the connection object type Teradata PT Connection.
Release Information
In a previous version, PowerExchange for Teradata Parallel Transporter API used Teradata PT API connection objects of type Teradata Parallel Transporter Connection. These connection objects have been replaced with connection objects of type Teradata PT Connection Deprecated. The following connection attributes are moved from the connection object definition to the session properties:
Log Database Log Table Name Error Database Error Table Name 1 Error Table Name 2 Drop Error Table
When you upgrade, the session properties contain the default values for these properties. The deprecated connection object retains the values you specified. If you run a session that uses a deprecated connection object, the PowerCenter Integration Service uses the values in the session properties. If you do not enter values in the session properties, it uses the connection attributes in the deprecated connection object. Informatica recommends that you replace deprecated connection objects with new connection objects. Deprecated connection objects might not be supported in future versions of PowerExchange for Teradata Parallel Transporter API.
CHAPTER 3
3.
Select Teradata PT Connection, and then click OK. The Relational Connection Editor dialog box appears.
4.
User Name
5.
Tenacity
Max Sessions
Min Sessions
Sleep
Data Encryption
Block Size
10
Attribute
System Operator
Teradata PT API operator type: - Export. Extracts data from Teradata. Select Export if the session uses a Teradata Parallel Transporter Reader. - Load. Bulk loads data into an empty Teradata database table. - Update. Performs update, insert, upsert, and delete operations against Teradata database tables. - Stream. Performs update, insert, upsert, and delete operations against Teradata database tables in near real-time mode. Select Stream if you want to enable recovery for sessions that load data to Teradata. Default is Stream.
6.
Click OK.
Configuring Recovery
You can recover Teradata PT API sessions that meet the following requirements:
The session must be enabled for recovery. The session must contain a PowerExchange for CDC source. The session must be configured to use the Stream system operator to load data to Teradata. Set the TPTRecoveryModel custom property to yes for the session or PowerCenter Integration Service. If the PowerCenter Integration Service runs on UNIX, set the THREADONOFF environment variable to 1.
A recovery table must exist in the target database before the PowerCenter Integration Service can recover a session or workflow. You can either create the recovery table manually or configure a target ODBC connection in addition to the Teradata PT API target connection object. Configure a target ODBC connection when you want to drop log, error, and work tables or truncate target tables. Otherwise, you can create the recovery table manually.
11
configure the session to use a Teradata PT API target connection and a target ODBC connection, the PowerCenter Integration Service can drop existing log, error, and work tables for a session when the session starts.
Truncate the target tables. Teradata PT API can truncate the target tables when the system operator is set to
Update or Stream in the connection object properties. If you configure the session to use a Teradata PT API target connection and a target ODBC connection, Teradata PT API can truncate the target tables when the system operator is Update, Stream, or Load.
each partition.
Error Tables. Log Teradata errors and rejected data when a session runs. Teradata PT API creates two error
Log Tables
Enter a log table name when you configure a session to load to Teradata. You can also choose to create the log table in a log database, a working database, or under the default database. Choose where you want to create the log table when you configure session to load to Teradata.
12
The following session properties allow you to specify log table information:
Property Log Database Description Name of the database that stores the log tables. If you do not enter a log database name in the session properties or a database name in the connection object, Teradata PT API stores the log tables under the user. Name of the log table. If you do not specify a log table name, the PowerCenter Integration Service uses the name <log_database>.INFA_LT_<number>. The exact table name appears in the session log.
When a session fails, see the log table for more information. Before you run the session again, drop the log table or enter a different table name in the session properties.
Error Tables
Teradata writes rejected data to error tables ErrorTable1 and ErrorTable2. ErrorTable1 contains data rejected for the following reasons:
Data conversion errors Constraint violations Access Module Processor configuration changes
You can enter a name for each error table when you configure a session to load to Teradata. You can also choose to create the error tables in an error database, a working database, or under the default database. Choose where you want to create the error tables when you configure a session to load to Teradata. The following session properties allow you to specify error table names:
Property Error Database Description Name of the database that stores the error tables. If you do not enter an error database name in the session properties or a database name in the connection object, Teradata PT API stores the error tables under the user. Name of the first error table. If you do not specify a name for the first error table, the PowerCenter Integration Service uses the name <error_database>.INFA_ET1_<number>. The exact table name appears in the session log. Name of the second error table. If you do not specify a name for the second error table, the PowerCenter Integration Service uses the name <error_database>.INFA_ET2_<number>. The exact table name appears in the session log.
When a session fails, see the error tables for more information about the errors. Before you run the session again, drop the error tables or enter different table names in the session properties.
13
Work Tables
The Update system operator uses DML statements for staging data. It creates work tables before Teradata PT API begins loading data and removes them from the database after Teradata PT API loads all rows to the target. Enter a work table name when you configure a session to load to Teradata. You can also choose to create the work table in the target database. Choose where you want to create the work table when you configure a session to load to Teradata. The following session properties allow you to specify work table information:
Property Work Table Database Description Name of the database that stores the work tables created by Teradata PT API when you select the Update system operator. If you do not specify a work table database, Teradata PT API stores the work tables in the target database. Name of the work tables when you select the Update system operator. The Teradata database creates one work table for each target table. If you do not specify a work table name, the PowerCenter Integration Service uses the name <work_table_database>.INFA<number>_WT. The exact table name appears in the session log.
Pipeline Partitioning
You can increase the number of partitions in a pipeline to improve session performance. Increasing the number of partitions allows the PowerCenter Integration Service to create multiple connections to sources and targets and process partitions of sources and targets concurrently. You can configure partitioning for a session that extracts from or loads to Teradata. If the session loads to Teradata, set the system operator to Stream in the connection object properties. Update partitioning information using the Partitions view on the Mapping tab of the session properties. The following table describes the partition types for partition points in Teradata PT API sessions:
Partition Point Source Qualifier Teradata PT API Target Partition Type Pass-through Pass-through
14
Staged Loading
Staged loading is the ability to pause an active load operation until additional data is available. Enable the session parameter pause acquisition to enable staged loading. When you run a session with pause acquisition enabled, the session extracts data from the source and pauses before it loads to the target. You can run the session multiple times to acquire data from different sources or different data from the same source. Disable pause acquisition and run the session to load the acquired data to the target at once. For example, you want to load data into the same target table from two sources. Run the session with pause acquisition when you load data from the first source. Session pauses the load operation after acquiring data from the source. Disable pause acquisition and run the session with the second source. The session loads data from both the sources into the target table at once. You cannot access the target until the session loads data from all the sources. You can use staged loading with Load and Update operators. If you enable pause acquisition, use the same operator for the subsequent runs of the session. After you successfully run a session with pause acquisition, turn off Drop log, work, and error tables and Truncate target tables for subsequent runs. Use the same log, work, and error tables for the subsequent runs. If you update the same target table through different sessions and use pause acquisition, specify the log, work, and error table names manually. Use the same table names for all sessions for the same target table.
15
Description Determines Teradata PT API tracing at the infrastructure level: TD_OFF. Teradata PT API disables tracing. TD_OPER. Teradata PT API enables tracing for driver-specific activities for Teradata. TD_OPER_ALL. Teradata PT API enables all driver-level tracing. TD_OPER_CLI. Teradata PT API enables tracing for activites involving CLIv2. TD_OPER_NOTIFY. Teradata PT API enables tracing for activities involving the Notify feature. TD_OPER_OPCOMMON. Teradata PT API enables tracing for activities involving the operator common library. Default is TD_OFF. You must enable the driver tracing level before you can enable the infrastructure tracing level.
File name and path of the Teradata PT API trace file. Default path is $PM_HOME. Default file name is <Name of the TPT Operator>_timestamp. For example, EXPORTER_20091221.
Note: You can view load statistics in the session log. The load summary in the Workflow Monitor does not display load statistics.
Otherwise, leave the second connection empty. Note: If you want to run an update or delete operation on a Teradata target table that does not have a primary key column, you must edit the target definition and specify at least one connected column as a primary key column. To configure a session to load to Teradata: 1. 2. Change the writer type to Teradata Parallel Transporter Writer in the Writers settings on the Mapping tab. From the Connections settings on the Targets node, select a Teradata PT connection.
16
3.
From the Connections settings on the Targets node of the Mapping tab, configure the following Teradata PT API target properties:
Property Work Table Database Work Table Name Macro Database Description Name of the database that stores the work tables.
Name of the work table. Name of the database that stores the macros Teradata PT API creates when you select the Stream system operator. The Stream system operator uses macros to modify tables. It creates macros before Teradata PT API begins loading data and removes them from the database after Teradata PT API loads all rows to the target. If you do not specify a macro database, Teradata PT API stores the macros in the log database. Causes load operation to pause before the session loads data to the Teradata PT API target. Disable when you want to load the data to the target. Default is disabled. The number of parallel instances to load data into the Teradata PT API target. Default is 1. The query band expression to be passed to the Teradata PT API. A query band expression is a set of name-value pairs that identify a querys originating source. In the expression, each name-value pair is separated by a semicolon and the expression ends with a semicolon. For example, ApplicationName=Informatica;Version=9.0.1;ClientUser=A;. Teradata PT API updates existing rows and inserts other rows as if marked for update. If disabled, Teradata PT API updates existing rows only. The PowerCenter Integration Service ignores this attribute when you treat source rows as inserts or deletes. Default is disabled. Teradata PT API deletes all rows in the Teradata target before it loads data. This attribute is available for the Update and Stream system operators. It is available for the Load system operator if you select a Teradata target ODBC connection. Default is disabled. Specifies how Teradata PT API handles rows that do not exist in the target table: - None. If Teradata PT API receives a row marked for update or delete but it is missing in the target table, Teradata PT API does not mark the row in the error table. - For Update. If Teradata PT API receives a row marked for update but it is missing in the target table, Teradata PT API marks the row as an error row. - For Delete. If Teradata PT API receives a row marked for delete but it is missing in the target table, Teradata PT API marks the row as an error row. - Both. If Teradata PT API receives a row marked for update or delete but it is missing in the target table, Teradata PT API marks the row as an error row. Default is None.
Pause Acquisition
Instances
Truncate Table
17
Description Specifies how Teradata PT API handles duplicate rows when it attempts to insert or update rows in the target table: - None. If Teradata PT API receives a row marked for insert or update that causes a duplicate row in the target table, Teradata PT API does not mark the row in the error table. - For Insert. If Teradata PT API receives a row marked for insert but it exists in the target table, Teradata PT API marks the row as an error row. - For Update. If Teradata PT API receives a row marked for update that causes a duplicate row in the target table, Teradata PT API marks the row as an error row. - Both. If Teradata PT API receives a row marked for insert or update that causes a duplicate row in the target table, Teradata PT API marks the row as an error row. Default is For Insert. Name of the database that stores the log tables. Name of the restart log table. Name of the database that stores the error tables. Name of the first error table. Name of the second error table. Drops existing log, error, and work tables for a session when the session starts. This attribute is available if you select a Teradata target ODBC connection. Default is disabled. Uses the Teradata PT API serialize mechanism to reduce locking overhead when you select the Stream system operator. Default is enabled. Number of statements to pack into a request when you select the Stream system operator. Must be a positive, nonzero integer. Default is 20. Minimum is 1. Maximum is 600. Causes Teradata PT API to determine the maximum number of statements to pack into a request when you select the Stream system operator. Default is disabled. Determines the maximum number of request buffers that may be allocated for the Teradata PT API job when you select the Stream system operator. Teradata PT API determines the maximum number of request buffers according to the following formula:
Max_Request_Buffers = Buffers * Number_Connected_Sessions
Log Database Log Table Name Error Database Error Table Name1 Error TableName2 Drop Log/Error/ Work Tables
Serialize
Pack
Pack Maximum
Buffers
Must be a positive, nonzero integer. Default is 3. Minimum is 2. Error Limit Maximum number of records that can be stored in the error table before Teradata PT API terminates the Stream system operator job. Must be -1 or a positive, nonzero integer. Default is -1, which specifies an unlimited number of records. Specifies how Teradata PT API overrides the normal replication services controls for an active Teradata PT API session: - On. Teradata PT API overrides normal replication services controls for the active session. - Off. Teradata PT API disables override of normal replication services for the active session when change data capture is active. - None. Teradata PT API does not send an override request to the Teradata Database. Default is None.
Replication Override
18
Description Determines Teradata PT API tracing at the driver level: - TD_OFF. Teradata PT API disables tracing. - TD_OPER. Teradata PT API enables tracing for driver-specific activities for Teradata. - TD_OPER_ALL. Teradata PT API enables all driver-level tracing. - TD_OPER_CLI. Teradata PT API enables tracing for activities involving CLIv2. - TD_OPER_NOTIFY. Teradata PT API enables tracing for activities involving the Notify feature. - TD_OPER_OPCOMMON. Teradata PT API enables tracing for activities involving the operator common library. Default is TD_OFF. Determines Teradata PT API tracing at the infrastructure level: - TD_OFF. Teradata PT API disables tracing. - TD_OPER. Teradata PT API enables tracing for driver-specific activities for Teradata. - TD_OPER_ALL. Teradata PT API enables all driver-level tracing. - TD_OPER_CLI. Teradata PT API enables tracing for activities involving CLIv2. - TD_OPER_NOTIFY. Teradata PT API enables tracing for activities involving the Notify feature. - TD_OPER_OPCOMMON. Teradata PT API enables tracing for activities involving the operator common library. Default is TD_OFF. You must enable the driver tracing level before you can enable the infrastructure tracing level. File name and path of the Teradata PT API trace file. Default path is $PM_HOME. Default file name is <Name of the TPT Operator>_timestamp. For example, LOAD_20091221.
19
APPENDIX A
Error Messages
This appendix includes the following topics:
TPTRD Messages, 20 TPTWR Messages, 26
TPTRD Messages
TPTRD_11001
Explanation: User Response:
TPTRD_11002
Explanation: User Response:
TPTRD_11003
Explanation: User Response:
TPTRD_21101
Explanation: User Response:
TPTRD_21201
Explanation: User Response:
TPTRD_21202
Explanation:
20
User Response:
Make sure that there is enough memory on the machine where the PowerCenter Integration Service is running.
TPTRD_21203
Explanation: User Response:
TPTRD_21204
Explanation: User Response:
TPTRD_21205
Explanation: User Response:
TPTRD_21206
Explanation: User Response:
TPTRD_21207
Explanation: User Response:
TPTRD_21208
Explanation: User Response:
TPTRD_21209
Explanation: User Response:
TPTRD_21210
Explanation: User Response:
TPTRD_21211
Explanation:
TPTRD Messages
21
User Response:
Check the error message returned by Teradata CLI or DBS. Contact Informatica Global Customer Support.
TPTRD_21212
Explanation: User Response:
TPTRD_21213
Explanation: User Response:
TPTRD_21214
Explanation: User Response:
TPTRD_21215
Explanation: User Response:
Plug-in failed to fetch data on row <row number> with status <status code>.
GetRow() call failed on the row <row number>. Contact Informatica Global Customer Support.
TPTRD_21216
Explanation: User Response:
TPTRD_21217
Explanation: User Response:
TPTRD_21218
Explanation: User Response:
TPTRD_21219
Explanation: User Response:
TPTRD_21220
Explanation: User Response:
Invalid TDPID.
Invalid host name. Make sure that you specify the correct TDPID in the connection object.
22
TPTRD_21301
Explanation: User Response:
TPTRD_21302
Explanation: User Response:
TPTRD_21501
Explanation: User Response:
TPTRD_21502
Explanation: User Response:
TPTRD_21503
Explanation: User Response:
TPTRD_21504
Explanation: User Response:
TPTRD_21505
Explanation: User Response:
TPTRD_21506
Explanation: User Response:
TPTRD_21507
Explanation: User Response:
TPTRD_21508
Explanation: User Response:
TPTRD Messages
23
TPTRD_21509
Explanation: User Response:
Plug-in failed to read data from table <table name> of Teradata database.
Internal error. Contact Informatica Global Customer Support.
TPTRD_21510
Explanation: User Response:
TPTRD_21511
Explanation: User Response:
Plug-in failed to validate Metadata Extension level DML statement <DML statement>.
The custom SQL in the Source Qualifier is incorrect. Verify that the custom SQL is correct.
TPTRD_21512
Explanation: User Response:
TPTRD_21513
Explanation: User Response:
TPTRD_21514
Explanation: User Response:
TPTRD_21515
Explanation: User Response:
TPTRD_21516
Explanation: User Response:
TPTRD_21517
Explanation: User Response:
Plug-in failed to retrieve source extension attached with particular source qualifier.
Internal error. Contact Informatica Global Customer Support.
TPTRD_21518
Explanation: User Response:
24
TPTRD_21519
Explanation: User Response:
TPTRD_21520
Explanation: User Response:
TPTRD_21521
Explanation: User Response:
TPTRD_21522
Explanation: User Response:
TPTRD_21523
Explanation: User Response:
TPTRD_21524
Explanation: User Response:
TPTRD_21525
Explanation: User Response:
TPTRD_21526
Explanation: User Response:
TPTRD_21527
Explanation: User Response:
TPTRD_21528
Explanation: User Response:
TPTRD_21529
Explanation:
TPTRD Messages
25
User Response:
Update the Max Sessions attribute and then restart the session.
TPTRD_21530
Explanation: User Response:
TPTRD_21531
Explanation: User Response:
TPTRD_21532
Explanation: User Response:
The minimum 256 bytes and maximum 64000 bytes Block Size is required.
The Block Size attribute for a Teradata PT connection object is set to an illegal value. Update the Block Size attribute and then restart the session.
TPTRD_21533
Explanation: User Response:
TPTRD_35061
Explanation: User Response:
The following system error occurred when the PowerCenter Integration Service tried to get the values of some session attributes: <error message>.
The PowerCenter Integration Service could not get the values of some session-level properties. A system error might have occurred or the repository might have inconsistencies. Fix the operating system error. Contact Informatica Global Customer Support.
TPTWR Messages
TPTWR_11001
Explanation: User Response:
TPTWR_11002
Explanation: User Response:
TPTWR_11003
Explanation: User Response:
26
TPTWR_31101
Explanation: User Response:
TPTWR_31201
Explanation: User Response:
TPTWR_31202
Explanation: User Response:
TPTWR_31203
Explanation: User Response:
TPTWR_31204
Explanation: User Response:
TPTWR_31205
Explanation: User Response:
TPTWR_31206
Explanation: User Response:
TPTWR_31207
Explanation: User Response:
TPTWR_31208
Explanation: User Response:
TPTWR Messages
27
TPTWR_31209
Explanation: User Response:
TPTWR_31210
Explanation: User Response:
TPTWR_31211
Explanation: User Response:
TPTWR_31212
Explanation: User Response:
TPTWR_31213
Explanation: User Response:
TPTWR_31214
Explanation: User Response:
TPTWR_31215
Explanation: User Response:
TPTWR_31216
Explanation: User Response:
TPTWR_31217
Explanation: User Response:
28
TPTWR_31218
Explanation: User Response:
TPTWR_31219
Explanation: User Response:
TPTWR_31220
Explanation: User Response:
TPTWR_31221
Explanation: User Response:
TPTWR_31222
Explanation: User Response:
TPTWR_31223
Explanation: User Response:
TPTWR_31224
Explanation: User Response:
TPTWR_31225
Explanation: User Response:
TPTWR_31226
Explanation: User Response:
TPTWR Messages
29
TPTWR_31227
Explanation: User Response:
TPTWR_31228
Explanation: User Response:
Plug-in failed to set DML Group <DML group name> to connection object.
DML group built is invalid. Contact Informatica Global Customer Support.
TPTWR_31229
Explanation: User Response:
TPTWR_31230
Explanation: User Response:
TPTWR_31231
Explanation: User Response:
TPTWR_31232
Explanation: User Response:
TPTWR_31233
Explanation: User Response:
TPTWR_31234
Explanation: User Response:
TPTWR_31235
Explanation: User Response:
TPTWR_31236
Explanation:
30
User Response:
Drop the error and log tables if they exist in database, and restart the session.
TPTWR_31237
Explanation: User Response:
TPTWR_31238
Explanation: User Response:
TPTWR_31239
Explanation: User Response:
TPTWR_31240
Explanation: User Response:
TPTWR_31301
Explanation: User Response:
TPTWR_31302
Explanation: User Response:
TPTWR_31303
Explanation: User Response:
TPTWR_31304
Explanation: User Response:
TPTWR_31401
Explanation: User Response:
TPTWR_31402
Explanation:
TPTWR Messages
31
User Response:
Make sure that there is enough memory on the machine where the PowerCenter Integration Service is running.
TPTWR_31403
Explanation: User Response:
TPTWR_31404
Explanation: User Response:
TPTWR_31501
Explanation: User Response:
TPTWR_31502
Explanation: User Response:
TPTWR_31503
Explanation: User Response:
TPTWR_31601
Explanation: User Response:
TPTWR_31602
Explanation: User Response:
TPTWR_31603
Explanation: User Response:
Plug-in failed to retrieve Teradata Parallel Transporter connection and session level attributes.
Connection object has some invalid parameters. Check whether all attributes in the connection object are correct.
TPTWR_31604
Explanation: User Response:
TPTWR_31605
Explanation:
Plug-in failed to build DML statements on table <table name> for system operator <system operator name>.
The system does not have enough memory to allocate to the DML statement.
32
User Response:
Make sure that there is enough memory on the machine where the PowerCenter Integration Service is running.
TPTWR_31606
Explanation:
User Response:
Make sure that there is enough memory on the machine where the PowerCenter Integration Service is running.
TPTWR_31607
Explanation:
User Response:
Make sure that there is enough memory on the machine where the PowerCenter Integration Service is running.
TPTWR_31608
Explanation:
User Response:
Make sure that there is enough memory on the machine where the PowerCenter Integration Service is running.
TPTWR_31609
Explanation:
User Response:
Make sure that there is enough memory on the machine where the PowerCenter Integration Service is running.
TPTWR_31610
Explanation: User Response:
Primary Key is not defined for any of the fields of table <table_name>. Cannot build DELETE DML Statement.
Row type is deleted and no primary key is defines in the target table. Define a primary key in the target table and restart the session.
TPTWR_31611
Explanation: User Response:
Primary key is defined for all fields of table <table_name>. Cannot build UPDATE DML Statement.
The entire field in target table is primary key and no other column exists for update. Make sure you have at least one column for update.
TPTWR_31612
Explanation: User Response:
Primary Key is not defined for any of the fields of table <table_name>. Cannot build UPDATE DML Statement.
Row type is update and no primary key is defined in the target table. Define a primary key in the target table and restart the session.
TPTWR_31613
Explanation:
TPTWR Messages
33
User Response:
TPTWR_31614
Explanation: User Response:
TPTWR_31615
Explanation: User Response:
TPTWR_31616
Explanation: User Response:
TPTWR_31617
Explanation: User Response:
TPTWR_31618
Explanation: User Response:
TPTWR_31619
Explanation: User Response:
TPTWR_31620
Explanation: User Response:
TPTWR_31621
Explanation: User Response:
TPTWR_31622
Explanation: User Response:
TPTWR_31623
Explanation: User Response:
34
TPTWR_31624
Explanation: User Response:
TPTWR_31625
Explanation: User Response:
TPTWR_31626
Explanation: User Response:
TPTWR_31627
Explanation: User Response:
TPTWR_31628
Explanation: User Response:
TPTWR_31629
Explanation: User Response:
TPTWR_31630
Explanation: User Response:
TPTWR_31631
Explanation: User Response:
TPTWR_31632
Explanation: User Response:
TPTWR_31633
Explanation: User Response:
TPTWR_31634
Explanation:
TPTWR Messages
35
User Response:
TPTWR_31635
Explanation: User Response:
TPTWR_31636
Explanation: User Response:
TPTWR_31637
Explanation: User Response:
TPTWR_31638
Explanation: User Response:
TPTWR_31639
Explanation: User Response:
TPTWR_31640
Explanation: User Response:
TPTWR_31641
Explanation: User Response:
TPTWR_31642
Explanation: User Response:
TPTWR_34701
Explanation:
User Response:
36
TPTWR_34702
Explanation:
User Response:
TPTWR_34703
Explanation:
User Response:
TPTWR_34704
Explanation: User Response:
TPTWR_34723
Explanation: User Response:
TPTWR_34725
Explanation: User Response:
TPTWR_34727
Explanation: User Response:
TPTWR_34729
Explanation: User Response:
TPTWR_34730
Explanation: User Response:
TPTWR Messages
37
TPTWR_34731
Explanation: User Response:
TPTWR_34732
Explanation: User Response:
TPTWR_35001
Explanation: User Response:
TPTWR_35002
Explanation: User Response:
TPTWR_35003
Explanation: User Response:
TPTWR_35004
Explanation: User Response:
TPTWR_35061
Explanation: User Response:
The following system error occurred when the PowerCenter Integration Service tried to get the values of some session attributes: <error message>.
The PowerCenter Integration Service could not get the values of some session-level properties. A system error might have occurred or the repository might have inconsistencies. Fix the operating system error. Contact Informatica Global Customer Support.
TPTWR_36001
Explanation: User Response:
TPTWR_36002
Explanation: User Response:
The session uses a deprecated connection object. Replace it with a valid connection object.
The session uses a connection object of type Teradata Parallel Transporter Connection, which is deprecated. Replace the deprecated connection object with a connection object of type Teradata PT Connection.
38
INDEX
C
connections Teradata PT API 9 Teradata PT, deprecated 7
PowerExchange for Teradata Parallel Transporter API upgrading 2 prerequisites PowerExchange for Teradata Parallel Transporter API 2
E
environment variables Teradata PT API, setting 3 error messages TPTRD 20 TPTWR 26 error tables Teradata PT, description 13 Teradata PT, dropping 16
R
recovery Teradata PT API sessions 11 recovery tables Teradata PT API, creating automatically 11 Teradata PT, creating manually 12
S
sessions configuring to extract from Teradata PT 15 configuring to load to Teradata PT 16
L
log tables Teradata PT API, description 12 Teradata PT, dropping 16
T
targets Teradata PT, primary key columns 16 Teradata PT API connections creating 9 Teradata PT connections deprecated connection objects 7
M
macro database Teradata PT 16
P
partitioning Teradata PT API sessions 14 plug-ins registering PowerExchange for Teradata Parallel Transporter API 6 PowerExchange for Teradata Parallel Transporter behavior changes 7 installing and configuring 3
W
work tables Teradata PT API, description 14 Teradata PT, dropping 16
39