Teradata TTU
Teradata TTU
Teradata TTU
com/cd/E14571_
01/integrate.1111/e12644/teradata.ht
m#ODIKM587
Teradata
This chapter describes how to work with Teradata in Oracle Data Integrator.
This chapter includes the following sections:
Section
Section
Section
Section
Section
Section
Section
Section
10.1,
10.2,
10.3,
10.4,
10.5,
10.6,
10.7,
10.8,
"Introduction"
"Installation and Configuration"
"Setting up the Topology"
"Setting Up an Integration Project"
"Creating and Reverse-Engineering a Teradata Model"
"Setting up Data Quality"
"Designing an Interface"
"KM Optimizations for Teradata"
10.1 Introduction
Oracle Data Integrator (ODI) seamlessly integrates data in an Teradata database.
Oracle Data Integrator features are designed to work best with Teradata, including
reverse-engineering, data integrity check, and integration interfaces.
10.1.1 Concepts
The Teradata database concepts map the Oracle Data Integrator concepts as
follows: A Teradata server corresponds to a data server in Oracle Data Integrator.
Within this server, a database maps to an Oracle Data Integrator physical schema.
Oracle Data Integrator uses Java Database Connectivity (JDBC) and Teradata
Utilities to connect to Teradata database.
possible to use the generic SQL KMs with the Teradata database. See Chapter 4,
"Generic SQL" for more information.
Table 10-1 Teradata Knowledge Modules
Knowledge Module
Description
CKM Teradata
This IKM is designed to leverage the power of the Teradata utilities for load
See Section 10.8.2, "Support for Teradata Utilities" for more information.
IKM Teradata
Incremental Update
Integrates data in a target file from a Teradata staging area in replace mod
for Teradata Utilities" for more information.
Knowledge Module
Description
Control Append
(append) mode.
This IKM is typically used for ETL configurations: source and target tables a
the interface's staging area is set to the logical schema of the source table
Loads data from a File to a Teradata staging area database using the Terad
10.8.2, "Support for Teradata Utilities" for more information.
RKM Teradata
Retrieves metadata from the Teradata database using the DBC system vie
columns.
FastLoad
MultiLoad
Tpump
FastExport
Teradata Parallel Transporter
The following requirements and restrictions apply for these Knowledge Modules:
Teradata Utilities must be installed on the machine running the Oracle Data
Integrator Agent.
The server name of the Teradata Server defined in the Topology must match
the Teradata connect string used for this server (without the COP_npostfix).
The IKM File to Teradata (TTU) and LKM File to Teradata (TTU) support a File
Character Set Encoding option specify the encoding of the files integrated
with TTU. If this option is unset, the default TTU charset is used. Refer to the
"Getting Started: International Character Sets and the Teradata Database"
Teradata guide for more information about character set encoding.
JDBC Driver
Oracle Data Integrator uses the Teradata JDBC Driver to connect to a Teradata
Database. The Teradata Gateway for JDBC must be running, and this driver must be
installed in your Oracle Data Integrator installation. You can find this driver at:
http://www.teradata.com/DownloadCenter/Group48.aspx
Name: Name of the data server that will appear in Oracle Data
Integrator
IP address.
<port>: gateway port number (usually 7060)
<server>: name of the Teradata server to connect
Create for this physical schema a logical schema using the standard procedure, as
described in "Creating a Logical Schema" of the Oracle Fusion Middleware
Developer's Guide for Oracle Data Integrator and associate it in a given context.
CKM Teradata
IKM File to Teradata (TTU)
IKM SQL to Teradata (TTU)
IKM Teradata Control Append
IKM Teradata Incremental Update
IKM Teradata Multi Statement
IKM Teradata Slowly Changing Dimension
IKM Teradata to File (TTU)
IKM SQL to Teradata Control Append
LKM File to Teradata (TTU)
LKM SQL to Teradata (TTU)
RKM Teradata
In most of the cases, consider using the standard JDBC reverse engineering for
starting. Standard reverse-engineering with Teradata retrieves tables and columns.
Preferably use customized reverse-engineering for retrieving more metadata.
Teradata customized reverse-engineering retrieves the tables, views, columns,
keys (primary indexes and secondary indexes) and foreign keys. Descriptive
information (column titles and short descriptions) are also reverse-engineered.
Standard Reverse-Engineering
To perform a Standard Reverse-Engineering on Teradata use the usual procedure,
as described in "Reverse-engineering a Model" of the Oracle Fusion Middleware
Developer's Guide for Oracle Data Integrator.
Customized Reverse-Engineering
To perform a Customized Reverse-Engineering on Teradata with a RKM, use the
usual procedure, as described in "Reverse-engineering a Model" of the Oracle
Fusion Middleware Developer's Guide for Oracle Data Integrator. This section
details only the fields specific to the Teradata technology:
1. In the Reverse tab of the Teradata Model, select the KM: RKM
Teradata.<project name>.
2. Set the REVERSE_FKS option to true, if you want to reverse-engineer
existing FK constraints in the database.
3. Set the REVERSE_TABLE_CONSTRAINTS to true if you want to reverseengineer table constrains.
The reverse-engineering process returns tables, views, columns, Keys (primary
indexes and secondary indexes) and Foreign Keys. Descriptive information (Column
titles and short descriptions) are also reverse-engineered
Note that Unique Indexes are reversed as follows:
You can use this RKM to retrieve specific Teradata metadata that is not supported
by the standard JDBC interface (such as primary indexes).
Recommended KM
Notes
CKM Teradata
Checks d
defined o
invalid re
dynamica
controls a
This KM s
optimizat
Pr
St
Use the Generic SQL KMs or the KMs specific to the other technology involved to
load data from a Teradata database to a target or staging area database.
For extracting data from a Teradata staging area to a file, use the IKM File to
Teradata (TTU). See Section 10.7.2, "Integrating Data in Teradata" for more
information.
KM
Notes
File
Loads da
staging a
bulk utilit
Because
Teradata
staging a
standard
with large
Consider
large flat
Teradata
This KM s
optimizat
SQL
St
Op
Ma
Loads da
database
database
utility.
This LKM
file or Na
specified
KM
Notes
staging t
named p
file. This
large volu
Consider
Th
co
Yo
be
Yo
da
This KM s
optimizat
Su
Su
Op
Ma
KM
Notes
Integrate
in replace
needs to
creates a
invoking
Consider
KM
Notes
your Tera
mode, wi
check.
To use th
on the sa
Teradata
This KM s
optimizat
Pr
Op
Ma
Integrate
in increm
creates a
the data
to the tar
should be
should be
performin
invoking
Inserts an
based pro
performa
optimized
Consider
your Tera
missing r
ones.
To use th
on the sa
This KM s
optimizat
Pr
Op
Ma
KM
Notes
Integrate
target tab
requests,
Integrate
used as a
Dimensio
IKM relies
Dimensio
datastore
should be
updated
Because
bulk set-b
optimized
Consider
your Tera
Slowly Ch
To use th
on the sa
the appro
Dimensio
the targe
This KM s
optimizat
Pr
Op
Ma
This KM a
option. T
Teradata
this versi
statemen
standard
to merge
target tab
KM
Notes
Integrate
Teradata
This IKM
on Terada
utilities to
file.
Consider
transform
from you
To use th
different
to a Terad
This KM s
optimizat
Su
This IKM
power of
files direc
to one fil
table as t
Dependin
have the
either rep
mode.
Consider
a single fl
Because
IKM is rec
volumes.
To use th
staging a
This KM s
optimizat
Pr
Su
Op
KM
Notes
Ma
IKM SQL to Teradata (TTU)
Integrate
database
table usin
FASTLOAD
This IKM
power of
source da
only be u
belong to
this data
(staging
be unload
then load
utility dir
named p
file. This
large volu
Dependin
have the
replace o
Consider
Yo
wi
so
All
sa
sta
Yo
be
To use th
staging a
schema.
This KM s
optimizat
Pr
Su
KM
Notes
Su
Op
Ma
Integrate
source da
in trunca
This IKM
configura
are on di
interface
logical sc
third sche
"Designin
more info
In the first interface of the package loading a table via the multistatement set the INIT_MULTI_STATEMENT option to YES.
The last interface must have the EXECUTE option set to YES in order
to run the generated multi-statement.
In the SQL_OPTION option, specify the additional SQL sentence that is added
at the end of the query, for example QUALIFY Clause.
Multi-statements are only supported when they are used within a package.
Temporary indexes are not supported.
Updates are considered as Inserts in terms of row count.
Updates can only have a single Dataset.
Only executing interface (EXECUTE = YES) reports row counts.
Journalized source data not supported.
Neither Flow Control nor Static Control is supported.
The SQL_OPTION option applies only to the last Dataset.
Depending on the KM strategy that is used, flow and static control are supported.
Source
Staging Area
Target
Exporting
LKM
ANSI SQL92
standard
compliant
ANSI SQL-92
standard
compliant
Teradata
NA
ANSI SQL92
standard
compliant
Teradata or
any ANSI SQL92 standard
compliant
database
Teradata or
any ANSI SQL92 standard
compliant
database
NA
IKM
KM
Strategy
Comment
IKM SQL to
Teradata
Control
Append
Multiconnectio
n IKM
Recommend
IKM SQL to
SQL
Incremental
Update
Multiconnectio
n IKM
Allows an inc
no temporar
if it is not po
objects in the
Supports flow
The applicati
Source
Staging Area
Target
Exporting
LKM
IKM
KM
Strategy
Comment
temporary ob
are made dir
configuration
on the stagin
should be us
data.
Supports flow
ANSI SQL92
standard
compliant
Teradata or
ANSI SQL-92
standard
compliant
Teradata
LKM +
standard
IKM
ANSI SQL92
standard
compliant
Teradata
Teradata
LKM +
standard
IKM
ANSI SQL92
standard
compliant
ANSI SQL-92
standard
compliant
Teradata
LKM +
standard
IKM
If no flow con
recommende
Teradata performance heavily relies on primary indexes. The Teradata KMs support
customized primary indexes (PI) for temporary and target tables. This applies to
Teradata LKMs, IKMs and CKMs. The primary index for the temporary and target
tables can be defined in these KMs using the PRIMARY_INDEX KM option, which
takes the following values:
[PK]: The PI will be the primary key of each temporary or target table. This
[NOPI]: Do not specify primary index (Teradata 13.0 & above only).
[UK]: The PI will be the update key of the interface. This is the default value.
This option takes the following values when pushing data FROM Teradata to a file:
When using TTU KMs, you should also take into account the following KM
parameters:
For details and appropriate choice of utility and load operator, refer to the Teradata
documentation.
DROP_CREATE: Always drop and recreate all temporary tables for every
execution (default behavior).
DELETE_ALL: Do not create temporary tables. Only submit DELETE ALL for
all temporary tables.
NONE: Do not issue any DDL on temporary tables. Temporary tables should
be handled separately.