0% found this document useful (0 votes)
6 views28 pages

connections and mapping document_8

Download as xlsx, pdf, or txt
Download as xlsx, pdf, or txt
Download as xlsx, pdf, or txt
You are on page 1/ 28

Source

Source Table Name Source Filed Names Source Filed Datatype


CONTACTS CONTACT_ID NUMBER
319 FIRST_NAME VARCHAR2(255)
LAST_NAME VARCHAR2(255)
EMAIL VARCHAR2(255)
PHONE VARCHAR2(20)
CUSTOMER_ID NUMBER

TEAM LEAD DA- DATA ARCHITEC DBA-DATABASE ADMINISTRATOR

what is the task?


why I am doing this task?
how can I implment this task?

raj@gmail.com

RAJ
V

LAST_DATE
VARIABLE_PORT TODAY_DATE
OUTPUT_PORT CURRENT_DATE
OUTOUT_PORT LAST_DAY

raj
arun
BUSINESS RULE/MAPPING RULE TARGET
Target Table Name
DIRECT MAPPING CONTACTS_TGT10
319

DIRECT MAPPING
DIRECT MAPPING
DIRECT MAPPING
CONCATENATE FIRST_NAME AND LAST_NAME
CONCATENATE FIRST_NAME AND LAST_NAME WITH DOT IN BETWEEN
GENERATE THE CURRENT SESSION NAME OF THE WORKFLOW
GENERATE TODAY'S DATE
CALCULTE EMAIL ID LENGTH
GENERATE LAST DATE OF CURRENT MONTH
ASE ADMINISTRATOR
RAJ
V
RAJV
FULL_NAME RAJV
FULL_NAME1 RAJ.V
SESSION_NAME s_m_CONTACTS_TGT
CURRENT_DATE 4/26/2023
EMAIL_ID_LENGTH 13
LAST_DATE 4/30/2023
RAJV
RAJ.V
10/27/2021
10/31/2021

ABC@GMAIL.COM
RAJ
V 10/27/2021
RAJV
RAJ.V

LAST_DATE = LAST_DAY(TODAY'SDATE)
CONCAT(FIRST_NAME,LAST_NAME) filter trnasformation
FIRST_NAME||LAST_NAME
router tranfmroation

LAST_DAY(CURRENT_DATE)

V_TODAY_NAME = SYSDATE SAL>1000


CURRENT_DATE=V_TODAY_NAME
CURRENT_DATE =SYSDATE

SYSDATE
TODAY_DATE
LAST_DAY(CURRENT_DATE)

v
kumar

salary
commision

salary+commisssion
TARGET
Target Filed Name Target Filed Datatype
CONTACT_ID NUMBER

EMAIL VARCHAR2(255)
PHONE VARCHAR2(20)
CUSTOMER_ID NUMBER
FULL_NAME VARCHAR2(255)
FULL_NAME1 VARCHAR2(255)
SESSION_NAME VARCHAR2(255)
CURRENT_DATE DATE
EMAIL_ID_LENGTH NUMBER
LAST_DATE DATE

10 MINS

10/31/2021
Source File Name Source Filed Names Source Filed Datatype
orders_src.csv ORDER_ID NUMBER(10)
ORDER_DATE DATE
STATUS VARCHAR2(255)
QUANTITY NUMBER(10)
PRICE DECIMAL(15,2)
DISCOUNT NUMBER(10)

1 QUARTER 3 MONTHS
1 year= 4 QUARTERS
1 QUARTER JAN , FEB , MAR
2 QUARTER APR , MAY , JUNE
3 QUARTER JULY , AUG , SEP
4 QUARTER OCT, NOV ,DEC
BUSINESS RULE
Target File Name
DIRECT MAPPING orders_target_ff.dat
DIRECT MAPPING | - pipe
DIRECT MAPPING
DIRECT MAPPING
DIRECT MAPPING
DIRECT MAPPING
CALCULATE QUANTITY*(PRICE -DISCOUNT) FOR FIRST QUARTER ONLY
CALCULATE QUANTITY* (PRICE -DISCOUNT) FOR SECOND QUARTER ONLY
CALCULATE QUANTITY* (PRICE -DISCOUNT) FOR THIRD QUARTER ONLY
CALCULATE QUANTITY* (PRICE -DISCOUNT) FOR FOURTH QUARTER ONLY

ORDER_DATE=01-01-2022 MONTH

5 MINS

2/1/2022

11/21/2022
|
ORDER_DATE
MONTH=1
IF (MONTH=1 OR MONTH =2 OR MONTH=3 , CALCULATE QUANTITY*(PRICE -DISCOUNT) ,0)
IF (MONTH=4 OR MONTH =5 OR MONTH=6 , CALCULATE QUANTITY*(PRICE -DISCOUNT) ,0)
IF (MONTH=7 OR MONTH =8 OR MONTH=9 , CALCULATE QUANTITY*(PRICE -DISCOUNT) ,0)
IF (MONTH=10 OR MONTH =11 OR MONTH=12, CALCULATE QUANTITY*(PRICE -DISCOUNT) ,0)

GET_DATE_PART(ORDER_DATE,'MM')
DD
MM
YYYY

GET_DATE_PART(ORDER_DATE,'MM')
QUANTITY* (PRICE- DISCOUNT)
IIF(MONTH=1 OR MONTH=2 OR MONTH=3 , V_SALES )
order_date
11/17/2021 00:00:00

take the month out


month =11
Target Filed Name Target Filed Datatype
ORDER_ID NUMBER(10)
ORDER_DATE DATE
STATUS VARCHAR2(255)
QUANTITY NUMBER(10)
PRICE DECIMAL(15,3)
DISCOUNT NUMBER(10)
Q1_SALES DECIMAL(15,3)
Q2_SALES DECIMAL(15,3)
Q3_SALES DECIMAL(15,3)
Q4_SALES DECIMAL(15,3)

1
2
3
4

MM/DD/YYYY

Q1_SALES
Q2_SALES
Q3_SALES
Q4_SALES
KT -knowledge Transfer

5 people
mapping documents 1- team lead
1- manager
2 - developers
1- ETL tester

oracle
load data from source to target data
Upstream
source
20 tables

EXPERSSIONS TR
datawarehouse project
ETL - Informatica

Devlopment project daily basis creating mappings


Maintaninace already mappings created
Production Support workflows running on daily

oracle
teradata/ sql server sql server
my sql
Downsteram teradta
targets greenplum
15 target tables db2

ports

INPUT
OUTPUT
VARIABLE
1. statrting from Scratch
2. On going project - 80%
change the mappings or add fileds to the source and target tables

oracle sql developer

teradata studio
FLORE STOFLORESTONE
FULL_NAMCONTACT(FFIRSTNAMFIRST_NAME||LAST_NAME
CONCAT(FIFLORE.STONE
FLORE.
CONCAT(CONCAT(FIRSFIRST_NAME||'.'||LAST_NAME
FLORE.

CURRENT_ ###
LAST_DAY( ###

OUTPUT_PCURRENT_SYSDATE
OUTOUT_PLAST_DAY LAST_DAY(CURRENT_DATE)
sum()
avg()
mx()
min()
coun()
SALARY MAX(SALARY) MINSALARY) SUM(SALARY)
14000 14000 14000 14000

5000 7000 5000 18000


6000
7000
AVG(SALARY) COUNT(SALARY)
14000 1

6000 3
100 Steven King SKING 515.123.4567 6/17/1987 AD_PRES 24000
101 Neena Kochhar NKOCHHAR 515.123.4568 9/21/1989 AD_VP 17000
102 Lex De Haan LDEHAAN 515.123.4569 1/13/1993 AD_VP 17000
103 Alexander Hunold AHUNOLD 590.423.4567 1/3/1990 IT_PROG 9000
104 Bruce Ernst BERNST 590.423.4568 5/21/1991 IT_PROG 6000
105 David Austin DAUSTIN 590.423.4569 6/25/1997 IT_PROG 4800
106 Valli Pataballa VPATABAL 590.423.4560 2/5/1998 IT_PROG 4800
107 Diana Lorentz DLORENTZ 590.423.5567 2/7/1999 IT_PROG 4200
108 Nancy Greenberg NGREENBE 515.124.4569 8/17/1994 FI_MGR 12000
109 Daniel Faviet DFAVIET 515.124.4169 8/16/1994 FI_ACCOUNT 9000
110 John Chen JCHEN 515.124.4269 9/28/1997 FI_ACCOUNT 8200
111 Ismael Sciarra ISCIARRA 515.124.4369 9/30/1997 FI_ACCOUNT 7700
112 Jose Manuel Urman JMURMAN 515.124.4469 3/7/1998 FI_ACCOUNT 7800
113 Luis Popp LPOPP 515.124.4567 12/7/1999 FI_ACCOUNT 6900
114 Den Raphaely DRAPHEAL 515.127.4561 12/7/1994 PU_MAN 11000
115 Alexander Khoo AKHOO 515.127.4562 5/18/1995 PU_CLERK 3100
116 Shelli Baida SBAIDA 515.127.4563 12/24/1997 PU_CLERK 2900
117 Sigal Tobias STOBIAS 515.127.4564 7/24/1997 PU_CLERK 2800
118 Guy Himuro GHIMURO 515.127.4565 11/15/1998 PU_CLERK 2600
119 Karen Colmenares KCOLMENA 515.127.4566 8/10/1999 PU_CLERK 2500
120 Matthew Weiss MWEISS 650.123.1234 7/18/1996 ST_MAN 8000
121 Adam Fripp AFRIPP 650.123.2234 4/10/1997 ST_MAN 8200
122 Payam Kaufling PKAUFLIN 650.123.3234 5/1/1995 ST_MAN 7900
123 Shanta Vollman SVOLLMAN 650.123.4234 10/10/1997 ST_MAN 6500
124 Kevin Mourgos KMOURGOS 650.123.5234 11/16/1999 ST_MAN 5800
125 Julia Nayer JNAYER 650.124.1214 7/16/1997 ST_CLERK 3200
126 Irene Mikkilineni IMIKKILI 650.124.1224 9/28/1998 ST_CLERK 2700
127 James Landry JLANDRY 650.124.1334 1/14/1999 ST_CLERK 2400
128 Steven Markle SMARKLE 650.124.1434 3/8/2000 ST_CLERK 2200
129 Laura Bissot LBISSOT 650.124.5234 8/20/1997 ST_CLERK 3300
130 Mozhe Atkinson MATKINSO 650.124.6234 10/30/1997 ST_CLERK 2800
131 James Marlow JAMRLOW 650.124.7234 2/16/1997 ST_CLERK 2500
132 TJ Olson TJOLSON 650.124.8234 4/10/1999 ST_CLERK 2100
133 Jason Mallin JMALLIN 650.127.1934 6/14/1996 ST_CLERK 3300
134 Michael Rogers MROGERS 650.127.1834 8/26/1998 ST_CLERK 2900
135 Ki Gee KGEE 650.127.1734 12/12/1999 ST_CLERK 2400
136 Hazel Philtanker HPHILTAN 650.127.1634 2/6/2000 ST_CLERK 2200
137 Renske Ladwig RLADWIG 650.121.1234 7/14/1995 ST_CLERK 3600
138 Stephen Stiles SSTILES 650.121.2034 10/26/1997 ST_CLERK 3200
139 John Seo JSEO 650.121.2019 2/12/1998 ST_CLERK 2700
140 Joshua Patel JPATEL 650.121.1834 4/6/1998 ST_CLERK 2500
141 Trenna Rajs TRAJS 650.121.8009 10/17/1995 ST_CLERK 3500
142 Curtis Davies CDAVIES 650.121.2994 1/29/1997 ST_CLERK 3100
143 Randall Matos RMATOS 650.121.2874 3/15/1998 ST_CLERK 2600
144 Peter Vargas PVARGAS 650.121.2004 7/9/1998 ST_CLERK 2500
145 John Russell JRUSSEL 011.44.1344.429268 10/1/1996 SA_MAN 14000 0.4
146 Karen Partners KPARTNER 011.44.1344.467268 1/5/1997 SA_MAN 13500 0.3
147 Alberto Errazuriz AERRAZUR 011.44.1344.429278 3/10/1997 SA_MAN 12000 0.3
148 Gerald Cambrault GCAMBRAU 011.44.1344.619268 10/15/1999 SA_MAN 11000 0.3
149 Eleni Zlotkey EZLOTKEY 011.44.1344.429018 1/29/2000 SA_MAN 10500 0.2
150 Peter Tucker PTUCKER 011.44.1344.129268 1/30/1997 SA_REP 10000 0.3
151 David Bernstein DBERNSTE 011.44.1344.345268 3/24/1997 SA_REP 9500 0.25
152 Peter Hall PHALL 011.44.1344.478968 8/20/1997 SA_REP 9000 0.25
153 Christopher Olsen COLSEN 011.44.1344.498718 3/30/1998 SA_REP 8000 0.2
154 Nanette Cambrault NCAMBRAU 011.44.1344.987668 12/9/1998 SA_REP 7500 0.2
155 Oliver Tuvault OTUVAULT 011.44.1344.486508 11/23/1999 SA_REP 7000 0.15
156 Janette King JKING 011.44.1345.429268 1/30/1996 SA_REP 10000 0.35
157 Patrick Sully PSULLY 011.44.1345.929268 3/4/1996 SA_REP 9500 0.35
158 Allan McEwen AMCEWEN 011.44.1345.829268 8/1/1996 SA_REP 9000 0.35
159 Lindsey Smith LSMITH 011.44.1345.729268 3/10/1997 SA_REP 8000 0.3
160 Louise Doran LDORAN 011.44.1345.629268 12/15/1997 SA_REP 7500 0.3
161 Sarath Sewall SSEWALL 011.44.1345.529268 11/3/1998 SA_REP 7000 0.25
162 Clara Vishney CVISHNEY 011.44.1346.129268 11/11/1997 SA_REP 10500 0.25
163 Danielle Greene DGREENE 011.44.1346.229268 3/19/1999 SA_REP 9500 0.15
164 Mattea Marvins MMARVINS 011.44.1346.329268 1/24/2000 SA_REP 7200 0.1
165 David Lee DLEE 011.44.1346.529268 2/23/2000 SA_REP 6800 0.1
166 Sundar Ande SANDE 011.44.1346.629268 3/24/2000 SA_REP 6400 0.1
167 Amit Banda ABANDA 011.44.1346.729268 4/21/2000 SA_REP 6200 0.1
168 Lisa Ozer LOZER 011.44.1343.929268 3/11/1997 SA_REP 11500 0.25
169 Harrison Bloom HBLOOM 011.44.1343.829268 3/23/1998 SA_REP 10000 0.2
170 Tayler Fox TFOX 011.44.1343.729268 1/24/1998 SA_REP 9600 0.2
171 William Smith WSMITH 011.44.1343.629268 2/23/1999 SA_REP 7400 0.15
172 Elizabeth Bates EBATES 011.44.1343.529268 3/24/1999 SA_REP 7300 0.15
173 Sundita Kumar SKUMAR 011.44.1343.329268 4/21/2000 SA_REP 6100 0.1
174 Ellen Abel EABEL 011.44.1644.429267 5/11/1996 SA_REP 11000 0.3
175 Alyssa Hutton AHUTTON 011.44.1644.429266 3/19/1997 SA_REP 8800 0.25
176 Jonathon Taylor JTAYLOR 011.44.1644.429265 3/24/1998 SA_REP 8600 0.2
177 Jack Livingston JLIVINGS 011.44.1644.429264 4/23/1998 SA_REP 8400 0.2
178 Kimberely Grant KGRANT 011.44.1644.429263 5/24/1999 SA_REP 7000 0.15
179 Charles Johnson CJOHNSON 011.44.1644.429262 1/4/2000 SA_REP 6200 0.1
180 Winston Taylor WTAYLOR 650.507.9876 1/24/1998 SH_CLERK 3200
181 Jean Fleaur JFLEAUR 650.507.9877 2/23/1998 SH_CLERK 3100
182 Martha Sullivan MSULLIVA 650.507.9878 6/21/1999 SH_CLERK 2500
183 Girard Geoni GGEONI 650.507.9879 2/3/2000 SH_CLERK 2800
184 Nandita Sarchand NSARCHAN 650.509.1876 1/27/1996 SH_CLERK 4200
185 Alexis Bull ABULL 650.509.2876 2/20/1997 SH_CLERK 4100
186 Julia Dellinger JDELLING 650.509.3876 6/24/1998 SH_CLERK 3400
187 Anthony Cabrio ACABRIO 650.509.4876 2/7/1999 SH_CLERK 3000
188 Kelly Chung KCHUNG 650.505.1876 6/14/1997 SH_CLERK 3800
189 Jennifer Dilly JDILLY 650.505.2876 8/13/1997 SH_CLERK 3600
190 Timothy Gates TGATES 650.505.3876 7/11/1998 SH_CLERK 2900
191 Randall Perkins RPERKINS 650.505.4876 12/19/1999 SH_CLERK 2500
192 Sarah Bell SBELL 650.501.1876 2/4/1996 SH_CLERK 4000
193 Britney Everett BEVERETT 650.501.2876 3/3/1997 SH_CLERK 3900
194 Samuel McCain SMCCAIN 650.501.3876 7/1/1998 SH_CLERK 3200
195 Vance Jones VJONES 650.501.4876 3/17/1999 SH_CLERK 2800
196 Alana Walsh AWALSH 650.507.9811 4/24/1998 SH_CLERK 3100
197 Kevin Feeney KFEENEY 650.507.9822 5/23/1998 SH_CLERK 3000
198 Donald OConnell DOCONNEL 650.507.9833 6/21/1999 SH_CLERK 2600
199 Douglas Grant DGRANT 650.507.9844 1/13/2000 SH_CLERK 2600
200 Jennifer Whalen JWHALEN 515.123.4444 9/17/1987 AD_ASST 4400
201 Michael Hartstein MHARTSTE 515.123.5555 2/17/1996 MK_MAN 13000
202 Pat Fay PFAY 603.123.6666 8/17/1997 MK_REP 6000
203 Susan Mavris SMAVRIS 515.123.7777 6/7/1994 HR_REP 6500
204 Hermann Baer HBAER 515.123.8888 6/7/1994 PR_REP 10000
205 Shelley Higgins SHIGGINS 515.123.8080 6/7/1994 AC_MGR 12000
206 William Gietz WGIETZ 515.123.8181 6/7/1994 AC_ACCOUNT 8300
90
100 90
100 90
102 60
103 60
103 60
103 60
103 60
101 100
108 100
108 100
108 100
108 100
108 100
100 30
114 30
114 30
114 30
114 30
114 30
100 50
100 50
100 50
100 50
100 50
120 50
120 50
120 50
120 50
121 50
121 50
121 50
121 50
122 50
122 50
122 50
122 50
123 50
123 50
123 50
123 50
124 50
124 50
124 50
124 50
100 80
100 80
100 80
100 80
100 80
145 80
145 80
145 80
145 80
145 80
145 80
146 80
146 80
146 80
146 80
146 80
146 80
147 80
147 80
147 80
147 80
147 80
147 80
148 80
148 80
148 80
148 80
148 80
148 80
149 80
149 80
149 80
149 80
149
149 80
120 50
120 50
120 50
120 50
121 50
121 50
121 50
121 50
122 50
122 50
122 50
122 50
123 50
123 50
123 50
123 50
124 50
124 50
124 50
124 50
101 10
100 20
201 20
101 40
101 70
101 110
205 110
20 source 5 target tables

3 developers

1 table - dev Teamlead 20 days


2-dev
2-dev
dev
1 table 5 unit testin SIT
soure SQ EXP
ORDER_ID 1002 ORDER_ID 1002 ORDER_ID
ORDER_DATE 02/20/2021 0ORDER_DATE 02/20/2021 00ORDER_DATE
STATUS Pending STATUS Pending STATUS
QUANTITY 253 QUANTITY 253 QUANTITY
PRICE 4896 PRICE 4896 PRICE
DISCOUNT 6 DISCOUNT 6 DISCOUNT
2 v_month
1237170 o_Q1_SALES
0 o_Q2_SALES
0 o_Q3_SALES
0 o_Q4_SALES
0
0
0
0
0
0
TARGET
ORDER_ID 1001 1002
ORDER_DATE11/17/202102/20/2021 00:00:00
STATUS Pending Pending
QUANTITY 512 253
PRICE 5698 4896
DISCOUNT 4 6
GET_DATE_PART(ORDER_DATE,'MM') Q1_SALES 0 1237170
IIF(v_MONTH=1 OR v_MONTH=2 OR v_MONTH=3 , QU
Q2_SALES 0 0
IIF(v_MONTH=4 OR v_MONTH=5 OR v_MONTH=6 , Q3_SALES 0 0
IIF(v_MONTH=7 OR v_MONTH=8 OR v_MONTH=9 , Q4_SALES 2915328 0
IIF(v_MONTH=10 OR v_MONTH=11 OR v_MONTH=12, QUANTITY*(PRICE-DISCOUNT) , 0)
0 number 20 0 0 COMP-X NOT A KEY 0
0 datetime 29 9 0 COMP-X NOT A KEY 0
0 string 255 0 0 COMP-X NOT A KEY 0
0 number 20 0 0 COMP-X NOT A KEY 0
0 number 20 0 0 COMP-X NOT A KEY 0
0 number 20 0 0 COMP-X NOT A KEY 0
0 0 0 Shift-In
0 0 0 Shift-In
0 0 0 Shift-In
0 0 0 Shift-In
0 0 0 Shift-In
0 0 0 Shift-In

You might also like