Static

Dept

Dynamic

DeptNo
D1
D2

Dname
X
Y

DeptNo
D1
D2
D3
EmpNo

SD
SQ
NewLookuprow

Lookup(Dep)
Emp
EmpNo
DeptNo
10 D1
20 D2
30 D3
40 D3

Lkp

RTR
I_DEPTNO D3
DEPTNO null
DeptNamenull

Dname
X
Y

Persistence

Rechache

Code
M
F
UN

TRG

Desc
Male
Female
Unknow

I_DEPTNO DeptName
30 D3
Z
40 D3
M

EmpNo

TRG
EmpNo

Dename
M
N
Z
M

0 no change
1 new
2 Change
PolicyNo
OLTP
Insurance
Source
1 T1
Amount
1 T2
Address
1 T3
Email

Gender
Dname
F
X
M
Y
UN
XX
NewLookuprow=1
NewLookuprow=2

Amount
Stage

T1
T2
1:01 T3

Isnul(DeptNo)
Not Isnull(DeptNo)
10 D1
M
20 D2
N
40 D3
Z

Address

Ph

Email

Apply logic

I_DEPTNO
30 D3

Update

I_DEPTNO DeptName
10 D1
X
20 D2
Y

Gender
Code
M
F
UN
XX
MS
DW
Fact
DIM_T1
DIM_T2

New

Desc
Male
Female
Unknow
YYYY
PremimuAmt

T1

13

14
Select * from T1 where updateDate> (select insertdate from Dummy where tablename=t1)
update dummy set insertdate=( select max(insertdate) from stage_t1 where tablename=t1

T1
PN
P1
p12
p14

InsertDate Update
7-Jan >
11
6-Jan >
6-Jan >
7-Jan
8D
3F

Thresold

S1

S2

Start

WK
S1
S2
S3
Parellel

Dummy
TableNameInsertDate
T1
6-Jan
t2
6-Jan

6-Jan
6-Jan
6-Jan

S8

F1

S1
S2
S3

S4

F2

F3

5
5
3

Incremental/Delta/ChangeDataCapture
Full load truncate and reload
Intial Load Old data

S5
S6
S7
S8

S1

F1
F2
F3

S2
5

S3
5

Taracing level related to log file

Terse
Normal
Verbose IntVerbose Data
It tells that how many records are getting loaded into target per second
Data CacheCondition columns data
Index
Other columns data
Rank

Lookup

Joiner

Agg

YYY

XXX
M1
10,000
XXX
M2

Sorter
M3

10

shared

DeptName
M

DeptName

remimuAmt
Insert
Update

tablename=t1)

tablename=t1

ngeDataCapture

10
20