sno Topics

1 Datawarehousing Concepts
2 ETL Concepts
3 tsortrow done
4 tunite done
5 tuniqerow done
6 tbufferinput done
7 tbuffer output done
8 thashinput done
9 thashoutput done
10 tfilelist done
11 tsleep done
12 tloop done
13 file input output components done
14 database input output components done
15 tsendmail done
16 treplicate done
17 tfiltercolumns done
18 tfilterrows done
19 treplace
20 tconverttype done
21 tdie done
22 tcontextload done
23 trowgenerator done
24 trunjob
25 prejob done
26 postjob done
27 dsamplerows done
28 tnormalize done
29 tdenormalize done
30 tmap done
31 taggrigaterow done
32 tjoin done
33 tsystem done
34 tjava done
35 tjavarow done
36 tjavaflex done
37 tschemacompliancecheck done
38 tlogrow done
39 tlogcatcher done
40 t statcatcher done
41 tfilecopy done
42 tfilearchive done
43 tfileProperties done
44 tfileunarchive done
45 tfiletouch done
46 tfiledelete done
47 tfileexist done
48 tftpfilelist done
49 tftpput done
50 tftpget done
51 tftpdelete done
52 tftpfileexist done
53 tftpConnection done
54 tftpRename done
55 tftpfileproperties done
56 toracleInput done
57 toraclerow done
58 toracleoutpt done
59 toracleconnection done
60 toracleBulk done
61 toracleBulkexec done
62 toracleClose done
63 toracleRollback done
64 toraclecommit done
65 tmssqlInput
66 tmssqlrow
67 tmssqloutpt
68 tmssqlconnection
69 tmssqlBulk
70 tmssqlBulkexec
71 tmssqlClose
 72 tmssqlRollback
73 tmssqlcommit
74 tDb2Input
75 tDb2row
76 tDb2outpt
77 tDb2connection
78 tDb2Bulk
79 tDb2Bulkexec
80 tDb2Close
81 tDb2Rollback
82 tDb2commit
83 OnsubJobOK done
84 OnSubjobError done
85 OnComponentOk done
86 OnComponentError done
87 runif done
88 tExcelInput done
89 tExceloutput done
90 tfileInputjson done
91 tfileoutputjson done
92 tfileInputXml done
93 tfileoutputXml done
94 tfileinputPositional done
95 tfileOutputPositional done
96 SCD1
97 SCD2
98 SCD3
99 stage loading
100 Dimension Loading
101 fact Loading
102 project Explanation
103 difference enterprise and open studio
Talend Components List and Course content
eno ename sal hra
100 A 1500 100
101 B 2000 200 IGNORE
102 C 3000 500
103 D 2500 250 IGNORE
104 E 3000 300
105 F 4500 450

ekey eno ename

1 100 A
2 101 B
3 102 C
4 103 D
5 100 A
6 102 C
7 104 E
8 105 F

eno ename sal hra

100 A 2000 100
101 B 2000 200 ignore
102 C 3000 600
103 D 2500 250 ignore
104 E 4500 300
105 F 4500 450 ignore
106 Z 5000 500

eno
100
101
102
103
104
105
106
 eno ename sal hra ETL_LOAD_DATE
100 A 1200 100 18-Feb-17
101 B 2000 200 15-Feb-17
102 C 3000 450 18-Feb-17
103 D 2500 250 15-Feb-17
104 E 1800 150 18-Feb-17
105 F 1800 180 15-Feb-17
106 G 1400 140 18-Feb-17

SCD2

sal hra start_dt end_dt active_flag version num

1200 100 12-Feb-17 18-Feb-17 N
2000 200 12-Feb-17 31/12/9999 y
3000 450 12-Feb-17 18-Feb-17 N 1
2500 250 12-Feb-17 31/12/9999 y
1500 100 18-Feb-17 31/12/9999 Y
3000 500 18-Feb-17 31/12/9999 Y 2
3000 300 18-Feb-17 31/12/9999 Y
4500 450 18-Feb-17 31/12/9999 Y

SCD3

ename prev_sal curr_sal prev_hra curr_hra etl_date

A 1500 2000 100 20-Feb-17
B 2000 200 15-Feb-17
C 3000 500 600 20-Feb-17
D 2500 250 15-Feb-17
E 3000 4500 300 20-Feb-17
F 4500 450 15-Feb-17
Z 5000 500 20-Feb-17
eno ename sal hra dno
100 A 2000 100 10 num_emps
101 B 2000 200 20 7
102 C 3000 600 10
103 D 2500 250 30
104 E 4500 300 20
105 F 4500 450 10
106 Z 5000 500 30

dno num_emps sum_sal avg_sal max_sal min_sal

10 3 9500 3166.66 4500 2000
sum_sal avg_sal max_sal min_sal
23500 3357.14 5000 2000
eno ename sal hra
100 A 2000 100
101 B 2000 200
102 C 3000 600
103 D 2500 250
104 E 4500 300
105 F 4500 450
106 Z 5000 500

list_enos num_emps sum_sal

100,101,102,103,104,000,000 7 23500
dno
10 dno num_emps sum_sal max_sal min_sal avg_sal
20 10 3 9500 4500 2000 3166.66
10 20 2 6500 4500 2000 3250
30
20
10
30

max_sal min_sal avg_sal

5000 2000 3357.14
eno ename sal hra
100 A 2000 100 ignore
101 B 2500 200 update
102 C 3000 600 ignore
103 D 2500 650 update
104 E 4500 300 ignore
105 F 4500 450 insert
106 Z 5000 500 insert
 scd1

eno ename sal hra ETL_LOAD_DATE

100 A 2000 100 1/12/2017
101 B 2500 200 7/12/2017
102 C 3000 600 1/12/2017
103 D 2500 650 7/12/2017
104 E 4500 300 1/12/2017
105 F 4500 450 7/12/2017
106 Z 5000 500 7/12/2017
eno ename sal hra
100 A 2000 100
101 B 4500 200
102 C 3000 600
103 D 2500 650
104 E 4500 450
105 F 4500 450
106 Z 5000 500
 scd2
empkey eno ename sal hra stdate enddate activeflag
1 100 A 2000 100 1/12/2017 31/12/9999 y
2 101 B 2500 200 1/12/2017 7/12/2017 n
3 102 C 3000 600 1/12/2017 31/12/9999 y
4 103 D 2500 650 1/12/2017 31/12/9999 y
5 104 E 4500 300 1/12/2017 7/12/2017 n
6 101 B 3150 200 7/12/2017 11/12/2017 n
7 104 E 4500 450 7/12/2017 31/12/9999 y
8 105 F 4500 450 7/12/2017 31/12/9999 y
9 106 Z 5000 500 7/12/2017 31/12/9999 y
10 101 B 3350 200 11/12/2017 31/12/9999 y
11 101 B 4500 200 28/12/2017 31/12/2017 y
eno ename sal hra
100 A 2800 200
101 B 2500 250 ignore
102 C 3000 450
103 D 2500 250 ignore
104 E 4500 450 ignore
105 F 4500 450
106 Z 5000 500

105 F 4500 450

106 Z 5000 500
 scd3

eno ename prevsal currsal prevHRA currHra etl_date

100 A 2600 2800 200 7/12/2017
101 B 2500 250 1/12/2017
102 C 3000 380 450 7/12/2017
103 D 2500 250 1/12/2017
104 E 4500 450 1/12/2017
105 F 4500 450 7/12/2017
106 Z 5000 500 7/12/2017
 emp

empno empname sal hra deptno

100 mahesh
101 lakshmi
102 gowrishankar
103
104
 EMP_DIM
ENO ENAME SAL HRA DEPTNO
100 A
101 B
102 C
103 D
104 E

CAL_ID EMP_ID PROD_ID

29052020 100 1002
SHOP_DIM 29052020 100 1003
SHOP_ID SHOP_NAME LOC ADD 29052020 101 1002
1 S1 HYD 29052020 101 1003
2 S2 CHE 29052020 102 1003
3 S3 BAN
4 S4 PUN
 PROD_DIM

PROD_ID PROD_NAME
1001 PUMA
1002 NIKE
1003 REEBOK
1004 ADIDAS

FACT_TABLE CAL_DIM
SHOP_ID QUANTITY PRICE TOTAL_SALE TOTAL_REVENUE CAL_ID DATE
2 10 5000 50000 25000 1012020 1/1/2020
2 20 4000 80000 40000 2012020 2/1/2020
1 20 5000 100000 50000 3012020 3/1/2020
1 10 4000 40000 20000 4012020 4/1/2020
3 15 6000 90000 45000
COLOR SIZE

MONTH WEEKUNM
HAN 1
JAN 1
JAN 1
JAN 1
 SRC

eno ename sal hra

100 A 1200 100 UPDATE
101 B 2000 200 IGNORE
102 C 3000 650 UPDATE
103 D 2500 250 IGNORE
104 E 3000 300 IGNORE
105 F 4000 400
 SLOWLY CHANGING DIM
SCD1
eno ename sal hra SCD_DATE
100 A 1200 100 19/05/2020
101 B 2000 200 14/05/2020
102 C 3000 650 19/05/2020
103 D 2500 250 14/05/2020
104 E 3000 300 14/05/2020
105 F 4000 400 19/05/2020
 SURROGATE KEY
eno ename sal hra EMPKEY eno
100 A 1300 100 1 100
101 B 2000 200 2 101
102 C 3000 450 3 102
103 D 2500 250 4 103
104 E 4000 400 5 104
105 F 5000 500 6 100
7 102
8 105
9 100
10 102
 SCD2

ename sal hra START_DATE END_DATE ACTIVE_FLAG

A 1000 100 14/05/2020 19/05/2020 N
B 2000 200 14/05/2020 31/12/9999 Y
C 3000 300 14/05/2020 19/05/2020 N
D 2500 250 14/05/2020 31/12/9999 Y
E 4000 400 14/05/2020 31/12/9999 Y
A 1200 100 19/05/2020 19/05/2020 N
C 3000 350 19/05/2020 29/05/2020 N
F 5000 500 19/05/2020 31/12/9999 Y
A 1300 100 29/05/2020 31/12/9999 Y
C 3000 450 29/05/2020 31/12/9999 Y
eno ename sal hra eno
100 A 1200 100 SHUFF 100
101 B 2000 200 IGNORE 101
102 C 3000 450 SHUFF 102
103 D 2500 250 IGNORE 103
104 E 4000 400 IGNORE 104
105 F 5000 500 105
SCD3
ename PREV_SAL CURR_SAL PREV_HRA CURR_HRA ETL_DATE
A 1100 1200 100 29/05/2020
B 2000 200 14/05/2020
C 3000 350 450 29/05/2020
D 2500 250 14/05/2020
E 4000 400 14/05/2020
F 5000 500 19/05/2020