Professional Documents
Culture Documents
Risk Management Report: 1. Data Analysis Project
Risk Management Report: 1. Data Analysis Project
Risk Management Report: 1. Data Analysis Project
For this, we used ETL Process i.e. Extract, Transform & Load
E (Extract) — we were Extracting the data from the data source which is our vendor Hong Kong
Exchange in terms of CSV File and then we were loading those data into the Staging layer first without
doing any modifications.
T (Transform)—In this Report , various transformations are done according to the different business
requirements like calculations or concatenations or aggregations on data depending upon the
requirements. So basically, we are doing transformations on data which adds value and changes data
such that the insightful report can be generated.
L (Load) — Once the transformations are done, we will load those data into our warehouse which will
be then used for the reporting purpose to give valuable information like trends, patterns, relationships
etc. within the data.
Tools Used- IBM Data Studio, Putty, Pentaho Report Designer, GitHub, JIRA
Tech Skills Required- SQL Server, Data warehouse-ETL, DB2, UNIX, Reporting
3. Self-Assessment Of Skills:
Areas:
• Insights - scope business requirements & deliver actionable insights to stakeholders - 9
I analyze the requirements whenever it is given and then communicate with the clients if I am
facing any issues so that I can deliver my solutions on time without any error.
• SQL - basic syntax, window functions, use views to clean/ data, optimize queries - 9
I have used SQL in my whole experience of around 5 years.
• Data sources - structured/unstructured, SQL databases, Big data, Time series, APIs – 7
I have experience of working in SQL databases, Data sources- structured/unstructured.
• ETL - build pipelines across a range of data sources – 9
I have mostly worked on the projects which was related to ETL.
• Modeling - build statistical models through selection, training & deployment –No
Experience
• Statistics - calculate statistical significance, design A/B tests, quantify trends ---No
Experience