DATA

ENGINEERING
 Introduction to Data Engineering Introduction to SQL
over view of Data engineering Set Operations
Role, Importance , challenges SQL Operators
Difference among Data Engineering Aggregate Functions and Group by
vs Data science vs Data analytics Clause
Data Life cycle - Ingestion, storage, Updating and Deleting
processing, analysis, and Data in Existing Table (DML)
visualization
Views
Understanding Data Engineering
Advanced Queries
High level - ( Data Pipeline, Data
Integrity Constraints
flow, Data storage , Data
Analytical Queries
Processing and Transformation,
Understanding ROLLUP and CUBE
Data Integration and ETL, Data
Understanding Joins
Warehousing, Big Data, cloud
Scalar Subqueries
computing )
Case Expressions
Multi table Insert and Merge
Regular Expression
Statistical Functions
Model Queries
Python -
Introduction to Azure Introdcution
Azure Portal Overview DataTypes in Python
Creating an Azure Data Factory operators in Python
Creating an Azure Data Lake Input and Output
Creating Storage Accounts Control Statements in Python
Linked Services Arrays in Python
Datasets .Strings and Characters
Pipelines Functions
.Copy Activity .Lists and Tuples
.Data bricks Activity .Dictionaries
Get Metadata Activity .Introduction to OOPS
.General Activities Classes and Objects
.Move and Transform activities Inheritance and Polymorphism
.Iteration and conditional activities .Abstract Classes and Interfaces
Azure Functions Exceptions
.Data Flows Files in Python
.Integration Run Times Regular Expressions in Python
Triggers .Data Structures in Python
Date and Time
Threads
.GUI
Networking in Python
. Database Connectivity
 Spark and Data Bricks Architecture
Mounting ADLS with Azure Data Bricks
RDDs
Data Frames
.Parallelize () and repartition
Struct Type and Struct Field
Select, With column and with column renamed
Collect
.UDF
Join()
Data frame Operations
Reading different Files
Py spark SQL Functions
Mounting to Data bricks
.Cluster Types and setting up the clusters
.Py spark Built-in Functions
.Cosmos DB connectivity with Azure Data bricks