www.linkedin.

com/in/ctestaoneill
 Certification benefits your career
Certified professionals
Your journey to
Microsoft Certified: Azure Data Engineer
Stand out
expertise is more
sought after Complete the free online training on Microsoft Learn
• https://aka.ms/AzureDataEngineerPASS

Prepare for one of the exams with a Microsoft Official Practice

Are better at their jobs Test
transfer
knowledge to real work • Expect in the next 5 business days a mail from PASS with a
situations2 voucher code for a free practice test
• You’ll have 2 months to use the voucher code

Earn more
% report salary increase due Next Boot Camp: Azure Data Engineer
to earning certification2
In person at PASS Summit 2019 - November 6th-8th, 2019
http://aka.ms/ms-passbootcamp

1 2019 Global Knowledge IT Skills and Salary Report

2 Pearson VUE 2018 Value of Certification Survey. © 2019 Pearson Education, Inc. or its affiliate(s). All rights reserved. Reproduced with permission
Lesson 01
Data Engineering Certification:
Setting the context
Industry observations

There are many…..

Industry observations
"On the one hand, we have an abundance
of data and information available to us, and
on the other hand, we lack the culture and
human capabilities to properly collect,
analyze and manage data.“

Jorgen Heizenberg, Research Director at Gartner

August 17th, 2018
Industry observations

Gartner Job Description Toolkit:

14th September 2018

"Data engineers play a key role in building

and managing data pipelines, and
promoting data and analytics use cases to
production (in line with business
processes).“
Data Engineering Pipeline Processing
Data Engineering Practices

Batch/Stream Design and

Secure
Processing Implement

Monitor Optimize
Data Engineering Technologies at Microsoft

Azure Databricks Azure Data Warehouse Azure Data Factory Azure SQL Database
Storage Account

Azure CosmosDB Azure Stream Analytics Azure HDInsight Azure Data Catalog
Data Lake Store
Using certification to drive Data Engineering skills.

Exam DP-200: Implementing an Azure Data Solution

Azure data engineers are responsible for data-related tasks that include provisioning
data storage services, ingesting streaming and batch data, transforming data,
implementing security requirements, implementing data retention policies,
identifying performance bottlenecks, and accessing external data sources.

Exam DP-201: Designing an Azure Data Solution

Azure data engineers are responsible for data-related tasks that include designing
Azure data storage solutions that use relational and non-relational data stores,
batch and real-time data processing solutions, and data security and compliance
solutions.
Lesson 02
Learning Resources
Microsoft Learn
Instructor lead training (ILT)
DP200: Implementing an Azure Data Solution (3 days)

DP201: Designing an Azure Data Solution (2 days)

Provides a rich in person training event with labs

Learn with a Microsoft Certified Trainers

Provides a guided learning environment

Qualified in the subjects they teach

Communities
Shared and applied experiences through:

Conferences

- Expert presentations / Training days

- Sponsor perspectives

- Networking with Peers

Blogs

- Both written and videos

- Great example in this area:

Cathrine Wilhelmsen (MVP) DP-200 prep blog
Experiences
Sandbox environments on Learn

Hands on Labs with Microsoft Certified Trainers

Training days at conferences

Ultimately, applying the knowledge to work

Lesson 03
Knowledge Domain
Implement / Design data storage solutions (40-45%)
Exam domain Learn resources
Implement non- Pillars of a great Azure architecture – 54 mins
relational data stores Core Cloud Services - Azure data storage options – 25 mins
Create an Azure Storage account – 30 mins
Introduction to Azure Data Lake storage – 30 mins
Introduction to Azure Databricks - 37 mins
Create an Azure Cosmos DB database built to scale – 27 mins
Choose the appropriate API for Azure Cosmos DB storage – 38 mins
Implement relational Query data in Azure SQL Data Warehouse – 60 mins
data stores Design a data warehouse with Azure SQL Data Warehouse – 40 mins
Provision an Azure SQL database to store application data – 50 mins
Manage data security Secure your Azure resources with conditional access – 26 mins
Security, responsibility and trust in Azure – 63 mins
Secure your Azure Storage account – 45 mins
Data warehouse security – 35 mins
Secure your Azure SQL Database – 1 hrs 17 mins
Manage and develop/ Design data processing (25-30%)

Exam domain Learn resources

Develop batch Upload data to Azure Data Lake Storage – 50 mins
processing solutions Data ingestion with Azure data factory – 49 mins
Import data into Azure SQL Data Warehouse by using PolyBase – 1 hrs 6 min
Access SQL Data Warehouse instances with Azure Databricks – 1 hrs 23 min
Perform basic data transformations in Azure Databricks – 46 mins
Perform advanced data transformation in Azure Databricks – 60 mins

Develop streaming Implement a Data Streaming Solution with Azure Streaming Analytics – 2 hrs
solutions Transform data by using Azure Stream Analytics – 49 mins
Work with streaming data in Azure Databricks – 1 hrs 4 min
DP200: Monitor and optimize data solutions (30-35%)

Exam domain Learn resources

Monitor data storage Design for efficiency and operations in Azure – 42 mins
Analyze your Azure infrastructure by using Azure Monitor logs – 34 mins
Gather metrics from your Azure Blob Storage containers – 1 hrs 26 min
Monitor data Alert and monitor data factories by using Azure Monitor – 12 mins
processing Visually monitor Azure data factories – 5 mins
Monitor and manage Azure Data Factory pipelines – 75 mins
Optimize Azure data Design for availability and recoverability in Azure – 59 mins
solutions How to optimize your Azure environment – 25 mins
Distribute your data globally with Azure Cosmos DB – 31 mins
Optimize the performance of Azure Cosmos DB by using partitioning and
indexing strategies – 1 hrs 16
DP201: Design for data security and compliance(25-30%)

Exam domain Learn resources

Design security for Manage secrets in your server apps with Azure Key Vault – 46 mins
source data access Secure your Azure Storage account – 45 mins
Secure your Azure SQL Database – 1 hrs 7 min
Design security for Design for security in Azure – 54 mins
data policies and Top 5 security items to consider before pushing to production – 45 mins
standards

Azure for the Data Engineer

Azure Fundamentals
Finally….
"Ultimately, technology for technology’s
sake is not going to do anything.

It is about your ability to take technology

and transform how you engage
customers, how you empower your own
employees, how you transform and
optimize your operations and your products
and services.

That’s ultimately the goal that each one of

you has."

Satya Nadella - Future Decoded, 1st Nov 2018

 Certification benefits your career
Certified professionals
Your journey to
Microsoft Certified: Azure Data Engineer
Stand out
expertise is more
sought after Complete the free online training on Microsoft Learn
• https://aka.ms/AzureDataEngineerPASS

Prepare for one of the exams with a Microsoft Official Practice

Are better at their jobs Test
transfer
knowledge to real work • Expect in the next 5 business days a mail from PASS with a
situations2 voucher code for a free practice test
• You’ll have 2 months to use the voucher code

Earn more
% report salary increase due Next Boot Camp: Azure Data Engineer
to earning certification2
In person at PASS Summit 2019 - November 6th-8th, 2019
http://aka.ms/ms-passbootcamp

1 2019 Global Knowledge IT Skills and Salary Report

2 Pearson VUE 2018 Value of Certification Survey. © 2019 Pearson Education, Inc. or its affiliate(s). All rights reserved. Reproduced with permission
Session Summary
In this module, you have learned about:
- Setting the context for Data Engineering Certs.
- The various modalities for learning.
- An exploration of the DP200 exam domains.
- An exploration of the DP201 exam domains.

Next steps
After the session, consider visiting the links in
this PowerPoint to start your learning on
Microsoft Learn. List out any follow up
questions to ask the onsite team at Microsoft
Ignite or PASS
29
 ▪ When you need a low cost, high throughput data store.
▪ When you need to store No-SQL data.
▪ When you do not need to query the data directly. No ad hoc query support.
▪ Suits the storage of archive or relatively static data.
▪ Suits acting as a HDInsight Hadoop data store.
Storage Account

▪ When you need a low cost, high throughput data store.

Data
▪ Unlimited storage for No-SQL data
▪ When you do not need to query the data directly. No ad hoc query support.
▪ Suits the storage of archive or relatively static data.
▪ Suits acting as a Databricks , HDInsight and IoT data store.
Data Lake Store

Engineering ▪
▪
Eases the deployment of a Spark based cluster.
Enables the fastest processing of Machine Learning solutions.

Technologies
▪ Enables collaboration between data engineers and data scientists.
▪ Provides tight enterprise security integration with Azure Active Directory
▪ Integration with other Azure Services and Power BI.
Azure Databricks

at Microsoft ▪
▪
▪
▪
Provides global distribution for both structured and unstructured data stores.
Millisecond query response time.
99.999% availability of data.
Worldwide elastic scale of both the storage and throughput
▪ Multiple consistency levels to control data integrity with concurrency
Azure CosmosDB

▪ When you require a relational data store.

▪ When you need to manage transactional workloads
▪ When you need to manage a high volume on inserts and reads
▪ When you need a service that requires high concurrency
▪ When you require a solution that can scale elastically
Azure SQL Database
 ▪ When you require a relational data store.
▪ When you need to manage analytical workloads
▪ When you need low cost storage.
▪ When you require the ability to pause and restart the compute.
Azure Data ▪ When you require a solution that can scale elastically
Warehouse

▪ When you require a fully managed event processing engine.

Data
▪ When you require temporal analysis of streaming data.
▪ Support for analyzing IoT streaming data.
▪ Support for analyzing application data through Event Hubs.
▪ Ease of use with a Stream Analytics Query Language.
Azure Stream Analytics

Engineering ▪ When you want to orchestrate the batch movement of data.

Technologies
▪ When you want to connect to wide range of data platforms.
▪ When you want to transform or enrich the data in movement.
▪ When you want to integrate with SSIS packages.
Azure Data Factory ▪ Enables verbose logging of data processing activities.

at Microsoft ▪
▪
▪
▪
When you need a low cost, high throughput data store.
When you need to store No-SQL data.
Provides a Hadoop Platform as a Service approach
Suits acting as a Hadoop, Hbase, LLAP or Kafka data store.
▪ Eases the deployment and management of clusters.
Azure HDInsight

▪ When you require documentation of your data stores.

▪ When you require a multi user approach to documentation.
▪ When you need to annotate data sources with descriptive metadata.
▪ A fully managed cloud service whose users can discover the data sources.
▪ When you require a solution that can help business users understand their data.

Azure Data Catalog

Additional resources
Resource
Guide to Microsoft Learning
Microsoft Training and Certification Poster
Microsoft Training and Certification master
deck
Learning path infographics
Description Link
Use this guide for a quick reference to all Microsoft Learning resources aka.ms/LearningGuide
Download the training and certification poster aka.ms/TrainCertPoster
Find the complete guide to Microsoft training and certifications aka.ms/TrainCertDeck
Download complete learning path for Azure Data Engineer and Azure aka.ms/AzureDataEngInfographic
Fundamentals.
aka.ms/AzureFundamentalsInfographic
Q&A
Resource
Azure Data Engineer Certification
Exams required to earn the Azure
Data Engineer certification
Azure Data Engineer training on
Microsoft Learn
Does Azure Data Engineer
certification require Azure
Fundamentals?
Practice Test for Azure Data
Engineer exams
Description Link
Review here certification description, including skills measure, exams and training aka.ms/AzureDataEngLearning
guidance
To earn the certification you must pass both exams Exam DP-200: Implementing an www.microsoft.com/en-
Azure Data Solution and DP-201: Designing an Azure Data Solution us/learning/exam-DP-200.aspx
www.microsoft.com/en-
us/learning/exam-dp-201.aspx
You need to complete all the Learning Paths in this link. It is more than 20 hours of aka.ms/AzureDataEngineerPASS
training.
For a suggested order to consume the training available, follow the guidance in the Azure aka.ms/AzureDataEngInfographic
Data Engineer Infographic.
aka.ms/AzureFundamentalsInfographic
Azure Fundamentals is optional - additional 10h
Azure Fundamentals certification is not required for Azure Data Engineer certification. aka.ms/AzureFundamentalsPASS
If you are new to Azure, we strongly recommend to take the Azure Fundamentals training
to review your basic concepts on Azure. Check out the recording for the Azure www.youtube.com/watch?v=DnEHBSvdN
Fundamentals Boot Camp. Recording is available in PASS.org Learning Center and in 74&feature=youtu.be
YouTube
Microsoft Official Practice Test for Azure Data Engineer exams will be available at the end
of October 2019.
Practice tests are available for many Microsoft exams. You can view these at
www.mindhub.com by choosing Microsoft from the IT Certifications dropdown and then
filtering on practice tests.
Q&A
Resource
About Microsoft Certifications and
exams
If you are Microsoft Certified
MCSE, or starting your journey
with Role-based Certifications,
what other certifications to
consider
Description Link
Review Microsoft Fundamentals and Role-based Certifications www.microsoft.com/certifications
We recommend to continue your certification journey with the new Microsoft Role-based • aka.ms/AzureFundamentalsLearning
Certifications. These are some you might be interested at: • aka.ms/AzureDataScienceLearn
• Azure Fundamentals • aka.ms/AzureAIEngLearning
• Azure Data Scientist • aka.ms/AzureDeveloperLearning
• Azure AI Engineer • aka.ms/AzureArchitectLearning
• Azure Developer
• Azure Solutions Architect

Why do exams change so often It is part of our strategy to keep exams and certifications updated with technology www.microsoft.com/learning/certification
changes, but we also adjust our exams based on experience and feedback from -exam-policies.aspx
candidates, industry specialists, and customers.
Support to schedule exams Microsoft Certifications exams are delivered by Pearson Vue. If you have issues scheduling http://home.pearsonvue.com/test-
an exam, Pearson Vue customer support can help taker/Customer-service.aspx
What is the best learning resource? Microsoft learning resources are designed to complement each other and to fit learning
preferences - in-person training, videos, hands-on labs, product documentation, step-by-
step guidance.
New role-based certifications are designed to prove not only your theoretical knowledge,
but actual for-the-job skills - actual experience with the technology solving business
problems, so don't rely only on training to pass the exams, use the technology
Other free online resources to Check out Azure on Pluralsight for additional content Azure.com/Pluralsight
prepare for the certification
Microsoft Press books information You can look here to see what new releases have been announced www.microsoftpressstore.com/store/bro
wse/coming-soon