In this course, the student will learn how to implement and manage data engineering
workloads on Microsoft Azure, using Azure services such as Azure Synapse Analytics,
Azure Data Lake Storage Gen2, Azure Stream Analytics, Azure Databricks, and others.
The course focuses on common data engineering tasks such as orchestrating data
transfer and transformation pipelines, working with data files in a data lake, creating
and loading relational data warehouses, capturing and aggregating streams of real
time data, and tracking data assets and lineage.

Course dates and course fee may be subjected to changes.

Course Outline

Lesson 1: Introduction to data engineering on Azure

Lesson 2: Introduction to Azure Data Lake Storage Gen2

Lesson 3: Introduction to Azure Synapse Analytics

Lesson 4: Use Azure Synapse serverless SQL pool to query files in a data lake

Lesson 5: Use Azure Synapse serverless SQL pools to transform data in a data lake

Lesson 6: Create a lake database in Azure Synapse Analytics

Lesson 7: Analyze data with Apache Spark in Azure Synapse Analytics

Lesson 8: Transform data with Spark in Azure Synapse Analytics

Lesson 9: Use Delta Lake in Azure Synapse Analytics

Lesson 10: Analyze data in a relational data warehouse

Lesson 11: Load data into a relational data warehouse

Lesson 12: Build a data pipeline in Azure Synapse Analytics

Lesson 13: Use Spark Notebooks in an Azure Synapse Pipeline

Lesson 14: Plan hybrid transactional and analytical processing using Azure Synapse Analytics

Lesson 15: Implement Azure Synapse Link with Azure Cosmos DB

Lesson 16: Implement Azure Synapse Link for SQL

Lesson 17: Get started with Azure Stream Analytics

Lesson 18: Ingest streaming data using Azure Stream Analytics and Azure Synapse Analytics

Lesson 19: Visualize real-time data with Azure Stream Analytics and Power BI

Lesson 20: Introduction to Microsoft Purview

Lesson 21: Integrate Microsoft Purview and Azure Synapse Analytics

Lesson 22: Explore Azure Databricks

Lesson 23: Use Apache Spark in Azure Databricks

Lesson 24: Run Azure Databricks Notebooks with Azure Data Factory