AZURE DATA ENGINEERING COURSE CONTENT

1. Azure Fundamentals (3 Hours)

 What and why cloud?
 Cloud vs. on premises
 Different Cloud Providers and what is Azure?
 PAAS, SAAS, IAAS
 Resource, Resource Group and Subscription
 Pricing Model
 Azure Data Storage
 Storage Account - Blob, table, file
 Access tiers - LRS, ZRS and GRS
 Introduction Data Lake
 Azure Data Lake Storage Gen 2
 Access Control List - ACL
 Access Ties - Hot, Cold, Archive

2. Azure SQL (8 Hours)

 When to use Elastic pools?
 When to use Managed Instance?
 SQL Basics
 Data Types
 Curd Operation - DDL and DML
 Tables
 Views
 Triggers
 Stores Procedures
 Functions
 Indexes
 Joins
 Sub Queries

3. Azure Data Factory (20 Hours)

 What is ETL?
 On prem ETL Tools
 Why ADF?
 ADF main components

Plot No:51/52, Sri Sai Nikethan Apartments, 2nd Floor, Flat No:205, A S Raju Nagar,
Kukatpally, Near South-India Shopping Mall, Hyderabad, Telangana, India Pin: 500072
  Integration run time (self-hosted, Azure, SSIS)
 Get Metadata Activity
 For Each activity
 Lookup Activity
 Stored Procedure Activity
 Execute Pipeline Activity
 Fail activity.
 If condition Activity
 Copy Data Activities - From ADLS to ADLS
 Copy Data Activities - From ADLS to SQL
 Copy Data Activities - From on-prem SQL to Azure SQL
 Copy Data Activities – Web API to Data Lake
 Conditional Split with mapping data flow
 Derived Columns with mapping data flow
 Joins with mapping data flow
 Union with mapping data flow
 Meta-data driven Pipeline
 Full Load/Incremental Load
 Global Parameters
 Dynamic Linked set
 Schedules Triggers
 Event based Triggers
 Tumbling Window Triggers
 Pipeline Monitoring
 ADF CI/CD pipeline
 Real time Project With ADF

4. Azure Data bricks (20 Hours)

 What is a Data brick?
 Why Data bricks?
 Three ways to create cluster
 All Purpose Cluster
 Job Cluster
 Cluster modes - single node, standard , high concurrency
 Data bricks file System
 File System utilities
 Different languages supported in Data bricks Notebooks
 Pyspark, Scala, Spark SQL
 Notebook Utilities
 Widget utilities

Plot No:51/52, Sri Sai Nikethan Apartments, 2nd Floor, Flat No:205, A S Raju Nagar,
Kukatpally, Near South-India Shopping Mall, Hyderabad, Telangana, India Pin: 500072
  Parameters passing one notebook to other
 Mount Point
 Way to access Storage Account
 SAS Key
 Service Principle
 Azure Key vault Backed Secret Scope
 Azure Delta Lake
 What is Delta Lake?
 Advantages and Challenges of Data lake
 Why Delta Lake
 Updates and Deletes in Delta Lake
 Delta Table creation
 Schema Evaluation
 Reading data from different file formats (csv , parquet,json)
 Writing data to different file formats (csv , parquet,json)
 Spark Functions - Aggregations, String, Math, Date etc.
 Data bricks Jobs Creations and Scheduling
 Batch Streaming
 Real time Streaming
 Data Bricks CICD
 Real Time Project with ADF and Data Bricks

5. Azure Synapse Analytics (5 Hours)

 Azure SQL Data warehouse Introduction
 Difference between Azure SQL and Azure SQL warehouse
 Synapse Architecture
 Dedicated Pool
 Server Less Pool
 Spark Pool
 ctas - Create table as select statement
 Massive Parallel Processing Architecture (MPP)
 Polybase
 Creating Dimension and Fact tables
 Hash Distributions
 Round Robin Distribution
 Replicated Distribution
 Stored Procedures
 Views

Plot No:51/52, Sri Sai Nikethan Apartments, 2nd Floor, Flat No:205, A S Raju Nagar,
Kukatpally, Near South-India Shopping Mall, Hyderabad, Telangana, India Pin: 500072
 6. Optimization Techniques / Best Practices - Bonus (4 Hours)
 ADF optimization Techniques/Interview Questions
 Data bricks Optimization Techniques/Interview Questions
 Synapse Optimization Techniques/Interview Questions

Synapse Optimization Techniques/Interview Questions

 Real Time Project 1 - ADF with Data bricks
 Real Time Projects 2 - Synapse with ADF and Spark Pool

Course Highlights:
1. Expert Instructors: Learn from industry professionals with over 10 years of experience, currently
working at Microsoft. Gain valuable insights and insider knowledge to stay ahead in the game.
2. Real-Time Project Training: Hands-on, industry-oriented projects.
3. 100% Practical Sessions: We believe in learning by doing. Our training is fully practical, ensuring
you gain the necessary skills and experience to excel in the field of Azure Data Engineering.
4. Daily Assignments: Get ready to level up your expertise! Complete daily assignments to
reinforce your learning and enhance your understanding. By completing these assignments, you
can confidently claim an additional 2 years of experience.
5. Weekly Quizzes: Test your knowledge and track your progress with weekly quiz sessions.
6. Interview Questions: FAAG company insights.
7. 50+ Live Sessions: Interact with instructors and fellow learners in over 55 live sessions. Ask
questions, clarify doubts, and engage in collaborative learning experiences.
8. Guaranteed Interview Success: Gain the confidence to crack interviews on your own and
become the best in the industry.

----------------------------------------------------------- End of the Doc--------------------------------------------------------

Plot No:51/52, Sri Sai Nikethan Apartments, 2nd Floor, Flat No:205, A S Raju Nagar,
Kukatpally, Near South-India Shopping Mall, Hyderabad, Telangana, India Pin: 500072