ADE Course Content With Reviews
ADE Course Content With Reviews
PVR Cloud Tech || For ADE Course Training By Mr. Srinivas (12+ Yrs Exp) || WhatsApp: +919346060794
Overview of Cloud
1) Basics of Cloud computing
1. What is Cloud?
2. Types of Cloud deployment models
A. Private Cloud
B. Public Cloud
C. Hybrid Cloud
3. Types of Cloud Services
A. IaaS – Infrastructure as a Service
B. PaaS – Platform as a Service
C. SaaS – Software as a Service
3) Introduction to Azure
6) Introduction to BigData
1. What is Data?
2. What is BigData?
3. Data Sources of Big Data?
Page
4. Characteristics of BigData
PVR Cloud Tech || For ADE Course Training By Mr. Srinivas (12+ Yrs Exp) || WhatsApp: +919346060794
5. Variety, Velocity, Volume, Veracity, Value
6. Types of Data
A. Structured Data
B. Semi-structured Data
C. Unstructured Data
7) Python Basics
1. Variables
2. DataTypes
3. Operators
4. Collections
5. Functions
6. Packagea and Modules
8) Basics of SQL
1. DQL Commands (select)
2. DDL commands (create, alter, drop , truncate)
3. DML Commands (insert , update, delete, merge)
4. Joins
5. Window functions
6. Aggregate functions
PVR Cloud Tech || For ADE Course Training By Mr. Srinivas (12+ Yrs Exp) || WhatsApp: +919346060794
Azure Data Factory
1) Azure Data Factory
1. What is Azure Data Factory?
2. Azure Data Factory Architecture
3. Azure Data Factory Portal UI
4. Top-level concepts
A. Pipelines
B. Activities
C. Linked services
D. Datasets
E. Triggers
F. Data Flows
G. Integration Runtimes
2) Pipeline
1. What is a Pipeline?
2. Create a new pipeline
3. Organize pipelines into folders
4. Debug pipeline
5. Publish pipeline
6. Parameters / Pipeline Parameters
3) Linked Service
PVR Cloud Tech || For ADE Course Training By Mr. Srinivas (12+ Yrs Exp) || WhatsApp: +919346060794
5) Activities
1. Wait
2. Variables
A. Create a variable
B. Set variable
C. Append variable
3. Copy Data
A. General
B. Source
C. Sink
D. Mapping
E. Settings
F. User Properties
4. Copy file(s) from one BLOB Container to another Container
A. One file from a folder
B. All files from a folder
C. All files and folders recursively from a folder
5. Copy data / file from BLOB to SQL Database / ADLS Gen2
A. As CSV, TSV, Parquet, Avro, ORC etc.
6. Databricks Notebook
7. Azure Function
8. Lookup, Stored Procedure
PVR Cloud Tech || For ADE Course Training By Mr. Srinivas (12+ Yrs Exp) || WhatsApp: +919346060794
7) Integration Runtime (IR)
1. Azure AutoResolveIntegrationRuntime
2. Azure Managed Virtual Network
3. Self-Hosted
4. Linked Self-Hosted
8) Source control
1. Git configuration
2. ARM Template
A. Export / Import
3. Azure Devops Repos
9) Global parameters
10) Credentials
12) Alerts
16) SDLC
PVR Cloud Tech || For ADE Course Training By Mr. Srinivas (12+ Yrs Exp) || WhatsApp: +919346060794
17) Agile Methodology
PVR Cloud Tech || For ADE Course Training By Mr. Srinivas (12+ Yrs Exp) || WhatsApp: +919346060794
31. Dataflows - look up Transformations
32. Dataflows - window functions transformations
33. Dataflows - pivot, unpivot transformations
34. Dataflows - Alter rows transformations
35. Dataflows - Removing Duplicates transformations
36. How to pass parameters to the pipeline
37. How to create alerts and rules
38. How to set global parameters
39. How to import and export ARM templates
40. How to integrate ADF with Devops
41. How to use Azure devops Repos
42. How to send mail notifications using logic apps
43. How to monitor the pipelines
44. How to debug the pipelines
45. How to schedule pipeline using triggers
46. How to create trigger dependency
47. How to one pipeline in another pipeline
Azure Databricks
1) Introduction to BigData
1. What is Data?
2) Introduction to Hadoop
1. What is Hadoop?
2. How Hadoop overcome bigdata challenges
3. Hadoop Architecture
4. Hadoop Daemons
5. HDFS
6. YARN
7. MapReduce
Page
PVR Cloud Tech || For ADE Course Training By Mr. Srinivas (12+ Yrs Exp) || WhatsApp: +919346060794
3) Introduction to Spark
1. Spark Architecture
2. Spark internals
3. Spark RDD
4. Spark DataFrame
5. Spark Streaming
1. What is Cloud?
2. Types of Cloud deployment models
A. Private Cloud
B. Public Cloud
C. Hybrid Cloud
3. Types of Cloud Services
A. IaaS – Infrastructure as a Service
B. PaaS – Platform as a Service
C. SaaS – Software as a Service
1. Azure
2. AWS – Amazon Web Services
6) Introduction to Azure
G. Logic Apps
PVR Cloud Tech || For ADE Course Training By Mr. Srinivas (12+ Yrs Exp) || WhatsApp: +919346060794
7) Introduction to Azure Databricks
1. credentials utility
2. Data utility
3. FilSystem utility
Page
4. Jobs utitlity
PVR Cloud Tech || For ADE Course Training By Mr. Srinivas (12+ Yrs Exp) || WhatsApp: +919346060794
5. Library utility
6. Notebook utility
7. secrets utility
8. widgets utility
9. Limitations of utilities
1. CSV Data
2. JSON Data
3. parquet files
4. Excel files
5. ORC file format
6. AVRO files
1. What is streaming?
2. Process streaming using Pyspark API
3. Handling bad records
4. Stream data into Gen2lake
5. Load the data into Tables
Page
PVR Cloud Tech || For ADE Course Training By Mr. Srinivas (12+ Yrs Exp) || WhatsApp: +919346060794
15) Databricks - Lakehouse (Delta Lake)
1. Introduction to workflows
2. Create,run and manage Databricks jobs
3. Schedule Databricks jobs
4. Monitor Databricks Jobs
Page
PVR Cloud Tech || For ADE Course Training By Mr. Srinivas (12+ Yrs Exp) || WhatsApp: +919346060794
Azure Synapse
1) Introduction & Overview
PVR Cloud Tech || For ADE Course Training By Mr. Srinivas (12+ Yrs Exp) || WhatsApp: +919346060794
7) Incremental Load to Azure Synapse in Azure Synapse
1. Incremental Load or Delta load from SQL to blob Storage in Azure Synapse
2. Multi Table Incremental Load or Delta load from SQL to to Azure Synapse
3. Incrementally copy new and changed files based on Last Modified Date
PVR Cloud Tech || For ADE Course Training By Mr. Srinivas (12+ Yrs Exp) || WhatsApp: +919346060794
11) Spark Pool Introduction in Azure Synapse
PVR Cloud Tech || For ADE Course Training By Mr. Srinivas (12+ Yrs Exp) || WhatsApp: +919346060794
Trainer Details
✓ Azure Data Engineer Expert ✓ 12+ Years of Experience
✓ 1500+ Trained ✓ 20+ Batches
1) A Azure Data Engineer Trainer, he has 12 years of corporate level training experience
and industry work experience in multiple MNCs.
2) Being versatile in training, have handled 3 levels of audience, Students/Freshers roles,
Beginners/Developers/Testers roles and Project Managers role to know and understand
ADE in various angles of learning perceptions to equip themselves to master Azure Data
Engineer.
3) With insight, knowledge and experience in practical teaching.
PVR Cloud Tech || For ADE Course Training By Mr. Srinivas (12+ Yrs Exp) || WhatsApp: +919346060794