Databricks Course Curriculum
Databricks Course Curriculum
Databricks Course Curriculum
14-Oct-2023
Apache Spark Architecture
Spark's internal details (Driver, Executor, task, stages, jobs etc.)
Spark Memory Allocation (Driver and Executor Memory Allocation)
Cluster Deployment Modes (Client, Cluster)
Narrow and Wide Transformations
Spark different configurations
Interview Questions based on Apache Spark Architecture
15-Oct-2023
Introduction to Databricks
Walkthrough of Databricks workspace
Different types of clusters and their uses.
Magic Commands
DBUTILS
Notebook Parametrization
Secret Scopes
Accessing Blob Storage/ ADLS Gen 2 using notebook
Understanding of DBFS
Interview Questions based on session.
21-Oct-2023
Databricks Data Processing
Read different file formats (CSV, JSON, Parquet.. etc.)
Different reading options
Interview Questions based on session.
22-Oct-2023
Narrow Transformations
Select,filter,map, flatmap etc.
Wide Transformations
Delta Tables
Time Travel
History
Vacuum
Incremental File Loading
Interview Questions based on session.
04-Nov-2023 and 05-Nov-2023
Unity Catalog
Benefits of Unity Catalog
Data Lineage
Data Auditing
Mini Project on Unity Catalog
Interview Questions
11-Nov-2023 and 12-Nov-2023
Structured Streaming