Snowflake Data Engineering
Uploaded by
rajeshganta.de7799Snowflake Data Engineering
Uploaded by
rajeshganta.de7799SNOWFLAKE TRAINING PROGRAM
[email protected]
Velmurugan M.S is a data professional with 15+ years of experience, including 8 years
in big data technologies like Apache Spark and Hadoop. He specializes in
MEET YOUR MENTOR designing data lakes and ELT processes using Databricks, Snowflake, AWS, and
Azure.
Currently a freelancer, Velmurugan has previously worked with IBM, Cognizant, and
HP, excelling in optimizing AWS and Azure architectures for performance and
scalability.
Currently a freelancer, Velmurugan is passionate about sharing his expertise with aspiring
data engineers.
He provides real-time experience through hands-on projects, simulating industry scenarios
to equip students with practical skills.
His teaching goes beyond technical knowledge, offering personalized guidance on
interview preparation, ensuring his students excel in their career transitions.
Beyond technical training, Velmurugan takes a personalized approach to mentoring,
focusing on helping learners confidently tackle interview challenges with scenario-based
questions and problem-solving strategies.
His deep industry insights, coupled with his engaging teaching style, make him a trusted
mentor for anyone aiming to excel in the field of big data and cloud technologies.
What sets us apart?
Real-time Training with Practical Experience
Compact & Interactive Batch Training
Certification Support
Peer-to-Peer Learning Environment
Professional Resume Building Assistance Mock Interview Sessions
Job Profile Optimization Guidance for International Job Interviews
Lifetime Access to Course Recordings
Comprehensive Interview Questions
from 50+ Companies
Course Completion Certificate
COURSE - SNOWFLAKE DATA ENGINEERING
This Course is ideal for:
Individuals seeking a specialized course in Snowflake
Data Engineering
Looking for more than 3 years of experience
2 Real Time Projects
COURSE -SNOWFLAKE DATA
Course duration - 2 months
ENGINEERING COURSE
Introduction & Fundamentals 3) Virtual Warehouses & Storage
Creation of Virtual Warehouses
1) Snowflake Architecture & Concepts Resource Monitors Management and Alerts
Key Concepts & Architecture Creation of Databases and Schema
Cloud Platforms Table Privileges
Snowflake Editions Cache Layer
Overview of Key Features
Overview of the Ecosystem 4) Data Management & Recovery
Time Travel & Fail Safe - Recovery
2) SnowSQL & User Management Zero Copy Cloning in Snowflake
SnowSQL (CLI Client) - Installation, Configuring,
and Usage 5) Data Staging in Snowflake
Lab – SnowSQL Lab & Exercises Types of Stages (Internal & External)
Roles and Users in Snowflake Overview of Data Loading/Unloading
Bulk Data Loading/Unloading from Local File
System
6) Data Loading & Querying 10) Advanced Data Processing
Querying Data in Staged Files Using Snowflake Tables as Data Sources
Bulk Data Loads Handling Large-Scale Data Ingestion
Loading Semi-Structured Data (JSON, XML) Optimizing Queries with Pushdown in Snowpark
7) Cloud Integrations 11) Data Processing Optimization
AWS Integration Process Partitioning, Bucketing & Indexing in Spark
AWS to Snowflake Data Loading Building Reusable ETL Pipelines
Loading Semi-Structured Data from On-Premises to
Handling Slowly Changing Dimensions (SCD Type 1, 2, 3)
Cloud
12) Scheduling & Performance Optimization
Advanced Snowflake Concepts
Scheduling ETL Jobs using ADF or AWS glue
8) Continuous Data Loading
Optimizing Performance for Large-Scale Data
Snowpipe & Configuration
Continuous Data Loading using Snowpipe
13) UDFs and Procedures
9)Snowflake & Snowpark Analytical Functions
Overview of Snowflake & Snowpark User Defined Functions
Differences Between Snowpark and Spark Procedures
Reading Data from Multiple Sources (CSV, JSON,
Parquet, Delta, Iceberg)
14) Performance Tuning 17) DBT Materialization
Query Tuning Understanding Materializations
Clustering Model Dependencies
Micro Partitions Table Type Materialization
Materialized Views Incremental & Ephemeral Materialization
DBT & Data Governance 18) DBT Sources & Seeds
Understanding Seeds and Sources
15) Introduction to DBT Source Configuration
DBT Overview Source Freshness & Validations
Set up DBT Cloud
Connecting DBT to Snowflake 19) DBT Testing & Snapshots
Data loading into the data warehouse DBT Testing Framework
Snapshots & Incremental Strategies
16) GitHub Integration & IDE
Version Control
20) DBT Macros & Hooks
Data repository setup & connect to DBT cloud
Creating & Using Macros
Fundamentals of DBT cloud IDE
Hooks & Exposures
Connecting Repository & Warehouse
Setting up a BI Dashboard in Snowflake
21) Data Security & Compliance 24) DAGs & Task Dependencies
Column-Level and Row-Level Masking Policies Understanding DAG Structure & Task Dependencies
Working With Dates and Time Stamps Using Snowflake Operators & Hooks
Date and Time Stamp Conversions SnowflakeOperator for running SQL queries
SnowflakeHook for executing queries dynamically
Data Pipelines, Airflow & Real-Time Project PythonOperator with Snowflake for custom processing
BranchOperator for conditional workflows
22) Data Orchestration
Creating ELT Pipeline, Connecting ADF to Snowflake
25) Build a fully automated Snowflake Data Pipeline using
using ODBC, JDBC & REST API
Airflow
Orchestration with ADF or AWS Glue or Airflow
Using dbt with Airflow & Snowflake
23) Airflow Architecture & Snowflake Integration
26) Real-World Use Case – Project Overview
Installing & Configuring Apache Airflow
Explanation of the Project
Running Airflow Locally using Docker
Architecture & Core Components (DAGs, Tasks, Planning the Data Pipeline Architecture
Operators, Hooks, Sensors)
Airflow Scheduler & Executor Types 27) Project Implementation – Part 1
Installing Snowflake Provider Package Data Ingestion using ADF & Airflow
Configuring Airflow Connections to Snowflake Data Transformation using DBT
28) Project Implementation – Part 2
Query Optimization & Performance Tuning
Setting up BI Dashboards
29) Testing & Debugging
Testing
Debugging ETL Pipelines
30) Final Review & Certification
Recap of Key Topics and Project discussion
Course Fees - Rs
20,000
* Includes Resume Building, Mock Interview & Certificate Assistance
Architectures Covered Within the Course are as Follows
Architecture Diagram of Project 01
Architecture Diagram of Project 02
CONTACT US
If you have any questions, feedback, or inquiries, please don't hesitate to get in touch with me.
I strive to respond to all inquiries within 24-48 hours.
+91 79875 02532
+91 89499 26696 +91 89499 26696
WhatsApp
Call
[email protected]
[email protected]
