🔥Rocking Snowflake with AWS🔥

Pre-requisities:

Snowflake & AWS Account

Stable internet connection while having hands-on
Basic SQL & Python Knowledge will be helpful but is not at all mandatory.
Thirst for New Learning

Humble Request to all readers:

You just need to do 3 things to support my channel

1)Like
2)Share
3) Subscribe to my YouTube Channel .

❄️Snowflake Essentials Concepts❄️

Introduction & Architecture

• Getting Started

• Snowflake - as a Service on AWS

Fundamental SQL Concepts

• Documentation Reference

Advanced SQL
• Working with CTEs (Common Table Expressions) in Snowflake

• Introduction to Window function

• Calculate Cumulative Sum in Snowflake

• Sliding Window concept in Snowflake

• Introduction to the Partition By Window Function

• Lag & Lead function in Snowflake

• EAV Model & UNPIVOT in Snowflake in-depth intuition

• Snowflake listagg function & within group clause in-depth intuition

 • HASH_AGG -- the "fingerprint" of Snowflake Table

• Querying Hierarchical Data in-depth intuition | Snowflake

• Solve any Correlated Subquery by following these steps

• EXISTS subquery in Snowflake in-depth intuition

Transaction, Commit and Rollback in Snowflake

• Documentation

• Fundamental Video

Snowflake Stored Procedure

• Documentation

• Fundamentals

• Pass argument to the Snowflake procedure

• Tactically return multiple values from Stored Procedure in Snowflake

• Snowflake Stored Procedure Logging

• Useful trick for Snowflake Stored Procedure in-depth intuition

• Transaction in Stored Procedure in-depth intuition

• Executing Multiple SQL Statements in a Stored Procedure

Snowflake User-Defined Functions

Documentation

Snowflake CDC
Documentation

Snowflake Zero Copy Cloning

Documentation

Different types of Tables Snowflake

Documentation

Fail-safe Property in Snowflake

Documentation
Snowflake Materialized Views
Documentation

Caching in Snowflake Data Warehouse

• Documentation

• Visualize Caching

Configuring a Snowflake Storage Integration to Access Amazon S3

• Documentation

• In-depth Explanation

Snowpipe
• Documentation

• Implementation with SQS

• Implementation with SNS

• Load JSON data from s3 using Snowpipe

• Email Alert Mechanism on load faliure

• Troubleshooting Snowpipe in-depth explanation

Explore Copy command in more detail

• Know more about COPY INTO command (Table) in Snowflake

• Saving rejected rows while executing copy command | Snowflake

Snowflake External Table

• External Table refresh using SQS

• External Table refresh using SNS

• Snowflake External Table Metadata

Snowflake Tasks
• Documentation

• Fundamentals

• Scheduling a Stored Procedure using Snowflake Task

• Create a Simple tree of TASKS

Snowflake Time Travel
• Documentation

• In-depth explanation

• Undrop a Table, Database or Schema

Snowflake Data Unloading

• Documentation

• Fundamental explanation

• Unload a Relational Table with multiple columns to JSON

Automatic Schema Detection in Snowflake

• Documentation

• In-depth Explanation

Snowflake Security & Access Control

Working with Roles and Users in Snowflake

Fundamental Video

Securing the Snowflake Account with Network Policies

Fundamental Video

Read server-side encrypted file in Snowflake

• Documentation

• Hands-on

Setup Multi-Factor Authentication (MFA) for your Snowflake Account

• Documentation

• Hands-on

Snowflake Data Masking

• Documentation
 • In-depth explanation

• Data Anonymization using Dynamic Data Masking

Snowflake Secure Views & Row-level security

• Secure View & Row-level Security In-depth explanation

• Implementing Row Access Policies in Snowflake

Snowflake with AWS Services

With S3
• Generating S3 pre-signed URLs using Snowflake with Indepth Intuition

• Transfer Data from S3 bucket to Snowflake via pandas

With EC2
• Build Snowflake API with Flask and deploy in EC2 | Part 1

• Build Snowflake API with Flask and deploy in EC2 | Part 2

• Build Snowflake API with Flask and deploy in EC2 | Part 3

• Key Pair Authentication in Snowflake for Linux machine from scratch

With AWS Lambda

• Snowflake Lambda Data Loader – Example with AWS S3 Trigger

• Snowflake-lambda-layer

• Use AWS Lambda to call Snowflake Stored Procedure

• Asynchronous layer over Snowflake

• Snowflake External Functions

• Snowflake External functions Part 2– How to do NLP and analyse product reviews stored in
Snowflake
• Sending Email Notifications from Snowflake Using External Functions

With AWS Glue/EMR

• PySpark-Snowflake Connectivity

• Connect EMR & Snowflake securely (Securing password with Secret Manager)

• Connecting Snowflake with Python Shell Jobs in AWS Glue

 Snowflake with Talend
• Snowflake ETL using Talend

• Snowflake ELT using Talend

Snowflake End-to-End Projects

• Building Serverless Data Stream pipeline using Kinesis data streams and Firehose for Snowflake

• How to do Natural Language Processing & analyse product reviews stored in Snowflake

• CDC Pipeline from MySQL RDS to Snowflake (from scratch)

V.V.I. Topics for Snowflake Interview

• Schema on Read in Snowflake

• Union & Union All Difference

• Solving Tree Node Problem with Correlated Subquery

• Snowflake SCD Type 2 in-depth explanation

• I have an existing table and I dropped that table and I created new table with same table name as
old  and with different data. Is there any way to get the old table data in Snowflake?
• Is it mandatory to create integration object or external stage before executing copy command?

• How to handle error notification at run for example Snowpipe is created but 100 records are going
in error daily how to get notification for error records?

There are 2 steps in monitoring, you completed the set up , went to chill and after 2 days
production system Snowpipe suddenly broke down😅

then step 1: alert should be sent to all developer then only they will come to check health ,
else no-one will even know issue happened in Snowpipe, so for Snowpipe alarm
functionality check this video , in-depth explanation

Snowflake Snowpipe - Email Alert Mechanism

Now next step , once alert triggered, developer will come to check what happened

Then to troubleshoot that check this video

Troubleshooting Snowpipe in-depth explanation