To take Service/Resource, we need to have the following items

1. Subscription
2. Resource Group
3. Region(Location) Policy
4. Resource(Service) Details

Account/Tenant

Created policy to take services from

East US

MG1 MG2 MG3

Subscription-1 Subscription-2 Subscription-3

Subscription-4

dev-rg qa-rg prod-rg RG1 RG2 RG3

ADF

ADB DB
ADLS

Policy⟶ Wanted to create resource/service with in the East US region

Resource Group: It's container where we can keep collection required services.
We can create Resource Group with two different ways
1. By using Resource Group Service
2. By Taking Resource

Data Storage
Data Processing
Storage Platform

PaaS IaaS

Azure SQL Server SQL Server MySQL

created it for
General Purpose Azure Storage Accounts
Designed for Bigdata processing

Azure Blob Storage

Azure Data Lake Storage Gen2

File File
Blob Table Queue Blob Table Queue Share
Share

To store the data in the storage account, make sure there should be container(root folder)

Note: When you upload a file into ADLS Gen2, the file will be
divided into multiple blocks and blocks will be shared across nodes

employee.csv

ADLS Gen2

4 Node Cluster

employee.csv
14mb Master Node

B1 B4 B2 B3

Worker Node-1 Worker Node-2 Worker Node-3

The default block size is 4mb in ADLS Gen2

block14mb
block24mb
Minimum size of block in ADLS Gen2 is 64kb
block34mb
Maximum size of block in ADLS Gen2 is 100mb
block42mb
Default size of block in ADLS Gen2 is 4mb

$5000
$1000
Data Storage in ADLS Data Processing in ADF/ADB

Uploaded files as
it is so size will To process 100
be 100 GB GB data
(format: csv)
Data Source Size : 100GB
Format: csv $250

75% reduces size $1250

To process 25 GB
To store 25 GB data
Data Source Size : 25GB data
Format: parquet

ADF/ADB
ADLS Gen2

Depends on storage and access, we are having four different types of pricing tiers
1. Hot
2. Cool
3. Cold
4. Archive

Storage Access
Having a quarterly report. This report is going to take
Hot High Cost Low Cost data from data source for current quarter only.

User will start doing analysis on every end of the

Quarter.
Less by More by
Cool Jan, Feb, Mar(Current Quarter). At end of the quarter,
comparing Hot comparing Hot
you delivered a report. Users will take one month time
complete their analysis.
Less by More by
Cold After April, they don't use this report/ less usage.
comparing Cool comparing Cool

Not possible to
Archive Less Cost
Access, no cost

Change access tier for ADLS Gen2 based on the following requirement

If age of the file is less than or equals to 30 days, then keep the pricing tier is Hot
If age of the file is greater than 30 days, then change pricing tier to Cool
If age of the file is greater than 90 days, then change pricing tier to Cold
If age of the file is greater than 180 days, then change pricing tier to Archive

To provide the solution by Azure Administrators, they will create a Rule to check and change the pricing tier.

Note: To read data from Archive access tier, we have to change pricing tier to either Hot, Cool, or Cold access tier.

Redundancy
It is used to replicate/duplicate the data in the Data Center
By default there will be three copies in the storage and maximum copies is 6
There are four different types of Redundancies
1. LRS
2. ZRS
3. GRS
4. GZRS Region: Central India(Primary Region) Region: Secondary Region

employee.csv
LRS

ZRS
1000 of miles away

GRS

GZRS

Avty Zone-1 Avty Zone-2 Avty Zone-3

ADLS Gen2

Azure SQL Server(Deployment Models)

SQL Databases

Daabase-1 Daabase-2 Daabase-3

Managed Instance SQL Server in VM

Single Database Elastic Pool Databases IaaS

PaaS

PaaS

DTU's Based Purchasing Model vCore Based Purchasing Model

General Business
Basic Standard Premium Hyperscale
Purpose Critical

Basic: It comes with fixed bundle of resources like Compute and Storage.
We can not increase or decrease compute. This is recommended for
development and POC projects.

To connect we required
Server: bhaskarsql321.database.windows.net
Authentication: SQL Authentication

Query Editor(Azure Portal)

SOURCE

Client Tools to deal with

SQL Server Management SQL Server
Studio
TARGET

Azure Data Studio

Server:

Standard: This pricing tier is budget friendly. It comes with 10 DTU's minimum.
We will be having control on DTU's. Whenever it is required, we can increase or
decrease.