Week 3 – Storage and Databases on AWS

Understanding Storage
on AWS
Storage Types
Block Storage File Storage Object Storage
A Piece of Land An Apartment Storage Unit
Storage Types
Block Storage File Storage Object Storage
Unit of Transaction Blocks Files Objects (files with metadata)
Laptop Disk Windows Share OneDrive / Google Drive /
Dropbox
Example

You cannot update the

object directly.
You can directly update the You can directly update the You create a new version of
How can you update?
file file the object and replace the
existing one or keep multiple
versions of the same object
Protocols SCSI, Fiber Channel, SATA SMB, CIFS, NFS REST/SOAP over HTTP/HTTPs
No metadata support it No metadata support it
Support for metadata stores only file system stores only file system Supports custom metadata
attributes attributes
Amazon EBS Amazon EFS Amazon S3
AWS Services
Amazon Instance Store Amazon FSX Amazon Glacier
• Amazon EBS Volume Types

Amazon EBS
Volume

Solid state drive (SSD) Hard disk drive (HDD)

SSD
volumes volumes
HDD

General Provisioned Throughput Cold

Purpose IOPS Optimized HDD

• GP2 • io1
• GP3 • io2
• io2 Block Express
Amazon EFS
Amazon EFS Architecture
Region • Fully managed
VPC • Highly available and
AZ a AZ b AZ c
durable
Subnet Subnet Subnet • Dynamic elasticity
EC2 EC2 EC2 EC2 EC2 EC2 • Grow/Shrink
• Storage classes and
Mount Target Mount Target Mount Target lifecycle management
• NFS v4.0 and v4.1
• Can be accessed across
• VPC
Amazon EFS
• Regions
• Accounts
File system File system
fs- fs- • On-Prem
2ae32d1e 5be32d6f
Amazon FSx
Amazon FSx

Amazon FSx for Amazon FSx

Windows File Server for Lustre

Fully managed file Fast and scalable shared

storage built on storage to power your
Windows Server HPC workloads

• Use cases
• Home directories, Highly available Microsoft SQL Server deployments, Lift-and-shift Windows
applications
• Built on Windows Server
• integrates with your on-premises Microsoft Active Directory (AD) as well as with AWS Microsoft
Managed AD.
• Fully managed
• AWS manages updates and patches, failover and failback, backups
Amazon FSx for Windows Architecture
Region • Multi-AZ availability
VPC and durability
AZ a AZ b

Subnet Subnet Subnet Subnet

• SMB 2.0 to 3.1.1
EC2 EC2 EC2 EC2

AWS Directory AWS Directory • DFS Namespace and

Service Service
Mount Target Mount Target Replication

• Can be accessed
across
Amazon FSx for • VPC
Windows File Server
• Regions
• Accounts
• On-Prem
 Amazon Simple
Storage Service (S3)
Bucket and Objects
• S3 Name Space – Global Files (Objects) Objects

• Bucket – Regional
Folder
• Durability – 99.999999999 % (Bucket)
Bucket
• Availability – 99.9x %
S3 Pricing
• Max object size 5 terabytes Compute Number of requests
Storage Capacity used
• Can host a static website Network Data transfer out
S3 Features

Versioning Replication Encryption

S3 Storage Class
• Amazon S3 offers a range of storage classes designed for different use
cases.
• https://aws.amazon.com/s3/storage-classes/

$$$
$
$$
$$

$
$$$

City Center
S3 Glacier
• A storage service optimized for infrequently used data, or "cold data"

• Suitable for data archiving and backup

• Archive Retrieval Options

Retrieval Mode Retrieval Time Retrieval Cost S3 Glacier

Expedited 1 – 5 minutes $$$ Bucket Vault

Standard 3 – 5 hours $$ Object Archive

Bulk 5 – 12 hours $ Object Size Max 5 TB Object Max 40 TB

AWS Snow Family
• Physical Device for Data Transfer

Snowcone Snowball Snowmobile

8 TB 50/80 TB 100 PB
Additional Resources
• Bucket Policy Examples
• https://docs.aws.amazon.com/AmazonS3/latest/userguide/example-bucket-policies.html
• Amazon S3 Charges
• https://aws.amazon.com/s3/pricing/
• Amazon S3 Multipart Upload
• https://docs.aws.amazon.com/AmazonS3/latest/userguide/mpuoverview.html
• Amazon S3 Storage Classes
• https://aws.amazon.com/s3/storage-classes/
• Amazon S3 Glacier
• https://aws.amazon.com/glacier/
• Amazon S3 Life Cycle Policies
• https://docs.aws.amazon.com/AmazonS3/latest/userguide/object-lifecycle-mgmt.html
• Amazon Snow Family
• https://aws.amazon.com/snow/
Types of Databases
SQL vs. NoSQL Databases
SQL (Optimized for Storage) NoSQL (Optimized for performance)
Key-value, document, wide-column,
Data Storage Rows and Columns
graph
Schemas Fixed Dynamic
Focused on collection of
Querying Using SQL
documents
Scalability Vertical Horizontal

Transactions Supported Support varies

A C I D BA S E
Atomicity Consistency Isolation Durability Basically Available Soft state Eventual consistency
Transitions are all Only valid data Transactions do not Written data System does System may system will become
or nothing is saved affect each other won’t be lost guarantee availability change over time consistent over time
Databases on AWS
Databases on AWS – Relational DB – RDS

RDS or Relational Database Service is an AWS

offering which makes it easy to setup, operate and
maintain relational Database in the cloud environment.
RDS is a managed AWS service which helps you with
management of time-consuming DB tasks such as:

✓ Backup and restore

✓ Scalability
✓ High availability
✓ Patching and upgrade
Databases on AWS – Relational DB – RDS

RDS supports the following DB engines:

✓ Amazon Aurora
✓ MySQL
✓ Oracle,
✓ MS SQL Server
✓ PostgreSQL
✓ MariaDB
✓ IBM Db2
Databases on AWS – Non-Relational Databases

AWS supports all major non-relational database workloads such as

Key-value, in-memory, document etc.

Important Nonrelational DB services:

✓ Amazon DynamoDB

✓ Amazon ElastiCache

✓ Amazon ElastiCache for Redis

✓ Amazon ElastiCache for Memcached

✓ Amazon DocumentDB (with MongoDB compatibility)

✓ Amazon Keyspaces (for Apache Cassandra)

Databases on AWS – Other Purpose-built Databases

Apart from the Relational and Non-relational Database

engines, AWS also supports the following purpose built, fully
managed Databases:

✓ Amazon Neptune

✓ Amazon Redshift

✓ Amazon Timestream

✓ Amazon QLDB
Databases on AWS – Summary

https://aws.amazon.com/products/databases/
Additional Resources
• Amazon Databases [Product Page]
• https://aws.amazon.com/products/databases/
• Getting started tutorials [Databases]
• https://aws.amazon.com/products/databases/learn/#Getting_started_tutorials
• Purpose-built databases on AWS
• https://aws.amazon.com/blogs/publicsector/purpose-built-databases-model-building-applications-cloud/
• AWS DynamoDB Features
• https://aws.amazon.com/dynamodb/features/
• AWS Purpose-built Databases workshop
• https://catalog.us-east-1.prod.workshops.aws/workshops/93f64257-52be-4c12-a95b-c0a1ff3b7e2b/en-
US
Questions?