Designing Applications and Architectures in AWS

(Aligned with AWS Solution Architect Associate Certification)

Databases
 A Day in the Life of Cloud Architect

You are a cloud architect in an organization and have been asked to develop
a comprehensive database solution that seamlessly integrates various
components for an upcoming product launch.

The marketing team needs a MySQL database to store all the customer
feedback. The operations team requires a DynamoDB database for real-time
product tracking across multiple regions, utilizing DynamoDB global table
replicas for swift data access.

Simultaneously, the analytics team intends to leverage the Redshift database

to query large datasets for insights and trends.

To achieve this, you will learn a few concepts in this lesson that will help you
find a solution for the given scenario.
 Learning Objectives

By the end of this lesson, you will be able to:

Create and manage a MySQL database for efficient data

storage and retrieval

Set up and utilize a DynamoDB database to handle NoSQL

data and achieve scalability

Establish DynamoDB global table replicas for data redundancy,

ensuring high availability and fault tolerance

Utilize Redshift for data warehousing and perform analytical

queries to extract valuable insights from your data
Introduction to Databases
 Databases: Overview

AWS provides a broad selection of purpose-built databases to help save, grow, and build a
robust cloud database.

Comprehensive High-performance
database selection scalability

Features of AWS
databases

Time and cost

Simplified migration
efficiency
process
 Types of AWS Databases

AWS databases can be categorized into:

Relational Key-value In-memory

For traditional For high-traffic web For caching, session

applications, ERP, CRM, applications, e- management, and
commerce, and gaming
and e-commerce geospatial applications
applications
 Relational Databases

Relational databases, also known as SQL databases, are the most common
type of databases.

Structured data

They are used to store structured data in a set of tables that are formally described.
 Key-Value Databases

Key-value databases are a type of non-relational database that utilizes a key-value method for
storing data. These databases are used in high-traffic and high-computing applications.
 In-Memory Databases

In-memory databases use cache-based storage to reduce the database infrastructure load and
enhance user response time.

Query

Result

Result
Query

Query
Databases
Result
Amazon Relational Database Service (RDS)
 Amazon RDS

Amazon Relational Database Service (Amazon RDS) simplifies the process of setting up,
operating, and scaling a relational database in the AWS cloud.

Here are some of the benefits of Amazon RDS:

• ​Ease of administration

• Scalability

• Security

• Cost-effectiveness

• Fast performance​
 Amazon RDS

Amazon RDS enables users to scale the compute and memory resources of their deployments
up to 32 vCPUs and 244 GiB of RAM.

RDS Instance
RDS Instance
RDS Instance

Scaling operations usually finish within minutes.

DB Instance

• A DB instance, the fundamental building block

of Amazon RDS, is a standalone database
environment that runs in the Cloud.

• Users can create multiple databases within a

DB instance and access them using standard
client tools and applications.
 RDS classes

DB instance classes determine the computation and memory capacity of an Amazon

RDS DB instance.

They can be categorized into

three types:

• General-purpose

• Memory-optimized

• Burstable performance
 Amazon RDS Database Engines

Amazon RDS supports several database engines:

 Limitations of Amazon RDS for Microsoft SQL

Certain server-level roles in Microsoft SQL are currently unavailable in Amazon RDS.
These include:

• bulkadmin

• dbcreator

• diskadmin

• securityadmin

• serveradmin

• sysadmin
 Limitations of Amazon RDS for MySQL

Several features of MySQL are currently unavailable in Amazon RDS, such as:

• Authentication plugin
• Error logging to the system log
• Group replication plugin
• InnoDB tablespace encryption
• Password strength plugin
• Persisted system variables
• Replication filters
• Semisynchronous replication
• Transportable tablespace
• X Plugin
 Limitations of Amazon RDS for MySQL

Certain Oracle privileges are currently unavailable in Amazon RDS, including:

• Alter database

• Alter system

• Create any directory

• Drop any directory

• Grant any privilege

• Grant any role

 Use Cases of Amazon RDS

Amazon RDS is commonly used for:

Web and mobile applications

E-commerce applications

Online games
 Amazon RDS Backups

Amazon RDS automatically creates and securely stores backups of DB instances in Amazon S3
for a specified retention period.

The types of Amazon RDS backups are:

Database snapshots

Point-in-time restores Snapshot copies

Automated backups Snapshot sharing

 Multi-Availability Zone Deployments

Multi-Availability Zone deployments synchronously replicate data to a standby instance in a

different Availability Zone.

Relational Database Standby

Replicate

Availability Zone 1 Availability Zone 2

 Multi-Availability Zone Deployments

Here are some benefits of Multi-Availability Zone deployments:

Enhanced durability: Increased availability:

The replica of the data stays If an Availability Zone fails,
up-to-date with the primary the backup is ready in less
database. than 30 seconds.

Stable performance: Automatic failover:

Multi-AZ deployments do not Amazon RDS automatically
suspend I/O activity on your initiates a failover to the up-
primary during backup. to-date standby.
 Read Replicas

Amazon RDS Read Replicas enhance the performance and durability of RDS
database (DB) instances.

Here are some benefits of Read Replicas:

• Enhanced performance
• Increased availability
• Designed for security

Source: https://aws.amazon.com/rds/features/read-replicas/
 Amazon Aurora

Amazon Aurora is a relational database that combines the speed and availability of high-end
commercial databases with the simplicity and cost-effectiveness of open-source databases.

High performance and scalability

High availability and durability

Robust security

The benefits of Compatibility with MySQL and PostgreSQL

Amazon Aurora
include:
Full manageability

Support for migration

 Amazon Aurora DB Cluster

An Amazon Aurora DB cluster includes one or more DB instances and a cluster volume that
manages the data for those DB instances.

Source: https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/Aurora.Overview.html
 Amazon Aurora DB Cluster

An Aurora DB Cluster in Amazon consists of two types:

M R
Primary instance Aurora replica
 Amazon Aurora DB Cluster

In each Aurora DB cluster, the primary instance handles both read and write operations,
updating the data in the cluster volume with every alteration.

Primary
M instance

Writes Reads

Data copies
 Amazon Aurora DB Cluster

An Aurora replica supports only read operations and connects to the same storage disk as the
primary DB instance.

R Aurora
Replica RR Aurora
Replicas

Each Aurora DB cluster can contain up

Reads

Reads
Reads

to 15 Aurora Replicas in addition to the

primary DB instance.

Data Copies Data Copies

Cluster Volumes
 Amazon Aurora Serverless

Amazon Aurora Serverless is a configuration that automatically scales. It starts, shuts down,
and adjusts capacity based on the application's needs.

There are two versions of Amazon Aurora

Serverless:

• Amazon Aurora Serverless v1

• Amazon Aurora Serverless v2
 Amazon Aurora Serverless v1

Amazon Aurora Serverless is a configuration that automatically scales. It starts, shuts down,
and adjusts capacity based on the application's needs.

• It allows the computational capacity of a DB

cluster to be scaled up or down according to
the application's needs.

• Unlike other versions, the capacity of DB

clusters created by Aurora Serverless v1 must
be managed manually.
 Amazon Aurora Serverless v1

The use cases for Amazon Aurora Serverless v1 include:

Infrequently-used Development and

applications test databases
 Amazon Aurora Serverless v1

Here are some benefits of Aurora Serverless v1:

Easy to use Scalable

Cost-effective Highly available

 Amazon Aurora Serverless v2

Aurora Serverless v2 helps users to automate the procedures for workload monitoring and
database capacity adjustment.

Here are some benefits of Aurora Serverless v2:

• Highly scalable
• Simple
• Highly available
• Transparent
• Cost-effective
• Durable
 Amazon Aurora Serverless v2

Use cases for Amazon Aurora Serverless v2 include:

Managing enterprise Supporting software as Distributing scaled-out Handling unpredictable

database fleets a service applications databases across workloads
multiple servers
 Aurora Multi-Master

Aurora Multi-Master lets users create multiple read and write master instances across several
availability zones.

Application

Read or Write Read or Write Read or Write

Master 1 Master 2 Master 3

Shared distributed storage volume

Availability Zone 1 Availability Zone 2 Availability Zone 3

 Amazon Aurora Costs

Costs associated with Amazon Aurora include:

Backtrack

Backup storage Snapshot export

Database Data transfer

storage and I/Os
DynamoDB
 Amazon DynamoDB

Amazon DynamoDB is a fully managed NoSQL database service. It offers:

Fast and predictable performance

Scalability without effort

Enterprise readiness
 Amazon DynamoDB: Use Cases

Amazon DynamoDB is widely used in:

Advertising technology Banking and finance

Retail Gaming

Media and entertainment Software and internet

 Amazon DynamoDB: Read Consistency

Amazon DynamoDB provides two types of read consistency:

Read consistency

Eventually consistent reads Strongly consistent reads

 Amazon DynamoDB Global Tables

Global dispersed
users

• Global tables offer a fully managed, multi-

region, and multi-master database.

• Amazon ensures fast, local read-and-write

Global app performance.

• Global tables automatically replicate

DynamoDB tables across the chosen AWS
Regions.

Replica (Europe) Replica (Asia)

 Amazon DynamoDB: Reading an Item

To read an item from a DynamoDB table, use the get-item command

An example of a read operation:

aws dynamodb get-item \

--table-name Catalog \
--key '{"Id":{"N":"1"}}'
 Amazon DynamoDB

To write an item in a DynamoDB table, users can use the following commands:

PutItem DeleteItem UpdateItem

This command creates a This command If the specified key doesn't

new item. If an item with deletes the item exist, this command adds a
the same key already associated with the new item. If the key exists,
exists, the new item specified key. it updates the item's
replaces it. attributes.
 Amazon DynamoDB

In DynamoDB, a global secondary index (GSI) has a partition key and a sort key
distinct from the base database's main key.

This index allows queries to access data from multiple base table partitions,
making it global.
 Amazon DynamoDB

In DynamoDB, a local secondary index allows for flexible queries within a

specific partition.

Unlike the global secondary index (GSI), which can span multiple partitions, the LSI
operates within the constraints of a specific partition key.
 DynamoDB Global Tables

The benefits of Amazon DynamoDB global tables are as follows:

Simple setup and

operation High availability, durability,
and multi-region fault
Enhanced
tolerance
performance

Consistent data with

Local read and write with
conflict resolution
global data access
 Case Study: Duolingo

Duolingo utilizes Amazon DynamoDB to store 31 billion items, supporting its online learning
platform that offers lessons in 80 languages.

Amazon
DynamoDB

31 billion items

80 different languages

24,000 read units per second and 3300 write units per second
 Amazon DynamoDB: Costs

Amazon DynamoDB offers the following cost structures:

On-demand capacity mode Provisioned capacity mode

Amazon DynamoDB: Features

Read Consistency

• DynamoDB supports both eventually consistent

and strongly consistent reads.

• Reading data from a DynamoDB table may not

immediately reflect the results of a recently
completed write operation.

• DynamoDB maximizes read throughput.

Amazon DynamoDB: Features

Capacity Management

• DynamoDB manages throughput capacity for

read and write operations.

• It can scale up or down to accommodate variable

read/write demands.

• Developers can select the capacity mode that

best aligns with their application’s requirements.
 Amazon Keyspaces for Apache Cassandra

You can run Cassandra workloads on AWS using the same Cassandra application code and
developer tools.

• Apache Cassandra is scalable and

highly available.

• The Apache Cassandra-compatible

database service is now available
for preview in 18 AWS regions.
 Amazon Keyspaces for Apache Cassandra

Here are some benefits of Apache Cassandra:

Offers high performance

and scalability Ensures high security Requires no servers to manage

01 03 05

02 04 06

Provides high availability Remains compatible with Maintains performance

Apache Cassandra at scale
 Amazon Keyspaces for Apache Cassandra

The use cases for Apache Cassandra are:

Building low-latency Migrating existing Developing applications Serving as a data store

applications Cassandra workloads to using open-source for applications
the cloud technologies
 Amazon DocumentDB

Amazon DocumentDB provides powerful and intuitive APIs for flexible and agile development.

• The data is represented as a JSON document.

• The document data model is intuitive for developers.

• The data is persisted in the database using the same

document model format used in the application code.
 Amazon DocumentDB

Amazon DocumentDB, with its MongoDB compatibility, offers several benefits such as:

Reliability:
Amazon DocumentDB provides dependable
database service with minimal downtime.

Speed: Management:
It is fast, facilitating It is a fully managed service,
efficient and prompt data removing the need for hands-
operations. on database management.
 Amazon DocumentDB

Amazon DocumentDB has several use cases, including:

User profiles

Real-time big data

Content management
Database Operations in DynamoDB

Duration:15 min

Problem Statement:

You have been assigned a task to create a database table that can store and read items using
the DynamoDB console.
 Assisted Practice: Guidelines

Steps to be followed are:

1. Create a table
2. Store and read the items
Creating a Replica of DynamoDB

Duration:15 min

Problem Statement:

You have been assigned a task to set up a global table replica and make data available across
different regions using DynamoDB.
 Assisted Practice: Guidelines

Steps to be followed are:

1. Create a replica in DynamoDB

Amazon ElastiCache
 Amazon ElastiCache

Amazon ElastiCache is a web service that simplifies the deployment, operation, and scaling of
an in-memory data store or cache in the cloud.

Key features of Amazon ElastiCache include:

• Easy management through the AWS management

console

• Engine protocol compatibility

• Detailed engine node monitoring at no additional cost via

Amazon CloudWatch

• Pay-per-use model for resource consumption

 Amazon ElastiCache

Here are some benefits of Amazon ElastiCache:

Fast performance

Scalable

Fully manageable
 Amazon ElastiCache

Some of the use cases of Amazon ElastiCache:

Media
Caching Geospatial
streaming
 Amazon ElastiCache: Data Engines

Amazon ElastiCache supports two different data engines:

Amazon ElastiCache

Redis Memcached
 Amazon ElastiCache for Redis

Amazon ElastiCache is a Redis-compatible in-memory data store service and can support high
performance since it is fully managed, scalable, and secure. The benefits are as follows:

High performance

Fully manageable

Redis-compatible

Highly available and reliable

Easily scalable

Secure and compliant

 Amazon ElastiCache for Memcached

Amazon ElastiCache is a Memcached-compatible in-memory key-value store service that can be used
as a cache or a data store. The benefits of Amazon ElastiCache for Memcached are as follows:

High performance

High security

Memcached-compatible

Easily scalable

Fully manageable

Auto discovery
Amazon Redshift
 Amazon Redshift

Amazon Redshift is a fully managed, petabyte-scale data warehouse service in the cloud.
The benefits of Amazon Redshift are as follows:

Easy-to-use

Best performance

Highly scalable

Cost-effective

Easy-to-manage

Secure and compliant

 Amazon Redshift Clusters

An Amazon Redshift data warehouse is a collection of computing resources called nodes. Nodes are
organized into a group called a cluster. Each cluster runs an Amazon Redshift engine and contains one
or more databases.

Nodes

Redshift Warehouse Redshift engine

Cluster

160 160 160 160 160

160
GB GB
GB GB GB
GB
Nodes Nodes Nodes Nodes Nodes
Leader Node

Massive Parallel Processing

 Amazon Redshift Costs

The following are the costs associated with Amazon Redshift:

Backup storage

Managed storage Data transfer

Compute node hours Data scan

 Amazon Redshift

The use cases of Amazon Redshift:

Data analytics as a
Session store
service

Streaming data analytics Real-time analytics

Configuring Query Data Using Redshift Query Editor

Duration:15 min

Problem Statement:

You have been assigned a task to create a table in Amazon Redshift and access the Redshift
Query Editor.
 Assisted Practice: Guidelines

Steps to be followed are:

1. Create a table in Redshift

Creating a RDS MySQL Database

Duration:15 min

Problem Statement:

You have been assigned a task to demonstrate the process of creating an Amazon RDS MySQL
database using the AWS Management Console.
 Assisted Practice: Guidelines

Steps to be followed are:

1. Create a RDS database

 Key Takeaways

Amazon RDS supports several database options including Amazon

Aurora, Oracle, Microsoft SQL Server, PostgreSQL, MySQL, and
MariaDB.

Amazon DynamoDB is a NoSQL database service, offering fast,

predictable performance and seamless scalability.

Amazon ElastiCache is a web service that simplifies the

deployment, operation, and scaling of an in-memory data store.

Amazon DocumentDB is designed for managing and scaling

JSON formatted data.
Deploying MySQL RDS Using AWS
Duration: 30 mins

Project agenda: To create and configure an RDS instance

Description: You must create an RDS database and deploy a Linux

instance by creating it in EC2 and connecting an SSH client through EC2.

Perform the following:

1. Create an RDS database
2. Launch an EC2 instance
3. Create security groups
4. Connect the terminal to SSH
Thank You