Intro to Amazon Cloud

EC2 overview

Wong Voon Wong

Partner Solutions Architect
29 Apr 2022

2 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 Agenda

• Introduction to AWS Cloud

• Global Reach
• EC2 Overview
• EC2 Details

3 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 What is AWS?
AWS provides a highly reliable, scalable, low-cost infrastructure platform
in the cloud that powers millions of businesses in over 240 countries and
territories around the world.

Benefits
§ Low Cost
§ Elasticity & Agility
§ Open & Flexible
§ Secure
§ Global Reach

4 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 What sets AWS apart?
Security Fine-grained control

200+ services to support any cloud workload; rapid

Service Breadth & Depth; pace of innovation customer driven releases

Experience: 1M+ customers Building and managing cloud since 2006

84 Availability Zones within 26 geographic Regions, 17 Local Zones,

Global Footprint 310+ Points of Presence (300+ Edge Locations and 13 Regional Edge
Caches) in 84 cities across 42 countries.

More machine learning happens on AWS than anywhere else.

Machine Learning Machine learning in the hands of every developer and data scientist.

100,000+ APN partners from over 150 countries. The AWS

Ecosystem Marketplace offers 50 categories, and 10,000+ Products

AWS positioned as a Leader in the Gartner Magic Quadrant for

Enterprise leader Cloud Infrastructure as a Service, Worldwide
5 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 Pricing Philosophy

High volume / low margin businesses are in our core DNA

Trade CapEX for Our economies of Pricing model Save more money as
variable expense scale provide us choice to support you grow bigger
with lower costs variable and stable
workloads

On-demand
Tiered pricing
111 price Savings Plans
Pay for what
reductions Volume discounts
you use
since 2006 Reserved Instances
Custom pricing
Spot

6 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 Customer obsessed

90% of roadmap originates with customer requests

“Performance, reliability, and responsiveness are fundamental

to our customer experience, and T3 instances help us to deliver on
that customer promise while also controlling our costs.”
—Heroku
7 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
It’s greener in the cloud.

AWS’s infrastructure is

3.6x more energy efficient

than the median of the surveyed U.S. enterprise data centers

AWS performs the same task with an

88% lower carbon footprint

Source: 451 Research, 2019, all rights reserved

8 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Reducing water used for cooling

AWS has multiple initiatives to improve our water

use efficiency for cooling data centers:

• Evaporative cooling
• Reduce potable water usage
• Recycled cooling water
• Invest in reclaimed water infrastructure

9 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 1
AWS Global Reach
10 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
11 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 Availability Zones
• A region is comprised of multiple Availability Zones (typically 3)
• An Availability Zone (AZ) is one or more discrete data centers with redundant
power, networking, and connectivity in an AWS Region
• High throughput, low latency (<10mS) network between Availability Zones
• All traffic between AZ’s is encrypted
• Physical Separation < 100km Region us-east-1 (N.Virginia)

Availability Zone Availability Zone Availability Zone

us-east-1a us-east-1b us-east-1c

12 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 Intra & inter-AZ connectivity
§ Dark fiber “spans”
§ Optimized for low-latency & physical diversity

§ Amazon controlled infrastructure

§ Geospatial coordinates

§ Dense wavelength division multiplexing (DWDM)

13 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
14 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
15 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
16 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 2
EC2 Overview
17 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 Choices for Compute

Amazon EC2 Amazon ECS, AWS Lambda

EKS, and Fargate
Virtual server instances Container management service Serverless compute
in the cloud for running for stateless code execution in
Docker on a managed response to triggers
cluster of EC2

18 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 Amazon EC2

Linux | Windows | Mac

Arm and x86 architectures

General purpose and workload optimized

Bare metal, disk, networking capabilities

Amazon EC2
Packaged | Custom | Community AMIs

Multiple purchase options: On-demand, RI, Spot

19 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 What’s a virtual CPU? (vCPU)

§ A vCPU is typically a hyper-threaded physical core*

§ Divide vCPU count by 2 to get core count
§ On Linux, “A” threads enumerated before “B” threads
§ On Windows, threads are interleaved

§ Cores by Amazon EC2 & RDS DB Instance type:

https://aws.amazon.com/ec2/virtualcores/

* CPU Optimizing options allow disabling hyperthreading and reduce

number of cores

20 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 Memory and Storage

What’s a GiB? What about storage?

§ Memory is presented as § Storage is independent of
GibiBytes (GiB) and not compute
Gigabytes (GB) § You allocate drives known as
§ 256 GiB = 275 GB EBS volumes
§ Max 64 TiB per volume
§ Some instance types provide
physically attached
(ephemeral) storage

21 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 Instance sizing

xlarge
2xlarge xlarge
4xlarge
xlarge
2xlarge
xlarge
8xlarge ≈ ≈ ≈
xlarge
2xlarge
xlarge
4xlarge
xlarge
2xlarge
xlarge

m5.8xlarge 2 – m5.4xlarge 4 – m5.2xlarge 8 – m5.xlarge

22 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 EC2 Naming Explained

Instance generation

c5n.xlarge
Instance Attribute Instance size
family

23 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 Instance Types
General Compute Memory Accelerated Storage
Purpose Optimized Optimized Computing Optimized

Burstable General Compute Compute Memory In-memory Memory Compute and Graphics General Dense Big Data
performance Purpose Intensive +memory up Optimized Intensive Memory Intensive Purpose GPU FPGA High I/O Storage Optimized
to 100 Gbps Intensive

T3 M5 C5 C5n R5 X1 X1e G3 P4 F1 D3 H1

Local storage
(NVMe SSD) M5d C5d R5d Z1d I3

T3a M5a R5a G5

metal M5m c5m R5m u-12tb1 Z1dm I3m

others A1 M6g C7g R6g P3dn I3en

24 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 Choose your processor and architecture

Intel® Xeon® Scalable NVIDIA V100 AMD EPYC processor AWS Graviton FPGAs for custom
(Skylake) processor Tensor Core GPUs Processor (arm) hardware acceleration

Right compute for the right application and workload

25 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 AWS Graviton2 Processor
Enabling the best price/performance for your cloud workloads

Graviton Processor Graviton2 Processor

7x performance, 4x compute cores,
First Arm-based processor and 5x faster memory
available in major cloud

Built on 64-bit Arm Neoverse cores Built with 64-bit Arm Neoverse
with AWS-designed silicon using 16 cores with AWS-designed silicon using
nm manufacturing technology 7 nm manufacturing technology

Up to 16 vCPUs,10 Gbps enhanced Up to 64 vCPUs, 25 Gbps enhanced

networking, 3.5 Gbps EBS networking, 19 Gbps EBS bandwidth
bandwidth

26 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 Choice of accelerators for specialized workloads

Elastic Graphics Elastic Inference

Easily add graphics acceleration to Reduce deep learning inference costs

your EC2 instance by up to 75%

Configure right amount of graphics Easily attach fractional sizes of a full GPU
acceleration for your workload instance to EC2 or SageMaker instances

Accelerate application for fraction of Scale inference acceleration up or down

cost of standalone graphics instances as needed with EC2 Auto Scaling

27 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 Broadest and deepest platform choice

Categories Capabilities Options

Choice of processor
General purpose (AWS, Intel, AMD)

Fast processors Elastic Block Store

Burstable (up to 4.5 GHz)

Compute intensive

Memory intensive
High memory footprint
(up to 24 TiB)

Instance storage
Elastic Inference 400+
(HDD and SSD)
Storage (High I/O) Elastic Graphics
Accelerated computing for virtually every
Dense storage (GPUs ,FPGA & ASIC) workload and
business need
GPU compute Networking Linux, Unix, Windows,
(up to 400 Gbps) macOS
Graphics intensive Bare Metal
Size
(Nano to 32xlarge)

28 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 What is an Amazon Machine Image (AMI)?

Provides the information required to launch an instance

Launch multiple instances from a single AMI
An AMI includes the following
• A template for the root volume (for example, operating system,
applications)
• Launch permissions that control which AWS accounts can use the AMI
• Block device mapping that specifies volumes to attach to the instance

29 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 Choosing an AMI
AWS Console AWS Marketplace

Use the AMI ID to launch through the API or AWS Command Line Interface (AWS CLI)
aws ec2 run-instances --image-id ami-04681a1dbd79675a5 --instance-type c4.8xlarge --count 10 --key-name MyKey

30 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 EC2 Operating Systems Supported
§ Windows 2003R2*/2008*/2008R2*/2012/2012R2/2016/2019/2022
§ Amazon Linux
§ Debian
§ Suse
§ CentOS
§ Red Hat Enterprise Linux
§ Ubuntu
§ Mac

for more OSes see: https://aws.amazon.com/marketplace/b/2649367011

31 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 Amazon EC2 purchase options

the second significant savings of up to 90%

discount more flexibility

32 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 Simplify capacity and cost optimization

Scale using
Spot,
On-Demand,
or both

Use Reserved Instances or

Savings Plans
for known/steady-state
workloads
Now with hibernate

AWS services make this easy and efficient

Amazon EC2 EC2 Fleet Amazon Elastic Amazon Elastic AWS Amazon AWS AWS Batch
Auto Scaling Container Service Container Service Thinkbox EMR CloudFormation
for Kubernetes

33 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 Hibernate Amazon EC2 Instances
Maintain a fleet of pre-warmed instances to quickly get to a productive state

Available with Amazon Use familiar Stop and Memory data saved in EBS RAM contents are
EBS-backed instances Start APIs root volume encrypted on EBS

Its just like closing and opening your laptop! Applications can pick up right where it left off

34 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 3
EC2 Design
35 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 EC2 Host Virtualization

EC2 instances Guest 1 Guest 2 Guest n

Hypervisor

Host server

Physical servers in
AWS global regions

36 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 Resource allocation
§ All resources assigned to you are dedicated to your instance with
no over commitment*
§ All vCPUs are dedicated to you
§ Memory allocated is assigned only to your instance
§ Network resources are partitioned to avoid “noisy
neighbors”
§ Curious about the number of instances per host?
§ See “Dedicated Hosts Configuration Table” for a guide.

*the “T” family is special

37 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 Which hypervisor do we use?
Original host architecture: Xen-based
• Hypervisor consumed resources from the underlying host
• Limited optimization

AWS Nitro Hypervisor: Custom KVM based hypervisor

• AWS Nitro System (launched on Nov 2017)
• Less server resources used, more resources for the customer
• AWS optimized

Bare metal: Direct access to processor and memory resources

• Built on the AWS Nitro system
• Enables custom hypervisors and micro-VM runtimes
38 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Nitro System

Nitro Card Nitro Security Chip Nitro Hypervisor

Local NVMe storage Integrated into motherboard Lightweight hypervisor

Elastic Block Storage Protects hardware resources Memory and CPU allocation
Networking, monitoring, Bare metal-like performance
and security

Modular building blocks for rapid design and delivery of EC2 instances

39 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 EC2 Security Groups

Security Group Rules

• Name
• Description
• Protocol
• Port range
• IP address, IP range, Security Group name

40 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 EC2-Specific Credentials
EC2 key pairs
• Linux – SSH key pair for first-time host login
• Windows – Retrieve Administrator password “Public Half” inserted by
Amazon into each EC2
Standard SSH RSA key pair instance that you launch
• Public/Private Keys
• Private keys are not stored by AWS
AWS approach for providing initial access to a
generic OS “Private Half”
• Secure downloaded to your
desktop
• Personalized
• Non-generic (NIST, PCI DSS)

41 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
 Any Questions?

Up Next: EC2 Hands on Lab

42 © 2022, Amazon Web Services, Inc. or its Affiliates. All rights reserved.