Aws 1

Containers on AWS
A Journey to Modern Applications
Johannes Langer, Senior Solutions Architect, AWS
June 2019
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential
The new normal: companies are increasingly
global and products are increasingly digital
47% 79% 67%

of CEOs said they are of CIOs believe that of all business leaders
being challenged by digital business is believe that they
the board of directors making their IT must pick up the pace
to make progress in organizations better of digitalization to
digital business prepared to change remain competitive
Source: Gartner
To maintain competitive advantage, digital
businesses must innovate as rapidly as possible
Experiment
Innovation
Flywheel
Ideas Feedback
Architectural patterns
What changes
have to be made Operational model
in this new world? Software delivery
Changes to the architectural patterns
When the impact of change is small,
release velocity can increase
Monolith Microservices
Does everything Do one thing
Microservices architectures
API
Gateway
Account Account DB
Mobile
Lookup
client
IoT Shipping DB
Shipment
Query
Client
Store Front
Inventory DB
Web App
Inventory
Query
Cloud-native architectures are
small pieces, loosely joined
Changes to the operational model
Isn’t all of this very hard now that
we have lots of pieces to operate?
AWS operational responsibility models
Less More
On-Premises Cloud
Compute Virtual Machine

EC2 Elastic Beanstalk Fargate AWS Lambda
Databases MySQL MySQL on EC2

RDS MySQL RDS Aurora Aurora Serverless DynamoDB
Storage Storage
S3
Messaging ESBs
Amazon MQ Kinesis SQS / SNS
Analytics
Hadoop Hadoop on EC2 EMR Elasticsearch Service Athena
What is serverless?
No infrastructure provisioning, Automatic scaling

no management
Pay for value Highly available and secure
COMPUTE
AWS AWS
Lambda Fargate
DATA STORES
Amazon Amazon Aurora Amazon

S3 Serverless DynamoDB
INTEGRATION
Amazon Amazon Amazon AWS AWS

API Gateway SQS SNS Step Functions AppSync
Changes to the delivery of software
How do I develop and deploy
code in a serverless microservices
architecture?
Microservice development lifecycle
developers services delivery pipelines
build test release monitor
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
(microservices, 2 pizza teams)
Best practices
(governance, templates)
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Containers are the best on ramp
towards modern applications
Application environment components
Runtime Engine Code
Dependencies Configuration
Different environments
Local Laptop Staging / QA Production On-Prem
It worked on my machine, why not in prod?
v6.0.0 v7.0.0 v4.0.0 v7.0.0
Docker to the rescue
Runtime Engine
Dependencies
Code
Four environments, same container
Why are enterprises
adopting containers?
• Accelerate software development
• Build modern applications
• Automate operations at web scale
Make AWS the BEST PLACE to run ANY
containerized applications
Helping customers scale containers
450+% Hundreds of millions

growth of containers started each week
of millions
of container instances
Typical use cases
• Microservices: Java, Node.js, Go, Web Apps, etc.

• Continuous Integration and Continuous Deployment (CICD)
• Batch Processing and ETL jobs
• Common PaaS Stack for Application Deployment
• Legacy Application Migration to the Cloud
• Hybrid Workloads
• AI/ML
• Scale Testing
• Backend for IoT use cases
AWS container services landscape
Amazon Elastic
Management Amazon Elastic
Container Service
Deployment, Scheduling, Container Service
for Kubernetes
Scaling & Management of
containerized applications
Hosting Amazon EC2 AWS Fargate

Where the containers run
Image Registry Amazon Elastic

Container Image Repository Container Registry
Amazon Elastic
Container Service
Scheduling and Orchestration
ECS
Cluster Manager Placement Engine
McDonald’s Home Delivery: Why Amazon ECS?
Speed to market
Scalability and reliability
Security
DevOps—CI / CD
Monitoring
AWS Fargate
Without Fargate, you end up managing more than just containers
EC2 Instance
Docker ECS
OS
Agent Agent
- Patching and Upgrading OS, agents, etc.
- Scaling the instance fleet for optimal utilization
Amazon Elastic Container Service
Amazon Elastic Container Service
AWS Fargate
run serverless containers
AWS Fargate
Managed by AWS
No EC2 Instances to provision, scale or manage
Elastic
Scale up & down seamlessly. Pay only for what you use
Your
containerized
applications
Integrated
with the AWS ecosystem: VPC Networking, Elastic Load
Balancing, IAM Permissions, CloudWatch and more
Fully managed container environment
with AWS ECS + Fargate
Bring existing code Production ready Powerful integrations

No changes required of existing ISO, PCI, HIPAA, SOC compliant. Native AWS integrations for
code, works with existing Launch ten or tens of thousands networking, security, CICD,
workflows and microservices of containers in seconds in 9 monitoring, and tracing
built on Amazon ECS global regions (+7 in 2018)
Fargate runs tens of millions of containers for AWS customers every week
migrated ~850 applications running in ~5000 containers
to Fargate to reduce the undifferentiated heavy lifting
that came with managing Kubernetes
AWS Fargate customers
“We moved to Fargate because we

need the ability to scale quickly up
from baseline and get fine-grained
network control, without having to
manage our own infrastructure”
Product Hunt
”We don't want to babysit

any clusters. That has
nothing to do with us”
Shimon Tolts
CTO, DATREE
Amazon Elastic
Container Service for Kubernetes
What is Kubernetes?
Gives you primitives

Open source container Helps you run
for building modern
management platform containers at scale
applications
Community, contribution, choice
But where you run Kubernetes matters
Quality of the Quality of the

Your users
cloud platform applications
—CNCF survey
Kubectl mycluster.eks.amazonaws.com
Availability Availability Availability

Zone 1 Zone 2 Zone 3
EKS is Kubernetes certified
How are customer using Amazon EKS?
PaaS
Microservices Platform-as-a-Service Enterprise App Machine Learning

Migration
Customers adopting Kubernetes on AWS
Customer example: Snap
100% on Kubernetes in the cloud

Moving core messaging architecture to AWS and EKS
Currently monolithic, breaking this into SOA and microservices
“Undifferentiated Heavy Lifting is work that we have to do that

doesn’t directly benefit our customers. It’s just work. EKS frees us up
to worry about delivering customer value and allows developers
without operational experience to innovate without having to know
where their code runs.”
More detailed talk: AWS New York Summit 2018 - Run Kubernetes with Amazon EKS (SRV318)
Amazon container services
AWS Fargate
THANK YOU! Questions?
https://aws.amazon.com/containers
[email protected]
@johlanger
Rich partner ecosystem
Monitoring &
Foundation DevOps Logging Security Networking
New: AWS Cloud Map
Service discovery for all your cloud resources

Constantly monitor the health of every resource
Dynamically update the location of each microservice
Increase developer productivity

AWS Single registry for all app resources
Cloud Define resources with user-friendly names
Map
Integration with Amazon container services
AWS Fargate
Amazon ECS
Amazon EKS
New: AWS App Mesh
Observability & traffic control
Easily export logs, metrics, and traces
Client side traffic policies—circuit breaking, retries
Routes for deployments
Works across clusters and container services
Amazon ECS
Amazon EKS
Kubernetes on EC2
AWS Fargate (coming soon!)
AWS built and run

No control plane to manage
Ease of operations
High scale
Container Customers
Fidelity Investments
EKS Reference Customers: SNAP Inc
Appcard
EKS Reference Customer: Fidelity Investments
“We built the next generation of our PaaS using EKS for large
enterprise workloads. We manage thousands of applications
and have hundreds of DevOps teams.”
Amr Abdelhalem, Head of Cloud Architecture
EKS Reference Customer: SNAP
“Snapchat serves millions of people around the world every

day, and we're thrilled to now leverage Amazon EKS as a core
compute service that can meet our needs now, as well as
upcoming plans to host several critical workloads in the
coming months.”
Alex Strand, Senior Director of Engineering, Snap Inc
EKS Reference Customer: Appcard
“Kubernetes is fast becoming the preferred solution for container

orchestration. Its biggest downside is that it is not simple to set
up and operate. EKS gives us all the benefits of Kubernetes, but
takes care of managing the hard stuff. We can dedicate less
resources to deployment and operations as result.”
Amichay Oren, Co-founder & CTO, AppCard Inc
Turner Broadcasting
Fargate Reference Customers: 99Designs
Harry’s Razors
Fargate Reference Customer: Turner Broadcasting
“The Cloud Architecture team begin

building tooling around Fargate to
accelerate the adoption and the move to
this new DevOps world. The result ended
up with reduce cost and time.”
Joseph Bulger, Principal Architect
Turner Broadcasting System
Fargate Reference Customer: 99Designs
“We moved to Fargate to reduce operational burden and

operational costs. Fargate made running Docker containers
easy, removing need to maintain instances.”
Robert McNeil, Sr. Engineer, 99designs
Fargate Reference Customer: Harry’s Razors
“With Fargate we eliminated EC2 instances, sizing

concerns, instance profiles and policies. Directly
leveraging service auto scaling and target tracking
policies, migrating without any downtime and
simplifying our overall system.”
Bryce Lohr, Technical Lead, Core Services, Harry’s
Introduction to Containers and
Docker
Application environment components
Runtime Engine Code
Dependencies Configuration
Different environments
v6.0.0 v7.0.0 v4.0.0 v7.0.0
v6.0.0 v7.0.0 v4.0.0 v7.0.0
Docker to the rescue
Runtime Engine
Dependencies
Code
Docker container image
Read only image that is used as a
W
rit
template to launch a container.
ab
le
ad
Container
d
ng
Start from base images that have
ix
ad
Image
d
your dependencies, add your References
n od
parent
custom code.
ej
image
U
Image
s
bu
nt
u
Docker file for easy, Base image
reproducible builds. bootfs
kernel
Four environments, same container
Virtual machine versus Docker
VM App 2
App 1 App 2 App 3 Container
Bins/Libs Bins/Libs Bins/Libs App 1 App 2 App 3
Guest OS Guest OS Guest OS Bins/Libs Bins/Libs Bins/Libs
Hypervisor Docker
Host OS Host OS
Server (Host) Server (Host)
Container & Docker Benefits
Portable application artifact that runs reliably everywhere
Run different applications or application versions with different

dependencies simultaneously
Better resource utilization by running multiple lightweight

containers per host
Reference Architectures (Informational)
Amazon ECS:
Rebalancing Amazon ECS Tasks using AWS Lambda
NGINX Reverse Proxy on Amazon EC2 Container Service
Java Microservices Deployed on EC2 Container Service
Amazon ECS Reference Architecture: Batch Processing
Node.js Microservices Deployed on EC2 Container Service
Amazon EC2 Container Service - Reference Architecture: Service Discovery to containers using CloudWatch Events,
Lambda and Route 53 private hosted zones
Service Discovery for AWS EC2 Container Service via DNS
Canary Blue/Green deployments on ECS
Blue/Green deployments on ECS
ECS Reference Architecture: Continuous Deployment
Amazon ECS Scheduler Driver to integrate Apache Mesos with ECS
AWS Fargate
Blue/Green deployments using Fargate
How to host an ASP.NET core application in AWS Fargate using Linux containers
Amazon EKS
CodeSuite - Continuous Deployment Reference Architecture for Kubernetes

Aws 1

Uploaded by

Copyright:

Available Formats

Aws 1

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Aws 1

Uploaded by

Copyright:

Available Formats

Containers on AWS

A Journey to Modern Applications

Johannes Langer, Senior Solutions Architect, AWS

47% 79% 67%

Compute Virtual Machine

Databases MySQL MySQL on EC2

No infrastructure provisioning, Automatic scaling

Pay for value Highly available and secure

Amazon Amazon Aurora Amazon

Amazon Amazon Amazon AWS AWS

build test release monitor

build test release monitor

build test release monitor

build test release monitor

build test release monitor

build test release monitor

Runtime Engine Code

Local Laptop Staging / QA Production On-Prem

v6.0.0 v7.0.0 v4.0.0 v7.0.0

Local Laptop Staging / QA Production On-Prem

Local Laptop Staging / QA Production On-Prem

450+% Hundreds of millions

• Microservices: Java, Node.js, Go, Web Apps, etc.

Hosting Amazon EC2 AWS Fargate

Image Registry Amazon Elastic

Cluster Manager Placement Engine

Scalability and reliability

- Scaling the instance fleet for optimal utilization

Bring existing code Production ready Powerful integrations

“We moved to Fargate because we

”We don't want to babysit

Gives you primitives

Quality of the Quality of the

Availability Availability Availability

Microservices Platform-as-a-Service Enterprise App Machine Learning

100% on Kubernetes in the cloud

“Undifferentiated Heavy Lifting is work that we have to do that

Service discovery for all your cloud resources

Increase developer productivity

AWS built and run

“Snapchat serves millions of people around the world every

“Kubernetes is fast becoming the preferred solution for container

“The Cloud Architecture team begin

“We moved to Fargate to reduce operational burden and

“With Fargate we eliminated EC2 instances, sizing

Runtime Engine Code

Local Laptop Staging / QA Production On-Prem

v6.0.0 v7.0.0 v4.0.0 v7.0.0

Local Laptop Staging / QA Production On-Prem

v6.0.0 v7.0.0 v4.0.0 v7.0.0

Local Laptop Staging / QA Production On-Prem

Read only image that is used as a

Local Laptop Staging / QA Production On-Prem

App 1 App 2 App 3 Container

Bins/Libs Bins/Libs Bins/Libs App 1 App 2 App 3

Guest OS Guest OS Guest OS Bins/Libs Bins/Libs Bins/Libs

Server (Host) Server (Host)

Portable application artifact that runs reliably everywhere

Run different applications or application versions with different