CST 423 CLOUD COMPUTING Mo dule 5 Ojus Thomas Lee CE Kidango or Ojus Thomas Lee CE Kidango or CST 423

CLOUD COMPUTI NG Mo dule 5 1 / 129

Syllabus Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 2 / 129

AmazonWebService Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 3 / 129

Amazon web services 1 Amazon Web Services (AWS) is a platform that allows the development of exible applications

by providing solutions for elastic infrastructure scalability, mess aging, and data storage. The platform is accessible

through SOAP or RESTful Web service interfaces Provides a Web-based console where users c an handle

administration and monitoring of the resources required, as well as their exp ense s computed on a pay-as-you-go basis.

1 Mastering Cloud Computing, Foundations and Applications Programming, Rajkumar Buyya, Christian Vecchiola, S.

Thamarai Selvi, Chapter 9 Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 4 / 129

AmazonWebService 2 2 Mastering Cloud Computing, Foundations and Applications Programming, Rajkumar Buyya,

Christian Vecchiola, S. Thamarai Selvi, Chapter 9 Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo

dule 5 5 / 129

Amazon web services - Compute services 3 Compute service s constitute the fundam ental element of cloud computing

system s. The fundamental service in this space is Amazon EC2, which delivers an IaaS s olution that has served as a

reference mo del for sev eral oerings from other vendors in the same market se gment. Amazon EC2 allows deploying

servers in the form of virtual machines created as instances of a sp e cic image. 3 Mastering Cloud Computing,

Foundations and Applications Programming, Rajkumar Buyya, Christian Vecchiola, S. Thamarai Selvi, Chapter 9 Ojus

Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 6 / 129

Amazon web services - Compute services 4 Compute service s constitute the fundam ental element of cloud computing

system s. The fundamental service in this space is Amazon EC2, which delivers an IaaS s olution that has served as a
reference mo del for sev eral oerings from other vendors in the same market se gment. Amazon EC2 allows deploying

servers in the form of virtual machines created as instances of a sp e cic image. 4 Mastering Cloud Computing,

Foundations and Applications Programming, Rajkumar Buyya, Christian Vecchiola, S. Thamarai Selvi, Chapter 9 Ojus

Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 7 / 129

Amazon web services - Compute services 5 Amazon EC2 allows deploying servers in the form of virtual machines

created as instances of a sp e cic image. Images com e with a preinstalled op erating system and a software stack, and

instances can b e congured for memory, num b er of pro cessors, and storage. Users are provided with credentials to

rem otely access the instance and further c on gure or install software if needed. 5 Mastering Cloud Computing,

Foundations and Applications Programming, Rajkumar Buyya, Christian Vecchiola, S. Thamarai Selvi, Chapter 9 Ojus

Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 8 / 129

Amazon web services - Compute services 6 Amazon machine images (AMI) Images com e with a preinstalled op erating

system and a software stack, and instances can b e congured for memory, num b er of pro cessors, and storage. Users

are provided with credentials to rem otely access the instance and further c on gure or install software if needed. 6

Mastering Cloud Computing, Foundations and Applications Programming, Rajkumar Buyya, Christian Vecchiola, S.

Thamarai Selvi, Chapter 9 Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 9 / 129

Amazon web services - Compute services 7 Amazon Machine Images (AMIs) are templates from which it is p ossible to

create a virtual machine. They are stored in Amazon S3 and identied by a unique identier in the form of ami-xxxxxx and

a manife st XML le. An AMI contains a physical le system layout with a predened op erating system installe d. These

are sp ecied by the Amazon Ramdisk Image (ARI, id: ari-yyyyyy) and t he Amazon Kernel Image (AKI, id: aki-zzzzzz)

are part of the conguration of the template. 7 Mastering Cloud Computing, Foundations and Applications Programming,

Rajkumar Buyya, Christian Vecchiola, S. Thamarai Selvi, Chapter 9 Ojus Thomas Lee CE Kidango or CST 423 CLOUD

COMPUTI NG Mo dule 5 10 / 129

AMI-ARI-AKI 8 8 https://aws.amazon.com/security/security-bulletins/linux-kernal-vulnerability-in- certain-ec2-amis/ Ojus

Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 11 / 129

Amazon web services - Compute services 9 AMIs are either created from scratch or \bundled" from existing EC2

instances. Once an AMI is created, it is stored in an S3 bucket and the user can decide whether to make it available to

other users or keep it for p ersonal use. It is also p ossible to ass o ciate a pro duct co de with a given AMI, thus allowing

the owner of the AMI to get revenue e very time this AMI is used to create EC2 instances . 9 Mastering Cloud

Computing, Foundations and Applications Programming, Rajkumar Buyya, Christian Vecchiola, S. Thamarai Selvi,

Chapter 9 Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 12 / 129

Amazon web services - Compute services- EC2 instances 10 EC2 instances represent virtual machines. They are

created using AMI as templates, which are sp ecialized by selecting the numb er of cores , their computing p ower, and

the installed memory. The pro cessing p ower is expressed in terms of virtual cores and EC2 Compute Units (ECUs) .

The ECUs a measure of the computing p ower of a virt ual core; it is used to express a predictable quantity of real CPU

p ower that is allo cated to an instance. 10 Mastering Cloud Computing, Foundations and Applications Programming,

Rajkumar Buyya, Christian Vecchiola, S. Thamarai Selvi, Chapter 9 Ojus Thomas Lee CE Kidango or CST 423 CLOUD

COMPUTI NG Mo dule 5 13 / 129

Amazon web services - Compute services- EC2 instances 11 Using compute units instead of real frequency values,

Amazon can change over time the mapping of such units to the underlying real am ount of computing p ower allo cated,

And ke ep the p erformance of EC2 instances consistent with standards set by the times. One ECU is dened as giving

the same p erformance as a 1.0 - 1.2 GHz 2007 Opteron or 2007 Xeon pro cessor. 11 Mastering Cloud Computing,

Foundations and Applications Programming, Rajkumar Buyya, Christian Vecchiola, S. Thamarai Selvi, Chapter 9 Ojus

Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 14 / 129

Amazon web services - Compute services- EC2 instances 12 Six categories of EC2 instances Standard instances.

Micro instances. High-memory instances. High-CPU instances. Cluster Compute instances Cluster GPU instances. 12

Mastering Cloud Computing, Foundations and Applications Programming, Rajkumar Buyya, Christian Vecchiola, S.
Thamarai Selvi, Chapter 9 Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 15 / 129

Amazon web services - Compute services- EC2 instances 13 Standard instances. This class oers a set of congurations

that are suitable for most applications. EC2 provides three dierent categories of standard instances with increasing

computing p ower, storage, and memory. Micro Instances This class is suitable for those applications that consume a

limited amount of computing p ower and memory and o ccasionally need bursts in CPU cycles to pro cess surges in the

workload. Micro instances can b e used for small We b applications with limited trac. 13 Mastering Cloud Computing,

Foundations and Applications Programming, Rajkumar Buyya, Christian Vecchiola, S. Thamarai Selvi, Chapter 9 Ojus

Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 16 / 129

Amazon web services - Compute services- EC2 instances 14 High-memory instances. This class targets applications

that need to pro cess huge workloads and require large amounts of mem ory. Three-tier Web applications characterized

by high trac are the target prole. Three categories of increasing memory and CPU are available, w ith memory prop

ortionally larger than computing p ower. High-CPU instances. This class targets compute-intensive applications. Two

congurations are available where computing p owe r prop ortionally increases more than memory. 14 Mastering Cloud

Computing, Foundations and Applications Programming, Rajkumar Buyya, Christian Vecchiola, S. Thamarai Selvi,

Chapter 9 Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 17 / 129

Amazon web services - Compute services- EC2 instances 15 Cluster Compute instances. This class is used to provide

virtual cluste r services. Instances in this category are characterized by high CPU compute p ower and large memory

and an e xtremely high I/O and network p erformance, which makes it suitable for HPC applications. Cluster GPU

instances. This class provides instances featuring graphic pro cessing units (GPUs) and high c omput e p ower, large

memory, and extremely high I/O and network p erformance. This class is particularly suited for clust er applications that

p erform heavy graphic computations, such as rende ring clusters. Since GPU can b e used for general-purp ose

computing, users of such instances can b enet from additional computing p ower, which makes this class suitable for H

PC applications. 15 Mastering Cloud Computing, Foundations and Applications Programming, Rajkumar Buyya,

Christian Vecchiola, S. Thamarai Selvi, Chapter 9 Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo
dule 5 18 / 129
Amazon web services - Compute services- EC2 instances 16 EC2 instances can b e run either by using the

command-line to ols provided by Amazon, which connects the Amazon Web Service that provides remote access to the

EC2 infrastructure, or via the AWS console, which allows the managem ent of other services, such as S3. By default an

EC2 instance is created with the kernel and the disk asso ciated to the AMI. 16 Mastering Cloud Computing,

Foundations and Applications Programming, Rajkumar Buyya, Christian Vecchiola, S. Thamarai Selvi, Chapter 9 Ojus

Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 19 / 129

Amazon web services - Compute services- EC2 instances 17 EC2 instances are dened with architecture (32 bit or 64

bit) and the space of disk available to the instance. This is an ephemeral disk; once the instance is shut down, the

content of the disk will b e lost. Alternatively, it is p ossible to attach an EBS volume to the instance, the content of which

will b e stored in S3. If the default AKI and ARI are not suitable, EC2 provides capabilities to run EC2 instances by sp

ecifying a dierent AKI and ARI, thus giving exibility in the creation of instances. 17 Mastering Cloud Computing,

Foundations and Applications Programming, Rajkumar Buyya, Christian Vecchiola, S. Thamarai Selvi, Chapter 9 Ojus

Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 20 / 129

Amazon web services - Compute services- EC2 environment 18 EC2 instances are executed within a virtual

environment, which provides them with the services they require to host applications. The EC2 environment is in charge

of allo cating addresses, attaching storage volumes, and conguring security in terms of access control and network

connectivity. 18 Mastering Cloud Computing, Foundations and Applications Programming, Rajkumar Buyya, Christian

Vecchiola, S. Thamarai Selvi, Chapter 9 Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5

21 / 129

Amazon web services - Compute services- EC2 environment 19 By default, instanc es are c re ate d with an internal IP

address , which makes them capable of communicating within the EC2 network and accessing the Internet as c lients. It

is p oss ible to asso ciate an Elastic IP to each instance, which can then b e rem app ed to a dierent instanc e over time.

Elastic IPs allow ins tanc es running in EC2 to act as servers reachable from the Internet and, since they are not strictly
b ound to sp ecic instances, to implement failover capabilities . 19 Mastering Cloud Computing, Foundations and

Applications Programming, Rajkumar Buyya, Christian Vecchiola, S. Thamarai Selvi, Chapter 9 Ojus Thomas Lee CE

Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 22 / 129

Amazon web services - Compute services- EC2 environment 20 EC2 instances are also given a domain name that

generally is in the form ec2-xxx-xxx-xxx.compute-x.amazonaws.com where xxx-xxx- xxx normally represents the four

parts of the external IP address separated by a dash compute-x gives information ab out the availability zone where

instances are deployed 20 Mastering Cloud Computing, Foundations and Applications Programming, Rajkumar Buyya,

Christian Vecchiola, S. Thamarai Selvi, Chapter 9 Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo

dule 5 23 / 129

Amazon web services - Compute services- EC2 environment 21 There are ve availability zones that are priced

dierently: two in the United States (Virginia and Northern California), one in Europ e (Ireland), and two in Asia Pacic

(Singap ore and Tokyo). 21 Mastering Cloud Computing, Foundations and Applications Programming, Rajkumar Buyya,

Christian Vecchiola, S. Thamarai Selvi, Chapter 9 Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo

dule 5 24 / 129

Availability Regions and Availability Zones 22 Availability regions are the geographic lo cations of the cloud data centers.

Dierent regions oer dierent service qualities in terms of latency, solutions p ortfolios, and costs. For the large

providers, their availability regions exist across the glob e . The availability zone refers to a logical data center within a

single region . Each availability zone includes multiple data centers, and no single data center is shared b etween

multiple av ailability zones. 22 https://www.bmc.com/blogs/cloud-availability-regions-zones/ Ojus Thomas Lee CE

Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 25 / 129

Availability Regions and Availability Zones 23 Amazon availability regions and Zones. 23

https://www.bmc.com/blogs/cloud-availability-regions-zones/ Ojus Thomas Lee CE Kidango or CST 423 CLOUD

COMPUTI NG Mo dule 5 26 / 129

CloudFormation 24 24 https://k21academy.com/amazon-web-services/aws-devops/aws-cloudformation/ Ojus Thomas

Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 27 / 129

Amazon web services - Advanced compute services 25 AWS CloudFormation: Managing your infrastruc ture with many

services can b e hard. Creating and managing multiple AWS resources can b e challenging and time-consuming. In fact,

doing those things could result in sp ending a whole lot of time managing your AWS resources instead of developing

your applications. 25 https://www.simplilearn.com/tutorials/aws-tutorial/aws-cloudformation Ojus Thomas Lee CE

Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 28 / 129

Amazon web services - Advanced compute services 26 AWS CloudFormation: AWS CloudForm ation can provide with

a simple way to create and manage a collection of AWS resources by provisioning and up dating them in an orderly and

predictable way. It allows you to create and mo del your infrastructure and applications without having to p erform

actions manually. 26 https://www.simplilearn.com/tutorials/aws-tutorial/aws-cloudformation Ojus Thomas Lee CE

Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 29 / 129

Amazon web services - Advanced compute services 27 AWS CloudFormation: AWS CloudForm ation is an AWS s

ervice that uses template les to automate the setup of AWS resources . It is an infrastructure automation or

Infrastructure-as-Co de (IaC) to ol and a cloud automation solution It can automate the setup and deployment of various

Infrastructure-as-a-Service (IaaS) oe rings on the AWS. CloudFormation supp orts virtually every service that runs in

AWS.. 27 https://www.contino.io/insights/aws-cloudformation Ojus Thomas Lee CE Kidango or CST 423 CLOUD

COMPUTI NG Mo dule 5 30 / 129

Amazon web services - Advanced compute services 28 AWS CloudFormation: AWS CloudForm ation enables you to

manage your complete infrastructure or AWS resources in a text le, or template. A collection of AWS resources is called

a stack. AWS resources can b e created or up dat ed by using a stack. All the resources you require in an application

can b e deploye d easily using templates. Also, you can reuse your templates to replicate your infrastructure in multiple
environments. 28 https://www.simplilearn.com/tutorials/aws-tutorial/aws-cloudformation Ojus Thomas Lee CE Kidango

or CST 423 CLOUD COMPUTI NG Mo dule 5 31 / 129

Amazon web services - Advanced compute services 29 AWS CloudFormation: An AWS CloudFormation template is a

formatted text le in JSON or YAML language that describ es your AWS infrastructure. To create, view and mo dify

templates, you can use AWS CloudFormation Designer or any text editor to ol. 29

https://www.simplilearn.com/tutorials/aws-tutorial/aws-cloudformation Ojus Thomas Lee CE Kidango or CST 423

CLOUD COMPUTI NG Mo dule 5 32 / 129

CloudFormation Template 30 30 https://k21academy.com/amazon-web-services/aws-devops/aws-cloudformation/ Ojus

Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 33 / 129

ElasticBeanstalk 31 31 https://k21academy.com/amazon-web-services/aws-devops/aws-cloudformation/ Ojus Thomas

Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 34 / 129

Amazon web services - Advanced compute services 32 AWS Elastic Beanstalk: AWS Elastic Beanstalk is an

easy-to-use service for deploying and scaling web applications and services develop ed with Java, .NET, PHP, No de.js,

Python, Ruby, Go, and Do cker on familiar servers such as Apache, Nginx, Passenger, and I IS. 32

https://www.edureka.co/blog/aws-elastic-b eanstalk/ Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG

Mo dule 5 35 / 129
Amazon web services - Advanced compute services - Elastic Bea nstalk 33 Benets of AWS Elastic Beanstalk Oers

Quicker Deployment: Elastic Beanstalk oers develop ers t he fastest and simplest way to deploy their application. Within

m inutes, the application will b e ready to use without users having to deal wit h the underlying infrastructure or resource

conguration. Supp orts Multi-Tenant Architecture: AWS Elastic Beanstalk ma kes it p ossible for users to share their

applications across dierent devices with high scalability and security. It provides a detailed rep ort of application usage

and user proles. 33 https://www.edureka.co/blog/aws-elastic-b eanstalk/ Ojus Thomas Lee CE Kidango or CST 423

CLOUD COMPUTI NG Mo dule 5 36 / 129

Amazon web services - Advanced compute services - Elastic Bea nstalk 34 Benets of AWS Elastic Beanstalk Simplies

Op erations: Beanstalk provisions and op erates the infrastructure and manages the application stack. Develop ers have

t o just fo cus on developing co de for their application rather than sp ending time on managing and conguring servers,

databases, rewalls, and networks. Oers Complete Resource Control: Beanstalk gives develop ers the freedom to

select the AWS resources like EC2 instance typ e, that are optimal for their application. It allows develop ers to retain full

control over AWS resources and access them at any time. 34 https://www.edureka.co/blog/aws-elastic-b eanstalk/ Ojus

Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 37 / 129

Amazon web services - Advanced compute services - Elastic Bea nstalk 35 How Do e s AWS Elastic Beanstalk Work?

By using Elastic Beanstalk, you create an application, upload an application version in the form of an application co de

bundle (for exam ple , a Python .war le) to Elastic Beanstalk, and then provide some information ab out the application.

Elastic Beanstalk automatically launches an e nvironme nt, creates and congures the AWS resources needed to run

your co de. After environment is launched, we can manage our environment and deploy ne w application versions. 35

https://k21academy.com/amazon-web-services/aws-devops/aws-elastic-b eanstalk/ Ojus Thomas Lee CE Kidango or

CST 423 CLOUD COMPUTI NG Mo dule 5 38 / 129

ElasticBeanstalk Working 36 36 https://k21academy.com/amazon-web-services/aws-devops/aws-cloudformation/ Ojus

Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 39 / 129

AWS-S3 37 37 https://k21academy.com/amazon-web-services/amazon-s3-bucket-and-storage- classes/ Ojus Thomas

Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 40 / 129

Amazon web services - Storage services - Amazon Simpl e Storage Service (S3) 38 Amazon Simple Storage Service

(S3) Amazon Simple Storage Service (S3) is a storage that can b e maintained and acce ssed over the Internet.

Amazon S3 provides a web service that can b e used to store and retrieve an unlimited amount of data. 38

https://k21academy.com/amazon-web-services/amazon-s3-bucket-and-storage- classes/ Ojus Thomas Lee CE Kidango

or CST 423 CLOUD COMPUTI NG Mo dule 5 41 / 129

Amazon web services - Storage services - Amazon Simpl e Storage Service (S3) 39 The core comp onents of S3 are

Buckets Buckets represent virtual containers in which to store objects By default, the maximum numb er of buckets that

can b e created p er account is 100. For additional buckets, one can submit a request for a service limit increase.

Objects objects represent the content that is actually stored. Objects can also b e enriched with metadata that can b e

used to tag the stored content with addit ional information Objects are stored inside buckets. 39

https://k21academy.com/amazon-web-services/amazon-s3-bucket-and-storage- classes/ Ojus Thomas Lee CE Kidango

or CST 423 CLOUD COMPUTI NG Mo dule 5 42 / 129

Amazon web services - Storage services - Amazon Simpl e Storage Service (S3) 40 Some of the b enets of AWS S3

are: Durability: S3 provides 99 : 999999999 p ercent durability. Low cost: S3 lets you store data in a range of \storage

classes." These classes are based on the frequency and im mediacy you require in accessing les. Scalability: S3

charge s you only for what resources you ac tually use, and there are no hidden fees or overage charges. You can scale

your storage resources to easily meet your organization's ever-changing demands. Availability: S3 oers 99 : 99 p ercent

availability of objects 40 https://www.simplilearn.com/tutorials/aws-tutorial/aws-s3 Ojus Thomas Lee CE Kidango or CST

423 CLOUD COMPUTI NG Mo dule 5 43 / 129

Amazon web services - Storage services - Amazon Simpl e Storage Service (S3) 41 Some of the b enets of AWS S3

are: Security: S3 oers an impressive range of access management to ols and encryption fe atures that provide
top-notch security. Flexibility: S3 is ideal for a wide range of uses like data storage, data backup, software delivery, data

archiving, disaster recovery, website hosting, mobile applications , IoT devices, and much more. Simple data transfer:

You don't have to b e an IT genius to execute data transfers on S3. The service revolves around simplicity and ease of

use. 41 https://www.simplilearn.com/tutorials/aws-tutorial/aws-s3 Ojus Thomas Lee CE Kidango or CST 423 CLOUD

COMPUTI NG Mo dule 5 44 / 129

Amazon web services - Storage services - Amazon Simpl e Storage Service (S3) 42 Access to S3 is provided with

RESTful Web services. These express all the op erations that can b e p erformed on the storage in the form of H TTP

requests (GET, PUT, DELETE, HEAD, and POST), which op erate dierently according to the element they address. As

a rule of thumb PUT/ POST requests add new content to the store, GET/HEAD requests are used to retrieve content

and information, and DELETE requests are used to remove ele ments or information attached to them. 42

https://www.simplilearn.com/tutorials/aws-tutorial/aws-s3 Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI

NG Mo dule 5 45 / 129

Amazon web services - Storage services - Amazon Simpl e Storage Service (S3) 43 Resource naming Buckets, objects,

and attached m etadata are made accessible through a REST interfac e. Therefore, they are represented by uniform

resource identiers (URIs) under the s3.amazonaws.com domain. Amazon oers three dierent ways of address ing a

bucket: Canonical f orm Sub domain form Virtual hosting form 43 Mastering Cloud Computing Foundations and

Applications Programming, Rajkumar Buyya, Christian Vecchiola,S. Thamarai Selvi Ojus Thomas Lee CE Kidango or

CST 423 CLOUD COMPUTI NG Mo dule 5 46 / 129

Amazon web services - Storage services - Amazon Simpl e Storage Service (S3) 44 Resource naming Canonical form

http : == s 3 : amazonaws : com = bukect name =: The bucket name is expressed as a path comp onent of the domain

name s3.amazonaws.com. This is the na ming convention that has less restriction in terms of allowed characters, since

all the characters that are allowed for a pat h comp onent can b e used. 44 Mastering Cloud Computing Foundations

and Applications Programming, Rajkumar Buyya, Christian Vecchiola,S. Thamarai Selvi Ojus Thomas Lee CE Kidango

or CST 423 CLOUD COMPUTI NG Mo dule 5 47 / 129

Amazon web services - Storage services - Amazon Simpl e Storage Service (S3) 45 Resource naming - Sub domain

form http : == bucketname : s 3 : amazon : com = . Alternatively, it is also p os sible to reference a bucket as a sub

domain of s3.amazonaws.com. To express a bucket name in this form, the name has to do all of the following: Be b

etween 3 and 63 chara ct ers long Contain only letters, num b ers, p erio ds, and dashes Start with a letter or a numb er

Contain at least one letter Have no fragments b etween p erio ds that start with a dash or end with a dash or that are

empty strings This form is equivalent to the previous one when it can b e used, but it is the one to b e preferred since it

works more eectively for all the geographical lo cations serving resources stored in S3. 45 Mastering Cloud Computing

Foundations and Applications Programming, Rajkumar Buyya, Christian Vecchiola,S. Thamarai Selvi Ojus Thomas Lee

CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 48 / 129

Amazon web services - Storage services - Amazon Simpl e Storage Service (S3) 46 Resource naming Virtual hosting

form http : == bucket name : com = . 46 Mastering Cloud Computing Foundations and Applications Programming,

Rajkumar Buyya, Christian Vecchiola,S. Thamarai Selvi, Chapter 9 Ojus Thomas Lee CE Kidango or CST 423 CLOUD

COMPUTI NG Mo dule 5 49 / 129

Amazon web services - Storage services - Amazon Simpl e Storage Service (S3) 47 Resource naming Since S3 is

logically organized as a at data store, all the buckets are managed under the s3. amazonaw s.com domain. Therefore,

the names of buckets must b e unique across all the users. 47 Mastering Cloud Computing Foundations and

Applications Programming, Rajkumar Buyya, Christian Vecchiola,S. Thamarai Selvi, Chapter 9 Ojus Thomas Lee CE

Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 50 / 129

Amazon web services - Storage services - Amazon Simpl e Storage Service (S3) 48 Resource naming Objects are

always referred as resources lo cal to a g iv en bucket. Therefore, they always app e ar as a part of the resource comp

onent of a URI. Since a bucket can b e expressed in three dierent ways, objects indirectly inherit this exibility: Canonical

form: http : == s 3 : amazonaws : com = bukect n ame = object name Sub domain form: http : == bucket name = s 3 :

amzonaws : com = object name Virtual hosting form: http : == bucket name : com = object name 48 Mastering Cloud
Computing Foundations and Applications Programming, Rajkumar Buyya, Christian Vecchiola,S. Thamarai Selvi,

Chapter 9 Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 51 / 129

Amazon web services - Storage services - Amazon Simpl e Storage Service (S3) 49 Amazon S3 storage classes

Amazon S3 oers eight dierent storage classes with dierent le vels of durability, availability, and p erform anc e

requirements. Amazon S3 Standard is the default. It is general purp ose storage for frequently accessed data. Amazon

S3 Standard-Infrequent Access (Standard-IA) is designed for less frequently accessed data, such as backups and

disaster recovery data. Amazon S3 One Zone-Infrequent Access (One Zone-IA) p erforms like the Standard-IA, but s

tores data only in one availability zone. Amazon S3 Intelligent-Tiering moves objec ts automatically to a more

cost-ecient storage class. Amazon S3 on Outp osts brings storage to installations not hoste d by Amazon. 49

https://en.wikip edia.org/wiki/Ama zon S3 Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5

52 / 129

Amazon web services - Storage services - Amazon Simpl e Storage Service (S3) 50 Amazon S3 storage classes

Amazon S3 oers eight dierent storage classes with dierent le vels of durability, availability, and p erform anc e

requirements. Amazon S3 Glacier Instant Retrieval is a low-cost storage for rarely accessed data, but which still requires

rapid retrieval. Amazon S3 Glacier Flexible Retrieval is also a low-cost option for long-lived data; it oers 3 retrieval sp

eeds, ranging from minutes to hours. Amazon S3 Glacier Deep Archive S3 Glacier Deep Archive is Amazon S3's

lowest-cost storage class and supp orts long-term retention and digit al preservation for data that may b e accessed

once or twice in a year 50 https://en.wikip edia.org/wiki/Ama zon S3 Ojus Thomas Lee CE Kidango or CST 423 CLOUD

COMPUTI NG Mo dule 5 53 / 129

AWS-Elastic Blo ck Store 51 51 https://commons.wikimedia.org/wiki/File:AWS Simple Icons Storage Amazon EBS.svg

Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 54 / 129

Amazon web services - Storage services - Amazon E lastic Blo ck Store (EBS) 52 EBS stands for Elastic Blo ck Store.

EC2 is a virtual server in a cloud while EBS is a virtual disk in a cloud. Amazon EBS allows you to create storage

volumes and attach them to the EC2 instances. Once the storage volume is created, you can create a le system on the

top of these volumes , and then you can run a database, store the les, applications or you can even use them as a blo

ck device in some other way. 52 https://en.wikip edia.org/wiki/Ama zon S3 Ojus Thomas Lee CE Kidango or CST 423

CLOUD COMPUTI NG Mo dule 5 55 / 129

Amazon web services - Storage services - Amazon E lastic Blo ck Store (EBS) 53 Amazon EBS volumes are plac ed in

a sp ecic availability zone, and they are automatically replicated to protect you from the failure of a single comp onent.

EBS volume do es not exist on one disk, it spreads across the Availability Zone. EBS volume is a disk w hic h is

attached to an EC2 instance. EBS volume attached to the EC2 instance where windows or Linux is installed know n as

Ro ot device of volume. 53 https://en.wikip edia.org/wiki/Ama zon S3 Ojus Thomas Lee CE Kidango or CST 423 CLOUD

COMPUTI NG Mo dule 5 56 / 129

AWS-Elastic Blo ck Store 54 54 https://www.javatp oint.com/aws-ebs Ojus Thomas Lee CE Kidango or CST 423

CLOUD COMPUTI NG Mo dule 5 57 / 129

Amazon web services - Storage services - Amazon E lastic Blo ck Store (EBS) 55 SSD stands for solid-state D rive s. It

is a general purp ose storage. It supp orts up to 4000 IOPS which is quite very high. SSD storage is very high p

erforming, but it is quite exp ensive as compared to HDD (Hard Disk Drive) storage. SSD volume typ es are optimized

for transactional workloads such as frequent read/write op erations with small I/O size, where the p erformance attribute

is IOPS. 55 https://en.wikip edia.org/wiki/Ama zon S3 Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG

Mo dule 5 58 / 129
AWS-Elastic Blo ck Store 56 56 https://www.javatp oint.com/aws-ebs# Ojus Thomas Lee CE Kidango or CST 423

CLOUD COMPUTI NG Mo dule 5 59 / 129

Amazon web services - Storage services - Amazon E lastic Blo ck Store (EBS) 57 General Purp ose SSD General Purp

ose SSD is also sometimes referred to as a GP 2. It is a General purp ose SSD volume that balances b oth price and p

erformance. You c an get a ratio of 3 IOPS p er GB with up to 10 ; 000 IOPS and the ability to burst up to 3000 IOPS for

an extended p erio d of time for volumes at 3334 GiB and ab ove. For example, if you get less than 10,000 IOPS, then

GP2 is preferable as it gives you the b est p erformance and price. 57 https://www.javatp oint.com/aws-ebs# Ojus

Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 60 / 129

Amazon web services - Storage services - Amazon E lastic Blo ck Store (EBS) 58 Provisioned IOPS SSD It is also

referred to as IO 1. It is mainly used for high-p e rformance applications such as intense applications, relational

databases. It is designed for I/O intensive applications such as large relational or NOSQL databases. It is used when

you require more than 10 ; 000 IOPS . 58 https://www.javatp oint.com/aws-ebs# Ojus Thomas Lee CE Kidango or CST

423 CLOUD COMPUTI NG Mo dule 5 61 / 129

Amazon web services - Storage services - Amazon E lastic Blo ck Store (EBS) 59 HDD It stands for Hard Disk Drive.

HDD based storage was intro duced in 2008. The size of the HDD based storage could b e b etween 1 GB to 1 TB. It

can supp ort up to 100 IOPS which is very low. 59 https://www.javatp oint.com/aws-ebs# Ojus Thomas Lee CE Kidango

or CST 423 CLOUD COMPUTI NG Mo dule 5 62 / 129

AWS-Elastic Blo ck Store 60 60 https://www.javatp oint.com/aws-ebs# Ojus Thomas Lee CE Kidango or CST 423

CLOUD COMPUTI NG Mo dule 5 63 / 129

Amazon web services - Storage services - Amazon E lastic Blo ck Store (EBS) 61 HDD - Throughput Optimized HDD

(st1) It is also referred to as ST1 . Throughput Optimized H DD is a low-cost HDD designed for those applications that
require higher throughput up t o 500 MB/s. It is useful for those applications that require the data to b e frequently

accessed. It is used for Big data, Data warehouses, Log pro cess ing, etc. The size of the Throughput H ard disk can b e

500 GiB to 16 TiB. It supp orts up to 500 IOPS. 61 https://www.javatp oint.com/aws-ebs# Ojus Thomas Lee CE Kidango

or CST 423 CLOUD COMPUTI NG Mo dule 5 64 / 129

Amazon web services - Storage services - Amazon E lastic Blo ck Store (EBS) 62 HDD - Cold HDD (sc1) It is also

known as SC1 . It is the lowe st cost storage designed for the applications where the workloads are infrequently acc

essed. It is useful when data is rarely acces sed. It is mainly used for a File s erver. It cannot b e a b o ot volume. The

size of the Cold Hard disk can b e 500 GiB t o 16 TiB. It supp orts up to 250 IOPS. 62 https://www.javatp

oint.com/aws-ebs# Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 65 / 129

Amazon web services - Storage services - Amazon E lastic Blo ck Store (EBS) 63 HDD - EBS Magnetic Volumes These

typ es of volumes are formerly known as Standard volumes and are a great t for ideal workloads like infrequently

accessed data like data backups for recovery, logs storage, and dev & test workloads. The volume range in size from 1

GB to 1 TB. It supp orts 100 IOPS on ave rage with the ability to burst to hundreds of IOPS. This typ e of volumes suits

for scenarios where the lowest storage cost is imp ortant. 63 https://www.javatp oint.com/aws-ebs# Ojus Thomas Lee

CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 66 / 129

Amazon web services - Storage services - Amazon E lastic Blo ck Store (EBS) 64 RDBMS have b ee n the common

data back-end for a wide range of applications Amazon provides applications w ith structured storage services in three

dierent forms: precongured E C2 AMIs, Amazon Relational Data Storage (RDS), and Amazon SimpleDB. 64

https://www.javatp oint.com/aws-ebs# Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 67 /

129

Amazon web services - Database Services - Precongured EC2 AMIs 65 Precongured EC2 AMIs Precongured EC2

AMIs are predened templates featuring an installation of a given database management system. EC2 instances created

from these AMIs can b e completed with an EBS volume for storage p ersistence. Available AMIs inc lude installations of
IBM DB2, Microsoft SQL Server, MySQL, Orac le, PostgreSQL, Sybase, and Vertica. Instances are priced hourly

according to the EC2 cost mo de l. But the administrative burden on the EC2 user, w ho has to c ongure, maintain, and

manage the relational database, but oers the greatest variety of pro ducts to cho os e from. 65 https://www.javatp

oint.com/aws-ebs# Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 68 / 129

AWS-Elastic Blo ck Store 66 66 https://intellipaat.com/blog/what-is-amazon-rds-in-aws/ Ojus Thomas Lee CE Kidango

or CST 423 CLOUD COMPUTI NG Mo dule 5 69 / 129

Amazon web services - Storage services - Amazon R D S 67 What Is Amazon RDS? Amazon RDS is a service which

provides databas e connectivity through the Internet. RDS makes it very simple and easy to set-up a relational database

in the cloud. Instead of concentrating on database features, you can concentrate more on the application to provide high

availability, security, and compatibility. 67 https://intellipaat.com/blog/what-is-amazon-rds-in-aws/ Ojus Thomas Lee CE

Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 70 / 129

Amazon RDS { fully ma naged 68 68 https://pages.awscloud.com/rs/112-TZM- 766/images/DMWQ1D1S1T1

Overview%20of%20Amazon%20Op

en%20Source%20Relational%20Databases%20Services%20%28RDS%29%20and%20Key%20Features.p df Ojus

Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 71 / 129

Amazon web services - Storage services - Amazon R D S 69 Benets of Amazon RDS Reduced Administration Burde n

Using RDS, you can easily deploy the database from project conception to pro duction. There is no need to install any

database software and provide t he infrastructure. AWS automat ically installs the latest software pa tches to the RDS

instance which you have launched. Cost-eective You just pay for what you use, a nd nothing m ore. No upfront payment

is needed, just the monthly usage paym ent . 69 https://intellipaat.com/blog/what-is-amazon-rds-in-aws/ Ojus Thomas

Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 72 / 129

Amazon web services - Storage services - Amazon R D S 70 Benets of Amazon RDS Security Using AWS Key

Management Service (KMS), you can create encrypt ion keys for maintaining security and authorized access for your

database. High Availability and Durability The autom ated recovery feature of RDS enables p oint-in-time recovery for

your database instance. Multi-AZs provide high availability and durability across the glob e. Scalability It just takes a few

m inutes to scale your infrastructure up or down, and you can scale up to a maximum of 32 vCPUs and 244 GiB. 70

https://intellipaat.com/blog/what-is-amazon-rds-in-aws/ Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI

NG Mo dule 5 73 / 129

Amazon web services - Storage services - Amazon R D S 71 Amazon RDS - Database Engines There are six database

e ngines which RDS provides Amazon Aurora PostgreSQL MySQL MariaDB Oracle Database Microsoft SQL Server 71

https://intellipaat.com/blog/what-is-amazon-rds-in-aws/ Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI

NG Mo dule 5 74 / 129

Content Delivery Network (CDN) 72 A Content Delivery Network (CDN) is a group of geographically distributed servers

that sp eed up the delivery of web content by bringing it closer to where users are. Data centers across the glob e use
caching, a pro c ess that temp orarily stores copies of les, so that you can access internet content from a web-enabled

device or browser more quickly through a server ne ar you. CDNs cache content like web pages, images, and video in

proxy servers near to your physical lo cation. This allow s you to do things like watch a movie, download software, check

your bank balance, p ost on so cial media, or make purchases, without having to wait for content to load. 72

https://www.akamai.com/our-thinking/cdn/what-is-a-cdn Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI

NG Mo dule 5 75 / 129

Content Delivery Network (CDN) 73 The mission of a CDN is to reduce latency. Latency is that annoying delay you exp

erience when trying to access a web page or video stream b efore it fully loads on your device. Although measured in

milliseconds, it can feel like forever, and may even result in a load error or time-out. Content delivery networks alleviate

latency by reducing the physical distance that the content needs to travel to reach you. CDNs are able to deliver web

content more quic kly and reliably by putting the content as close to the e nd user as p ossible. 73

https://www.akamai.com/our-thinking/cdn/what-is-a-cdn Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI

NG Mo dule 5 76 / 129

Content Delivery Network (CDN) 74 Let's say it's the weekend and you want to kick back and stream the latest Hollywo

o d movie release | the CDN nds an optimal server on its network to serve up that video. Usually, that will b e the server

c los est to your physical lo cation. The media les will b e cached and remain on that content delivery network server for

other user requests in the same geographic are a. If the content you requested is unavailable or outdated, the CDN

service will store the newly fetched content to serve any future requests. 74

https://www.akamai.com/our-thinking/cdn/what-is-a-cdn Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI

NG Mo dule 5 77 / 129

Content Delivery Network (CDN) 75 While the delivery of website content is a common use for CDNs, it's not their only

function. CDNs deliver a wide variety of content that includes: 4K and HD-quality video, audio streams, software

downloads such as apps, games, and OS up dates, and much more. Potentially any data that can b e digitized can b e

de liv ered through a content delivery network. 75 https://www.akamai.com/our-thinking/cdn/what-is-a-cdn Ojus Thomas

Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 78 / 129

Amazon CloudFront 76 76 https://www.imp erva.com/learn/p erform ance/what-is-cdn-how-it-works/ Ojus Thomas Lee

CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 79 / 129

Amazon CloudFront 77 77 https://www.imp erva.com/learn/p erform ance/what-is-cdn-how-it-works/ Ojus Thomas Lee

CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 80 / 129

Amazon CloudFront 78 78 https://www.imp erva.com/learn/p erform ance/what-is-cdn-how-it-works/ Ojus Thomas Lee

CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 81 / 129

Amazon CloudFront 79 79 https://www.simplilearn.com/tutorials/aws-tutorial/aws-cloudfront Ojus Thomas Lee CE

Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 82 / 129

Amazon web services - Storage services - Amazon R D S 80 Amazon CloudFront is a content delivery network (CDN)

op erated by Amazon Web Service s. Content delivery networks provide a globally- dist ributed network of proxy servers

that c ac he content, such as web vide os or other bulky media, more lo cally to consume rs , thus improving access sp

eed for downloading the content. 80 https://en.wikip edia.org/wiki/Ama zon CloudFront Ojus Thomas Lee CE Kidango or

CST 423 CLOUD COMPUTI NG Mo dule 5 83 / 129

Amazon CloudFront 81 81 https://k21academy.com/amazon-web-services/aws-cloudfront/ Ojus Thomas Lee CE

Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 84 / 129

Amazon CloudFront 82 82 https://k21academy.com/amazon-web-services/aws-cloudfront/ Ojus Thomas Lee CE

Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 85 / 129

Amazon CloudFront 83 83 https://k21academy.com/amazon-web-services/aws-cloudfront/ Ojus Thomas Lee CE

Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 86 / 129

Amazon CloudFront 84 84 https://k21academy.com/amazon-web-services/aws-cloudfront/ Ojus Thomas Lee CE

Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 87 / 129

Amazon CloudFront 85 85 https://k21academy.com/amazon-web-services/aws-cloudfront/ Ojus Thomas Lee CE

Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 88 / 129

Amazon CloudFront 86 Benets of AWS CloudFront It's easy to use and ensures higher pro ductivity. It improv es

reliability and availability by storing copies o f objects in multiple edge lo c ations worldwide. Because of the `Content

Privacy' feature, it has a high level of security. To deliver content quickly, it employs HTTP or HTTPS proto cols. It has

the most advanced security features, including eld-level encryption and HTTPS supp ort. 86

https://k21academy.com/amazon-web-services/aws-cloudfront/ Ojus Thomas Lee CE Kidango or CST 423 CLOUD

COMPUTI NG Mo dule 5 89 / 129

Amazon web services - Storage services - Amazon R D S 87 CloudFront has servers lo cated in Europ e (United

Kingdom, Ireland, The Netherlands, Germany, Spain) Asia (Hong Kong, Singap ore, Japan, Taiwan and India) Australia,

South America, Africa, and several major cities in the United States. In Novemb er 2022, the service op erated from 400

edge lo cations on six continents. 87 https://en.wikip edia.org/wiki/Ama zon CloudFront Ojus Thomas Lee CE Kidango or

CST 423 CLOUD COMPUTI NG Mo dule 5 90 / 129

Go ogle Compute Engine 88 88 https://k21academy.com/go ogle-cloud/go ogle-compute-engine/ Ojus Thomas Lee CE

Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 91 / 129

Go ogle Compute Engine (GCE) 89 Go ogle Compute Engine (GCE) is part of Go ogle's Infrastructure-as-a-Service

(IaaS) o ering, You can build high-p erformance, fault-tolerant, massively scalable compute no des to handle your

application's needs. 89 https://www.networkmanagementsoftware.com/fundamentals-go ogle-compute- engine-gce/#wb

ounce-mo dal Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 92 / 129

Go ogle Compute Engine (GCE) 90 VM Instances are compris ed of on Op erating Syste m and infrastructure resources

such as CPU, Memory, Disk, and N etworking. Creating VM instances can b e done using the GCP console (console.go

ogle.com), using the command line via Cloudshell or SDK, or via the REST API. When creating a VM instance, you have

the option of cho osing a predened machine typ e or a custom machine typ e. 90

https://www.networkmanagementsoftware.com/fundamentals-go ogle-compute- engine-gce/#wb ounce-mo dal Ojus

Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 93 / 129

Go ogle Compute Engine (GCE) 91 Advantages Of Compute Engine Storage Eciency: The p ersistent disks supp ort up

to 257 TB of storage which is more than 10 times higher than what Amazon Elastic Blo ck Storage (EBS) can accommo

date. The organizations that require more scalable storage options can go for Compute Engine Cost: Within t he GCP

ecosystem, users pay only for the computing time that they have consumed. The p er-second billing plan is used by the

Go ogle compute engine. Stability: It oers more stable services b ecause of its ability to provide live migration of VMs b

etween the hosts. 91 https://www.networkmanagementsoftware.com/fundamentals-go ogle-compute- engine-gce/#wb

ounce-mo dal Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 94 / 129

Go ogle Compute Engine (GCE) 92 Advantages Of Compute Engine Backups: Go ogle Cloud Plat form has a robust,

inbuilt, and redundant backup system. The Com pute Engine uses this system for agship pro ducts like Search Engine

and Gmail. Scalability: It makes reservations to help ensure that applications have the capacity they need as they scale.

Security: Go ogle Compute Engine is a more secure and safe place for cloud applications. 92

https://www.networkmanagementsoftware.com/fundamentals-go ogle-compute- engine-gce/#wb ounce-mo dal Ojus

Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 95 / 129

Go ogle Compute Engine (GCE) - Features 93 Machine Typ es It describ es t he virtual hardware that is attached to an

ins tanc e which also includes RAM and CPUs. There are two typ es of machines Predened Machine Typ es Custom

Machine Typ es 93 https://k21academy.com/go ogle-cloud/go ogle-compute-engine/ Ojus Thomas Lee CE Kidango or

CST 423 CLOUD COMPUTI NG Mo dule 5 96 / 129

Go ogle Compute Engine (GCE) - Features 94 Machine Typ es Predened Machine Typ es These are pre-congured

virtual machine templates that can b e used t o set up the virtual machines. The congurations have b een pre-optimized

by Go ogle and meet most of the requirements. 94 https://k21academy.com/go ogle-cloud/go ogle-compute-engine/

Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 97 / 129
Go ogle Compute Engine (GCE) - Features 95 Machine Typ es Custom Machine Typ es: The virtua l hardware can b e

congured manually for a Compute Engine VM instance. Users can select the numb er of virtual CPUs (vCPUs) and

memory, provided they are within Go ogle's set limits. 95 https://k21academy.com/go ogle-cloud/go

ogle-compute-engine/ Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 98 / 129

Go ogle Compute Engine (GCE) - Features 96 Persistent Disks Persistent disks are ne twork-based \disks" abstracted

to app ear as a blo ck device. Data is durable, meaning the data will remain as you left it after reb o ots and shutdowns.

Available as either a standard hard disk drive or as a solid state drive (SSD) , p ersistent disks are lo cated indep

endently of the VM instances, which means they can b e detached and reattached to other instances. characteristics

Ideal for ecient and reliable blo ck storage Max 64TB p er instance Only available within a single zone 96

https://www.networkmanagementsoftware.com/fundamentals-go ogle-compute- engine-gce/#wb ounce-mo dal Ojus

Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 99 / 129

Go ogle Compute Engine (GCE) - Features 97 Lo cal SSD Lo cal SSD disks are physically attache d to VM instances .

These will oer the highest p ossible IOPS and are used for seriously intensive workloads. Ideal for very high-p

erformance lo cal blo ck storage Available as SCSI or NVMe Max 3TB (which is a total of eight 375GB disks) Available

only to a single Instance, meaning it cannot b e reattached elsewhere Only Persistent if you do not stop or terminate

your instance. Do es not supp ort snapshots 97 https://www.networkmanagementsoftware.com/fundamentals-go

ogle-compute- engine-gce/#wb ounce-mo dal Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo

dule 5 100 / 129

Go ogle Compute Engine (GCE) - Features 98 Images Images contain a b o otloader, Op e rating System, le system

structure, and any s oftware c us tomizations needed for your deploym ent. The image describ es what actually gets

loaded onto the ro ot disk. Tons of public im age s are available from Go ogle and other authorized third-party vendors.

Go ogle Compute Engine (GCE) uses the selected image to create a p ersistent b o ot disk for each instance. 98

https://www.networkmanagementsoftware.com/fundamentals-go ogle-compute- engine-gce/#wb ounce-mo dal Ojus

Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 101 / 129
Go ogle Compute Engine (GCE) - Features 99 Images Some public images include: CentOS Container-Optimized OS

from Go ogle CoreOS Debian RHEL SLES Ubuntu FreeBSD Windows Serve r 2008, 2012, 2016 SQL Server on

Windows Server 99 https://www.networkmanagementsoftware.com/fundamentals-go ogle-compute- engine-gce/#wb

ounce-mo dal Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 102 / 129

Go ogle Cloud Platform - Storage Services 100 Various Storage Option provided by GCP The storage options that GCP

provides are : Go ogle Cloud Storage , Go ogle Cloud Bigtable, Go ogle Cloud SQL, Go ogle Cloud Spanner, Cloud

Datastore and Cloud Firestore. 100 https://medium.datadriveninvestor.com/storage-options-in-go ogle-cloud-platform-

rundown-f78100c4ed37 Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 103 / 129

Go ogle Cloud Store 101 101 https://medium.datadriveninvestor.com/storage-options-in-go ogle-cloud-platform-

rundown-f78100c4ed37 Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 104 / 129

Go ogle Cloud Store 102 Go ogle Cloud Storage oers develop ers and IT organizations durable and highly available

object storage. Object storage means this: you say to your storage, \Here, keep this arbitrary sequence of bytes," and

the storage lets you address it with a unique key. In Go ogle Cloud Storage and in other systems, these unique keys are

in the form of UR Ls, which means object storage inte ract s well w it h web technologies. 102

https://medium.datadriveninvestor.com/storage-options-in-go ogle-cloud-platform- rundown-f78100c4ed37 Ojus Thomas

Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 105 / 129

Go ogle Cloud Store 103 Go ogle Cloud Storage is not a le system The storage objects oered by Go ogle Cloud

Storage are \immutable," which means that you do not edit them in plac e, but instead create a new version. Go ogle

Cloud Storage's primary use is whenever binary large-object storage is needed: online content, backup and archiving,

storage of intermediate results in pro cessing workows, and more. 103

https://medium.datadriveninvestor.com/storage-options-in-go ogle-cloud-platform- rundown-f78100c4ed37 Ojus Thomas

Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 106 / 129

Go ogle Cloud Store - Storage Classes 104 104 https://medium.datadriveninvestor.com/storage-options-in-go

ogle-cloud-platform- rundown-f78100c4ed37 Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule

5 107 / 129

Cloud-Firestore 105 105 https://k21academy.com/go ogle-cloud/go ogle-cloud-storage-and-database/ Ojus Thomas Lee

CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 108 / 129

Cloud-Firestore 106 Cloud Firestore is a exible, scalable database for mobile, web, and server deve lopm ent from

Firebase and Go ogle Cloud. It keeps the data in-sync across client apps through real-time listeners and oers oine

supp ort for mobile and web so users can build resp onsive apps that work regardle ss of network latency or Internet

connect iv ity. 106 https://k21academy.com/go ogle-cloud/go ogle-cloud-storage-and-database/ Ojus Thomas Lee CE

Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 109 / 129

Cloud-Filestore 107 107 https://k21academy.com/go ogle-cloud/go ogle-cloud-storage-and-database/ Ojus Thomas Lee

CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 110 / 129

Cloud-Filestore 108 Go ogle Cloud Filest ore is widely used when it comes to p erforming heavy machine learning tasks,

m edia pro cessing, rendering, etc due to the high throughput it is highly preferred. It is generally not considered as a

storage option, but a temp orary drive for p erforming high read intensive tasks. 108 https://k21academy.com/go

ogle-cloud/go ogle-cloud-storage-and-database/ Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo
dule 5 111 / 129

Cloud-SQL 109 109 https://medium.datadriveninvestor.com/storage-options-in-go ogle-cloud-platform-

rundown-f78100c4ed37 Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 112 / 129

Cloud-SQL 110 Cloud SQL is an easy-to-use service that delivers fully managed relational databases. It helps you to fo

cus on building your application and not worry ab out database management tedious tasks such as applying patches

and up dates,managing backups, and conguring replications. 110

https://medium.datadriveninvestor.com/storage-options-in-go ogle-cloud-platform- rundown-f78100c4ed37 Ojus Thomas

Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 113 / 129

Cloud-SQL 111 Features of Cloud SQL: Oers MySQL and PostgreSQL databases as a service Automatic replication

Managed backups Vertical s caling (read and write) Horizontal s caling (read) Go ogle security 111

https://medium.datadriveninvestor.com/storage-options-in-go ogle-cloud-platform- rundown-f78100c4ed37 Ojus Thomas

Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 114 / 129

Cloud-SQL 112 The three relational database engines covered by Go ogle Cloud SQL include: MySQL PostgreSQL

SQL Server 112 https://www.netsolutions.com/insights/what-is-go ogle-cloud-sql-its-features-and- some-pro

ducts-that-have-b eneted-from-it/ Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 115 /

129

Cloud-Spanner 113 113 https://medium.datadriveninvestor.com/storage-options-in-go ogle-cloud-platform-

rundown-f78100c4ed37 Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 116 / 129

Cloud-Spanner 114 Cloud Spanner is a fully managed, mission-critical, relational database service. It oers transactional

consistency at a global scale, schemas, SQL, and automatic, synchronous replication for high availability. 114

https://medium.datadriveninvestor.com/storage-options-in-go ogle-cloud-platform- rundown-f78100c4ed37 Ojus Thomas

Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 117 / 129

Cloud-Spanner-Architecture 115 115 https://jayendrapatil.com/go ogle-cloud-spanner/ Ojus Thomas Lee CE Kidango or

CST 423 CLOUD COMPUTI NG Mo dule 5 118 / 129

Cloud-Spanner-Architecture 116 Cloud Spanner distributes an instance across zones of one or more regions to provide

high p erformance and high availability Cloud Spanner instances have: At le as t three read-write replicas of the

database each in a dierent zone Each zone is a separate isolation fault domain Paxos dis tributed consensus proto col

used for writes/transaction commits Synchronous replication of writes to all zones across all regions Database is

available even if one zone fails (99.999% availability SLA for multi-re gio n and 99.99% availability SLA for re gional) 116

https://jayendrapatil.com/go ogle-cloud-spanner/ Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo

dule 5 119 / 129

Cloud-Spanner-Architecture 117 Spanner is global database system, p er region we'll get minimum of 3 shards. Each

shard will b e in each z one . In Spanner terms a shard is called as Split. Each shard will b e replicated to the other

Zones. For eg: if you have a shard called S1 on Zone A, it'll b e replicated to Zone B and C. Spanner supp orts the

strong consistency across all the no des(Globally). If you write something on US region, you can read that same data

from the Asia region or any other region. Spanner is very keen in syncronizing and maintains the same time across all

the no des over the global datacenters. The ir hardwares are built with Atomic Clo cks to maintain the time. GPS time

servers will s ync with Oscillators to synchronize the time across the global datacenters with every 30sec interval. 117

https://jayendrapatil.com/go ogle-cloud-spanner/ Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo

dule 5 120 / 129

Go ogle Ap pEngine 118 Go ogle AppEngine is a PaaS implementation that provides services for developing and

hosting scalable We b applications. Develop ers can develop applications in Java, Python, and Go, a new programming

language develop ed by Go ogle to simplify the development of Web applications. Application usage of Go ogle

resources and services is m etered by AppEngine, which bills users when their applications nish their free quotas. 118
https://jayendrapatil.com/go ogle-cloud-spanner/ Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo

dule 5 121 / 129

Go ogle Ap pEngine 119 AppEngine is a platform for developing scalable applications accessible through the Web. The

platform is logically divided into four major comp onents: Infrastructure, The runtime environment, The underlying s

torage, and The set of scalable services that can b e used to develop applic ations. 119 Mastering Cloud Computing,

Foundations and Applications Programming, Rajkumar Buyya, Christian Vecchiola, S. Thamarai Selvi, Chapter 9 Ojus

Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 122 / 129

Go ogle App Engine Architecture 120 120 Mastering Cloud Computing, Foundations and Applications Programming,

Rajkumar Buyya, Christian Vecchiola, S. Thamarai Selvi, Chapter 9 Ojus Thomas Lee CE Kidango or CST 423 CLOUD

COMPUTI NG Mo dule 5 123 / 129

Go ogle App Engine - Infrastructure 121 AppEngine's infrastructure takes advantage of many servers available within

Go ogle datacenters. For each HTTP request, AppEngine lo cates the servers hosting the application that prcesses the

request, evaluates their load, and, if necessary, allo cates additional resources (i.e., servers) or redirects the request to

an existing server. The infrastructure is also resp onsible for monitoring application p erformance and collecting statistics

on which the billing is calculated. 121 Mastering Cloud Computing, Foundations and Applications Programming,

Rajkumar Buyya, Christian Vecchiola, S. Thamarai Selvi, Chapter 9 Ojus Thomas Lee CE Kidango or CST 423 CLOUD

COMPUTI NG Mo dule 5 124 / 129

Go ogle App Engine - Runtime environment 122 AppEngine's infrastructure takes advantage of many servers available

within Go ogle datacenters. For each HTTP request, AppEngine lo cates the servers hosting the application that

prcesses the request, evaluates their load, and, if necessary, allo cates additional resources (i.e., servers) or redirects

the request to an existing server. The infrastructure is also resp onsible for monitoring application p erformance and

collecting statistics on which the billing is calculated. 122 Mastering Cloud Computing, Foundations and Applications

Programming, Rajkumar Buyya, Christian Vecchiola, S. Thamarai Selvi, Chapter 9 Ojus Thomas Lee CE Kidango or

CST 423 CLOUD COMPUTI NG Mo dule 5 125 / 129

Go ogle App Engine - Runtime environment 123 The runtime environment represents the execution contex t of

applications hosted on AppEngine. With reference to the AppEngine infrastructure co de, which is always active and

running, the runtime Comes into existence when the request handler starts executing and Terminates once the handler

has completed. 123 Mastering Cloud Computing, Foundations and Applications Programming, Rajkumar Buyya,

Christian Vecchiola, S. Thamarai Selvi, Chapter 9 Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo

dule 5 126 / 129

Go ogle App Engine - Runtime environment- Sandb oxing 124 One of the major resp onsibilities of the runtime

environment is to provide the application environment an isolated and protected contex t in which it can execute without

causing a threat to the server and without b eing inuenced by othe r applications. This isolated enviroment is known as
sandb ox. 124 Mastering Cloud Computing, Foundations and Applications Programming, Rajkumar Buyya, Christian

Vecchiola, S. Thamarai Selvi, Chapter 9 Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5

127 / 129

Go ogle App Engine - Runtime environment- Sandb oxing 125 Sandb oxing is achieved by means of mo died runtimes

for applications that dis able some of the common features normally available with their default implementations. If an

application tries to p erform any op eration that is considered p otentially harmful, an exception is thrown and the

execution is interrupted. The op erations that are not allowed in the sandb ox include writing to the server's le system;

accessing computer through network b esides using Mail, UrlFetch, and XMPP; executing co de outside the scop e of a

request, a queued task, and a cron job; and pro cessing a request for more than 30 seconds. 125 Mastering Cloud

Computing, Foundations and Applications Programming, Rajkumar Buyya, Christian Vecchiola, S. Thamarai Selvi,

Chapter 9 Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 128 / 129

Go ogle App Engine - Supp orted Runtime 126 126 https://cloud.go ogle.com/app engine/do cs/standard/runtimes Ojus

Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 129 / 129

Go ogle App Engine - Supp orted Runtime - Long Time 127 127 https://cloud.go ogle.com/app engine/do

cs/standard/runtimes Ojus Thomas Lee CE Kidango or CST 423 CLOUD COMPUTI NG Mo dule 5 130 / 129