S3-101

o S3 is one of the first services that has been produced by aws.

o S3 stands for Simple Storage Service.
o S3 provides developers and IT teams with secure, durable, highly scalable object
storage.
o It is easy to use with a simple web services interface to store and retrieve any
amount of data from anywhere on the web.

What is S3?
o S3 is a safe place to store the files.
o It is Object-based storage, i.e., you can store the images, word files, pdf files, etc.
o The files which are stored in S3 can be from 0 Bytes to 5 TB.
o It has unlimited storage means that you can store the data as much you want.
o Files are stored in Bucket. A bucket is like a folder available in S3 that stores the
files.
o S3 is a universal namespace, i.e., the names must be unique globally. Bucket
contains a DNS address. Therefore, the bucket must contain a unique name to
generate a unique DNS address.

If you create a bucket, URL look like:

o If you upload a file to S3 bucket, then you will receive an HTTP 200 code means
that the uploading of a file is successful.

Advantages of Amazon S3
o Create Buckets: Firstly, we create a bucket and provide a name to the bucket.
Buckets are the containers in S3 that stores the data. Buckets must have a unique
name to generate a unique DNS address.
o Storing data in buckets: Bucket can be used to store an infinite amount of data.
You can upload the files as much you want into an Amazon S3 bucket, i.e., there
is no maximum limit to store the files. Each object can contain upto 5 TB of data.
Each object can be stored and retrieved by using a unique developer assigned-
key.
o Download data: You can also download your data from a bucket and can also
give permission to others to download the same data. You can download the
data at any time whenever you want.
o Permissions: You can also grant or deny access to others who want to download
or upload the data from your Amazon S3 bucket. Authentication mechanism
keeps the data secure from unauthorized access.
 o Standard interfaces: S3 is used with the standard interfaces REST and SOAP
interfaces which are designed in such a way that they can work with any
development toolkit.
o Security: Amazon S3 offers security features by protecting unauthorized users
from accessing your data.

S3 is a simple key-value store

S3 is object-based. Objects consist of the following:

o Key: It is simply the name of the object. For example, hello.txt, spreadsheet.xlsx,
etc. You can use the key to retrieve the object.
o Value: It is simply the data which is made up of a sequence of bytes. It is actually
a data inside the file.
o Version ID: Version ID uniquely identifies the object. It is a string generated by
S3 when you add an object to the S3 bucket.
o Metadata: It is the data about data that you are storing. A set of a name-value
pair with which you can store the information regarding an object. Metadata can
be assigned to the objects in Amazon S3 bucket.
o Subresources: Subresource mechanism is used to store object-specific
information.
o Access control information: You can put the permissions individually on your
files.

Amazon S3 Concepts
o Buckets
o Objects
o Keys
o Regions
o Data Consistency Model

o Buckets
o A bucket is a container used for storing the objects.
o Every object is incorporated in a bucket.
o For example, if the object named photos/tree.jpg is stored in the
treeimage bucket, then it can be addressed by using the URL
http://treeimage.s3.amazonaws.com/photos/tree.jpg.
o A bucket has no limit to the amount of objects that it can store. No bucket
can exist inside of other buckets.
o S3 performance remains the same regardless of how many buckets have
been created.
o The AWS user that creates a bucket owns it, and no other AWS user
cannot own it. Therefore, we can say that the ownership of a bucket is not
transferrable.
 o The AWS account that creates a bucket can delete a bucket, but no other
AWS user can delete the bucket.

o Objects
o Objects are the entities which are stored in an S3 bucket.
o An object consists of object data and metadata where metadata is a set of
name-value pair that describes the data.
o An object consists of some default metadata such as date last modified,
and standard HTTP metadata, such as Content type. Custom metadata can
also be specified at the time of storing an object.
o It is uniquely identified within a bucket by key and version ID.

o Key
o A key is a unique identifier for an object.
o Every object in a bucket is associated with one key.
o An object can be uniquely identified by using a combination of bucket
name, the key, and optionally version ID.
o For example, in the URL http://jtp.s3.amazonaws.com/2019-01-
31/Amazons3.wsdl where "jtp" is the bucket name, and key is "2019-01-
31/Amazons3.wsdl"

o Regions
o You can choose a geographical region in which you want to store the
buckets that you have created.
o A region is chosen in such a way that it optimizes the latency, minimize
costs or address regulatory requirements.
o Objects will not leave the region unless you explicitly transfer the objects
to another region.

o Data Consistency Model

Amazon S3 replicates the data to multiple servers to achieve high availability.
Two types of model:
o Read-after-write consistency for PUTS of new objects.
 o For a PUT request, S3 stores the data across multiple servers to
achieve high availability.
o A process stores an object to S3 and will be immediately available
to read the object.
o A process stores a new object to S3, it will immediately list the keys
within the bucket.
o It does not take time for propagation, the changes are reflected
immediately.
o Eventual consistency for overwrite PUTS and DELETES
o For PUTS and DELETES to objects, the changes are reflected
eventually, and they are not available immediately.
o If the process replaces an existing object with the new object, you
try to read it immediately. Until the change is fully propagated, the
S3 might return prior data.
o If the process deletes an existing object, immediately try to read it.
Until the change is fully propagated, the S3 might return the
deleted data.
o If the process deletes an existing object, immediately list all the keys
within the bucket. Until the change is fully propagated, the S3
might return the list of the deleted key.