CBD-3354 Distributed Systems

and Cloud Computing (Class 3)

Cloud Computing for Big Data

Lambton College in Toronto
Hugo Bosch
[email protected]
 Chapter 2. Designing for Operations
• Designing for operations means making sure all the normal operational
functions can be done well. Normal operational functions include tasks
such as periodic maintenance, updates, and monitoring.
• If a service provides an API, that API should include an Access Control
List (ACL) mechanism that determines which users are permitted or
denied access, and also determines rate-limiting settings.
• An example of access controls is a public key infrastructure (PKI) that
uses digital certificates to prove identity like Putty.
Challenging Questions
1. Why is design for operations so important?
2. How is automated configuration typically supported?
Chapter 3. Selecting a Service Platform
• Infrastructure as a Service (IaaS): Computer and network hardware,
real or virtual, ready for you to use.
• Platform as a Service (PaaS): Your software running in a vendor-
provided framework or stack.
• Software as a Service (SaaS): An application provided as a web site.
The consumers of SaaS, PaaS, and IaaS
Chapter 3. Selecting a Service Platform
A platform may be described along three axes:

1. Level of service abstraction: IaaS, PaaS, SaaS

2. Type of machine: Physical, virtual or process container
3. Level of resource sharing: Shared or private
Level of service abstraction: IaaS, PaaS, SaaS
• Abstraction is how far users are kept from the details of the raw
machine itself.
• The closer you are to the raw machine (low abstraction), the more
control you have.
• The higher the level of abstraction, the less you have to concern
yourself with technical details of building infrastructure and the more
you can focus on the application (high abstraction).
Infrastructure as a Service (IaaS)
• IaaS provides bare machines, networked and ready for you to install the
operating system and your own software.
• The provider takes care of the infrastructure: the machines themselves, power,
cooling, and networking, providing internet access, and all datacenter operations.
• A datacenter example is:
• https://www.youtube.com/watch?v=zXsoygN_v7A

• Server: Software that provides a function or API. (Not a piece of hardware.)

• Service: A user-visible system or product composed of many servers.
• Machine: A virtual or physical machine.
• Oversubscribed: A system that provides capacity X is used in a place where Y
capacity is needed, when X < Y. Used to describe a potential or actual need.
• Undersubscribed: The opposite of oversubscribed.
Platform as a Service (PaaS)
• PaaS enables you to run your applications from a vendor-provided
framework.
• An example is Google AppEngine.
• PaaS providers charge for their services based on how much CPU,
bandwidth, and storage are used.
• PaaS provides many high-level services including storage services,
database services, and many of the same services available in IaaS
offerings.
Software as a Service (SaaS)
• SaaS is a web-accessible application.
• The application is the service, and you interact with it as you would any
web site.
• The provider handles all the details of hardware, operating system, and
platform.
• Some common examples include:
1. Salesforce.com
2. Google Apps
3. Basecamp
• The service is fully managed, upgraded, and maintained by the provider.
Type of machine: Physical, virtual, or process
container
• A physical machine is a traditional computer with one or more CPUs,
and subsystems for memory, disk, and network.
• Virtual machines are created when a physical machine is partitioned
to run a separate operating system for each partition.
• Virtual machines permit isolation at the OS level.
• Virtual machines are allocated a fixed amount of disk space, memory,
and CPU from the physical machine.
• Virtual machines are very heavy-weight.
Process Container
• A container is a group of processes running on an operating system that are
isolated from other such groups of processes.
• Each container has an environment with its own process name space,
network configuration, and other resources.
• Containers are very lightweight because they do not require an entire OS.
Example
• “Docker is an open-source project that automates the deployment of
applications inside software containers.”
• https://en.wikipedia.org/wiki/Docker_(software)
• https://www.docker.com/
Level of resource sharing: Shared or private
• In a “public cloud,” a third party owns the infrastructure and uses it to
provide service for many customers.
• In a “private cloud,” a company runs its own computing infrastructure
on its own premises.
• Hybrids may also be created, such as private clouds run in rented
datacenter space.
• The choice between private or public use of a platform is a business
decision based on four factors: compliance, privacy, cost, and control.
 Compliance, privacy, cost, and control
• Using a public cloud for certain data or services may cause a company to fail a compliance audit.
• Even in a failover scenario, a company that moves the data into the public cloud would fail an audit.
• Due to software bugs, employee mistakes, or other issues, your data could be exposed to other
customers or the entire world.
• The cost of using a public cloud may or may not be less than the cost of building the necessary
infrastructure yourself.
• Amortizing the expense over many customers reduces cost.
• Calculating the total cost of ownership (TCO) and return on investment (ROI) will help determine
which is the best option.
• A private cloud affords you more control.
• In a public cloud you have less control.
• Letting the vendor take care of all hardware selection means losing the ability to specify low-level
hardware requirements (specific CPU types or storage products).
Colocation
• Colocation is a useful way to provide services.
• It occurs when a datacenter owner rents space to other people, called
tenants.
• Any rental of datacenter space has been called colocation service.
• Using a colocation facility can get you up and running quickly.
• Tenants can take advantage of capability economies of scale rather
than manage their own ISP connections and relationships.
Selection Strategies
There are many strategies one may use to choose between IaaS, PaaS, and SaaS.

1. Default to Virtual
2. Make a Cost-Based Decision
3. Leverage Provider Expertise
4. Get Started Quickly
5. Implement Ephemeral Computing
6. Use the Cloud for Overflow Capacity
7. Leverage Superior Infrastructure
8. Develop an In-House Service Provider
9. Contract for an On-Premises, Externally Run Service
10. Maximize Hardware Output
11. Implement a Bare Metal Cloud
Challenging Questions
1. Compare IaaS, PaaS, and SaaS on the basis of cost, configurability,
and control.
2. What are the warnings to consider in adopting Software as a
Service?
3. List the key advantages of virtual machines.
4. Why might you choose physical over virtual machines?
5. Which factors might make you choose private over public cloud
services?