Learning Outcomes (Fundamental Cloud Architectures) carry out runtime workload tracking and data processing.

• Hypervisor – Workloads between hypervisors and the

The student should be able to: virtual servers that they host may require distribution.
1. Describe several of the more common foundational • Logical Network Perimeter – The logical network perimeter
cloud architectural models. isolates cloud consumer network boundaries in relation to
how and where workloads are distributed.
2. Explore involvement and importance of different
combinations of cloud computing mechanisms in • Resource Cluster – Clustered IT resources in active/active
relation to architectures. mode are commonly used to support workload balancing
between different cluster nodes. 

4.1 Workload Distribution Architecture • Resource Replication – This mechanism can generate new
w instances of virtualized IT resources in response to runtime
IT resources can be horizontally scaled via the addition of workload distribution demands. 
one or more identical IT resources, and a load balancer that
provides runtime logic capable of evenly distributing the
workload among the available IT resources (Figure 11.1). The 4.2 Resource Pooling Architecture
resulting workload distribution architecture reduces both IT
resource overutilization and under-utilization to an extent A resource pooling architecture is based on the use of one or
dependent upon the sophistication of the load balancing more resource pools, in which identical IT resources
algorithms and runtime logic. are grouped and maintained by a system that automatically
ensures that they remain synchronized. 
Physical server pools are composed of networked servers
that have been installed with operating systems and
other necessary programs and/or applications and are ready
for immediate use.
Virtual server pools are usually configured using one of
several available templates chosen by the cloud
consumer during provisioning. For example, a cloud
consumer can set up a pool of mid-tier Windows servers
with 4 GB of RAM or a pool of low-tier Ubuntu servers with 2
GB of RAM.
Storage pools, or cloud storage device pools, consist of file-
based or block-based storage structures that
  This fundamental architectural model can be applied to any contain empty and/or filled cloud storage devices.
IT resource, with workload distribution
Network pools (or interconnect pools) are composed of
commonly carried out in support of distributed virtual
different preconfigured network connectivity devices.
servers, cloud storage devices, and cloud services. Load
For example, a pool of virtual firewall devices or physical
balancing systems applied to specific IT resources usually
network switches can be created for redundant
produce specialized variations of this architecture
connectivity, load balancing, or link aggregation. 
that incorporate aspects of load balancing, such as:
• the service load balancing architecture explained later in CPU pools are ready to be allocated to virtual servers, and
this chapter are typically broken down into individual
• the load balanced virtual server architecture  processing cores. 
• the load balanced virtual switches architecture 
Pools of physical RAM can be used in newly provisioned
In addition to the base load balancer mechanism, and the physical servers or to vertically scale physical servers.
virtual server and cloud storage device mechanisms Dedicated pools can be created for each type of IT resource
to which load balancing can be applied, the following and individual pools can be grouped into a larger
mechanisms can also be part of this cloud architecture: pool, in which case each individual pool becomes a sub-pool
• Audit Monitor – When distributing runtime workloads, the (Figure 11.2).
type and geographical location of the IT resources that
process the data can determine whether monitoring is
necessary to fulfill legal and regulatory requirements.
• Cloud Usage Monitor – Various monitors can be involved to
 resource pools, in addition to hosting the virtual servers and
sometimes the resource pools themselves.
• Logical Network Perimeter – The logical network
perimeter is used to logically organize and isolate resource
pools. 
  Pay-Per-Use Monitor – The pay-per-use monitor
collects usage and billing information on how
Resource pools can become highly complex, with multiple individual cloud consumers are allocated and use IT
pools created for specific cloud consumers or resources from various pools.
applications. A hierarchical structure can be established to • Remote Administration System – This mechanism
form parent, sibling, and nested pools in order to is commonly used to interface with backend systems
facilitate the organization of diverse resource pooling and programs in order to provide resource pool
requirements (Figure 11.3). administration features via a front-end portal.
• Resource Management System – The resource
management system mechanism supplies cloud
consumers
with the tools and permission management options
for administering resource pools.
• Resource Replication – This mechanism is used to
generate new instances of IT resources for resource
pools. 

4.3 Dynamic Scalability Architecture

The dynamic scalability architecture is an architectural
model based on a system of predefined scaling conditions
that trigger the dynamic allocation of IT resources from
resource pools. Dynamic allocation enables variable
  utilization as dictated by usage demand fluctuations, since
    unnecessary IT resources are efficiently reclaimed
without requiring manual interaction.
Figure 11.3 Pools B and C are sibling pools that are taken
from the larger Pool A, which has been allocated to
a cloud consumer. This is an alternative to taking the IT The automated scaling listener is configured with workload
resources for Pool B and Pool C from a general thresholds that dictate when new IT resources
reserve of IT resources that is shared throughout the cloud.  need to be added to the workload processing. This
mechanism can be provided with logic that determines
After resources pools have been defined, multiple instances how many additional IT resources can be dynamically
of IT resources from each pool can be created to provided, based on the terms of a given cloud
provide an in-memory pool of “live” IT resources. consumer’s provisioning contract.
In addition to cloud storage devices and virtual servers,
which are commonly pooled mechanisms, the The following types of dynamic scaling are commonly used:
following mechanisms can also be part of this cloud • Dynamic Horizontal Scaling – IT resource instances are
architecture: scaled out and in to handle fluctuating
workloads. The automatic scaling listener monitors requests
• Audit Monitor – This mechanism monitors resource pool and signals resource replication to initiate
usage to ensure compliance with privacy and IT resource duplication, as per requirements and
regulation requirements, especially when pools contain cloud permissions.
storage devices or data loaded into • Dynamic Vertical Scaling – IT resource instances are scaled
memory. up and down when there is a need to adjust
• Cloud Usage Monitor – Various cloud usage monitors are the processing capacity of a single IT resource. For example,
involved in the runtime tracking and a virtual server that is being overloaded
synchronization that are required by the pooled IT resources can have its memory dynamically increased or it may have a
and any underlying management systems. processing core added.
• Hypervisor – The hypervisor mechanism is responsible for • Dynamic Relocation – The IT resource is relocated to a host
providing virtual servers with access to with more capacity. For example, a
database may need to be moved from a tape-based SAN following mechanisms can also be used in this form of cloud
storage device with 4 GB per second I/O architecture:
capacity to another disk-based SAN storage device with 8 GB • Cloud Usage Monitor – Specialized cloud usage monitors
per second I/O capacity. can track runtime usage in response to
dynamic fluctuations caused by this architecture.
Figures 11.5 to 11.7 illustrate the process of dynamic • Hypervisor – The hypervisor is invoked by a dynamic
horizontal scaling. scalability system to create or remove virtual
server instances, or to be scaled itself.
• Pay-Per-Use Monitor – The pay-per-use monitor is engaged
to collect usage cost information in
response to the scaling of IT resources.  

4.4 Elastic Resource Capacity Architecture

The elastic resource capacity architecture is primarily related
to the dynamic provisioning of virtual servers, using
a system that allocates and reclaims CPUs and RAM in
immediate response to the fluctuating processing
requirements of hosted IT resources (Figures 11.8 and 11.9).
  

 
 

Figure 11.8 Cloud service consumers are actively sending

requests to a cloud service (1), which are monitored
by an automated scaling listener (2). An intelligent
automation engine script is deployed with workflow logic
(3) that is capable of notifying the resource pool using
allocation requests (4).

The dynamic scalability architecture can be applied to a

range of IT resources, including virtual servers and
cloud storage devices. Besides the core automated scaling
listener and resource replication mechanisms, the
  
   
Figure 11.9 Cloud service consumer requests increase (5),
causing the automated scaling listener to signal the
intelligent automation engine to execute the script (6). The
script runs the workflow logic that signals the
hypervisor to allocate more IT resources from the resource Some additional mechanisms that can be included in this
pools (7). The hypervisor allocates additional CPU cloud architecture are the following:
and RAM to the virtual server, enabling the increased • Cloud Usage Monitor – Specialized cloud usage monitors
workload to be handled (8).  collect resource usage information on IT
resources before, during, and after scaling, to help define the
Resource pools are used by scaling technology that interacts future processing capacity thresholds of
with the hypervisor and/or VIM to retrieve and the virtual servers.
return CPU and RAM resources at runtime. The runtime • Pay-Per-Use Monitor – The pay-per-use monitor is
processing of the virtual server is monitored so that responsible for collecting resource usage cost
additional processing power can be leveraged from the information as it fluctuates with the elastic provisioning.
resource pool via dynamic allocation, before capacity • Resource Replication – Resource replication is used by this
thresholds are met. The virtual server and its hosted architectural model to generate new instances
applications and IT resources are vertically scaled in of the scaled IT resources.   
response.
This type of cloud architecture can be designed so that the
intelligent automation engine script sends its 4.5 Service Load Balancing Architecture
scaling request via the VIM instead of to the hypervisor
The service load balancing architecture can be considered a
directly. Virtual servers that participate in elastic
specialized variation of the workload distribution
resource allocation systems may require rebooting in order
architecture that is geared specifically for scaling cloud
for the dynamic resource allocation to take effect.
service implementations. Redundant deployments of
Intelligent Automation Engine cloud services are created, with a load balancing system
The intelligent automation engine automates administration added to dynamically distribute workloads.
tasks by executing scripts that contain The duplicate cloud service implementations are organized
workflow logic.  into a resource pool, while the load balancer is
positioned as either an external or built-in component to
allow the host servers to balance the workloads
themselves.
Depending on the anticipated workload and processing
capacity of host server environments, multiple
instances of each cloud service implementation can be
generated as part of a resource pool that responds to
fluctuating request volumes more efficiently.
The load balancer can be positioned either independent of neighboring Cloud Service A implementations on Virtual
the cloud services and their host servers (Figure Servers B and C (2). 
11.10), or built-in as part of the application or server’s
The service load balancing architecture can involve the
environment. In the latter case, a primary server with
the load balancing logic can communicate with neighboring following mechanisms in addition to the load balancer:
• Cloud Usage Monitor – Cloud usage monitors may be
servers to balance the workload (Figure 11.11). 
involved with monitoring cloud service instances
and their respective IT resource consumption levels, as well
as various runtime monitoring and usage
data collection tasks.
• Resource Cluster – Active-active cluster groups are
incorporated in this architecture to help balance
workloads across different members of the cluster.
• Resource Replication – The resource replication
mechanism is utilized to generate cloud service
implementations in support of load balancing requirements. 
To know more about Scaling and Load Balancing, click this
link to watch the videoLinks to an external site..

4.6 Cloud Bursting Architecture

The cloud bursting architecture establishes a form of
dynamic scaling that scales or “bursts out” on-premise IT
resources into a cloud whenever predefined capacity
thresholds have been reached. The corresponding cloud-
based IT resources are redundantly pre-deployed but remain
inactive until cloud bursting occurs. After they are no longer
Figure 11.10 The load balancer intercepts messages sent by required, the cloud-based IT resources are released and the
cloud service consumers (1) and forwards them to architecture “bursts in” back to the on-premise
the virtual servers so that the workload processing is environment. 
horizontally scaled (2).
Cloud bursting is a flexible scaling architecture that provides
cloud consumers with the option of using cloud-based IT
resources only to meet higher usage demands. The
foundation of this architectural model is based on the
automated scaling listener and resource replication
mechanisms.
The automated scaling listener determines when to redirect
requests to cloud-based IT resources, and resource
replication is used to maintain synchronicity between on-
premise and cloud-based IT resources in relation to state
information (Figure 11.12). 

 
   
Figure 11.11 Cloud service consumer requests are sent to
Cloud Service A on Virtual Server A (1). The cloud
service implementation includes built-in load balancing logic
that is capable of distributing requests to the
In addition to the automated scaling listener and resource
replication, numerous other mechanisms can be
used to automate the burst in and out dynamics for this
architecture, depending primarily on the type of IT
resource being scaled.

4.7 Elastic Disk Provisioning Architecture

Cloud consumers are commonly charged for cloud-based
storage space based on fixed-disk storage allocation,
meaning the charges are predetermined by disk capacity and
not aligned with actual data storage
consumption. Figure 11.13 demonstrates this by illustrating a
scenario in which a cloud consumer provisions a
virtual server with the Windows Server operating system and
three 150 GB hard drives. The cloud consumer Figure 11.14 The cloud consumer requests a virtual server
is billed for using 450 GB of storage space after installing the with three hard disks, each with a capacity of 150
operating system, even though it has not yet GB (1). The virtual server is provisioned by this architecture
installed any software.  with a total of 450 GB of disk space (2). The 450
GB are set as the maximum disk usage that is allowed for this
virtual server, although no physical disk space
has been reserved or allocated yet (3). The cloud consumer
has not installed any software, meaning the actual
used space is currently at 0 GB (4). Because the allocated disk
space is equal to the actual used space (which is
currently at zero), the cloud consumer is not charged for any
disk space usage (5).
Thin-provisioning software is installed on virtual servers that
process dynamic storage allocation via the
hypervisor, while the pay-per-use monitor tracks and reports
granular billing-related disk usage data (Figure
11.15).

Figure 11.13 The cloud consumer requests a virtual server

with three hard disks, each with a capacity of 150
GB (1). The virtual server is provisioned according to the
elastic disk provisioning architecture, with a total of
450 GB of disk space (2). The 450 GB is allocated to the
virtual server by the cloud provider (3). The cloud
consumer has not installed any software yet, meaning the
actual used space is currently 0 GB (4). Because the
450 GB are already allocated and reserved for the cloud
consumer, it will be charged for 450 GB of disk usage
as of the point of allocation (5).
 
The elastic disk provisioning architecture establishes a    
dynamic storage provisioning system that ensures that the
cloud consumer is granularly billed for the exact amount of Figure 11.15 A request is received from a cloud consumer,
storage that it actually uses. This system uses thin and the provisioning of a new virtual server
provisioning technology for the dynamic allocation of storage instance begins (1). As part of the provisioning process, the
space, and is further supported by runtime usage hard disks are chosen as dynamic or thinprovisioned disks
monitoring to collect accurate usage data for billing purposes (2). The hypervisor calls a dynamic disk allocation component
(Figure 11.14).    to create thin disks for the
virtual server (3). Virtual server disks are created via the thin-
provisioning program and saved in a folder of
near-zero size. The size of this folder and its files grow as
operating applications are installed and additional
files are copied onto the virtual server (4). The pay-per-use
monitor tracks the actual dynamically allocated
storage for billing purposes (5). 
The following mechanisms can be included in this
architecture in addition to the cloud storage device, virtual
server, hypervisor, and pay-per-use monitor:
• Cloud Usage Monitor – Specialized cloud usage monitors
can be used to track and log storage usage
fluctuations.
• Resource Replication – Resource replication is part of an
elastic disk provisioning system when
conversion of dynamic thin-disk storage into static thick-disk
storage is required. 

4.8 Redundant Storage Architecture

Cloud storage devices are occasionally subject to failure and
disruptions that are caused by network
connectivity issues, controller or general hardware failure, or
security breaches. A compromised cloud storage
device’s reliability can have a ripple effect and cause impact
failure across all of the services, applications, and
infrastructure components in the cloud that are reliant on its
availability.  Storage Replication
A logical unit number (LUN) is a logical drive that represents Storage replication is a variation of the resource replication
a partition of a physical drive.  mechanisms used to synchronously or
asynchronously replicate data from a primary storage device
The storage service gateway is a component that acts as the to a secondary storage device. It can be
external interface to cloud storage services, used to replicate partial and entire LUNs.     
and is capable of automatically redirecting cloud consumer
requests whenever the location of the Cloud providers may locate secondary cloud storage devices
requested data has changed. in a different geographical region than the
primary cloud storage device, usually for economic reasons.
However, this can introduce legal concerns for
some types of data. The location of the secondary cloud
storage devices can dictate the protocol and method
used for synchronization, as some replication transport
protocols have distance restrictions.
Some cloud providers use storage devices with dual array
and storage controllers to improve device
redundancy, and place secondary storage devices in a
different physical location for cloud balancing and
disaster recovery purposes. In this case, cloud providers may
need to lease a network connection via a third-party cloud
provider in order to establish the replication between the
two devices. 
To know more about Cloud Infrastructure, click this linkLinks
to an external site.