UNIT III-Notes - CC
UNIT III-Notes - CC
VIRTUALIZATION TECHNOLOGY
Introduction:
In computing, virtualization is the creation of a virtual (rather than actual) version of something,
such as a hardware platform, operating system (OS), storage device, or network resources. A
physical computer is clearly a complete and actual machine, both subjectively (from the user's
point of view) and objectively (from the hardware system administrator's point of view), a virtual
machine is subjectively a complete machine , but objectively merely a set of files and running
programs on an actual, physical machine.
With virtualization, several operating systems can be run in parallel on a single central
processing unit. It differs from multitasking, which involves running several programs on the
same OS. The goal of virtualization is to centralize administrative tasks while improving
scalability and overall hardware-resource utilization. Virtualization includes automatic
computing and utility computing in which computing power is seen as utility that client can pay
for only as needed.
Virtual Machine: a representation of real machine using software that provides an operating
environment which can run/host a guest OS.
Guest OS: An OS running on virtual machine environment.
Virtualization software layer is also called as hypervisor or VMM (Virtual Machine Monitor),
a middleware layer between underlying hardware and VM in the system.
Types of Virtualization
Hardware: It refers to the creation of a virtual machine that acts like a real computer with an
operating system. Software executed on virtual machines is separated from the underlying
hardware resources. Here, the host machine is the actual machine on which the virtualization
takes place, and the guest machine is the virtual machine. The words host and guest are used to
distinguish the software that runs on the actual machine from the software that runs on the virtual
machine.
Different types of hardware virtualization include:
1. Full virtualization: Almost complete simulation of the actual hardware to allow software,
which typically consists of a guest operating system, to run unmodified.
2. Partial virtualization: Some but, not all of the target environment is simulated. Some guest
programs, therefore, may need modifications to run in this virtual environment.
3. Para-virtualization: A hardware environment is not simulated; however, the guest programs
are executed in their own isolated domains, as if they are running on a separate system. Guest
programs need to be specifically modified to run in this environment.
Desktop: Desktop virtualization is the concept of separating the logical desktop from the
physical machine. One form of desktop virtualization, virtual desktop infrastructure (VDI), can
be thought as a more advanced form of hardware virtualization. Rather than interacting with a
host computer directly via a keyboard, mouse, and monitor, the user interacts with the host
computer using another desktop computer or a mobile device over internet.
Another form, session virtualization, allows multiple users to connect and log into a shared but
powerful computer over the network and use it simultaneously. Each is given a desktop and a
personal folder in which they store their files.
Software
• Operating system-level virtualization, hosting of multiple virtualized environments within a
single OS instance.
• Application virtualization and workspace virtualization, the hosting of individual applications
in an environment separated from the underlying OS. Application virtualization is closely
associated with the concept of portable applications.
• Service virtualization, emulating the behavior of dependent system components that are needed
to exercise an application under test (AUT) for development or testing purposes. Rather than
virtualizing entire components, it virtualizes only specific slices of dependent behavior critical to
the execution of development and testing tasks.
Memory
This virtualization aggregating RAM resources from networked systems into a single memory
pool. Virtual memory gives an application program the impression that it has contiguous
working memory, isolating it from the underlying physical memory implementation.
Storage
It the process of completely abstracting the logical storage from physical storage. It enables
distributed file system through parallel processing.
Data
It refers presentation of data as an abstract layer, independent of underlying database systems,
structures and storage. Database virtualization, the decoupling of the database layer, which lies
between the storage and application layers within the application stack over all.
Network
It creates virtualized network addressing space within or across network subnets
User-Application Level:
On a traditional OS, an application often runs as a process. Therefore, application-level
virtualization is also known as process-level virtualization. The most popular approach is to
deploy high level language (HLL) VMs. In this scenario, the virtualization layer exports an
abstraction of a VM that can run programs written and compiled to a particular abstract machine
definition. Any program written in the HLL and compiled for this VM will be able to run on it.
The Microsoft .NET CLR and Java Virtual Machine (JVM) are two good examples of this class
of VM. Other forms of application-level virtualization are known as application isolation,
application sandboxing, or application streaming. The process involves wrapping the application
in a layer that is isolated from the host OS and other applications. The result is an application
that is much easier to distribute and remove from user workstations.
Advantages:
VMs at the operating system level have minimal startup/shutdown costs, low resource
requirements, and high Scalability
It is possible for a VM and its host environment to synchronize state changes when
necessary.
Before virtualization, the operating system manages the hardware. After virtualization, a
virtualization layer is inserted between the hardware and the OS. In such a case, the
virtualization layer is responsible for converting portions of the real hardware into virtual
hardware. Depending on the position of the virtualization layer, there are several classes of VM
architectures, namely
1. Hypervisor architecture
2. Paravirtualization
3. host-based virtualization
1. Hypervisor and Xen Architecture
Depending on the functionality, a hypervisor can assume a micro-kernel architecture or a
monolithic hypervisor architecture. A micro-kernel hypervisor includes only the basic and
unchanging functions (such as physical memory management and processor scheduling). The
device drivers and other changeable components are outside the hypervisor. A monolithic
hypervisor implements all the aforementioned functions, including those of the device drivers.
Therefore, the size of the hypervisor code of a micro-kernel hypervisor is smaller than that of a
monolithic hypervisor.
The Xen Architecture
Xen is an open source hypervisor program developed by Cambridge University. Xen is a
microkernel hypervisor, which separates the policy from the mechanism. It implementsall the
mechanisms, leaving the policy to be handled by Domain 0, as shown in Figure. Xen does not
include any device drivers natively. It just provides a mechanism by which a guest OS can have
direct access to the physical devices.
Like other virtualization systems, many guest OSes can run on top of the hypervisor. The guest
OS (privileged guest OS), which has control ability, is called Domain 0, and the others are called
Domain U. It is first loaded when Xen boots without any file system drivers being available.
Domain 0 is designed to access hardware directly and manage devices.
Para-virtualization
It is a split driver model consisting of a frontend driver and a backend driver. The frontend driver
is running in Domain U and the backend driver is running in Domain 0. They interact with each
other via a block of shared memory. The frontend driver manages the I/O requests of the guest
OSes and the backend driver is responsible for managing the real I/O devices and multiplexing
the I/O data of different VMs. Although para-I/O-virtualization achieves better device
performance than full device emulation, it comes with a higher CPU overhead.
Virtual Hierarchy
A virtual hierarchy is a cache hierarchy that can adapt to fit the workload or mix of workloads.
The hierarchy’s first level locates data blocks close to the cores needing them for faster access,
establishes a shared-cache domain, and establishes a point of coherence for faster
communication. The first level can also provide isolation between independent workloads. A
miss at the L1 cache can invoke the L2 access.
Virtual cluster based on application partitioning or customization. The most important thing is to
determine how to store those images in the system efficiently. There are common installations
for most users or applications, such as operating systems or user-level programming libraries.
These software packages can be preinstalled as templates (called template VMs). With these
templates, users can build their own software stacks. New OS instances can be copied from the
template VM.
Fast Deployment and Effective Scheduling
Deployment means two things: to construct and distribute software stacks (OS, libraries,
applications) to a physical node inside clusters as fast as possible, and to quickly switch runtime
environments from one user’s virtual cluster to another user’s virtual cluster. If one user finishes
using his system, the corresponding virtual cluster should shut down or suspend quickly to save
the resources to run other VMs for other users.
High-Performance Virtual Storage
Basically, there are four steps to deploy a group of VMs onto a target cluster: preparing the disk
image, configuring the VMs, choosing the destination nodes, and executing the VM deployment
command on every host. Many systems use templates to simplify the disk image preparation
process. A template is a disk image that includes a preinstalled operating system with or without
certain application software. Templates could implement the COW (Copy on rite) format. A new
COW backup file is very small and easy to create and transfer.
Live VM Migration Steps
There are four ways to manage a virtual cluster. First, we can use a guest-based manager, by
which the cluster manager resides on a guest system. In this case, multiple VMs form a virtual
cluster. We can build a cluster manager on the host systems. The host-based manager supervises
the guest systems and can restart the guest system on another physical machine. Third way to
manage a virtual cluster is to use an independent cluster manager on both the host and guest
systems. Finally, you can use an integrated cluster on the guest and host systems. This means the
manager must be designed to distinguish between virtualized resources and physical resources.
A VM can be in one of the following four states.
An inactive state is defined by the virtualization platform, under which the VM is not
enabled.
An active state refers to a VM that has been instantiated at the virtualization platform to
perform a real task.
A paused state corresponds to a VM that has been instantiated but disabled to process a
task or paused in a waiting state.
A VM enters the suspended state if its machine file and virtual resources are stored back
to the disk.
live migration of a VM from one machine to another consists of the following six steps:
Steps 0 and 1: Start migration
This step makes preparations for the migration, including determining the migrating VM and the
destination host.
Steps 2: Transfer memory
Since the whole execution state of the VM is stored in memory, sending the VM’s memory to the
destination node ensures continuity of the service provided by the VM. All of the memory data is
transferred.
Step 3: Suspend the VM and copy the last portion of the data. The migrating VM’s execution is
suspended when the last round’s memory data is transferred.
Steps 4 and 5: Commit and activate the new host. After all the needed data is copied, on the
destination host, the VM reloads the states and recovers the execution of programs in it, and the
service provided by this VM continues.
Network Migration
To enable remote systems to locate and communicate with a VM, each VM must be assigned a
virtual IP address known to other entities. This address can be distinct from the IP address of the
host machine where the VM is currently located. Each VM can also have its own distinct virtual
MAC address. The VMM maintains a mapping of the virtual IP and MAC addresses to their
corresponding VMs. Live migration is a key feature of system virtualization technologies. Here,
we focus on VM migration within a cluster environment where a network-accessible storage
system, such as storage area network (SAN) or network attached storage (NAS), is employed.
Only memory and CPU status needs to be transferred from the source node to the target node. In
fact, these issues with the precopy approach are caused by the large amount of transferred data
during the whole migration process. A checkpointing/recovery and trace/replay approach (CR/
TR-Motion) is proposed to provide fast VM migration. Another strategy of postcopy is
introduced for live migration of VMs. Here, all memory pages are transferred only once during
the whole migration process and the baseline total migration time is reduced.
HYPERVISOR VMware:
A hypervisor is a form of virtualization software used in Cloud hosting to divide and allocate
the resources on various pieces of hardware. The program which provides partitioning,
isolation, or abstraction is called a virtualization hypervisor. The hypervisor is a hardware
virtualization technique that allows multiple guest operating systems (OS) to run on a single
host system at the same time. A hypervisor is sometimes also called a virtual machine manager
(VMM).
TYPE-1 Hypervisor:
The hypervisor runs directly on the underlying host system. It is also known as a “Native
Hypervisor” or “Bare metal hypervisor”. It does not require any base server operating system. It
has direct access to hardware resources. Examples of Type 1 hypervisors include VMware
ESXi, Citrix XenServer, and Microsoft Hyper-V hypervisor.
TYPE-2 Hypervisor:
A Host operating system runs on the underlying host system. It is also known as ‘Hosted
Hypervisor”. Such kind of hypervisors doesn’t run directly over the underlying hardware rather
they run as an application in a Host system(physical machine). Basically, the software is
installed on an operating system. Hypervisor asks the operating system to make hardware calls.
An example of a Type 2 hypervisor includes VMware Player or Parallels Desktop. Hosted
hypervisors are often found on endpoints like PCs. The type-2 hypervisor is very useful for
engineers, and security analysts (for checking malware, or malicious source code and newly
developed applications).
KVM:
Kernel-based Virtual Machine (KVM) is an open source virtualization technology built into
Linux®. Specifically, KVM lets you turn Linux into a hypervisor that allows a host machine to
run multiple, isolated virtual environments called guests or virtual machines (VMs). KVM is part
of Linux. KVM was first announced in 2006 and merged into the mainline Linux kernel version a
year later. Because KVM is part of existing Linux code, it immediately benefits from every new
Linux feature, fix, and advancement without additional engineering.
KVM converts Linux into a type-1 (bare-metal) hypervisor. All hypervisors need some operating
system-level components—such as a memory manager, process scheduler, input/output (I/O)
stack, device drivers, security manager, a network stack, and more—to run VMs. KVM has all
these components because it’s part of the Linux kernel. Every VM is implemented as a regular
Linux process, scheduled by the standard Linux scheduler, with dedicated virtual hardware like a
network card, graphics adapter, CPU(s), memory, and disks.
SERVER VIRTUALIZATION:
Server virtualization is the process of dividing a physical server into multiple unique and isolated
virtual servers by means of a software application. Each virtual server can run its own operating
systems independently.
Full Virtualization: Full virtualization uses a hypervisor, a type of software that directly
communicates with a physical server's disk space and CPU. The hypervisor monitors the
physical server's resources and keeps each virtual server independent and unaware of the other
virtual servers. It also relays resources from the physical server to the correct virtual server as it
runs applications. The biggest limitation of using full virtualization is that a hypervisor has its
own processing needs. This can slow down applications and impact server performance.
OS-Level Virtualization: Unlike full and para-virtualization, OS-level visualization does not
use a hypervisor. Instead, the virtualization capability, which is part of the physical server
operating system, performs all the tasks of a hypervisor. However, all the virtual servers must
run that same operating system in this server virtualization method.
Server virtualization is a cost-effective way to provide web hosting services and effectively
utilize existing resources in IT infrastructure. Without server virtualization, servers only use a
small part of their processing power. This results in servers sitting idle because the workload is
distributed to only a portion of the network’s servers. Data centers become overcrowded with
underutilized servers, causing a waste of resources and power.
DESKTOP VIRTUALIZATION:
Since the user devices is basically a display, keyboard, and mouse, a lost or stolen device
presents a reduced risk to the organization. All user data and programs exist in the desktop
virtualization server, not on client devices.
Remote desktop virtualization is typically based on a client/server model, where the
organization’s chosen operating system and applications run on a server located either in the
cloud or in a data center. In this model all interactions with users occur on a local device of the
user’s choosing, reminiscent of the so-called ‘dumb’ terminals popular on mainframes and early
Unix systems.
Remote Workforce Enablement: Since each virtual desktop resides in central servers, new user
desktops can be provisioned in minutes and become instantly available for new users to access.
Additionally IT support resources can focus on issues on the virtualization servers with little
regard to the actual end-user device being used to access the virtual desktop. Finally, since all
applications are served to the client over a network, users have the ability to access their business
applications virtually anywhere there is internet connectivity. If a user leaves the organization,
the resources that were used for their virtual desktop can then be returned to centrally pooled
infrastructure.
Security: IT professionals rate security as their biggest challenge year after year. By removing
OS and application concerns from user devices, desktop virtualization enables centralized
security control, with hardware security needs limited to virtualization servers, and an emphasis
on identity and access management with role-based permissions that limit users only to those
applications and data they are authorized to access. Additionally, if an employee leaves an
organization there is no need to remove applications and data from user devices; any data on the
user device is ephemeral by design and does not persist when a virtual desktop session ends.
Types of Virualization:
The three most popular types of desktop virtualization are Virtual desktop infrastructure (VDI),
Remote desktop services (RDS), and Desktop-as-a-Service (DaaS).
VDI simulates the familiar desktop computing model as virtual desktop sessions that run on VMs
either in on-premises data center or in the cloud. Organizations who adopt this model manage the
desktop virtualization server as they would any other application server on-premises. Since all
end-user computing is moved from users back into the data center, the initial deployment of
servers to run VDI sessions can be a considerable investment, tempered by eliminating the need
to constantly refresh end-user devices.
RDS is often used where a limited number of applications need be virtualized, rather than a full
Windows, Mac, or Linux desktop. In this model applications are streamed to the local device
which runs its own OS. Because only applications are virtualized RDS systems can offer a higher
density of users per VM.
DaaS shifts the burden of providing desktop virtualization to service providers, which greatly
alleviates the IT burden in providing virtual desktops. Organizations that wish to move IT
expenses from capital expense to operational expenses will appreciate the predictable monthly
costs that DaaS providers base their business model on.
NETWOK VIRTUALIZATION:
Network Virtualization (NV) refers to abstracting network resources that were traditionally
delivered in hardware to software. NV can combine multiple physical networks to one virtual,
software-based network, or it can divide one physical network into separate, independent virtual
networks.
Network virtualization software allows network administrators to move virtual machines across
different domains without reconfiguring the network. The software creates a network overlay
that can run separate virtual network layers on top of the same physical network fabric.
Network virtualization is rewriting the rules for the way services are
delivered, from the software-defined data center (SDDC), to the cloud, to the
edge. This approach moves networks from static, inflexible, and inefficient to
dynamic, agile, and optimized. Modern networks must keep up with the
demands for cloud-hosted, distributed apps, and the increasing threats of
cybercriminals while delivering the speed and agility you need for faster time
to market for your applications. With network virtualization, you can forget
about spending days or weeks provisioning the infrastructure to support a
new application. Apps can be deployed or updated in minutes for rapid time
to value.
Network virtualization helps organizations achieve major advances in speed, agility, and security
by automating and simplifying many of the processes that go into running a data center network
and managing networking and security in the cloud. Here are some of the key benefits of
network virtualization:
VMware NSX Data Center is a network virtualization platform that delivers networking and
security components like firewalling, switching, and routing that are defined and consumed in
software. NSX takes an architectural approach built on scale-out network virtualization that
delivers consistent, pervasive connectivity and security for apps and data wherever they reside,
independent of underlying physical infrastructure.
Data center virtualization systems are made with hypervisors. There is a special kind of software
called a hypervisor that is used to set up and manage virtual machines (VMs). Hypervisors from
top virtualization companies allow users to create virtual machines (VMs). These companies
include Citrix, VMware, IBM, Microsoft, Virtual Box, XenServer, and others. Users can create
VMs in the cloud, in a mixed environment, or on-premises. Large data centers use virtual
machines (VMs) to spread out resources efficiently. They have lots of computing power. They
do this to get the most out of them. Virtual machines (VMs) are given all the parts of a real data
center when they are built. This includes memory, storage, and even operating systems.
Virtual Machines (VMs) are like a simulated layer that runs on top of a real data server or
system. They keep other VMs separate. Type 1 hypervisors, also called "bare-metal"
hypervisors, work directly on the hardware. Type 2 hypervisors, also called "hosted"
hypervisors, work on an operating system.
Users can set up one or more virtual data centers by using hypervisors. They can effectively
manage virtual machines (VMs). This makes the best use of resources. Once the virtual machine
(VM) is running, data center virtualization can make many resources virtual. These resources
include servers, storage, networking, security, and control.
Making virtual copies of physical data center resources is called data center virtualization. This
includes all the hardware and software tools. For example, servers, data storage devices,
networks, operating systems, apps, and platforms. Many digital businesses are looking for ways
to save money. They want to save on buying and keeping hardware and software. They want to
use the newest technologies. When companies use data center virtualization technology, they can
fulfill these goals. They also get many other benefits. Here are some of the virtualized data center
providers,
Cisco UCS
Vmware vsphere
Citrix
Microsoft Azure
Wipro