CS 22
CS 22
A Grid [3] enables the sharing, selection, and Cloud infrastructure is very robust and will always be
aggregation of a wide variety of geographically available at any time.
distributed resources including supercomputers,
storage systems, data sources, and specialized devices 1.1 Definition and Trends
owned by different organizations for solving large-
A number of computing researchers and practitioners
scale resource-intensive problems in science,
have attempted to define Clouds in various ways [6].
engineering, and commerce. Inspired by the electrical
Based on our observation of the essence of what
power Grid’s pervasiveness, ease of use, and reliability
Clouds are promising to be, we propose the following
[4], the motivation of Grid computing was initially
definition:
driven by large-scale, resource (computational and
data)-intensive scientific applications that required • "A Cloud is a type of parallel and distributed
more resources than a single computer (PC, system consisting of a collection of inter-
workstation, supercomputer, or cluster) could have connected and virtualised computers that are
provided in a single administrative domain. Due to its dynamically provisioned and presented as one
potential to make impact on the 21st century as much or more unified computing resources based on
as the electric power Grid did on the 20th century, Grid service-level agreements established through
computing has been hailed as the next revolution after negotiation between the service provider and
the Internet and the Web. consumers.”
Today, the latest paradigm to emerge is that of At a cursory glance, Clouds appear to be a
Cloud computing [5] which promises reliable services combination of clusters and Grids. However, this is not
delivered through next-generation data centers that are the case. Clouds are clearly next-generation data
built on compute and storage virtualization centers with nodes “virtualized” through hypervisor
technologies. Consumers will be able to access technologies such as VMs, dynamically “provisioned”
applications and data from a “Cloud” anywhere in the on demand as a personalized resource collection to
world on demand. In other words, the Cloud appears to meet a specific service-level agreement, which is
be a single point of access for all the computing needs established through a “negotiation” and accessible as a
of consumers. The consumers are assured that the composable service via “Web 2.0” technologies.
grid
cloud
cluster
cloud
Value-added
Service Yes No No Yes No
Providers
APIs supporting
different
Customizable
Solaris OS, programming
Programming Linux-based
Python Not applicable Java, C, C++, models in C#
Framework Amazon Machine
FORTRAN and other .Net
Image (AMI)
supported
languages
Simple Storage Service (S3), before he can start, stop, data that can be accessed across required devices (such
and monitor instances of the uploaded AMIs. Amazon as computers and mobile phones) from anywhere in the
EC2 charges the user for the time when the instance is world. The user is able to access the uploaded
alive, while Amazon S3 charges for any data transfer applications and data through a Web-based Live
(both upload and download). Dekstop or his own devices with Live Mesh software
Google App Engine [14] allows a user to run Web installed. Each user’s Live Mesh is password-protected
applications written using the Python programming and authenticated via his Windows Live Login, while
language. Other than supporting the Python standard all file transfers are protected using Secure Socket
library, Google App Engine also supports Application Layers (SSL).
Programming Interfaces (APIs) for the datastore, Sun network.com (Sun Grid) [16] enables the user
Google Accounts, URL fetch, image manipulation, and to run Solaris OS, Java, C, C++, and FORTRAN based
email services. Google App Engine also provides a applications. First, the user has to build and debug his
Web-based Administration Console for the user to applications and runtime scripts in a local development
easily manage his running Web applications. environment that is configured to be similar to that on
Currently, Google App Engine is free to use with up to the Sun Grid. Then, he needs to create a bundled zip
500MB of storage and about 5 million page views per archive (containing all the related scripts, libraries,
month. executable binaries and input data) and upload it to Sun
Microsoft Live Mesh [15] aims to provide a Grid. Finally, he can execute and monitor the
centralized location for a user to store applications and application using the Sun Grid Web portal or API.
After the completion of the application, the user will provider and sub-leasing these to the consumers. A
need to download the execution results to his local broker can accept requests from many users who have
development environment for viewing. a choice of submitting their requirements to different
GRIDS Lab Aneka [17], which is being brokers. Consumers, brokers and providers are bound
commercialized through Manjrasoft, is a .NET-based to their requirements and related compensations
service-oriented platform for constructing enterprise through SLAs. An SLA specifies the details of the
Grids. It is designed to support multiple application service to be provided in terms of metrics agreed upon
models, persistence and security solutions, and by all parties, and penalties for meeting and violating
communication protocols such that the preferred the expectations, respectively.
selection can be changed at anytime without affecting Such markets can bridge disparate Clouds allowing
an existing Aneka ecosystem. To create an enterprise consumers to choose a provider that suits their
Grid, the service provider only needs to start an requirements by either executing SLAs in advance or
instance of the configurable Aneka container hosting by buying capacity on the spot. Providers can use the
required services on each selected desktop computer. markets in order to perform effective capacity
The purpose of the Aneka container is to initialize planning. A provider is equipped with a price-setting
services and acts as a single point for interaction with mechanism which sets the current price for the
the rest of the enterprise Grid. Aneka provides SLA resource based on market conditions, user demand, and
support such that the user can specify QoS current level of utilization of the resource. Pricing can
requirements such as deadline (maximum time period be either fixed or variable depending on the market
which the application needs to be completed in) and conditions. An admission-control mechanism at a
budget (maximum cost that the user is willing to pay provider’s end selects the auctions to participate in or
for meeting the deadline). The user can access the the brokers to negotiate with, based on an initial
Aneka Enterprise Grid remotely through the Gridbus estimate of the utility. The negotiation process
broker. The Gridbus broker also enables the user to proceeds until an SLA is formed or the participants
negotiate and agree upon the QoS requirements to be decide to break off. These mechanisms interface with
provided by the service provider. the resource management systems of the provider in
order to guarantee the allocation being offered or
4. Global Cloud Exchange and Markets negotiated can be reclaimed, so that SLA violations do
not occur. The resource management system also
Enterprises currently employ Cloud services in order to provides functionalities such as advance reservations
improve the scalability of their services and to deal that enable guaranteed provisioning of resource
with bursts in resource demands. However, at present, capacity.
service providers have inflexible pricing, generally
limited to flat rates or tariffs based on usage thresholds, Brokers gain their utility through the difference
and consumers are restricted to offerings from a single between the price paid by the consumers for gaining
provider at a time. Also, many providers have resource shares and that paid to the providers for
leasing their resources. Therefore, a broker has to
proprietary interfaces to their services thus restricting
choose those users whose applications can provide it
the ability of consumers to swap one provider for
maximum utility. A broker interacts with resource
another.
providers and other brokers to gain or to trade resource
For Cloud computing to mature, it is required that shares. A broker is equipped with a negotiation module
the services follow standard interfaces. This would that is informed by the current conditions of the
enable services to be commoditised and thus, would resources and the current demand to make its
pave the way for the creation of a market infrastructure decisions.
for trading in services. An example of such a market
Consumers have their own utility functions that
system, modeled on real-world exchanges, is shown in
cover factors such as deadlines, fidelity of results, and
Figure 4. The market directory allows participants to
turnaround time of applications. They are also
locate providers or consumers with the right offers.
constrained by the amount of resources that they can
Auctioneers periodically clear bids and asks received
from market participants. The banking system ensures request at any time, usually by a limited budget.
Consumers also have their own limited IT
that financial transactions pertaining to agreements
infrastructure that is generally not completely exposed
between participants are carried out.
to the Internet. Therefore, a consumer participates in
Brokers perform the same function in such a market the utility market through a resource management
as they do in real-world markets: they mediate between proxy that selects a set of brokers based on their
consumers and providers by buying capacity from the
Compute Cloud
Storage Cloud
Broker 1
Directory
.
. Bank
.
Auctioneer
Enterprise .
Resource
Manager
(Proxy) Broker N
Global Cloud Compute
Cloud
Market
Enterprise IT Consumer
Storage Cloud
Figure 4: Global Cloud exchange and market infrastructure for trading services.
offerings. He then forms SLAs with the brokers that obtain restitution in case an SLA is violated. This
bind the latter to provide the guaranteed resources. The motivates the need for a legal framework for
enterprise consumer then deploys his own environment agreements in such markets, a research issue that is out
on the leased resources or uses the provider’s of scope of themes pursued in this paper.
interfaces in order to scale his applications.
The idea of utility markets for computing resources 5. Summary and Conclusion
has been around for a long time. Recently, many
research projects such as SHARP [18], Tycoon [19], Cloud computing is a new and promising paradigm
Bellagio [20], and Shirako [21] have come up with delivering IT services as computing utilities. As
market structures for trading in resource allocations. Clouds are designed to provide services to external
These have particularly focused on trading in VM- users, providers need to be compensated for sharing
based resource slices on networked infrastructures such their resources and capabilities. In this paper, we have
as PlanetLab. As mentioned before, the Gridbus project proposed architecture for market-oriented allocation of
has created a resource broker that is able to negotiate resources within Clouds. We have discussed some
with resource providers. Thus, the technology for representative platforms for Cloud computing covering
enabling utility markets is already present and ready to the state-of-the-art. We have also presented a vision for
be deployed. the creation of global Cloud exchange for trading
services.
However, significant challenges persist in the
universal application of such markets. Enterprises The state-of-the-art Cloud technologies have limited
currently employ conservative IT strategies and are support for market-oriented resource management and
unwilling to shift from the traditional controlled they need to be extended to support: negotiation of
environments. Cloud computing uptake has only QoS between users and providers to establish SLAs;
recently begun and many systems are in the proof-of- mechanisms and algorithms for allocation of VM
concept stage. Regulatory pressures also mean that resources to meet SLAs; and manage risks associated
enterprises have to be careful about where their data with the violation of SLAs. Furthermore, interaction
gets processed, and therefore, are not able to employ protocols needs to be extended to support
Cloud services from an open market. This could be interoperability between different Cloud service
mitigated through SLAs that specify strict constraints providers.
on the location of the resources. However, another As Cloud platforms become ubiquitous, we expect
open issue is how the participants in such a market can
the need for internetworking them to create a market- [10] Morgan Stanley. Technology Trends. 12 June
oriented global Cloud exchange for trading services. 2008.
Several challenges need to be addressed to realize this http://www.morganstanley.com/institutional/tec
vision. They include: market-maker for bringing hresearch/pdfs/TechTrends062008.pdf [18 July
service providers and consumers; market registry for 2008]
publishing and discovering Cloud service providers [11] K. Keahey, I. Foster, T. Freeman, and X.
and their services; clearing house and brokers for Zhang. Virtual workspaces: Achieving quality
mapping service requests to providers who can meet of service and quality of life in the Grid.
QoS expectations; and payment management and Scientific Programming, 13(4):265-275,
accounting infrastructure for trading services. Finally, October 2005.
we need to address regulatory and legal issues, which
[12] I. Llorente, OpenNebula Project.
go beyond technical issues.
http://www.opennebula.org/ [23 July 2008]
[13] Amazon Elastic Compute Cloud (EC2),
http://www.amazon.com/ec2/ [18 July 2008]
[14] Google App Engine,
http://appengine.google.com [18 July 2008]
[15] Microsoft Live Mesh, http://www.mesh.com
[18 July 2008]
References [16] Sun network.com (Sun Grid),
[1] L. Kleinrock. A vision for the Internet. ST Journal http://www.network.com [18 July 2008]
of Research, 2(1):4-5, Nov. 2005. [17] X. Chu, K. Nadiminti, C. Jin, S. Venugopal,
[2] S. London. INSIDE TRACK: The high-tech and R. Buyya. Aneka: Next-Generation
rebels. Financial Times, 06 Sept. 2002. Enterprise Grid Platform for e-Science and e-
http://search.ft.com/nonFtArticle?id=02090600 Business Applications. In Proceedings of the
0371 [18 July 2008] 3th IEEE International Conference on e-Science
and Grid Computing (e-Science 2007),
[3] I. Foster and C. Kesselman (eds). The Grid: Bangalore, India, Dec. 2007.
Blueprint for a Future Computing
Infrastructure. Morgan Kaufmann, San [18] Y. Fu, J. Chase, B. Chun, S. Schwab, and A.
Francisco, USA, 1999. Vahdat. SHARP: an architecture for secure
resource peering. ACM SIGOPS Operating
[4] M. Chetty and R. Buyya. Weaving Computational
Systems Review, 37(5):133–148, Dec. 2003.
Grids: How Analogous Are They with Electrical
Grids? Computing in Science and Engineering, [19] K. Lai, L. Rasmusson, E. Adar, L. Zhang, and
4(4):61–71, July–Aug. 2002. B. A. Huberman. Tycoon: An implementation
[5] A. Weiss. Computing in the Clouds. netWorker, of a distributed, market-based resource
11(4):16-25, Dec. 2007. allocation system. Multiagent and Grid Systems,
1(3):169–182, 2005.
[6] Twenty Experts Define Cloud Computing,
http://cloudcomputing.sys- [20] A. AuYoung, B. Chun, A. Snoeren, and A.
con.com/read/612375_p.htm [18 July 2008]. Vahdat. Resource allocation in federated
[7] R. Buyya, D. Abramson, and S. Venugopal. The
distributed computing infrastructures. In
Grid Economy. Proceedings of the IEEE, 93(3): Proceedings of the 1st Workshop on Operating
698-714, IEEE Press, USA, March 2005. System and Architectural Support for the
Ondemand IT Infrastructure (OASIS 2004),
[8] S. Venugopal, X. Chu, and R. Buyya. A
Boston, USA, Oct. 2004.
Negotiation Mechanism for Advance Resource
Reservation using the Alternate Offers Protocol. In [21] D. E. Irwin, J. S. Chase, L. E. Grit, A. R.
Proceedings of the 16th International Workshop Yumerefendi, D. Becker, and K. Yocum.
on Quality of Service (IWQoS 2008), Twente, The Sharing networked resources with brokered
Netherlands, June 2008. leases. In Proceedings of the 2006 USENIX
[9] D. Hamilton. 'Cloud computing' seen as next Annual Technical Conference (USENIX 2006),
wave for technology investors. Financial Post, Boston, USA, June 2006.
04 June 2008.
http://www.financialpost.com/money/story.html
?id=562877 [18 July 2008]