Cs6703 Grid and Cloud Computing Unit 1
Cs6703 Grid and Cloud Computing Unit 1
Unit 1
Dr Gnanasekaran Thangavel
Professor and Head
Faculty of Information Technology
R M K College of Engineering and
Technology
UNIT I INTRODUCTION
Cooperation
Agent Cooperation
Distribution
Agent
Internet
Internet
Subscription Distribution
Job Request
Large-scale
Resource
Application
Management
Client-server
3-tier architecture
N-tier architecture
loose coupling, ortight coupling
Peer-to-peer
Space based
RMI Architecture
17 Dr Gnanasekaran Thangavel 6/15/17
Categories of Applications in
Science distributed computing
Life Sciences
Cryptography
Internet
Financial
Mathematics
Language
Art
Puzzles/Games
Miscellaneous
Distributed Human Project
Collaborative Knowledge Bases
Charity
18 Dr Gnanasekaran Thangavel 6/15/17
Advantages
Economics:-
Computers harnessed together give a better price/performance ratio
than mainframes.
Speed:-
A distributed system may have more total computing power than a
mainframe.
Inherent distribution of applications:-
Some applications are inherently distributed. E.g., an ATM-banking
application.
Reliability:-
If one machine crashes, the system as a whole can still survive if you
have multiple server machines and multiple storage devices
(redundancy).
Extensibility and Incremental Growth:-
Possible to gradually scale up (in terms of processing power and
functionality) by adding more sources (both hardware and software).
This can be done without disruption to the rest of the system.
19 Dr Gnanasekaran Thangavel 6/15/17
Disadvantages
Complexity :-
Lack of experience in designing, and implementing a
distributed system. E.g. which platform (hardware and OS) to
use, which language to use etc.
Network problem:-
If the network underlying a distributed system saturates or
goes down, then the distributed system will be effectively
disabled thus negating most of the advantages of the
distributed system.
Security:-
Security is a major hazard since easy access to data means
easy access to secret data as well.
Dr Gnanasekaran Thangavel
20 6/15/17
Issues and Challenges
Heterogeneity of components :-
variety or differences that apply to computer
hardware, network, OS, programming language and
implementations by different developers.
All differences in representation must be deal with if
to do message exchange.
Example : different call for exchange message in
UNIX different from Windows.
Openness:-
System can be extended and re-implemented in
various ways.
Cannot be achieved unless the specification and
documentation are made available to software
21
developer.
Dr Gnanasekaran Thangavel 6/15/17
Issues and Challenges cont
Transparency:-
Aim : make certain aspects of distribution
are invisible to the application programmer ;
focus on design of their particular application.
They not concern the locations and details of
how it operate, either replicated or migrated.
Failures can be presented to application
programmers in the form of exceptions
must be handled.
22 Dr Gnanasekaran Thangavel 6/15/17
Issues and Challenges cont
Transparency:-
This concept can be summarize as shown in this Figure:
Benefits
Exploit Underutilized resources
Resource load Balancing
Virtualize resources across an enterprise
Data Grids, Compute Grids
Enable collaboration for virtual organizations
29 Dr Gnanasekaran Thangavel 6/15/17
Grid Applications
Data and computationally intensive applications:
This technology has been applied to computationally-intensive
scientific, mathematical, and academic problems like drug
discovery, economic forecasting, seismic analysis back office
data processing in support of e-commerce
A chemist may utilize hundreds of processors to screen
thousands of compounds per hour.
Teams of engineers worldwide pool resources to analyze
terabytes of structural data.
Meteorologists seek to visualize and analyze petabytes of
climate data with enormous computational demands.
Resource sharing
Computers, storage, sensors, networks,
30
Sharing always
Dr Gnanasekaran conditional: issues of trust, policy, negotiation,
Thangavel 6/15/17
payment,
Grid Topologies
Intragrid
Local grid within an organization
Trust based on personal contracts
Extragrid
Resources of a consortium of organizations
connected through a (Virtual) Private
Network
Trust based on Business to Business
contracts
Intergrid
Global sharing of resources through the
31 internet
Dr Gnanasekaran Thangavel 6/15/17
Computational Grid
2 Computational jobs
4
Grid application
3 Processed jobs
Computation result
User
A User sends computation or
Resource Broker
A Resource Broker distribute the jobs
data intensive application to
Global Grids in order to speed
in an application to the Grid resources Grid Resources
based on users QoS requirements and Grid Resources (Cluster, PC,
up the execution of the details of available Grid resources for Supercomputer, database,
application. further executions. instruments, etc.) in the Global Grid
execute the user jobs.
EuroGrid, Grid eurogrid.org Create tech for remote access to super comp resources
Interoperability (GRIP) European Union & simulation codes; in GRIP, integrate with Globus
Toolkit
Fusion Collaboratory fusiongrid.org Create a national computational collaboratory for fusion
DOE Off. Science research
Globus Project globus.org Research on Grid technologies; development and
DARPA, DOE, NSF, support of Globus Toolkit; application and deployment
NASA, Msoft
GridLab gridlab.org Grid technologies and applications
European Union
GridPP gridpp.ac.uk Create & apply an operational grid within the U.K. for
U.K. eScience particle physics research
Grid Research Integration grids-center.org Integration, deployment, support of the NSF Middleware
Dev. & Support Center NSF Infrastructure for research & education
Local OS
46 Dr Gnanasekaran Thangavel 6/15/17
Layered Grid Architecture
(By Analogy to Internet Architecture)
Application
Collective Coherency control, replica selection, task management, virtual data catalog,
(App) virtual data code catalog,
GridSim Toolkit
Appn Res entity Info serv Job mgmt Res alloc Statis
modeling
Resource Modeling and Simulation
Single CPU SMPs Clusters Load Netw Reservation
Virtual Machine
53 PCs Workstation
Dr Gnanasekaran Thangavel SMPs Clusters Distributed Resources
6/15/17
Web 2.0, Clouds, and Internet of Things
55
What is a Service Oriented Architecture (SOA)?
A method of design, deployment, and
management of both applications and the
software infrastructure where:
All software is organized into business services
that are network accessible and executable.
Service interfaces are based on public
standards for interoperability.
56
Key Characteristics of SOA
Quality of service, security and
performance are specified.
Software infrastructure is responsible for
managing.
Services are cataloged and discoverable.
Data are cataloged and discoverable.
Protocols use only industry standards.
57
What is a Service?
Information Management
Information Systems
SOA
Systems Design
Information
Computing & Communications Technology
59
Why Getting SOA Will be Difficult
Managing for Projects:
Software: 1 - 4 years
Hardware: 3 - 5 years;
Communications: 1 - 3 years;
Project Managers: 2 - 4 years;
Reliable funding: 1 - 4 years;
User turnover: 30%/year;
Security risks: 1 minute or less.
Managing for SOA:
Data: forever.
60
Infrastructure: 10+ years.
Why Managing Business Systems is Difficult?
61
How to View Organizing for SOA
Pr i v a t e A p p l i c a t i o n s a n d Fi l e s PER SO N A L LEV EL
P r i v a cy an d
I n d i v i d u al
S ecu r i t y B a r r i er VARIETY HERE
G r a p h i c I n f o W i n d o w , Pe r so n a l To o l s, I n q u ir y La n gu a ge s
C u st o m i z e d A p p l i c a t i o n s, Pr o t o t y p i n g To o l s, Lo c a l LO C A L LEV EL
A p p l i c a t i o n s a n d Fi l e s
A p p l i ca ti o n s
S e cu r i t y B ar r i er
A p p l ic a t i o n s D e v e l o p m e n t & M a i n t e n a n c e A PP LI C A T I O N LEV EL
B u si n e ss
S ecu r i ty B a r r i er
62
SOA Must Reflect Timing
Private Applications and Files PERSONAL
Infrastructure
Business A Business B Support BUSINESS
Functional Process A
Functional Process B
PROCESS
Functional Process C
Functional Process D
LONG TERM
Corporate Policy, Corporate Standards, Reference Models,
STABILITY &
Data Management and Tools, Integrated Systems
Configuration Data Base, Shared Computing and ENTERPRISE TECHNOLOGY
Telecommunications, Security and Survivability COMPLEXITY
Industry Standards, Commercial Off-the-Shelf
Products and Services
GLOBAL
63
SOA Must Reflect Conflicting Interests
Personal
Local
Organizations
Missions
Enterprise
64
Organization of Infrastructure Services
Infrastructure
Services
(Enterprise Information)
65
Organization of Data Services
Data
Services
66
Data Interoperability Policies
Data are an enterprise resource.
70
Security Services = Information Assurance
Conduct Attack/Event Response
Ensure timely detection and appropriate
response to attacks.
Manage measures required to minimize the
networks vulnerability.
Secure Information Exchanges
Secure information exchanges that occur on
the network with a level of protection that is
matched to the risk of compromise.
Provide Authorization and Non-Repudiation
71
Organization of Computing Services
Computing
Services
72
Computing Services
Provide Adaptable Hosting Environments
information sharing.
Shared Computing Infrastructure Resources
73
Organization of Communication Services
Communication
Services
74
Network Services Implementation
From point-to-point communications (push
communications) to network-centric
processes (pull communications).
Data posted to shared space for retrieval.
Network controls assure data
synchronization and access security.
75
Communication Services
Provide Information Transport
servers.
Expand the infrastructure for on-demand capacity.
76
Organization of Application Services
Application
Services
77
Application Services and Tools
Provide Common End User Interface Tools
Application generators, test suites, error identification,
application components and standard utilities.
Common end-user Interface Tools.
E-mail, collaboration tools, information dashboards, Intranet
portals, etc.
78
Example of Development Tools
Business Process Execution Language, BPEL, is an
executable modeling language. Through XML it enables code
generation.