Scribd
Upload
53 views16 pages

Exploiting Dynamic Resource Allocation For Efficient Parallel Data Processing in The Cloud

The document discusses exploiting dynamic resource allocation for efficient parallel data processing in the cloud. It describes a system with several modules including a user interface to create user profiles and submit jobs, a job manager to allocate tasks to resources like task managers, and task managers that process tasks and return results. The system aims to decrease cloud overload and increase performance by allocating jobs and tasks to proper resources dynamically.

Uploaded by

michu
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
53 views16 pages

Exploiting Dynamic Resource Allocation For Efficient Parallel Data Processing in The Cloud

The document discusses exploiting dynamic resource allocation for efficient parallel data processing in the cloud. It describes a system with several modules including a user interface to create user profiles and submit jobs, a job manager to allocate tasks to resources like task managers, and task managers that process tasks and return results. The system aims to decrease cloud overload and increase performance by allocating jobs and tasks to proper resources dynamically.

Uploaded by

michu
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 16

Exploiting Dynamic Resource

Allocation for Efficient Parallel


Data Processing in the Cloud

INTRODUCTION
Parallel data processing is to make easy access of
service
Perform different task using different resources as the
infrastructure needed
Goal is to decrease the overload and increase the
performance of the cloud

MODULE DESCRIPTION
User Interface
Create a user page using GUI.
Establish the communication between client and
cloud.
User able to know about the
overview of the whole application
Input
Run the application.
Output
Connection Establishment with web

MODULE DESCRIPTION
Login
Check the user credential by login page
Can add new user through user registration
Input
Username and password
Output
Connection Establishment with cloud

MODULE DIAGRAM

MODULE DESCRIPTION
Resource Storage
Display resources and services provided by
in one home page.
Input
Select the resource as application need.
Output
Service submit page

cloud

MODULE DESCRIPTION
Job manager
Media between the cloud and resources
Allocate the job of the client to the proper resources
Input
Type the application
Output
Job handover to job manager

MODULE DIAGRAM

USECASE DIAGRAM
User

Login

Cloud

Job manager

Task Manager

Task Manager

Task Manager

CLASS DIAGRAM
cloud
request
response

User
user name
Password

connectJM()
receiveRes()

DB check()

JobManager
search
assign
allocate()
searchTm()
getResult()

TaskM
receive
process
TaskM
receive
process
process()
sendRes()
opname()

TaskM
receive
process
process()
sendRes()
opname()

process()
sendRes()
opname()

OBJECT DIAGRAM

STATE DIAGRAM
login

connect

storage

job manager

task2

task1

result

client1

client2

ACTIVITY DIAGRAM

cloud

job manager

task manager

SEQUENCE DIAGRAM
User

Login page

Cloud

Jobmanager

Taskmanager

Login
connect to cloud
task to jobmanager
Assign task to task manager
Response to user

response to cloud
response to jobmanager

COLLABORATION DIAGRAM
1: Login
User

2:
Login
page

Cloud
5:
6:
3:
4:
Jobmana
ger

7:

Taskma
nager

REFERENCE
1]Daniel Warneke and Odej Kao , Exploiting Dynamic Resource
Allocation for Parallel Data Processing in Cloud/vol.2011
[2] Amazon Web Services LLC, Amazon Elastic Compute
Cloud(Amazon EC2), http://aws.amazon.com/ec2/, 2009.
[3] Amazon Web Services LLC, Amazon Elastic MapReduce,
http://aws.amazon.com/elasticmapreduce/, 2009.
[4] D. Battre, S. Ewen, F. Hueske, O R. Chaiken, B. Jenkins, P.-A.
Larson, B. Ramsey, D. Shakib, S. Weaver, and J. Zhou,
SCOPE: Easy and Efficient Parallel
Processing of Massive Data Sets, Proc. Very Large Database
Endowment, vol. 1, no. 2, pp. 1265-1276, 2008.
[5] Kao, V. Markl, and D. Warneke,Nephele/PACTs: A Programming
Model and Execution Framework for Web-Scale Analytical
Processing, Proc. ACM Symp.
Cloud Computing (SoCC 10), pp. 119-130, 2010.

You might also like