Scribd
Upload
8 views19 pages

Lecture 1-1

Uploaded by

nyashadzashemutonhori
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
8 views19 pages

Lecture 1-1

Uploaded by

nyashadzashemutonhori
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 19

H C E /H H

E/
HSE311

Department of Computer Engineering

Parallel &Distributed Computing


Parallel computing
• What is Parallel Computing?
• What is Parallel Processing?
• How Does Parallel Processing Work
• Examples of Parallel Processing
• Classes of Parallel Computers
• Parallel Computing Techniques
Distributed Computing

• What is Distributed Computing


• Ways of Distributing systems
• Examples and Use Cases of Distributed
Computing
What is Parallel computing

• Parallel computing is a
computing architecture
that divides a problem
into smaller tasks and
runs them concurrently.
What is Parallel computing

• Parallel computing refers to


the process of breaking
down larger problems into
smaller, independent, often
similar parts that can be
executed simultaneously by
multiple processors
communicating via shared
memory.
What is Parallel processing

• Parallel processing is a computing technique when multiple


streams of calculations or data processing tasks co-occur
through numerous central processing units (CPUs) working
concurrently
How does Parallel processing
work
• A computer scientist uses specialized software created for the task
to break down a complex problem into its component elements
• When processing is done in parallel, a big job is broken down into several smaller jobs
better suited to the number, size, and type of available processing units
• After all the program parts have been processed, the result is a fully processed program
segment.
Uses of Parallel processing

• Supercomputers for Use in Astronomy


• Making Predictions in Agriculture
• Video Post-Production Effects
• Accurate Medical Imaging
• Desktops and laptops
• Smartphones
• The Internet of Things (IOT)
Classes of Parallel Computers

• Multi-Core Computing
• Symmetric Multiprocessing
• Distributed Computing
• Cluster Computing
• Massively Parallel Computing
Parallel Computing Techniques

• Bit-Level Parallelism
• Instruction-Level Parallelism
• Superword Level Parallelism
• Task Parallelism
Benefits of parallel computing

• Parallel computing models the real world

• Saves time

• Saves money

• Solve more complex or larger problems

• Leverage remote resources


What is Distributed computing

• Distributed
computing is the
method of
making multiple
computers work
together to solve
a common
Ways of Distributing systems

• Distributed Computing
System.
• Cluster Computing:
• It is a collection of connected
computers that work together as a
unit to perform operations together,
functioning in a single system
Ways of Distributing systems

• Distributed Computing
System.
• Grid Computing:
• In grid computing, the subgroup
consists of distributed systems, which
are often set up as a network of
computer systems,
Ways of Distributing systems

• Distributed Information System


 Distributed transaction processing:
 It works across different servers using multiple
communication models. The four
characteristics that transactions have:
 Atomic:
 Consistent:
 Isolated:
 Durable:
Ways of Distributing systems

• Distributed Information System


 Enterprise Application
Integration:
 Enterprise Application Integration
(EAI) is the process of bringing
different businesses together
Ways of Distributing systems

• Distributed Pervasive System


• Pervasive Computing is also
abbreviated as ubiquitous (Changed and
removed) computing and it is the new
step towards integrating everyday
objects with microprocessors so that this
information can communicate.
• Home system: Nowadays many devices
used in the home are digital so we can
control them from anywhere and
effectively.
Ways of Distributing systems

 Distributed Pervasive System


 Pervasive Computing
 Electronic Health System:
 Nowadays smart medical wearable
devices are also present through which
we can monitor our health regularly.
Use Cases of Distributed Computing

• Artificial Intelligence and Machine Learning


• Scientific Research and High-Performance Computing
(HPC)
• Financial Services
• Energy and Environment
• Internet of Things (IoT)
• Blockchain and Cryptocurrencies

You might also like