Scribd
Upload
2 views

5-Parallel-and-Distributed-Computing

The document discusses the differences between Parallel Computing and Distributed Computing, highlighting their structures, functions, advantages, and disadvantages. Parallel Computing involves multiple processors performing tasks simultaneously, while Distributed Computing consists of autonomous computers working together without shared memory. Both models are essential in high-performance computing, with applications in various fields such as artificial intelligence, scientific research, and blockchain technology.

Uploaded by

dorowie1009
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
2 views

5-Parallel-and-Distributed-Computing

The document discusses the differences between Parallel Computing and Distributed Computing, highlighting their structures, functions, advantages, and disadvantages. Parallel Computing involves multiple processors performing tasks simultaneously, while Distributed Computing consists of autonomous computers working together without shared memory. Both models are essential in high-performance computing, with applications in various fields such as artificial intelligence, scientific research, and blockchain technology.

Uploaded by

dorowie1009
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 9

Parallel and Distributed

Computing
RYAN LUNGCAY

https://www.geeksforgeeks.org/difference-between-parallel-computing-and-distributed-computing/?ref=header_outind
Difference between Parallel Computing and Distributed Computing

Introduction
Parallel Computing and Distributed Computing are two important models of computing that
have important roles in today’s high-performance computing. Both are designed to perform a
large number of calculations breaking down the processes into several parallel tasks;
however, they differ in structure, function, and utilization. Therefore, in the following article,
there is a dissection of Parallel Computing and Distributed Computing, their gains, losses, and
applications.
What is Parallel Computing?
In parallel computing multiple processors performs multiple tasks assigned to them
simultaneously. Memory in parallel systems can either be shared or distributed. Parallel
computing provides concurrency and saves time and money.

Examples

Blockchains, Smartphones, Laptop computers, Internet of Things, Artificial intelligence and


machine learning, Space shuttle, Supercomputers are the technologies that uses Parallel
computing technology.
Advantages of Parallel Computing

● Increased Speed: In this technique, several calculations are executed concurrently


hence reducing the time of computation required to complete large scale problems.
● Efficient Use of Resources: Takes full advantage of all the processing units it is
equipped with hence making the best use of the machine’s computational power.
● Scalability: Also the more processors built into the system, the more complex problems
can be solved within a short time.
● Improved Performance for Complex Tasks: Best suited for activities which involve a
large numerical calculation like, number simulation, scientific analysis and modeling and
data processing.
Disadvantages of Parallel Computing

● Complexity in Programming: Parallel writing programming that is used in


organizing tasks in a parallel manner is even more difficult than that of serial
programming.
● Synchronization Issues: Interaction of various processors when operating
concurrently can become synchronized and result in problem areas on the overall
communication.
● Hardware Costs: The implementation of parallel computing does probably involve
the use of certain components such as multi-core processors which could possibly be
costly than the normal systems.
What is Distributed Computing?
In distributed computing we have multiple autonomous computers which seems to the user as
single system. In distributed systems there is no shared memory and computers communicate
with each other through message passing. In distributed computing a single task is divided
among different computers.

Examples

Artificial Intelligence and Machine Learning, Scientific Research and High-Performance


Computing, Financial Sectors, Energy and Environment sectors, Internet of Things, Blockchain
and Cryptocurrencies are the areas where distributed computing is used.
Advantages of Distributed Computing

● Fault Tolerance: The failure of one node means that this node is no longer part of the
computations, but that is not fatal for the entire computation since there are other
computers participating in the process thereby making the system more reliable.
● Cost-Effective: Builds upon existing hardware and has flexibility in utilizing commodity
machines instead of the need to have expensive and specific processors for its use.
● Scalability: The distributed systems have the ability to scale and expand horizontally
through the addition of more machines in the networks and therefore they can take on
greater workloads and processes.
● Geographic Distribution: Distributed computing makes it possible to execute tasks at
different points thereby eliminating latencies.
Disadvantages of Distributed Computing

● Complexity in Management: The task of managing a distributed system itself can be


made more difficult since it may require dealing with the latency and/or failure of a network
as well as issues related to synchronizing the information to be distributed.
● Communication Overhead: Inter node communication requirements can actually hinder
the package transfer between nodes that are geographically distant and hence the overall
performance is greatly compromised.
● Security Concerns: In general, distributed systems are less secure as compared to
centralized system because distributed systems heavily depend on a network.
Difference between Parallel Computing and Distributed Computing:

S.N
Parallel Computing Distributed Computing
O

Many operations are performed


1. System components are located at different locations
simultaneously

2. Single computer is required Uses multiple computers

Multiple processors perform multiple


3. Multiple computers perform multiple operations
operations

It may have shared or distributed


4. It have only distributed memory
memory

Processors communicate with each other Computer communicate with each other through
5.
through bus message passing.

Improves system scalability, fault tolerance and resource


6. Improves the system performance

You might also like