Different Computing Paradigms (Parallel and Distributed)
Different Computing Paradigms (Parallel and Distributed)
1. Distributed Computing :
Distributed computing is defined as a type of computing where
multiple computer systems work on a single problem. Here all the
computer systems are linked together and the problem is divided
into sub-problems where each part is solved by different computer
systems.
The goal of distributed computing is to increase the performance
and efficiency of the system and ensure fault tolerance.
In the below diagram, each processor has its own local memory and
all the processors communicate with each other over a network.
2. Parallel Computing :
Parallel computing is defined as a type of computing where multiple
computer systems are used simultaneously. Here a problem is
broken into sub-problems and then further broken down into
instructions. These instructions from each sub-problem are executed
concurrently on different processors.
Here in the below diagram you can see how the parallel computing
system consists of multiple processors that communicate with each
other and perform multiple tasks over a shared memory
simultaneously.
3. Cluster Computing :
A cluster is a group of independent computers that work together to
perform the tasks given.
Cluster computing is defined as a type of computing that consists of
two or more independent computers, referred to as nodes, that work
together to execute tasks as a single machine.
As you can see in the below diagram, all the nodes, (irrespective of
whether they are a parent node or child node), act as a single entity
to perform the tasks.
4. Grid Computing :
Grid computing is defined as a type of computing where it is
constitutes a network of computers that work together to perform
tasks that may be difficult for a single machine to handle. All the
computers on that network work under the same umbrella and are
termed as a virtual super computer.
There type of cloud are public, private, hybrid and community and
some cloud providers are Google cloud, AWS, Microsoft Azure and
IBM cloud.