Parallel and Disputing Computing
Parallel and Disputing Computing
DATE 8-11-2024
1. Parallel Computing
-Description: In parallel computing, multiple processors perform multiple tasks
simultaneously to solve a problem faster. It typically involves a single computer with multiple
processors working together.
-Example Diagram: A single machine with multiple processors or cores, all connected to
shared memory and working in parallel.
Use Cases: Scientific simulations, real-time data processing.
Advantages: Reduces computation time by dividing tasks across processors.
Disadvantages Limited by the number of processors available on a single machine.
2. Distributed Computings
Description: Distributed computing involves a network of independent computers (nodes)
working together to achieve a common goal. Each node has its memory and processors and can
execute tasks independently.
Example Diagram: Multiple computers connected over a network, each performing parts of a
task.
Use Cases: Large-scale simulations, data processing in business applications.
Advantages: Scalability, fault tolerance, resource sharing.
Disadvantages: Network latency and complexity in managing distributed resources.
3. Cloud Computing
Description: Cloud computing provides on-demand access to computing resources (like
servers, storage, and applications) over the internet. These resources are managed by cloud
service providers.
Example Diagram: A client connecting to a cloud provider with a network of servers offering
various services (e.g., storage, compute power).
Use Cases: Web hosting, data backup, software as a service (SaaS).
Advantages: Flexible resource allocation, reduced hardware costs for users, scalability.
Disadvantages: Dependency on internet connection, security and privacy concerns.
4. Cluster Computing
Description: In cluster computing, a group of computers works together as a single system.
Clusters are typically located in the same physical location and connected with high-speed
connections.
Example Diagram**: Multiple computers (nodes) connected in a network to act as a single
unit, usually controlled by a centralized node.
Use Cases: Scientific research, data analysis, and web servers.
Advantages: High performance, cost-effective for intensive computing tasks.
Disadvantages: Requires careful configuration and maintenance, limited to specific
applications.
5. Grid Computing
Description: Grid computing is similar to distributed computing but focuses on sharing
resources across different locations. Grids are generally formed to perform very large tasks by
pooling resources.
Example Diagram: Multiple organizations’ computers connected over a wide area, each
contributing resources as needed.
Use Cases: Research in fields like physics and bioinformatics, where massive computational
power is required.
Advantages: Resource sharing across organizations, effective for very large computational
tasks.
Disadvantages: Complex to set up and maintain, security issues due to shared resources.