Scribd
Upload
12 views

OS Techniques

YARN (Yet Another Resource Negotiator) is a distributed resource management framework developed by Yahoo! in 2010. It is used by companies like Google, Facebook, and Twitter to manage resources for large-scale data processing applications. YARN decouples resource management from data processing and allows different processing engines like batch processing and stream processing to utilize resources stored in HDFS. It provides benefits like making proper usage of resources easier and enabling Hadoop to support more varied processing approaches.

Uploaded by

walyise
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
12 views

OS Techniques

YARN (Yet Another Resource Negotiator) is a distributed resource management framework developed by Yahoo! in 2010. It is used by companies like Google, Facebook, and Twitter to manage resources for large-scale data processing applications. YARN decouples resource management from data processing and allows different processing engines like batch processing and stream processing to utilize resources stored in HDFS. It provides benefits like making proper usage of resources easier and enabling Hadoop to support more varied processing approaches.

Uploaded by

walyise
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 2

CSC 742 ASSIGNMENT

OPERATING SYSTEMS TECHNIQUES

Name: SAMUEL WALBE YISE

Matric No: 238354

"YARN" stands for Yet Another Resource Negotiator. It was coined in 2010 by engineers at
Yahoo! to describe a new distributed resource management framework that they were develo
ping. YARN is now used by a variety of companies, including Google, Facebook, and Twitte
r, to manage the resources needed to run large-scale data processing applications.

To put it simple, YARN is a large scale distributed operating system for big data applications.

1. YARN is a complex system, but it can be simplified as follows:

2. YARN provides a way to allocate resources to applications in a cluster of machines.

3. YARN applications are divided into smaller units called containers.

4. Containers are scheduled to run on machines in the cluster based on the resources that
they need.

5. YARN monitors the containers and ensures that they have the resources they need to r
un.

6. YARN is a powerful tool for managing resources in large-scale data processing cluste
rs. It is used by a variety of companies to run their most important applications.

How does YARN work?


The technology is designed for cluster management and is one of the key features in the seco
nd generation of Hadoop, the Apache Software Foundation’s open-source distributed processi
ng framework.

YARN is a software rewrite that is capable of decoupling Map reduces resource management
and scheduling capabilities from the data processing component.

In its structure, the processing component is separated from the resource management one. B
asically, YARN helps the information stored in Hadoop Distributed File System (HDFS)to be
run by different data processing engines. Some examples could be batch processing and strea
m processing.

YARN makes the proper usage of the available resources easier, which makes the handling
large quantity of data easier..

What are the benefits of YARN?

The benefit of this is that it enables Hadoop to support more varied processing approaches an
d a broader array of applications. Such as Hadoop clusters now being able to run interactive q
uerying and streaming data applications along with MapReduce batch jobs.

Combining central resource management with node manager agents that monitor the processi
ng operations of individual cluster nodes has helped to increase the appeal of YARN

You might also like