CSC 742 ASSIGNMENT

OPERATING SYSTEMS TECHNIQUES

Name: SAMUEL WALBE YISE

Matric No: 238354

"YARN" stands for Yet Another Resource Negotiator. It was coined in 2010 by engineers at
Yahoo! to describe a new distributed resource management framework that they were develo
ping. YARN is now used by a variety of companies, including Google, Facebook, and Twitte
r, to manage the resources needed to run large-scale data processing applications.

To put it simple, YARN is a large scale distributed operating system for big data applications.

1. YARN is a complex system, but it can be simplified as follows:

2. YARN provides a way to allocate resources to applications in a cluster of machines.

3. YARN applications are divided into smaller units called containers.

4. Containers are scheduled to run on machines in the cluster based on the resources that
they need.

5. YARN monitors the containers and ensures that they have the resources they need to r
un.

6. YARN is a powerful tool for managing resources in large-scale data processing cluste
rs. It is used by a variety of companies to run their most important applications.

How does YARN work?

The technology is designed for cluster management and is one of the key features in the seco
nd generation of Hadoop, the Apache Software Foundation’s open-source distributed processi
ng framework.

YARN is a software rewrite that is capable of decoupling Map reduces resource management
and scheduling capabilities from the data processing component.

In its structure, the processing component is separated from the resource management one. B
asically, YARN helps the information stored in Hadoop Distributed File System (HDFS)to be
run by different data processing engines. Some examples could be batch processing and strea
m processing.

YARN makes the proper usage of the available resources easier, which makes the handling
large quantity of data easier..

What are the benefits of YARN?

The benefit of this is that it enables Hadoop to support more varied processing approaches an
d a broader array of applications. Such as Hadoop clusters now being able to run interactive q
uerying and streaming data applications along with MapReduce batch jobs.

Combining central resource management with node manager agents that monitor the processi
ng operations of individual cluster nodes has helped to increase the appeal of YARN