List of Pages in Category YARN (41 pages)
YARN (Yet Another Resource Negotiator)
A general architecture for running distributed applications. YARN specifies the following components:
- ResourceManager - Manages the global assignment of compute resources to applications.
- ApplicationMaster - Manages the lifecycle of applications.
- NodeManager - Launches and monitors the compute containers on machines in the cluster.
- JobHistory Server - Keeps track of completed applications.
The ApplicationMaster negotiates with the ResourceManager for cluster resources—described in terms of a number of containers, each with a certain memory limit—and then runs application-specific processes in those containers. The containers are overseen by NodeManagers running on cluster nodes, which ensure that the application does not use more resources than it has been allocated.
MapReduce v2 (MRv2) is implemented as a YARN application.
*
C
- Configuring Oozie
- Configuring Spark on YARN for Long-Running Applications
- Configuring Sqoop 2
- Configuring TLS/SSL for HDFS, YARN and MapReduce
- Configuring YARN Security
)D
I
- Impala Resource Management
- Installing CDH 5 with YARN on a Single Linux Node in Pseudo-distributed mode
- Integrated Resource Management with YARN
J
M
- Managing MapReduce and YARN
- Managing the Impala Llama ApplicationMaster
- Managing YARN
- MapReduce (MRv1) and YARN (MRv2) High Availability
- MapReduce 2.0 (YARN)
- Migrating from MapReduce 1 (MRv1) to MapReduce 2 (MRv2, YARN)
- Monitoring YARN Applications
N
R
- REQUEST_POOL Query Option
- RESERVATION_REQUEST_TIMEOUT Query Option (CDH 5 only)
- ResourceManager Metrics
- Running Spark Applications on YARN
S
- Setting HADOOP_MAPRED_HOME
- Setting HADOOP_MAPRED_HOME
- Step 16: Configure Either MRv1 Security or YARN Security
- Step 2: Verify User Accounts and Groups in CDH 5 Due to Security
T
V
W
Y
- YARN (MR2 Included) Metrics
- YARN (MR2 Included) Properties in CDH 5.0.0
- YARN (MR2 Included) Properties in CDH 5.1.0
- YARN (MR2 Included) Properties in CDH 5.2.0
- YARN (MR2 Included) Properties in CDH 5.3.0
- YARN (MR2 Included) Properties in CDH 5.4.0
- YARN (MR2 Included) Properties in CDH 5.5.0
- YARN (MRv2) ResourceManager High Availability
- YARN ONLY: Container-executor Error Codes
- YARN Pool Metrics