Hortonworks Docs
»
»
Also available as:
Managing Data Operating System
Introduction
Understanding YARN architecture and features
Application Development
Using the YARN REST APIs to Manage Applications
Collect Application Data with the Timeline Server
Timeline Service 2.0 Overview
Architecture of Timeline Service 2.0
Timeline Service 2.0 Installation
Installation Modes for HBase associated with Timeline Service 2.0
Configure External HBase for Timeline Service 2.0
Enable System Service Mode
Enable System Service Mode On a Newly Installed Cluster
Enable System Service Mode On an Upgraded Cluster
Life cycle management of ats-hbase
Remove ats-hbase before switching between clusters
Publish Application-Specific Data
Application Information for Timeline Service 2.0
REST APIs for Querying Timeline Service 2.0
Timeline Server 1.5 Overview
Upgrade Timeline Server 1.0 to 1.5
Configure the Timeline Server
Enable Generic Data Collection
Configure Per-framework Data Collection
Configure the Timeline Server Store
Configure Timeline Server Security
Run the Timeline Server
Access Generic Data from the Command Line
Publish Per-framework Data in Applications
Application Management
Manage Long-running YARN Applications
Using the YARN Services API
YARN Services API Swagger Specification
Deploying and Managing Services and Microservices on YARN
Launch the Service YARN file
Save the YARN file as Service App
Using the Saved YARN file to Assemble a Complex Service
Managing the YARN service life cycle through the REST API
YARN Services API Examples
Use the YARN CLI to View Logs for Running Applications
Run Multiple MapReduce Versions Using the YARN Distributed Cache
Enable Cross-Origin Support on YARN
Run Docker Containers on YARN
Prerequisites for installing Docker
Recommendations for running Docker containers on YARN
Install Docker
Configure Docker
Configure YARN for running Docker containers
Run Docker on YARN using the YARN services API
Accessing the YARN services examples
Quick start for running YARN services API on Docker containers
Configure Docker Swarm and an Overlay Network
Configure Docker settings for YARN
Run the YARN service on a cluster
Run the YARN service on a Kerberized cluster
Run the YARN service on a non-Kerberized cluster
Add a local Docker registry
Test the local Docker registry
Attaching storage to YARN containers by using CSI
YARN components for CSI support
Configure CSI on YARN
Configure CSI volume processor in ResourceManager
Deploy CSI driver on each NodeManager
Configure YARN CSI driver adapters
Advanced: configure customized CSI driver adapters
Cluster Management
Using Scheduling to Allocate Resources
YARN Resource Allocation
Use CPU Scheduling
Configure CPU Scheduling and Isolation
Configure GPU Scheduling and Isolation
Options to Run Distributed Shell and GPU
GPU support for Docker
Enable GPU Support for Docker on an Ambari Cluster
Enable GPU Support for Docker on a non-Ambari Cluster
Limit CPU Usage with Cgroups
Enable Cgroups
Using Cgroups
Managing Device Plug-ins (Technical Preview)
Use the device plug-in
Prerequisites for using the device plug-in
Enable the device plug-in framework
Configure the device plug-in
Restart YARN and run a job
Node Manager API to query resource allocation
Develop a device plug-in
Prerequisites for developing a device plug-in
Define the device plug-in interface
Implement the DevicePluginScheduler interface
Package the plug-in
Partition a Cluster Using Node Labels
Configure Node Labels
Use Node Labels
Allocating Resources with the Capacity Scheduler
Capacity Scheduler Overview
Enable the Capacity Scheduler
Set up Queues
Hierarchical Queue Characteristics
Scheduling Among Queues
Control Access to Queues with ACLs
Define Queue Mapping Policies
Configure Queue Mapping for Users and Groups to Specific Queues
Configure Queue Mapping for Users and Groups to Queues with the Same Name
Enable Override of Default Queue Mappings
Manage Cluster Capacity with Queues
Set Queue Priorities
Resource Distribution Workflow
Resource Distribution Workflow Example
Set User Limits
Application Reservations
Set Flexible Scheduling Policies
Examples of FIFO and Fair Sharing Policies
Configure Queue Ordering Policies
Best Practices for Ordering Policies
Start and Stop Queues
Set Application Limits
Enable Preemption
Preemption Workflow
Configure Preemption
Enable Priority Scheduling
Configure ACLs for Application Priorities
Enable Intra-Queue Preemption
Properties for Configuring Intra-Queue Preemption
Intra-Queue Preemption Based on Application Priorities
Intra-Queue Preemption based on User Limits
Monitoring Clusters using YARN Web User Interface
Accessing YARN Web User Interface
Monitoring Clusters
Monitoring Queues
Monitoring Applications
Searching an application
Viewing application details
Managing and Monitoring Services
Create New Services
Create a standard service
Create a custom service
Monitoring Flow Activity
Monitoring Nodes
Monitoring GPU metrics
Tools
Fault Tolerance
Configure Work-preserving Restart
Configure the ResourceManager for Work-preserving Restart
Configure NodeManagers for Work-preserving Restart
© 2012-2019, Hortonworks, Inc.
Document licensed under the
Creative Commons Attribution ShareAlike 4.0 License
.
Hortonworks.com
|
Documentation
|
Support
|
Community
