Monitoring Dynamic Resource Pools

You can monitor dynamic resource pools. A dynamic resource pool is a named configuration of resources and a policy for scheduling the resources among YARN applications and Impala queries running in the pool.

Dynamic resource pools allow you to schedule and allocate resources to YARN applications and Impala queries based on a user's access to specific pools and the resources available to those pools. If a pool's allocation is not in use, it can be preempted and distributed to other pools. Otherwise, a pool receives a share of resources according to the pool's weight. Access control lists (ACLs) restrict who can submit work to dynamic resource pools and administer them.
  1. To view dynamic resource pools, go to the YARN service.
  2. Click the Resource Pools tab.
  3. Click a duration link at the top right of the charts to change the time period for which the resource usage displays.
    • Status - a summary of the virtual CPU cores and memory that can be allocated by the YARN scheduler.
    • Resource Pools Usage - a list of pools that have been explicitly configured and pools created by YARN, and properties of the pools. The Configuration link takes you to the Dynamic Resource Pool Configuration page.
      • Allocated Memory - The memory assigned to the pool that is currently allocated to applications and queries.
      • Allocated VCores - The number of virtual CPU cores assigned to the pool that are currently allocated to applications and queries.
      • Allocated Containers - The number of YARN containers assigned to the pool whose resources have been allocated.
      • Pending Containers - The number of YARN containers assigned to the pool whose resources are pending.