Apache Hive Performance Tuning
Also available as:
PDF

Monitoring Apache Hive performance

You can use Grafana, part of Ambari Metrics, to monitor Hive performance. Grafana includes prebuilt dashboards for advanced visualization of cluster metrics. From these dashboards, you can assess the performance of the system.

Grafana includes the following Hive LLAP dashboards:

  • Hive LLAP Heatmap

    Shows all the nodes that are running LLAP daemons with percentage summaries for available executors and cache. This dashboard enables you to identify the hotspots in the cluster in terms of executors and cache.

  • Hive LLAP Overview

    Shows the aggregated information across all of the clusters: for example, the total cache memory from all the nodes. This dashboard enables you to see that your cluster is configured and running correctly. For example, you might have configured 10 nodes, but see executors and cache indicators for only 8 nodes.

  • Hive LLAP Daemon

    Metrics that show the operating status for a specific Hive LLAP Daemon.

From an issue in the Hive LLAP Overview dashboard, you can go to the LLAP Daemon dashboard and determine which node is having the problem.