Chapter 2. Hive High Performance Best Practices
The following sections in this chapter describe best practices for increasing Hive performance:
- 1. Hive Architectural Overview
- 2. Hive High Performance Best Practices
- Use the Tez Query Execution Engine
- Use the ORC File Format
- Use Column Statistics and the Cost-Based Optimizer (CBO)
- Design Data Storage Smartly
- Better Workload Management by Using Queues
- Hive Setup for Using Multiple Queues
- Guidelines for Interactive Queues
- Guidelines for a Mix of Batch and Interactive Queues
- Create and Configure YARN Capacity Scheduler Queues
- Refreshing YARN Queues with Changed Settings
- Setting Up Interactive Queues for HDP 2.2
- Hive, Tez, and YARN Settings in Ambari 2.x and HDP 2.x
- Setting Up Queues for Mixed Interactive and Batch Workloads
- 3. Configuring Memory Usage
- 4. Query Optimization