Hive on Spark Executor Nodes
Component | Memory | CPU | Disk | |
---|---|---|---|---|
Hive-on-Spark |
Individual executor heaps should be no larger than 16 GB so machines with more RAM can use multiple executors. |
|
Disk space requirements are driven by scratch space requirements for Spark spill. | |
For more information on how to reserve YARN cores and memory that will be used by Spark executors, refer to the Hive documentation. |