As the number of concurrent users increases, keep the number of queues to a minimum and increase the number of sessions in each queue. For example, for 5-10 concurrent users, 2-5 queues with 1-2 sessions each might be adequate. To set 3 queues with 2 sessions for each queue:
hive.server2.tez.default.queues=hive1,hive2,hive3 hive.server2.tez.sessions.per.default.queue=2
If the number of concurrent users increases to 15, you might achieve better performance using 5 queues with 3 sessions per queue:
hive.server2.tez.default.queues=hive1,hive2,hive3,hive4,hive5 hive.server2.tez.sessions.per.default.queue=3
The following table provides general guidelines for the number of queues and sessions for increasing numbers of concurrent users.
Table 1.1. Queues and Sessions for Increasing Numbers of Concurrent Users
Number of Users | Number of Concurrent Users | Number of Queues | Number of Sessions per Queue |
|---|---|---|---|
50 | 5 | 2-5 | 1-2 |
100 | 10 | 5 | 2 |
150 | 15 | 5 | 3 |
200 | 20 | 5 | 4 |
