1.4. Adjusting Settings for Increasing Numbers of Concurrent Users

As the number of concurrent users increases, keep the number of queues to a minimum and increase the number of sessions in each queue. For example, for 5-10 concurrent users, 2-5 queues with 1-2 sessions each might be adequate. To set 3 queues with 2 sessions for each queue:

hive.server2.tez.default.queues=hive1,hive2,hive3
hive.server2.tez.sessions.per.default.queue=2

If the number of concurrent users increases to 15, you might achieve better performance using 5 queues with 3 sessions per queue:

hive.server2.tez.default.queues=hive1,hive2,hive3,hive4,hive5
hive.server2.tez.sessions.per.default.queue=3

The following table provides general guidelines for the number of queues and sessions for increasing numbers of concurrent users.

 

Table 1.1. Queues and Sessions for Increasing Numbers of Concurrent Users

Number of Users

Number of Concurrent Users

Number of Queues

Number of Sessions per Queue

50

5

2-5

1-2

100

10

5

2

150

15

5

3

200

20

5

4