Impala queries fail
Condition
Impala queries running with high concurrency fail on Cloudera Embedded Container Service (ECS) with the following errors: Invalid or unknown query handle and Invalid session id.
Cause
Impala queries might fail because a single Cloudera Embedded Container Service server may not be able to handle the load. To resolve this issue, enable Cloudera Embedded Container Service High Availability and increase the Cloudera Embedded Container Service server replicas. This process is called promoting the Cloudera Embedded Container Service agents to servers. You must promote only one Cloudera Embedded Container Service agent at a time. This procedure is explained using an example where you promote the Cloudera Embedded Container Service agent on agent1.example.com and then promote the Cloudera Embedded Container Service agent on agent2.example.com.
Solution
-
In Cloudera Manager,
navigate to . Stop the Cloudera Embedded Container Service Agent
running on agent1 and then delete the agent by selecting the respective
option from the Actions for Selected drop-down
menu.
-
In Cloudera Manager,
navigate to and click Add Role
Instances.
-
Add the available host agent1 as an Cloudera Embedded Container Service server in the Add
Role Instances to ECS pop-up. Click
Ok.
-
Click Continue.
-
Start the new Cloudera Embedded Container Service server from Cloudera Embedded Container Service Instances view. For example,
start Cloudera Embedded Container Service Server on agent1.
-
Confirm the node’s status from webUI or the command line by running the
following command:
sudo /var/lib/rancher/rke2/bin/kubectl --kubeconfig=/etc/rancher/rke2/rke2.yaml get nodes
