Configuring Impala coordinator high availability (HA)

A single Impala coordinator might not handle the number of concurrent queries you want to run or provide the memory your queries require. You can configure multiple active coordinates to resolve or mitigate these problems.

You can configure up to five active-active Impala coordinators to run in an Impala Virtual Warehouse. When you create an Impala Virtual Warehouse, you can choose one of the following options:
  • Single coordinator
  • Active-passive coordinators
  • Active-active coordinators
Using two coordinators in active-passive mode, one coordinator is active at a time. If the coordinator goes down, the passive coordinator becomes active.

When using active-active coordinators, the client software uses a cookie to keep a virtual connection to a particular coordinator. When a coordinator disappears for some reason, perhaps due to a coordinator shutting down, then the client software may print the error "Invalid session id" before it automatically reconnects to a new coordinator.

Using active-active coordinators, you can have up to five coordinators running concurrently in active-active mode with a cookie-based load-balancing.

An Impala Web UI appears for each coordinator that you can use for troubleshooting.

Clients who connect to your Impala Virtual Warehouse using multiple coordinators must use the latest Impala shell. The following procedure covers these tasks.

  1. Follow instructions for adding a new Impala Virtual Warehouse.
  2. In New Virtual Warehouse, in High availability (HA), select Enabled (Active-Active).
  3. In Number of Active Coordinators, accept the default of 2, or increase the number of coordinators up to 5.
    You can edit an existing Impala Virtual Warehouse to change the number of active coordinators.
  4. Click Cloudera Data Warehouse > Overview > Web UIand click each Impala Coordinator Web UI link to get information about the coordinator.
  5. In the Impala Virtual Warehouse, click options , and select Copy Impala shell Download command.
    This action copies a command to your clipboard that looks something like this:
    impala-shell --protocol='hs2-http' --ssl -i "tpcds-impala.your_company.com:443"
  6. Provide the command to clients who want to connect to the Impala Virtual Warehouse with multiple coordinators using the Impala shell.
  7. Instruct the client user to update impyla to version compatible with CDW, as listed in Data Warehouse Release Notes in section, “Version mapping”.
    For example, installing/updating impyla 0.18a2, is required to connect to your Virtual Warehouse active-active coordinators in CDW 2021.0.3-b27 or later.
  8. Inform the client that to connect over ODBC to an HA-configured Impala Virtual Warehouse that uses active-active coordinators, you must append impala.session.id to the HTTPAuthCookies connector configuration option of the Cloudera ODBC driver.
    Table 1. HTTPAuthCookies
    Key Name Value Required
    HTTPAuthCookies impala.auth,JESSSIONID,KNOXSESSIONID,impala.session.id Yes