Configuring resource management

If you are experiencing memory issues and notice queries failing, it is recommended that you increase the allocated query memory for the Trino Coordinator and Worker.

  1. Log in to the Cloudera Data Warehouse service as DWAdmin.
  2. Go to the Virtual Warehouses tab, locate the Trino Virtual Warehouse and click > Edit.
    The Trino Virtual Warehouse Details page is displayed.
  3. Click the Configurations tab, select Trino Coordinator, and select trino-config-properties from the Configuration files drop-down menu.
  4. Search for the following properties and modify the values as recommended:
    • query.max-memory — Maximum amount of user memory that can be used by a query across the entire cluster.

      Recommended value: query.max-memory-per-node * number of worker nodes. For example, for 40 nodes, the value is 2560 GB.

    • query.max-memory-per-node — Maximum amount of user memory that can be used by a query on a worker node.

      Recommended value: 64 GB

    Properties to configure resource management for Trino Virtual Warehouse
  5. Click Apply Changes.
  6. From the Configuration tab, click Trino Worker and then select trino-config-properties from the Configuration files drop-down menu.
  7. Search for the same memory related properties that are specified in Step 4 and set the appropriate values.
  8. Click Apply Changes.