Cloudera Docs

Configuring spill memory

During memory intensive queries, if you notice issues related to the spill memory, you can configure certain properties to facilitate running of queries that require memory exceeding per query or per node limits.

  1. Log in to the Cloudera Data Warehouse service as DWAdmin.
  2. Go to the Virtual Warehouses tab, locate the Trino Virtual Warehouse and click > Edit.
    The Trino Virtual Warehouse Details page is displayed.
  3. Click the Configurations tab, select Trino Worker, and select trino-config-properties from the Configuration files drop-down menu.
  4. Click Add Custom Configuration and add the following properties along with the recommended values:
    • query-max-spill-per-node — Maximum spill space that can be used by a single query on a single worker node.

      Recommended value: 100 GB

    • max-spill-per-node — Maximum spill space that can be used by all queries on a single worker node.

      Recommended value: 275 GB

    Configuration settings for Trino spill memory performance.
  5. Click Apply Changes.