Enabling release of stale metadata

Use Cloudera Manager to enable the release of stale metadata in Impala.

By: Manish Maheshwari, Data Architect and Data Scientist at Cloudera, Inc.

  1. In Cloudera Manager Admin Console, click IMPALA.
  2. Click the Configuration tab.
  3. Search for catalogd.
  4. Scroll down to locate the Catalog Server Command Line Argument Advanced Configuration Snippet (Safety Valve), and enter the following configuration information into the text box:

    --invalidate_tables_timeout_s=28800
    --invalidate_tables_on_memory_pressure=true

    The above sets the Catalog daemon to release metadata after it has not been accessed (not used) in 28,800 seconds or 8 hours.

  5. Search for impalad.
  6. Scroll down to locate the Impala Daemon Command Line Argument Advanced Configuration Snippet (Safety Valve), and enter the following configuration information into the text box:

    --invalidate_tables_timeout_s=28800
    --invalidate_tables_on_memory_pressure=true

    The above sets the Impala daemon to release metadata after it has not been accessed (not used) in 28,800 seconds or 8 hours.

  7. Click Save Changes at the bottom right corner of the page.
  8. Scroll up to the top of the page and click the refresh icon to restart the services so your configuration changes can take effect: