Troubleshooting Crashes Caused by Memory Resource Limit

Default settings for max_map_count can be insufficient for Impala installations that run with many concurrent queries. We recommend increasing max_map_count to avoid potential failures due to exhausting memory mapping limits under heavy load.

Increasing the virtual memory parameter

max_map_count is the OS virtual memory parameter and defines the maximum number of memory map areas that a process can use.

To increase the max_map_countparameter in your OS and to make the above setting durable, refer to your OS documentation.

  • For example, if you are using RHEL 9, add the following line to /etc/sysctl.conf:

    /etc/sysctl.conf:vm.max_map_count=8000000
  • Reload the config as root: sysctl -p.

  • Check the new value: cat /proc/sys/vm/max_map_count.

  • Restart.