Impala Properties in CDH 5.13.0
Role groups:
Impala Catalog Server
Categories:
Advanced
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Catalog Server Command Line Argument Advanced Configuration Snippet (Safety Valve) | For advanced use only, key-value pairs (one on each line) to be added (verbatim) to Catalog Server command line flags. Key names should begin with a hyphen(-). For example: -log_filename=foo.log |
catalogd_cmd_args_safety_valve
|
false | ||
Impala Catalog Server Advanced Configuration Snippet (Safety Valve) for core-site.xml | For advanced use only. A string to be inserted into core-site.xml for this role only. |
catalogd_core_site_safety_valve
|
false | ||
Catalog Server HBase Advanced Configuration Snippet (Safety Valve) | For advanced use only, a string to be inserted into hbase-site.xml for this role only. |
catalogd_hbase_conf_safety_valve
|
false | ||
Catalog Server HDFS Advanced Configuration Snippet (Safety Valve) | For advanced use only, a string to be inserted into hdfs-site.xml for this role only. |
catalogd_hdfs_site_conf_safety_valve
|
false | ||
Catalog Server Hive Advanced Configuration Snippet (Safety Valve) | For advanced use only, a string to be inserted into hive-site.xml for this role only. |
catalogd_hive_conf_safety_valve
|
false | ||
Java Configuration Options for Catalog Server | These arguments will be passed as part of the Java command line. Commonly, garbage collection flags, PermGen, or extra debugging flags would be passed here. Note: When CM version is 6.3.0 or greater, {{JAVA_GC_ARGS}} will be replaced by JVM Garbage Collection arguments based on the runtime Java JVM version. |
catalogd_java_opts
|
false | ||
Impala Catalog Server Environment Advanced Configuration Snippet (Safety Valve) | For advanced use only, key-value pairs (one on each line) to be inserted into a role's environment. Applies to configurations of this role except client configuration. |
CATALOGSERVER_role_env_safety_valve
|
false | ||
Catalog Server Core Dump Directory | Directory where the Catalog Server core dump is placed. |
core_dump_dir
|
/var/log/catalogd |
core_dump_dir
|
false |
Catalog Server Hive Metastore Connection Retries | Number of retry attempts the Catalog Server will make when connecting to the Hive Metastore Server. By default, the Catalog Server waits one second between retries. |
hive.metastore.connect.retries
|
5 |
hive_metastore_connect_retries
|
false |
Catalog Server Hive Metastore Connection Timeout | Timeout for requests to the Hive Metastore Server from Catalog Server. Consider increasing this if you have tables with a lot of metadata and see timeout errors. |
hive.metastore.client.socket.timeout
|
1 hour(s) |
hive_metastore_timeout
|
false |
Load Catalog in Background | If true, loads catalog metadata in the background. If false, metadata is loaded lazily (on access). Only effective in CDH 5 and Impala 1.2.4 and higher. |
load_catalog_in_background
|
false |
load_catalog_in_background
|
false |
Catalog Server Max Breakpad Dump Files | Maximum number of Breakpad dump files stored by Catalog Server Role. |
max_minidumps
|
9 |
max_minidumps
|
false |
Catalog Server Breakpad Dump Directory | Directory for storing Catalog Server Breakpad dumps. |
minidump_path
|
/var/log/impala-minidumps |
minidump_path
|
false |
Heap Dump Directory | Path to directory where heap dumps are generated when java.lang.OutOfMemoryError error is thrown. This directory is automatically created if it does not exist. If this directory already exists, role user must have write access to this directory. If this directory is shared among multiple roles, it should have 1777 permissions. The heap dump files are created with 600 permissions and are owned by the role user. The amount of free space in this directory should be greater than the maximum Java Process heap size configured for this role. |
oom_heap_dump_dir
|
/tmp |
oom_heap_dump_dir
|
false |
Dump Heap When Out of Memory | When set, generates heap dump file when java.lang.OutOfMemoryError is thrown. | true |
oom_heap_dump_enabled
|
true | |
Kill When Out of Memory | When set, a SIGKILL signal is sent to the role process when java.lang.OutOfMemoryError is thrown. | true |
oom_sigkill_enabled
|
true | |
Automatically Restart Process | When set, this role's process is automatically (and transparently) restarted in the event of an unexpected failure. This configuration applies in the time after the Start Wait Timeout period. | true |
process_auto_restart
|
true | |
Enable Metric Collection | Cloudera Manager agent monitors each service and each of its role by publishing metrics to the Cloudera Manager Service Monitor. Setting it to false will stop Cloudera Manager agent from publishing any metric for corresponding service/roles. This is usually helpful for services that generate large amount of metrics which Service Monitor is not able to process. | true |
process_should_monitor
|
true | |
Process Start Retry Attempts | Number of times to try starting a role's process when the process exits before the Start Wait Timeout period. After a process is running beyond the Start Wait Timeout, the retry count is reset. Setting this configuration to zero will prevent restart of the process during the Start Wait Timeout period. | 3 |
process_start_retries
|
false | |
Process Start Wait Timeout | The time in seconds to wait for a role's process to start successfully on a host. Processes which exit/crash before this time will be restarted until reaching the limit specified by the Start Retry Attempts count parameter. Setting this configuration to zero will turn off this feature. | 20 |
process_start_secs
|
false |
Logs
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Catalog Server Log Directory | Directory where Catalog Server will place its log files. |
log_dir
|
/var/log/catalogd |
log_dir
|
false |
Impala Catalog Server Logging Threshold | The minimum log level for Impala Catalog Server logs | INFO |
log_threshold
|
false | |
Catalog Server Verbose Log Level | Verbose logging level for the GLog logger. These messages are always logged at 'INFO' log level, so this setting has no effect if Logging Threshold is set to 'WARN' or above. |
GLOG_v
|
1 |
log_verbose_level
|
false |
Catalog Server Log Buffer Level | Buffer log messages logged at this level or lower (-1 means don't buffer; 0 means buffer INFO only; 1 means buffer WARNING only, ...) |
logbuflevel
|
0 |
logbuflevel
|
false |
Catalog Server Maximum Log Files | The number of log files that are kept for each severity level before all older log files are removed. The number has to be greater than 1 to keep at least the current log file open. If set to 0, all log files are retained and log rotation is effectively disabled. |
max_log_files
|
10 |
max_log_files
|
false |
Impala Catalog Server Max Log Size | The maximum size, in megabytes, per log file for Impala Catalog Server logs. Typically used by log4j or logback. | 200 MiB |
max_log_size
|
false |
Monitoring
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Catalog Server Connectivity Health Test | Enables the health test that verifies the Catalog Server is connected to the StateStore | true |
catalogserver_connectivity_health_enabled
|
false | |
Catalog Server Connectivity Tolerance at Startup | The amount of time to wait for the Catalog Server to fully start up and connect to the StateStore before enforcing the connectivity check. | 3 minute(s) |
catalogserver_connectivity_tolerance
|
false | |
File Descriptor Monitoring Thresholds | The health test thresholds of the number of file descriptors used. Specified as a percentage of file descriptor limit. | Warning: 50.0 %, Critical: 70.0 % |
catalogserver_fd_thresholds
|
false | |
Impala Catalog Server Host Health Test | When computing the overall Impala Catalog Server health, consider the host's health. | true |
catalogserver_host_health_enabled
|
false | |
Impala Catalog Server Process Health Test | Enables the health test that the Impala Catalog Server's process state is consistent with the role configuration | true |
catalogserver_scm_health_enabled
|
false | |
Health Test Startup Tolerance | The amount of time allowed after this role is started that failures of health tests that rely on communication with this role will be tolerated. | 5 minute(s) |
catalogserver_startup_tolerance
|
false | |
Web Metric Collection | Enables the health test that the Cloudera Manager Agent can successfully contact and gather metrics from the web server. | true |
catalogserver_web_metric_collection_enabled
|
false | |
Web Metric Collection Duration | The health test thresholds on the duration of the metrics request to the web server. | Warning: 10 second(s), Critical: Never |
catalogserver_web_metric_collection_thresholds
|
false | |
Enable Health Alerts for this Role | When set, Cloudera Manager will send alerts when the health of this role reaches the threshold specified by the EventServer setting eventserver_health_events_alert_threshold | true |
enable_alerts
|
false | |
Enable Configuration Change Alerts | When set, Cloudera Manager will send alerts when this entity's configuration changes. | false |
enable_config_alerts
|
false | |
Heap Dump Directory Free Space Monitoring Absolute Thresholds | The health test thresholds for monitoring of free space on the filesystem that contains this role's heap dump directory. | Warning: 10 GiB, Critical: 5 GiB |
heap_dump_directory_free_space_absolute_thresholds
|
false | |
Heap Dump Directory Free Space Monitoring Percentage Thresholds | The health test thresholds for monitoring of free space on the filesystem that contains this role's heap dump directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Heap Dump Directory Free Space Monitoring Absolute Thresholds setting is configured. | Warning: Never, Critical: Never |
heap_dump_directory_free_space_percentage_thresholds
|
false | |
Log Directory Free Space Monitoring Absolute Thresholds | The health test thresholds for monitoring of free space on the filesystem that contains this role's log directory. | Warning: 10 GiB, Critical: 5 GiB |
log_directory_free_space_absolute_thresholds
|
false | |
Log Directory Free Space Monitoring Percentage Thresholds | The health test thresholds for monitoring of free space on the filesystem that contains this role's log directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Log Directory Free Space Monitoring Absolute Thresholds setting is configured. | Warning: Never, Critical: Never |
log_directory_free_space_percentage_thresholds
|
false | |
Navigator Audit Failure Thresholds | The health test thresholds for failures encountered when monitoring audits within a recent period specified by the mgmt_navigator_failure_window configuration for the role. The value that can be specified for this threshold is the number of bytes of audits data that is left to be sent to audit server. |
mgmt.navigator.failure.thresholds
|
Warning: Never, Critical: Any |
mgmt_navigator_failure_thresholds
|
false |
Monitoring Period For Audit Failures | The period to review when checking if audits are blocked and not getting processed. |
mgmt.navigator.failure.window
|
20 minute(s) |
mgmt_navigator_failure_window
|
false |
Navigator Audit Pipeline Health Check | Enable test of audit events processing pipeline. This will test if audit events are not getting processed by Audit Server for a role that generates audit. |
mgmt.navigator.status.check.enabled
|
true |
mgmt_navigator_status_check_enabled
|
false |
Metric Filter | Defines a Metric Filter for this role. Cloudera Manager Agents will not send filtered metrics to the Service Monitor. Define the following fields:
jvm_heap_used_mb metric:
{
"includeHealthTestMetricSet": true,
"filterType": "whitelist",
"metrics": ["jvm_heap_used_mb"]
} |
monitoring_metric_filter
|
false | ||
Resident Set Size Thresholds | The health test thresholds on the resident size of the process. | Warning: Never, Critical: Never |
process_resident_set_size_thresholds
|
false | |
Process Swap Memory Thresholds | The health test thresholds on the swap memory usage of the process. This takes precedence over the host level threshold. | Warning: 200 B, Critical: Never |
process_swap_memory_thresholds
|
false | |
Role Triggers | The configured triggers for this role. This is a JSON-formatted list of triggers. These triggers are evaluated as part as the health system. Every trigger expression is parsed, and if the trigger condition is met, the list of actions provided in the trigger expression is executed. Each trigger has the following fields:
[{"triggerName": "sample-trigger",
"triggerExpression": "IF (SELECT fd_open WHERE roleName=$ROLENAME and last(fd_open) > 1500) DO health:bad",
"streamThreshold": 0, "enabled": "true"}] See the trigger rules documentation for more details on how to write triggers using tsquery.The JSON format is evolving and may change and, as a result, backward compatibility is not guaranteed between releases. |
[] |
role_triggers
|
true | |
Unexpected Exits Thresholds | The health test thresholds for unexpected exits encountered within a recent period specified by the unexpected_exits_window configuration for the role. | Warning: Never, Critical: Any |
unexpected_exits_thresholds
|
false | |
Unexpected Exits Monitoring Period | The period to review when computing unexpected exits. | 5 minute(s) |
unexpected_exits_window
|
false |
Other
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Enable Catalog Server Web Server | Enable/Disable Catalog Server web server. This web server contains useful information about Catalog Server daemon. |
enable_webserver
|
true |
catalogd_enable_webserver
|
false |
Performance
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Maximum Process File Descriptors | If configured, overrides the process soft and hard rlimits (also called ulimits) for file descriptors to the configured value. |
rlimit_fds
|
false |
Ports and Addresses
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Catalog Server Service Port | Port where Catalog Server is exported. |
catalog_service_port
|
26000 |
catalog_service_port
|
false |
Catalog Server HTTP Server Port | Port where Catalog Server debug web server runs. |
webserver_port
|
25020 |
catalogserver_webserver_port
|
false |
Resource Management
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Java Heap Size of Catalog Server in Bytes | Maximum size in bytes for the Java Process heap memory. Passed to Java -Xmx. | 4 GiB |
catalogd_embedded_jvm_heapsize
|
false | |
Cgroup CPU Shares | Number of CPU shares to assign to this role. The greater the number of shares, the larger the share of the host's CPUs that will be given to this role when the host experiences CPU contention. Must be between 2 and 262144. Defaults to 1024 for processes not managed by Cloudera Manager. |
cpu.shares
|
1024 |
rm_cpu_shares
|
true |
Custom Control Group Resources (overrides Cgroup settings) | Custom control group resources to assign to this role, which will be enforced by the Linux kernel. These resources should exist on the target hosts, otherwise an error will occur when the process starts. Use the same format as used for arguments to the cgexec command: resource1,resource2:path1 or resource3:path2 For example: 'cpu,memory:my/path blkio:my2/path2' ***These settings override other cgroup settings.*** |
custom.cgroups
|
rm_custom_resources
|
false | |
Cgroup I/O Weight | Weight for the read I/O requests issued by this role. The greater the weight, the higher the priority of the requests when the host experiences I/O contention. Must be between 100 and 1000. Defaults to 1000 for processes not managed by Cloudera Manager. |
blkio.weight
|
500 |
rm_io_weight
|
true |
Cgroup Memory Hard Limit | Hard memory limit to assign to this role, enforced by the Linux kernel. When the limit is reached, the kernel will reclaim pages charged to the process. If reclaiming fails, the kernel may kill the process. Both anonymous as well as page cache pages contribute to the limit. Use a value of -1 to specify no limit. By default processes not managed by Cloudera Manager will have no limit. If the value is -1, Cloudera Manager will not monitor Cgroup memory usage therefore some of the charts will show 'No Data' |
memory.limit_in_bytes
|
-1 MiB |
rm_memory_hard_limit
|
true |
Cgroup Memory Soft Limit | Soft memory limit to assign to this role, enforced by the Linux kernel. When the limit is reached, the kernel will reclaim pages charged to the process if and only if the host is facing memory pressure. If reclaiming fails, the kernel may kill the process. Both anonymous as well as page cache pages contribute to the limit. Use a value of -1 to specify no limit. By default processes not managed by Cloudera Manager will have no limit. If the value is -1, Cloudera Manager will not monitor Cgroup memory usage therefore some of the charts will show 'No Data' |
memory.soft_limit_in_bytes
|
-1 MiB |
rm_memory_soft_limit
|
true |
Security
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Catalog Server Webserver TLS/SSL Server Certificate File (PEM Format) | The path to the TLS/SSL file containing the server certificate key used for TLS/SSL. Used when Catalog Server Webserver is acting as a TLS/SSL server. The certificate file must be in PEM format. |
webserver_certificate_file
|
webserver_certificate_file
|
false | |
Catalog Server Web Server User Password | Password for Catalog Server web server authentication. |
webserver_htpassword_password
|
webserver_htpassword_password
|
false | |
Catalog Server Web Server Username | Username for Catalog Server web server authentication. |
webserver_htpassword_user
|
webserver_htpassword_user
|
false | |
Catalog Server Webserver TLS/SSL Server Private Key File (PEM Format) | The path to the TLS/SSL file containing the private key used for TLS/SSL. Used when Catalog Server Webserver is acting as a TLS/SSL server. The certificate file must be in PEM format. |
webserver_private_key_file
|
webserver_private_key_file
|
false | |
Catalog Server Webserver TLS/SSL Private Key Password | The password for the private key in the Catalog Server Webserver TLS/SSL Server Certificate and Private Key file. If left blank, the private key is not protected by a password. |
webserver_private_key_password_cmd
|
webserver_private_key_password_cmd
|
false |
Stacks Collection
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Stacks Collection Data Retention | The amount of stacks data that is retained. After the retention limit is reached, the oldest data is deleted. |
stacks_collection_data_retention
|
100 MiB |
stacks_collection_data_retention
|
false |
Stacks Collection Directory | The directory in which stacks logs are placed. If not set, stacks are logged into a stacks subdirectory of the role's log directory. |
stacks_collection_directory
|
stacks_collection_directory
|
false | |
Stacks Collection Enabled | Whether or not periodic stacks collection is enabled. |
stacks_collection_enabled
|
false |
stacks_collection_enabled
|
true |
Stacks Collection Frequency | The frequency with which stacks are collected. |
stacks_collection_frequency
|
5.0 second(s) |
stacks_collection_frequency
|
false |
Stacks Collection Method | The method used to collect stacks. The jstack option involves periodically running the jstack command against the role's daemon process. The servlet method is available for those roles that have an HTTP server endpoint exposing the current stacks traces of all threads. When the servlet method is selected, that HTTP endpoint is periodically scraped. |
stacks_collection_method
|
jstack |
stacks_collection_method
|
false |
Suppressions
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Suppress Parameter Validation: Catalog Server Service Port | Whether to suppress configuration warnings produced by the built-in parameter validation for the Catalog Server Service Port parameter. | false |
role_config_suppression_catalog_service_port
|
true | |
Suppress Parameter Validation: Catalog Server Command Line Argument Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Catalog Server Command Line Argument Advanced Configuration Snippet (Safety Valve) parameter. | false |
role_config_suppression_catalogd_cmd_args_safety_valve
|
true | |
Suppress Parameter Validation: Impala Catalog Server Advanced Configuration Snippet (Safety Valve) for core-site.xml | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Catalog Server Advanced Configuration Snippet (Safety Valve) for core-site.xml parameter. | false |
role_config_suppression_catalogd_core_site_safety_valve
|
true | |
Suppress Parameter Validation: Catalog Server HBase Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Catalog Server HBase Advanced Configuration Snippet (Safety Valve) parameter. | false |
role_config_suppression_catalogd_hbase_conf_safety_valve
|
true | |
Suppress Parameter Validation: Catalog Server HDFS Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Catalog Server HDFS Advanced Configuration Snippet (Safety Valve) parameter. | false |
role_config_suppression_catalogd_hdfs_site_conf_safety_valve
|
true | |
Suppress Parameter Validation: Catalog Server Hive Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Catalog Server Hive Advanced Configuration Snippet (Safety Valve) parameter. | false |
role_config_suppression_catalogd_hive_conf_safety_valve
|
true | |
Suppress Parameter Validation: Java Configuration Options for Catalog Server | Whether to suppress configuration warnings produced by the built-in parameter validation for the Java Configuration Options for Catalog Server parameter. | false |
role_config_suppression_catalogd_java_opts
|
true | |
Suppress Parameter Validation: Impala Catalog Server Environment Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Catalog Server Environment Advanced Configuration Snippet (Safety Valve) parameter. | false |
role_config_suppression_catalogserver_role_env_safety_valve
|
true | |
Suppress Parameter Validation: Catalog Server HTTP Server Port | Whether to suppress configuration warnings produced by the built-in parameter validation for the Catalog Server HTTP Server Port parameter. | false |
role_config_suppression_catalogserver_webserver_port
|
true | |
Suppress Configuration Validator: CDH Version Validator | Whether to suppress configuration warnings produced by the CDH Version Validator configuration validator. | false |
role_config_suppression_cdh_version_validator
|
true | |
Suppress Parameter Validation: Catalog Server Core Dump Directory | Whether to suppress configuration warnings produced by the built-in parameter validation for the Catalog Server Core Dump Directory parameter. | false |
role_config_suppression_core_dump_dir
|
true | |
Suppress Parameter Validation: Catalog Server Log Directory | Whether to suppress configuration warnings produced by the built-in parameter validation for the Catalog Server Log Directory parameter. | false |
role_config_suppression_log_dir
|
true | |
Suppress Parameter Validation: Catalog Server Breakpad Dump Directory | Whether to suppress configuration warnings produced by the built-in parameter validation for the Catalog Server Breakpad Dump Directory parameter. | false |
role_config_suppression_minidump_path
|
true | |
Suppress Parameter Validation: Heap Dump Directory | Whether to suppress configuration warnings produced by the built-in parameter validation for the Heap Dump Directory parameter. | false |
role_config_suppression_oom_heap_dump_dir
|
true | |
Suppress Parameter Validation: Custom Control Group Resources (overrides Cgroup settings) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Custom Control Group Resources (overrides Cgroup settings) parameter. | false |
role_config_suppression_rm_custom_resources
|
true | |
Suppress Parameter Validation: Role Triggers | Whether to suppress configuration warnings produced by the built-in parameter validation for the Role Triggers parameter. | false |
role_config_suppression_role_triggers
|
true | |
Suppress Parameter Validation: Stacks Collection Directory | Whether to suppress configuration warnings produced by the built-in parameter validation for the Stacks Collection Directory parameter. | false |
role_config_suppression_stacks_collection_directory
|
true | |
Suppress Parameter Validation: Catalog Server Webserver TLS/SSL Server Certificate File (PEM Format) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Catalog Server Webserver TLS/SSL Server Certificate File (PEM Format) parameter. | false |
role_config_suppression_webserver_certificate_file
|
true | |
Suppress Parameter Validation: Catalog Server Web Server User Password | Whether to suppress configuration warnings produced by the built-in parameter validation for the Catalog Server Web Server User Password parameter. | false |
role_config_suppression_webserver_htpassword_password
|
true | |
Suppress Parameter Validation: Catalog Server Web Server Username | Whether to suppress configuration warnings produced by the built-in parameter validation for the Catalog Server Web Server Username parameter. | false |
role_config_suppression_webserver_htpassword_user
|
true | |
Suppress Parameter Validation: Catalog Server Webserver TLS/SSL Server Private Key File (PEM Format) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Catalog Server Webserver TLS/SSL Server Private Key File (PEM Format) parameter. | false |
role_config_suppression_webserver_private_key_file
|
true | |
Suppress Parameter Validation: Catalog Server Webserver TLS/SSL Private Key Password | Whether to suppress configuration warnings produced by the built-in parameter validation for the Catalog Server Webserver TLS/SSL Private Key Password parameter. | false |
role_config_suppression_webserver_private_key_password_cmd
|
true | |
Suppress Health Test: Audit Pipeline Test | Whether to suppress the results of the Audit Pipeline Test heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_catalogserver_audit_health
|
true | |
Suppress Health Test: StateStore Connectivity | Whether to suppress the results of the StateStore Connectivity heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_catalogserver_connectivity
|
true | |
Suppress Health Test: File Descriptors | Whether to suppress the results of the File Descriptors heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_catalogserver_file_descriptor
|
true | |
Suppress Health Test: Heap Dump Directory Free Space | Whether to suppress the results of the Heap Dump Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_catalogserver_heap_dump_directory_free_space
|
true | |
Suppress Health Test: Host Health | Whether to suppress the results of the Host Health heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_catalogserver_host_health
|
true | |
Suppress Health Test: Log Directory Free Space | Whether to suppress the results of the Log Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_catalogserver_log_directory_free_space
|
true | |
Suppress Health Test: Resident Set Size | Whether to suppress the results of the Resident Set Size heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_catalogserver_memory_rss_health
|
true | |
Suppress Health Test: Process Status | Whether to suppress the results of the Process Status heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_catalogserver_scm_health
|
true | |
Suppress Health Test: Swap Memory Usage | Whether to suppress the results of the Swap Memory Usage heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_catalogserver_swap_memory_usage
|
true | |
Suppress Health Test: Unexpected Exits | Whether to suppress the results of the Unexpected Exits heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_catalogserver_unexpected_exits
|
true | |
Suppress Health Test: Web Server Status | Whether to suppress the results of the Web Server Status heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_catalogserver_web_metric_collection
|
true |
Impala Daemon
Categories:
Advanced
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Abort on Config Error | Abort Impala startup if there are improper configs or running on unsupported hardware. |
abort_on_config_error
|
true |
abort_on_config_error
|
false |
Impala Daemon Core Dump Directory | Directory where an Impala Daemon core dump is placed. |
core_dump_dir
|
/var/log/impalad |
core_dump_dir
|
false |
Impala Daemon Hive Metastore Connection Retries | Number of retry attempts the Impala Daemon will make when connecting to the Hive Metastore Server. By default, the Impala Daemon waits one second between retries. |
hive.metastore.connect.retries
|
5 |
hive_metastore_connect_retries
|
false |
Impala Daemon Hive Metastore Connection Timeout | Timeout for requests to the Hive Metastore Server from Impala. Consider increasing this if you have tables with a lot of metadata and see timeout errors. |
hive.metastore.client.socket.timeout
|
1 hour(s) |
hive_metastore_timeout
|
false |
Impala Daemon HDFS Advanced Configuration Snippet (Safety Valve) | For advanced use only, a string to be inserted into hdfs-site.xml for this role only. |
impala_hdfs_site_conf_safety_valve
|
false | ||
Impala Daemon Hive Advanced Configuration Snippet (Safety Valve) | For advanced use only, a string to be inserted into hive-site.xml for this role only. |
impala_hive_conf_safety_valve
|
false | ||
Impala Daemon Llama Site Advanced Configuration Snippet (Safety Valve) | An XML snippet to append to llama-site.xml for Impala Daemons. This configuration only has effect on Impala versions 1.3 or greater. |
impala_llama_site_conf_safety_valve
|
false | ||
Impala Daemon Command Line Argument Advanced Configuration Snippet (Safety Valve) | For advanced use only, key-value pairs (one on each line) to be added (verbatim) to Impala Daemon command-line flags. Key names should begin with a hyphen(-). For example: -log_filename=foo.log |
impalad_cmd_args_safety_valve
|
false | ||
Impala Daemon Advanced Configuration Snippet (Safety Valve) for core-site.xml | For advanced use only. A string to be inserted into core-site.xml for this role only. |
impalad_core_site_safety_valve
|
false | ||
Impala Daemon Fair Scheduler Advanced Configuration Snippet (Safety Valve) | An XML string to use verbatim for the contents of fair-scheduler.xml for Impala Daemons. This configuration only has effect on Impala versions 1.3 or greater. |
impalad_fair_scheduler_safety_valve
|
false | ||
Impala Daemon HBase Advanced Configuration Snippet (Safety Valve) | For advanced use only, a string to be inserted into hbase-site.xml for this role only. |
impalad_hbase_conf_safety_valve
|
false | ||
Result Cache Maximum Size | Maximum number of query results a client may request to be cached on a per-query basis to support restarting fetches. This option guards against unreasonably large result caches requested by clients. Requests exceeding this maximum will be rejected. |
max_result_cache_size
|
100000 |
impalad_result_cache_max_size
|
false |
Impala Daemon Environment Advanced Configuration Snippet (Safety Valve) | For advanced use only, key-value pairs (one on each line) to be inserted into a role's environment. Applies to configurations of this role except client configuration. |
IMPALAD_role_env_safety_valve
|
false | ||
Llama Maximum Request Attempts | Maximum number of times a request to reserve, expand, or release resources is attempted until the request is cancelled. |
llama_max_request_attempts
|
5 |
llama_max_request_attempts
|
false |
Llama Registration Timeout Seconds | Maximum number of seconds that Impala attempts to register or re-register with Llama. If registration is unsuccessful, Impala cancels the action with an error, which could result in an impalad startup failure or a cancelled query. A setting of -1 seconds means try indefinitely. |
llama_registration_timeout_secs
|
30 second(s) |
llama_registration_timeout_secs
|
false |
Llama Registration Wait Seconds | Number of seconds to wait between attempts during Llama registration. |
llama_registration_wait_secs
|
3 second(s) |
llama_registration_wait_secs
|
false |
Impala Daemon Logging Advanced Configuration Snippet (Safety Valve) | For advanced use only, a string to be inserted into log4j.properties for this role only. |
log4j_safety_valve
|
false | ||
Impala Daemon Max Breakpad Dump Files | Maximum number of Breakpad dump files stored by Impala Daemon Role. |
max_minidumps
|
9 |
max_minidumps
|
false |
Impala Daemon Breakpad Dump Directory | Directory for storing Impala Daemon Breakpad dumps. |
minidump_path
|
/var/log/impala-minidumps |
minidump_path
|
false |
Automatically Restart Process | When set, this role's process is automatically (and transparently) restarted in the event of an unexpected failure. This configuration applies in the time after the Start Wait Timeout period. | true |
process_auto_restart
|
true | |
Enable Metric Collection | Cloudera Manager agent monitors each service and each of its role by publishing metrics to the Cloudera Manager Service Monitor. Setting it to false will stop Cloudera Manager agent from publishing any metric for corresponding service/roles. This is usually helpful for services that generate large amount of metrics which Service Monitor is not able to process. | true |
process_should_monitor
|
true | |
Process Start Retry Attempts | Number of times to try starting a role's process when the process exits before the Start Wait Timeout period. After a process is running beyond the Start Wait Timeout, the retry count is reset. Setting this configuration to zero will prevent restart of the process during the Start Wait Timeout period. | 3 |
process_start_retries
|
false | |
Process Start Wait Timeout | The time in seconds to wait for a role's process to start successfully on a host. Processes which exit/crash before this time will be restarted until reaching the limit specified by the Start Retry Attempts count parameter. Setting this configuration to zero will turn off this feature. | 20 |
process_start_secs
|
false |
Logs
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Impala Daemon Audit Log Directory | The directory in which Impala daemon audit event log files are written. If "Impala Audit Event Generation" property is enabled, Impala will generate its audit logs in this directory. |
audit_event_log_dir
|
/var/log/impalad/audit |
audit_event_log_dir
|
true |
Enable Impala Audit Event Generation | Enables audit event generation by Impala daemons. The audit log file will be placed in the directory specified by 'Impala Daemon Audit Log Directory' parameter. |
enable_audit_event_log
|
false |
enable_audit_event_log
|
false |
Enable Impala Lineage Generation | Enables lineage generation by Impala daemons. The lineage log file is placed in the directory specified by the 'Impala Daemon Lineage Log Directory' parameter. |
enable_lineage_log
|
true |
enable_lineage_log
|
false |
Impala Daemon Lineage Log Directory | The directory in which Impala daemon lineage log files are written. If "Impala Lineage Generation" property is enabled, Impala generates its lineage logs in this directory. |
lineage_event_log_dir
|
/var/log/impalad/lineage |
lineage_event_log_dir
|
true |
Impala Daemon Log Directory | Directory where Impala Daemon will place its log files. |
log_dir
|
/var/log/impalad |
log_dir
|
false |
Impala Daemon Logging Threshold | The minimum log level for Impala Daemon logs | INFO |
log_threshold
|
false | |
Impala Daemon Verbose Log Level | Verbose logging level for the GLog logger. These messages are always logged at 'INFO' log level, so this setting has no effect if Logging Threshold is set to 'WARN' or above. |
GLOG_v
|
1 |
log_verbose_level
|
false |
Impala Daemon Log Buffer Level | Buffer log messages logged at this level or lower (-1 means don't buffer; 0 means buffer INFO only; 1 means buffer WARNING only, ...) |
logbuflevel
|
0 |
logbuflevel
|
false |
Impala Daemon Maximum Audit Log File Size | The maximum size (in queries) of the Impala Daemon audit event log file before a new one is created. |
max_audit_event_log_file_size
|
5000 line(s) |
max_audit_event_log_file_size
|
false |
Impala Daemon Maximum Lineage Log File Size | The maximum size (in entries) of the Impala daemon lineage log file before a new one is created. |
max_lineage_log_file_size
|
5000 line(s) |
max_lineage_log_file_size
|
false |
Impala Maximum Log Files | The number of log files that are kept for each severity level before all older log files are removed. The number has to be greater than 1 to keep at least the current log file open. If set to 0, all log files are retained and log rotation is effectively disabled. |
max_log_files
|
10 |
max_log_files
|
false |
Impala Daemon Max Log Size | The maximum size, in megabytes, per log file for Impala Daemon logs. Typically used by log4j or logback. | 200 MiB |
max_log_size
|
false |
Monitoring
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Enable Health Alerts for this Role | When set, Cloudera Manager will send alerts when the health of this role reaches the threshold specified by the EventServer setting eventserver_health_events_alert_threshold | true |
enable_alerts
|
false | |
Enable Configuration Change Alerts | When set, Cloudera Manager will send alerts when this entity's configuration changes. | false |
enable_config_alerts
|
false | |
Query Monitoring Timeout | The timeout used by the Cloudera Manager Agent's query monitor when communicating with the Impala Daemon web server, specified in seconds. | 5.0 second(s) |
executing_queries_timeout_seconds
|
false | |
Heap Dump Directory Free Space Monitoring Absolute Thresholds | The health test thresholds for monitoring of free space on the filesystem that contains this role's heap dump directory. | Warning: 10 GiB, Critical: 5 GiB |
heap_dump_directory_free_space_absolute_thresholds
|
false | |
Heap Dump Directory Free Space Monitoring Percentage Thresholds | The health test thresholds for monitoring of free space on the filesystem that contains this role's heap dump directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Heap Dump Directory Free Space Monitoring Absolute Thresholds setting is configured. | Warning: Never, Critical: Never |
heap_dump_directory_free_space_percentage_thresholds
|
false | |
Query Monitoring Failures Thresholds | The health test thresholds for failures encountered when monitoring queries within a recent period specified by the impala_query_monitoring_failure_window configuration for the role. | Warning: Never, Critical: Any |
impala_query_monitoring_failure_thresholds
|
false | |
Monitoring Period For Query Monitoring Failures | The period to review when computing query monitoring failures. | 5 minute(s) |
impala_query_monitoring_failure_window
|
false | |
Impala Daemon Query Collection Status Health Check | Enables the health check that determines if query collection for the Impala Daemon is successful. | true |
impala_query_monitoring_status_check_enabled
|
false | |
Impala Daemon Connectivity Health Test | Enables the health test that verifies the Impala Daemon is connected to the StateStore. | true |
impalad_connectivity_health_enabled
|
false | |
Impala Daemon Connectivity Tolerance at Startup | The amount of time to wait for the Impala Daemon to fully start up and connect to the StateStore before enforcing the connectivity check. | 3 minute(s) |
impalad_connectivity_tolerance
|
false | |
File Descriptor Monitoring Thresholds | The health test thresholds of the number of file descriptors used. Specified as a percentage of file descriptor limit. | Warning: 50.0 %, Critical: 70.0 % |
impalad_fd_thresholds
|
false | |
Impala Daemon Concurrent Client Connections Monitoring Percentage Thresholds | The health check thresholds for monitoring of the number of concurrent client connections to Impala Daemon. Specified as a percentage of the maximum client connections parameter. | Warning: 80.0 %, Critical: 95.0 % |
impalad_frontend_connections_thresholds
|
false | |
Impala Daemon Host Health Test | When computing the overall Impala Daemon health, consider the host's health. | true |
impalad_host_health_enabled
|
false | |
Pause Duration Thresholds | The health test thresholds for the weighted average extra time the pause monitor spent paused. Specified as a percentage of elapsed wall clock time. | Warning: 30.0, Critical: 60.0 |
impalad_pause_duration_thresholds
|
false | |
Pause Duration Monitoring Period | The period to review when computing the moving average of extra time the pause monitor spent paused. | 5 minute(s) |
impalad_pause_duration_window
|
false | |
Impala Daemon Ready Status Health Check | Enables the health check that determines if the Impala daemon is ready to process queries. | true |
impalad_ready_status_check_enabled
|
false | |
Impala Daemon Ready Status Startup Tolerance | The amount of time at Impala Daemon startup allowed for the Impala Daemon to start accepting new queries for processing. | 3 minute(s) |
impalad_ready_status_check_startup_tolerance
|
false | |
Impala Daemon Process Health Test | Enables the health test that the Impala Daemon's process state is consistent with the role configuration | true |
impalad_scm_health_enabled
|
false | |
Impala Daemon Scratch Directories Free Space Monitoring Absolute Thresholds | The health test thresholds for monitoring of free space on the filesystem that contains this role's Impala Daemon Scratch Directories. | Warning: 10 GiB, Critical: 5 GiB |
impalad_scratch_directories_free_space_absolute_thresholds
|
false | |
Impala Daemon Scratch Directories Free Space Monitoring Percentage Thresholds | The health test thresholds for monitoring of free space on the filesystem that contains this role's Impala Daemon Scratch Directories. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Impala Daemon Scratch Directories Free Space Monitoring Absolute Thresholds setting is configured. | Warning: Never, Critical: Never |
impalad_scratch_directories_free_space_percentage_thresholds
|
false | |
Web Metric Collection | Enables the health test that the Cloudera Manager Agent can successfully contact and gather metrics from the web server. | true |
impalad_web_metric_collection_enabled
|
false | |
Web Metric Collection Duration | The health test thresholds on the duration of the metrics request to the web server. | Warning: 10 second(s), Critical: Never |
impalad_web_metric_collection_thresholds
|
false | |
Log Directory Free Space Monitoring Absolute Thresholds | The health test thresholds for monitoring of free space on the filesystem that contains this role's log directory. | Warning: 10 GiB, Critical: 5 GiB |
log_directory_free_space_absolute_thresholds
|
false | |
Log Directory Free Space Monitoring Percentage Thresholds | The health test thresholds for monitoring of free space on the filesystem that contains this role's log directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Log Directory Free Space Monitoring Absolute Thresholds setting is configured. | Warning: Never, Critical: Never |
log_directory_free_space_percentage_thresholds
|
false | |
Navigator Audit Failure Thresholds | The health test thresholds for failures encountered when monitoring audits within a recent period specified by the mgmt_navigator_failure_window configuration for the role. The value that can be specified for this threshold is the number of bytes of audits data that is left to be sent to audit server. |
mgmt.navigator.failure.thresholds
|
Warning: Never, Critical: Any |
mgmt_navigator_failure_thresholds
|
false |
Monitoring Period For Audit Failures | The period to review when checking if audits are blocked and not getting processed. |
mgmt.navigator.failure.window
|
20 minute(s) |
mgmt_navigator_failure_window
|
false |
Navigator Audit Pipeline Health Check | Enable test of audit events processing pipeline. This will test if audit events are not getting processed by Audit Server for a role that generates audit. |
mgmt.navigator.status.check.enabled
|
true |
mgmt_navigator_status_check_enabled
|
false |
Metric Filter | Defines a Metric Filter for this role. Cloudera Manager Agents will not send filtered metrics to the Service Monitor. Define the following fields:
jvm_heap_used_mb metric:
{
"includeHealthTestMetricSet": true,
"filterType": "whitelist",
"metrics": ["jvm_heap_used_mb"]
} |
monitoring_metric_filter
|
false | ||
Resident Set Size Thresholds | The health test thresholds on the resident size of the process. | Warning: Never, Critical: Never |
process_resident_set_size_thresholds
|
false | |
Process Swap Memory Thresholds | The health test thresholds on the swap memory usage of the process. This takes precedence over the host level threshold. | Warning: Any, Critical: Any |
process_swap_memory_thresholds
|
false | |
Query Monitoring Full Sync Period | The full sync period of the Impala query monitor in the Cloudera Manager Agent, specified in minutes. When a full sync is happening, all query profiles are sent over regardless of having been updated or not. If set to zero, a full sync is performed at each polling period. | 2.0 minute(s) |
query_monitoring_full_sync_period_minutes
|
false | |
Query Monitoring Period | The polling period of the Impala query monitor in the Cloudera Manager Agent, specified in seconds. If set to zero, query monitoring is disabled. | 1.0 second(s) |
query_monitoring_period_seconds
|
false | |
Role Triggers | The configured triggers for this role. This is a JSON-formatted list of triggers. These triggers are evaluated as part as the health system. Every trigger expression is parsed, and if the trigger condition is met, the list of actions provided in the trigger expression is executed. Each trigger has the following fields:
[{"triggerName": "sample-trigger",
"triggerExpression": "IF (SELECT fd_open WHERE roleName=$ROLENAME and last(fd_open) > 1500) DO health:bad",
"streamThreshold": 0, "enabled": "true"}] See the trigger rules documentation for more details on how to write triggers using tsquery.The JSON format is evolving and may change and, as a result, backward compatibility is not guaranteed between releases. |
[] |
role_triggers
|
true | |
Unexpected Exits Thresholds | The health test thresholds for unexpected exits encountered within a recent period specified by the unexpected_exits_window configuration for the role. | Warning: Never, Critical: Any |
unexpected_exits_thresholds
|
false | |
Unexpected Exits Monitoring Period | The period to review when computing unexpected exits. | 5 minute(s) |
unexpected_exits_window
|
false |
Other
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Impala Daemon Query Options Advanced Configuration Snippet (Safety Valve) | A list of key-value pairs of additional query options to pass to the Impala Daemon command line, separated by ','. |
default_query_options
|
default_query_options
|
false | |
Impala Daemons Load Balancer | Address of the load balancer used for Impala daemons. Should be specified in host:port format. If this is specified and Kerberos is enabled, Cloudera Manager adds a principal for 'impala/load_balancer_host@realm' to the keytab for all Impala daemons. |
impalad_load_balancer
|
false | ||
Local UDF Library Dir | User-defined function (UDF) libraries are copied from HDFS into this local directory. |
local_library_dir
|
/var/lib/impala/udfs |
local_library_dir
|
false |
Impala Daemon Scratch Directories | Directories where Impala Daemon will write data such as spilling information to disk to free up memory. This can potentially be large amounts of data. |
scratch_dirs
|
scratch_dirs
|
false |
Performance
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Maximum Process File Descriptors | If configured, overrides the process soft and hard rlimits (also called ulimits) for file descriptors to the configured value. |
rlimit_fds
|
false |
Ports and Addresses
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Impala Daemon Backend Port | Port on which thrift-based ImpalaInternalService is exported. |
be_port
|
22000 |
be_port
|
false |
Impala Daemon Beeswax Port | Port on which Beeswax client requests are served by Impala Daemons. |
beeswax_port
|
21000 |
beeswax_port
|
false |
Impala Daemon HiveServer2 Port | Port on which HiveServer2 client requests are served by Impala Daemons via the thrift binary protocol. |
hs2_port
|
21050 |
hs2_port
|
false |
Enable Impala Daemon Web Server | Enable or disable the Impala Daemon web server. This web server contains useful information about Impala Daemon. |
enable_webserver
|
true |
impalad_enable_webserver
|
false |
Impala Daemon HTTP Server Port | Port where Impala debug web server runs. |
webserver_port
|
25000 |
impalad_webserver_port
|
false |
Llama Callback Port | Port where Llama notification callback should be started |
llama_callback_port
|
28000 |
llama_callback_port
|
false |
StateStoreSubscriber Service Port | Port where StateStoreSubscriberService is running. |
state_store_subscriber_port
|
23000 |
state_store_subscriber_port
|
false |
Resource Management
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Impala Daemon Memory Limit | Memory limit for Impala Daemon, enforced by the daemon itself. This limit does not include memory consumed by the daemon's embedded JVM. The Impala Daemon uses up to this amount of memory for query processing, cached data, network buffers, background operations, etc. If exceeded, queries running on the Impala Daemon will be killed until the Impala Daemon is under the memory limit. |
mem_limit
|
impalad_memory_limit
|
false | |
Cgroup CPU Shares | Number of CPU shares to assign to this role. The greater the number of shares, the larger the share of the host's CPUs that will be given to this role when the host experiences CPU contention. Must be between 2 and 262144. Defaults to 1024 for processes not managed by Cloudera Manager. |
cpu.shares
|
1024 |
rm_cpu_shares
|
true |
Custom Control Group Resources (overrides Cgroup settings) | Custom control group resources to assign to this role, which will be enforced by the Linux kernel. These resources should exist on the target hosts, otherwise an error will occur when the process starts. Use the same format as used for arguments to the cgexec command: resource1,resource2:path1 or resource3:path2 For example: 'cpu,memory:my/path blkio:my2/path2' ***These settings override other cgroup settings.*** |
custom.cgroups
|
rm_custom_resources
|
false | |
Cgroup I/O Weight | Weight for the read I/O requests issued by this role. The greater the weight, the higher the priority of the requests when the host experiences I/O contention. Must be between 100 and 1000. Defaults to 1000 for processes not managed by Cloudera Manager. |
blkio.weight
|
500 |
rm_io_weight
|
true |
Cgroup Memory Hard Limit | Hard memory limit to assign to this role, enforced by the Linux kernel. When the limit is reached, the kernel will reclaim pages charged to the process. If reclaiming fails, the kernel may kill the process. Both anonymous as well as page cache pages contribute to the limit. Use a value of -1 to specify no limit. By default processes not managed by Cloudera Manager will have no limit. If the value is -1, Cloudera Manager will not monitor Cgroup memory usage therefore some of the charts will show 'No Data' |
memory.limit_in_bytes
|
-1 MiB |
rm_memory_hard_limit
|
true |
Cgroup Memory Soft Limit | Soft memory limit to assign to this role, enforced by the Linux kernel. When the limit is reached, the kernel will reclaim pages charged to the process if and only if the host is facing memory pressure. If reclaiming fails, the kernel may kill the process. Both anonymous as well as page cache pages contribute to the limit. Use a value of -1 to specify no limit. By default processes not managed by Cloudera Manager will have no limit. If the value is -1, Cloudera Manager will not monitor Cgroup memory usage therefore some of the charts will show 'No Data' |
memory.soft_limit_in_bytes
|
-1 MiB |
rm_memory_soft_limit
|
true |
Security
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Disk Spill Encryption | Encrypt and verify the integrity of all data spilled to disk as part of a query. This feature is only supported for Impala 2.0 and higher and CDH 5.2 and higher (which includes Impala 2.0). |
disk_spill_encryption
|
false |
disk_spill_encryption
|
false |
LDAP Server CA Certificate | The location on disk of the certificate, in .pem format, used to confirm the authenticity of the LDAP server certificate. This is the Certificate Authority (CA) certificate, and it was used to sign the LDAP server certificate. If not set, all certificates are trusted, which means that an attacker could potentially intercept otherwise encrypted usernames and passwords. |
ldap_ca_certificate
|
impalad_ldap_ca_certificate
|
false | |
Impala Daemon Webserver TLS/SSL Server Certificate File (PEM Format) | The path to the TLS/SSL file containing the server certificate key used for TLS/SSL. Used when Impala Daemon Webserver is acting as a TLS/SSL server. The certificate file must be in PEM format. |
webserver_certificate_file
|
webserver_certificate_file
|
false | |
Impala Daemon Web Server User Password | Password for Impala Daemon webserver authentication. |
webserver_htpassword_password
|
webserver_htpassword_password
|
false | |
Impala Daemon Web Server Username | Username for Impala Daemon webserver authentication. |
webserver_htpassword_user
|
webserver_htpassword_user
|
false | |
Impala Daemon Webserver TLS/SSL Server Private Key File (PEM Format) | The path to the TLS/SSL file containing the private key used for TLS/SSL. Used when Impala Daemon Webserver is acting as a TLS/SSL server. The certificate file must be in PEM format. |
webserver_private_key_file
|
webserver_private_key_file
|
false | |
Impala Daemon Webserver TLS/SSL Private Key Password | The password for the private key in the Impala Daemon Webserver TLS/SSL Server Certificate and Private Key file. If left blank, the private key is not protected by a password. |
webserver_private_key_password_cmd
|
webserver_private_key_password_cmd
|
false |
Suppressions
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Suppress Parameter Validation: Impala Daemon Audit Log Directory | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Daemon Audit Log Directory parameter. | false |
role_config_suppression_audit_event_log_dir
|
true | |
Suppress Parameter Validation: Impala Daemon Backend Port | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Daemon Backend Port parameter. | false |
role_config_suppression_be_port
|
true | |
Suppress Parameter Validation: Impala Daemon Beeswax Port | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Daemon Beeswax Port parameter. | false |
role_config_suppression_beeswax_port
|
true | |
Suppress Configuration Validator: CDH Version Validator | Whether to suppress configuration warnings produced by the CDH Version Validator configuration validator. | false |
role_config_suppression_cdh_version_validator
|
true | |
Suppress Parameter Validation: Impala Daemon Core Dump Directory | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Daemon Core Dump Directory parameter. | false |
role_config_suppression_core_dump_dir
|
true | |
Suppress Configuration Validator: Impala Daemon Default Memory Limit Validator | Whether to suppress configuration warnings produced by the Impala Daemon Default Memory Limit Validator configuration validator. | false |
role_config_suppression_default_impalad_memory_limit_validator
|
true | |
Suppress Parameter Validation: Impala Daemon Query Options Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Daemon Query Options Advanced Configuration Snippet (Safety Valve) parameter. | false |
role_config_suppression_default_query_options
|
true | |
Suppress Parameter Validation: Impala Daemon HiveServer2 Port | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Daemon HiveServer2 Port parameter. | false |
role_config_suppression_hs2_port
|
true | |
Suppress Configuration Validator: Impala Audit Enabled Validator | Whether to suppress configuration warnings produced by the Impala Audit Enabled Validator configuration validator. | false |
role_config_suppression_impala_audit_enabled_validator
|
true | |
Suppress Parameter Validation: Impala Daemon HDFS Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Daemon HDFS Advanced Configuration Snippet (Safety Valve) parameter. | false |
role_config_suppression_impala_hdfs_site_conf_safety_valve
|
true | |
Suppress Parameter Validation: Impala Daemon Hive Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Daemon Hive Advanced Configuration Snippet (Safety Valve) parameter. | false |
role_config_suppression_impala_hive_conf_safety_valve
|
true | |
Suppress Configuration Validator: Impala Lineage Enabled Validator | Whether to suppress configuration warnings produced by the Impala Lineage Enabled Validator configuration validator. | false |
role_config_suppression_impala_lineage_enabled_validator
|
true | |
Suppress Parameter Validation: Impala Daemon Llama Site Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Daemon Llama Site Advanced Configuration Snippet (Safety Valve) parameter. | false |
role_config_suppression_impala_llama_site_conf_safety_valve
|
true | |
Suppress Parameter Validation: Impala Daemon Command Line Argument Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Daemon Command Line Argument Advanced Configuration Snippet (Safety Valve) parameter. | false |
role_config_suppression_impalad_cmd_args_safety_valve
|
true | |
Suppress Configuration Validator: Impala Daemon Command Line Arguments Safety Valve Validator | Whether to suppress configuration warnings produced by the Impala Daemon Command Line Arguments Safety Valve Validator configuration validator. | false |
role_config_suppression_impalad_cmd_args_safety_valve_validator
|
true | |
Suppress Parameter Validation: Impala Daemon Advanced Configuration Snippet (Safety Valve) for core-site.xml | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Daemon Advanced Configuration Snippet (Safety Valve) for core-site.xml parameter. | false |
role_config_suppression_impalad_core_site_safety_valve
|
true | |
Suppress Parameter Validation: Impala Daemon Fair Scheduler Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Daemon Fair Scheduler Advanced Configuration Snippet (Safety Valve) parameter. | false |
role_config_suppression_impalad_fair_scheduler_safety_valve
|
true | |
Suppress Parameter Validation: Impala Daemon HBase Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Daemon HBase Advanced Configuration Snippet (Safety Valve) parameter. | false |
role_config_suppression_impalad_hbase_conf_safety_valve
|
true | |
Suppress Parameter Validation: LDAP Server CA Certificate | Whether to suppress configuration warnings produced by the built-in parameter validation for the LDAP Server CA Certificate parameter. | false |
role_config_suppression_impalad_ldap_ca_certificate
|
true | |
Suppress Parameter Validation: Impala Daemons Load Balancer | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Daemons Load Balancer parameter. | false |
role_config_suppression_impalad_load_balancer
|
true | |
Suppress Parameter Validation: Impala Daemon Environment Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Daemon Environment Advanced Configuration Snippet (Safety Valve) parameter. | false |
role_config_suppression_impalad_role_env_safety_valve
|
true | |
Suppress Parameter Validation: Impala Daemon HTTP Server Port | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Daemon HTTP Server Port parameter. | false |
role_config_suppression_impalad_webserver_port
|
true | |
Suppress Parameter Validation: Impala Daemon Lineage Log Directory | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Daemon Lineage Log Directory parameter. | false |
role_config_suppression_lineage_event_log_dir
|
true | |
Suppress Parameter Validation: Llama Callback Port | Whether to suppress configuration warnings produced by the built-in parameter validation for the Llama Callback Port parameter. | false |
role_config_suppression_llama_callback_port
|
true | |
Suppress Parameter Validation: Local UDF Library Dir | Whether to suppress configuration warnings produced by the built-in parameter validation for the Local UDF Library Dir parameter. | false |
role_config_suppression_local_library_dir
|
true | |
Suppress Parameter Validation: Impala Daemon Logging Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Daemon Logging Advanced Configuration Snippet (Safety Valve) parameter. | false |
role_config_suppression_log4j_safety_valve
|
true | |
Suppress Parameter Validation: Impala Daemon Log Directory | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Daemon Log Directory parameter. | false |
role_config_suppression_log_dir
|
true | |
Suppress Parameter Validation: Impala Daemon Breakpad Dump Directory | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Daemon Breakpad Dump Directory parameter. | false |
role_config_suppression_minidump_path
|
true | |
Suppress Parameter Validation: Custom Control Group Resources (overrides Cgroup settings) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Custom Control Group Resources (overrides Cgroup settings) parameter. | false |
role_config_suppression_rm_custom_resources
|
true | |
Suppress Parameter Validation: Role Triggers | Whether to suppress configuration warnings produced by the built-in parameter validation for the Role Triggers parameter. | false |
role_config_suppression_role_triggers
|
true | |
Suppress Parameter Validation: Impala Daemon Scratch Directories | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Daemon Scratch Directories parameter. | false |
role_config_suppression_scratch_dirs
|
true | |
Suppress Parameter Validation: StateStoreSubscriber Service Port | Whether to suppress configuration warnings produced by the built-in parameter validation for the StateStoreSubscriber Service Port parameter. | false |
role_config_suppression_state_store_subscriber_port
|
true | |
Suppress Configuration Validator: Impala Daemon Unlimited Memory Limit Validator | Whether to suppress configuration warnings produced by the Impala Daemon Unlimited Memory Limit Validator configuration validator. | false |
role_config_suppression_unlimited_impalad_memory_limit_validator
|
true | |
Suppress Parameter Validation: Impala Daemon Webserver TLS/SSL Server Certificate File (PEM Format) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Daemon Webserver TLS/SSL Server Certificate File (PEM Format) parameter. | false |
role_config_suppression_webserver_certificate_file
|
true | |
Suppress Parameter Validation: Impala Daemon Web Server User Password | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Daemon Web Server User Password parameter. | false |
role_config_suppression_webserver_htpassword_password
|
true | |
Suppress Parameter Validation: Impala Daemon Web Server Username | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Daemon Web Server Username parameter. | false |
role_config_suppression_webserver_htpassword_user
|
true | |
Suppress Parameter Validation: Impala Daemon Webserver TLS/SSL Server Private Key File (PEM Format) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Daemon Webserver TLS/SSL Server Private Key File (PEM Format) parameter. | false |
role_config_suppression_webserver_private_key_file
|
true | |
Suppress Parameter Validation: Impala Daemon Webserver TLS/SSL Private Key Password | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Daemon Webserver TLS/SSL Private Key Password parameter. | false |
role_config_suppression_webserver_private_key_password_cmd
|
true | |
Suppress Health Test: Audit Pipeline Test | Whether to suppress the results of the Audit Pipeline Test heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_impalad_audit_health
|
true | |
Suppress Health Test: StateStore Connectivity | Whether to suppress the results of the StateStore Connectivity heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_impalad_connectivity
|
true | |
Suppress Health Test: File Descriptors | Whether to suppress the results of the File Descriptors heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_impalad_file_descriptor
|
true | |
Suppress Health Test: Impala Concurrent Client Connections | Whether to suppress the results of the Impala Concurrent Client Connections heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_impalad_frontend_connections
|
true | |
Suppress Health Test: Heap Dump Directory Free Space | Whether to suppress the results of the Heap Dump Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_impalad_heap_dump_directory_free_space
|
true | |
Suppress Health Test: Host Health | Whether to suppress the results of the Host Health heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_impalad_host_health
|
true | |
Suppress Health Test: Log Directory Free Space | Whether to suppress the results of the Log Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_impalad_log_directory_free_space
|
true | |
Suppress Health Test: Resident Set Size | Whether to suppress the results of the Resident Set Size heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_impalad_memory_rss_health
|
true | |
Suppress Health Test: Pause Duration | Whether to suppress the results of the Pause Duration heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_impalad_pause_duration
|
true | |
Suppress Health Test: Query Monitoring Status Check | Whether to suppress the results of the Query Monitoring Status Check heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_impalad_query_monitoring_status
|
true | |
Suppress Health Test: Impala Daemon Ready Check | Whether to suppress the results of the Impala Daemon Ready Check heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_impalad_ready_status
|
true | |
Suppress Health Test: Process Status | Whether to suppress the results of the Process Status heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_impalad_scm_health
|
true | |
Suppress Health Test: Impala Daemon Scratch Directories Free Space | Whether to suppress the results of the Impala Daemon Scratch Directories Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_impalad_scratch_directories_free_space
|
true | |
Suppress Health Test: Swap Memory Usage | Whether to suppress the results of the Swap Memory Usage heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_impalad_swap_memory_usage
|
true | |
Suppress Health Test: Unexpected Exits | Whether to suppress the results of the Unexpected Exits heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_impalad_unexpected_exits
|
true | |
Suppress Health Test: Web Server Status | Whether to suppress the results of the Web Server Status heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_impalad_web_metric_collection
|
true |
Impala Llama ApplicationMaster
Categories:
Advanced
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Enable Resource Caching | Whether Llama should cache allocated resources on release. |
llama.am.cache.enabled
|
true |
llama_am_cache_enabled
|
false |
Resource Caching Idle Timeout | Timeout policy for resources being cached. |
llama.am.cache.eviction.timeout.policy.idle.timeout.ms
|
30 second(s) |
llama_am_cache_eviction_timeout_policy_idle_timeout_ms
|
false |
Anti-Deadlock Backoff Percentage | Percentage of resources that will be backed off by the Impala ApplicationMaster anti-deadlock logic. Random reservations will be backed off until the percentage of backed off resources reaches this percentage. |
llama.am.gang.anti.deadlock.backoff.percent
|
30 % |
llama_am_gang_anti_deadlock_backoff_percent
|
false |
Anti-Deadlock Maximum Delay | Maximum amount of time the backed off reservations will be in 'backed off' state. The actual amount time is a random value between the minimum and the maximum. |
llama.am.gang.anti.deadlock.max_delay_ms
|
30 second(s) |
llama_am_gang_anti_deadlock_max_delay_ms
|
false |
Anti-Deadlock Minimum Delay | Minimum amount of time the backed off reservations will be in 'backed off' state. The actual amount time is a random value between the minimum and the maximum. |
llama.am.gang.anti.deadlock.min_delay_ms
|
10 second(s) |
llama_am_gang_anti_deadlock_min_delay_ms
|
false |
Anti-Deadlock No Allocation Limit Interval | Interval of time without any new allocation that will trigger the Impala ApplicationMaster anti-deadlock logic. |
llama.am.gang.anti.deadlock.no.allocation.limit.ms
|
30 second(s) |
llama_am_gang_anti_deadlock_no_allocation_limit_ms
|
false |
Enable Resource Cache Normalization | Whether to break resource requests into smaller requests of standard size before the resource cache. The sizes are taken from Yarn settings Container Memory Increment and Container Virtual CPU Cores Increment. |
llama.am.resource.normalizing.enabled
|
true |
llama_am_resource_normalizing_enabled
|
false |
Maximum Client Notification Retries | Maximum number of retries for a client notification. After the maximum number of client notification retries has been reached without success the client is considered lost and all its reservations are released. A successful client notification resets the retries count. |
llama.am.server.thrift.client.notifier.max.retries
|
5 |
llama_am_server_thrift_client_notifier_max_retries
|
false |
Client Notification Retry Interval | Client notification retry interval, in milliseconds. |
llama.am.server.thrift.client.notifier.retry.interval.ms
|
5 second(s) |
llama_am_server_thrift_client_notifier_retry_interval_ms
|
false |
Impala Llama ApplicationMaster Advanced Configuration Snippet (Safety Valve) for llama-site.xml | For advanced use only. A string to be inserted into llama-site.xml for this role only. |
llama_config_valve
|
false | ||
Fair Scheduler XML Advanced Configuration Snippet (Safety Valve) | Enter an XML string that will be inserted verbatim into the Fair Scheduler allocations file. Overrides the configuration set using the Pools configuration UI. This configuration only has effect on Impala versions 1.3 or greater. |
llama_fair_scheduler_safety_valve
|
false | ||
Java Configuration Options for Llama Server | These arguments will be passed as part of the Java command line. Commonly, garbage collection flags, PermGen, or extra debugging flags would be passed here. Note: When CM version is 6.3.0 or greater, {{JAVA_GC_ARGS}} will be replaced by JVM Garbage Collection arguments based on the runtime Java JVM version. |
llama_java_opts
|
false | ||
Impala Llama ApplicationMaster Environment Advanced Configuration Snippet (Safety Valve) | For advanced use only, key-value pairs (one on each line) to be inserted into a role's environment. Applies to configurations of this role except client configuration. |
LLAMA_role_env_safety_valve
|
false | ||
Impala Llama ApplicationMaster Logging Advanced Configuration Snippet (Safety Valve) | For advanced use only, a string to be inserted into log4j.properties for this role only. |
log4j_safety_valve
|
false | ||
Heap Dump Directory | Path to directory where heap dumps are generated when java.lang.OutOfMemoryError error is thrown. This directory is automatically created if it does not exist. If this directory already exists, role user must have write access to this directory. If this directory is shared among multiple roles, it should have 1777 permissions. The heap dump files are created with 600 permissions and are owned by the role user. The amount of free space in this directory should be greater than the maximum Java Process heap size configured for this role. |
oom_heap_dump_dir
|
/tmp |
oom_heap_dump_dir
|
false |
Dump Heap When Out of Memory | When set, generates heap dump file when java.lang.OutOfMemoryError is thrown. | true |
oom_heap_dump_enabled
|
true | |
Kill When Out of Memory | When set, a SIGKILL signal is sent to the role process when java.lang.OutOfMemoryError is thrown. | true |
oom_sigkill_enabled
|
true | |
Automatically Restart Process | When set, this role's process is automatically (and transparently) restarted in the event of an unexpected failure. This configuration applies in the time after the Start Wait Timeout period. | true |
process_auto_restart
|
true | |
Llama System Group | The group that the Llama processes should run as. | llama |
process_groupname
|
true | |
Enable Metric Collection | Cloudera Manager agent monitors each service and each of its role by publishing metrics to the Cloudera Manager Service Monitor. Setting it to false will stop Cloudera Manager agent from publishing any metric for corresponding service/roles. This is usually helpful for services that generate large amount of metrics which Service Monitor is not able to process. | true |
process_should_monitor
|
true | |
Process Start Retry Attempts | Number of times to try starting a role's process when the process exits before the Start Wait Timeout period. After a process is running beyond the Start Wait Timeout, the retry count is reset. Setting this configuration to zero will prevent restart of the process during the Start Wait Timeout period. | 3 |
process_start_retries
|
false | |
Process Start Wait Timeout | The time in seconds to wait for a role's process to start successfully on a host. Processes which exit/crash before this time will be restarted until reaching the limit specified by the Start Retry Attempts count parameter. Setting this configuration to zero will turn off this feature. | 20 |
process_start_secs
|
false | |
Llama System User | The user that the Llama process should run as. | llama |
process_username
|
true |
Logs
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Llama Log Directory | Directory where Llama will place its log files. |
llama_log_dir
|
/var/log/impala-llama |
llama_log_dir
|
false |
Impala Llama ApplicationMaster Logging Threshold | The minimum log level for Impala Llama ApplicationMaster logs | INFO |
log_threshold
|
false | |
Impala Llama ApplicationMaster Maximum Log File Backups | The maximum number of rolled log files to keep for Impala Llama ApplicationMaster logs. Typically used by log4j or logback. | 10 |
max_log_backup_index
|
false | |
Impala Llama ApplicationMaster Max Log Size | The maximum size, in megabytes, per log file for Impala Llama ApplicationMaster logs. Typically used by log4j or logback. | 200 MiB |
max_log_size
|
false |
Monitoring
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Enable Health Alerts for this Role | When set, Cloudera Manager will send alerts when the health of this role reaches the threshold specified by the EventServer setting eventserver_health_events_alert_threshold | true |
enable_alerts
|
false | |
Enable Configuration Change Alerts | When set, Cloudera Manager will send alerts when this entity's configuration changes. | false |
enable_config_alerts
|
false | |
Heap Dump Directory Free Space Monitoring Absolute Thresholds | The health test thresholds for monitoring of free space on the filesystem that contains this role's heap dump directory. | Warning: 10 GiB, Critical: 5 GiB |
heap_dump_directory_free_space_absolute_thresholds
|
false | |
Heap Dump Directory Free Space Monitoring Percentage Thresholds | The health test thresholds for monitoring of free space on the filesystem that contains this role's heap dump directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Heap Dump Directory Free Space Monitoring Absolute Thresholds setting is configured. | Warning: Never, Critical: Never |
heap_dump_directory_free_space_percentage_thresholds
|
false | |
File Descriptor Monitoring Thresholds | The health test thresholds of the number of file descriptors used. Specified as a percentage of file descriptor limit. | Warning: 50.0 %, Critical: 70.0 % |
llama_fd_thresholds
|
false | |
Impala Llama ApplicationMaster Host Health Test | When computing the overall Impala Llama ApplicationMaster health, consider the host's health. | true |
llama_host_health_enabled
|
false | |
Impala Llama ApplicationMaster Process Health Test | Enables the health test that the Impala Llama ApplicationMaster's process state is consistent with the role configuration | true |
llama_scm_health_enabled
|
false | |
Log Directory Free Space Monitoring Absolute Thresholds | The health test thresholds for monitoring of free space on the filesystem that contains this role's log directory. | Warning: 10 GiB, Critical: 5 GiB |
log_directory_free_space_absolute_thresholds
|
false | |
Log Directory Free Space Monitoring Percentage Thresholds | The health test thresholds for monitoring of free space on the filesystem that contains this role's log directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Log Directory Free Space Monitoring Absolute Thresholds setting is configured. | Warning: Never, Critical: Never |
log_directory_free_space_percentage_thresholds
|
false | |
Navigator Audit Failure Thresholds | The health test thresholds for failures encountered when monitoring audits within a recent period specified by the mgmt_navigator_failure_window configuration for the role. The value that can be specified for this threshold is the number of bytes of audits data that is left to be sent to audit server. |
mgmt.navigator.failure.thresholds
|
Warning: Never, Critical: Any |
mgmt_navigator_failure_thresholds
|
false |
Monitoring Period For Audit Failures | The period to review when checking if audits are blocked and not getting processed. |
mgmt.navigator.failure.window
|
20 minute(s) |
mgmt_navigator_failure_window
|
false |
Navigator Audit Pipeline Health Check | Enable test of audit events processing pipeline. This will test if audit events are not getting processed by Audit Server for a role that generates audit. |
mgmt.navigator.status.check.enabled
|
true |
mgmt_navigator_status_check_enabled
|
false |
Metric Filter | Defines a Metric Filter for this role. Cloudera Manager Agents will not send filtered metrics to the Service Monitor. Define the following fields:
jvm_heap_used_mb metric:
{
"includeHealthTestMetricSet": true,
"filterType": "whitelist",
"metrics": ["jvm_heap_used_mb"]
} |
monitoring_metric_filter
|
false | ||
Process Swap Memory Thresholds | The health test thresholds on the swap memory usage of the process. This takes precedence over the host level threshold. | Warning: 200 B, Critical: Never |
process_swap_memory_thresholds
|
false | |
Role Triggers | The configured triggers for this role. This is a JSON-formatted list of triggers. These triggers are evaluated as part as the health system. Every trigger expression is parsed, and if the trigger condition is met, the list of actions provided in the trigger expression is executed. Each trigger has the following fields:
[{"triggerName": "sample-trigger",
"triggerExpression": "IF (SELECT fd_open WHERE roleName=$ROLENAME and last(fd_open) > 1500) DO health:bad",
"streamThreshold": 0, "enabled": "true"}] See the trigger rules documentation for more details on how to write triggers using tsquery.The JSON format is evolving and may change and, as a result, backward compatibility is not guaranteed between releases. |
[] |
role_triggers
|
true | |
Unexpected Exits Thresholds | The health test thresholds for unexpected exits encountered within a recent period specified by the unexpected_exits_window configuration for the role. | Warning: Never, Critical: Any |
unexpected_exits_thresholds
|
false | |
Unexpected Exits Monitoring Period | The period to review when computing unexpected exits. | 5 minute(s) |
unexpected_exits_window
|
false |
Other
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Core Queues | Queues Llama ApplicationMaster should connect to at start up. |
llama.am.core.queues
|
llama_am_core_queues
|
false | |
Administrative Interface ACLs | ACL for Impala ApplicationMaster admins. The ACL is a comma-separated list of user and group names. The user and group list is separated by a blank. For e.g. "alice,bob users,wheel". A special value of "*" means all users are allowed. These take effect only if security is enabled. |
llama.am.server.thrift.admin.acl
|
* |
llama_am_server_thrift_admin_acl
|
false |
Client ACLs | ACL for Impala ApplicationMaster clients. The ACL is a comma-separated list of user and group names. The user and group list is separated by a blank. For e.g. "alice,bob users,wheel". A special value of "*" means all users are allowed. These take effect only if security is enabled. |
llama.am.server.thrift.client.acl
|
* |
llama_am_server_thrift_client_acl
|
false |
Performance
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Queue Expiration Age | Time in milliseconds after which Llama will discard its AM for a queue that has been empty of reservations. Does not apply to queues specified with the Core Queues property. |
llama.am.queue.expire.ms
|
5 minute(s) |
llama_am_queue_expire_ms
|
false |
AM Heartbeat Interval | Llama ApplicationMaster heartbeat interval, in milliseconds. On each heartbeat the ApplicationMaster submits new reservations to YARN ResourceManager and gets updates from it. |
llama.am.server.thrift.client.notifier.heartbeat.ms
|
5 second(s) |
llama_am_server_thrift_client_notifier_heartbeat_ms
|
false |
Thrift Server Maximum Threads | Maximum number of threads used by the Llama ApplicationMaster auxiliary service uses for serving client requests. |
llama.am.server.thrift.server.max.threads
|
50 |
llama_am_server_thrift_server_max_threads
|
false |
Thrift Server Minimum Threads | Minimum number of threads used by the Llama ApplicationMaster auxiliary service uses for serving client requests. |
llama.am.server.thrift.server.min.threads
|
10 |
llama_am_server_thrift_server_min_threads
|
false |
Thrift Transport Timeout | Socket time, in milliseconds, used Llama ApplicationMaster auxiliary service for all its server and client Thrift connections. |
llama.am.server.thrift.transport.timeout.ms
|
1 minute(s) |
llama_am_server_thrift_transport_timeout_ms
|
false |
Maximum Process File Descriptors | If configured, overrides the process soft and hard rlimits (also called ulimits) for file descriptors to the configured value. |
rlimit_fds
|
false |
Ports and Addresses
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Llama Thrift Admin Port | Port on which the Llama ApplicationMaster listens to administrative requests on its administrative Thrift interface. |
llama.am.server.thrift.admin.address
|
15002 |
llama_am_server_thrift_admin_address
|
false |
Bind Impala Llama ApplicationMaster to Wildcard Address | If enabled, the Impala Llama ApplicationMaster binds to the wildcard address ("0.0.0.0") on all of its ports. | false |
llama_bind_wildcard
|
false | |
Llama HTTP Port | Port on which the Llama ApplicationMaster listens to HTTP requests. |
llama.am.server.thrift.http.address
|
15001 |
llama_http_port
|
false |
Llama Thrift Port | Port on which the Llama ApplicationMaster serves its Thrift interface. |
llama.am.server.thrift.address
|
15000 |
llama_port
|
false |
Resource Management
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Java Heap Size of Impala Llama ApplicationMaster in Bytes | Maximum size in bytes for the Java Process heap memory. Passed to Java -Xmx. | 256 MiB |
llama_java_heapsize
|
false | |
Cgroup CPU Shares | Number of CPU shares to assign to this role. The greater the number of shares, the larger the share of the host's CPUs that will be given to this role when the host experiences CPU contention. Must be between 2 and 262144. Defaults to 1024 for processes not managed by Cloudera Manager. |
cpu.shares
|
1024 |
rm_cpu_shares
|
true |
Custom Control Group Resources (overrides Cgroup settings) | Custom control group resources to assign to this role, which will be enforced by the Linux kernel. These resources should exist on the target hosts, otherwise an error will occur when the process starts. Use the same format as used for arguments to the cgexec command: resource1,resource2:path1 or resource3:path2 For example: 'cpu,memory:my/path blkio:my2/path2' ***These settings override other cgroup settings.*** |
custom.cgroups
|
rm_custom_resources
|
false | |
Cgroup I/O Weight | Weight for the read I/O requests issued by this role. The greater the weight, the higher the priority of the requests when the host experiences I/O contention. Must be between 100 and 1000. Defaults to 1000 for processes not managed by Cloudera Manager. |
blkio.weight
|
500 |
rm_io_weight
|
true |
Cgroup Memory Hard Limit | Hard memory limit to assign to this role, enforced by the Linux kernel. When the limit is reached, the kernel will reclaim pages charged to the process. If reclaiming fails, the kernel may kill the process. Both anonymous as well as page cache pages contribute to the limit. Use a value of -1 to specify no limit. By default processes not managed by Cloudera Manager will have no limit. If the value is -1, Cloudera Manager will not monitor Cgroup memory usage therefore some of the charts will show 'No Data' |
memory.limit_in_bytes
|
-1 MiB |
rm_memory_hard_limit
|
true |
Cgroup Memory Soft Limit | Soft memory limit to assign to this role, enforced by the Linux kernel. When the limit is reached, the kernel will reclaim pages charged to the process if and only if the host is facing memory pressure. If reclaiming fails, the kernel may kill the process. Both anonymous as well as page cache pages contribute to the limit. Use a value of -1 to specify no limit. By default processes not managed by Cloudera Manager will have no limit. If the value is -1, Cloudera Manager will not monitor Cgroup memory usage therefore some of the charts will show 'No Data' |
memory.soft_limit_in_bytes
|
-1 MiB |
rm_memory_soft_limit
|
true |
Security
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Role-Specific Kerberos Principal | Kerberos principal used by the Impala Llama ApplicationMaster roles. | llama |
kerberos_role_princ_name
|
true |
Stacks Collection
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Stacks Collection Data Retention | The amount of stacks data that is retained. After the retention limit is reached, the oldest data is deleted. |
stacks_collection_data_retention
|
100 MiB |
stacks_collection_data_retention
|
false |
Stacks Collection Directory | The directory in which stacks logs are placed. If not set, stacks are logged into a stacks subdirectory of the role's log directory. |
stacks_collection_directory
|
stacks_collection_directory
|
false | |
Stacks Collection Enabled | Whether or not periodic stacks collection is enabled. |
stacks_collection_enabled
|
false |
stacks_collection_enabled
|
true |
Stacks Collection Frequency | The frequency with which stacks are collected. |
stacks_collection_frequency
|
5.0 second(s) |
stacks_collection_frequency
|
false |
Stacks Collection Method | The method used to collect stacks. The jstack option involves periodically running the jstack command against the role's daemon process. The servlet method is available for those roles that have an HTTP server endpoint exposing the current stacks traces of all threads. When the servlet method is selected, that HTTP endpoint is periodically scraped. |
stacks_collection_method
|
jstack |
stacks_collection_method
|
false |
Suppressions
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Suppress Configuration Validator: CDH Version Validator | Whether to suppress configuration warnings produced by the CDH Version Validator configuration validator. | false |
role_config_suppression_cdh_version_validator
|
true | |
Suppress Parameter Validation: Role-Specific Kerberos Principal | Whether to suppress configuration warnings produced by the built-in parameter validation for the Role-Specific Kerberos Principal parameter. | false |
role_config_suppression_kerberos_role_princ_name
|
true | |
Suppress Parameter Validation: Core Queues | Whether to suppress configuration warnings produced by the built-in parameter validation for the Core Queues parameter. | false |
role_config_suppression_llama_am_core_queues
|
true | |
Suppress Parameter Validation: Administrative Interface ACLs | Whether to suppress configuration warnings produced by the built-in parameter validation for the Administrative Interface ACLs parameter. | false |
role_config_suppression_llama_am_server_thrift_admin_acl
|
true | |
Suppress Parameter Validation: Llama Thrift Admin Port | Whether to suppress configuration warnings produced by the built-in parameter validation for the Llama Thrift Admin Port parameter. | false |
role_config_suppression_llama_am_server_thrift_admin_address
|
true | |
Suppress Parameter Validation: Client ACLs | Whether to suppress configuration warnings produced by the built-in parameter validation for the Client ACLs parameter. | false |
role_config_suppression_llama_am_server_thrift_client_acl
|
true | |
Suppress Parameter Validation: Impala Llama ApplicationMaster Advanced Configuration Snippet (Safety Valve) for llama-site.xml | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Llama ApplicationMaster Advanced Configuration Snippet (Safety Valve) for llama-site.xml parameter. | false |
role_config_suppression_llama_config_valve
|
true | |
Suppress Parameter Validation: Fair Scheduler XML Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Fair Scheduler XML Advanced Configuration Snippet (Safety Valve) parameter. | false |
role_config_suppression_llama_fair_scheduler_safety_valve
|
true | |
Suppress Parameter Validation: Llama HTTP Port | Whether to suppress configuration warnings produced by the built-in parameter validation for the Llama HTTP Port parameter. | false |
role_config_suppression_llama_http_port
|
true | |
Suppress Parameter Validation: Java Configuration Options for Llama Server | Whether to suppress configuration warnings produced by the built-in parameter validation for the Java Configuration Options for Llama Server parameter. | false |
role_config_suppression_llama_java_opts
|
true | |
Suppress Parameter Validation: Llama Log Directory | Whether to suppress configuration warnings produced by the built-in parameter validation for the Llama Log Directory parameter. | false |
role_config_suppression_llama_log_dir
|
true | |
Suppress Parameter Validation: Llama Thrift Port | Whether to suppress configuration warnings produced by the built-in parameter validation for the Llama Thrift Port parameter. | false |
role_config_suppression_llama_port
|
true | |
Suppress Parameter Validation: Impala Llama ApplicationMaster Environment Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Llama ApplicationMaster Environment Advanced Configuration Snippet (Safety Valve) parameter. | false |
role_config_suppression_llama_role_env_safety_valve
|
true | |
Suppress Parameter Validation: Impala Llama ApplicationMaster Logging Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Llama ApplicationMaster Logging Advanced Configuration Snippet (Safety Valve) parameter. | false |
role_config_suppression_log4j_safety_valve
|
true | |
Suppress Parameter Validation: Heap Dump Directory | Whether to suppress configuration warnings produced by the built-in parameter validation for the Heap Dump Directory parameter. | false |
role_config_suppression_oom_heap_dump_dir
|
true | |
Suppress Parameter Validation: Llama System Group | Whether to suppress configuration warnings produced by the built-in parameter validation for the Llama System Group parameter. | false |
role_config_suppression_process_groupname
|
true | |
Suppress Parameter Validation: Llama System User | Whether to suppress configuration warnings produced by the built-in parameter validation for the Llama System User parameter. | false |
role_config_suppression_process_username
|
true | |
Suppress Parameter Validation: Custom Control Group Resources (overrides Cgroup settings) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Custom Control Group Resources (overrides Cgroup settings) parameter. | false |
role_config_suppression_rm_custom_resources
|
true | |
Suppress Parameter Validation: Role Triggers | Whether to suppress configuration warnings produced by the built-in parameter validation for the Role Triggers parameter. | false |
role_config_suppression_role_triggers
|
true | |
Suppress Parameter Validation: Stacks Collection Directory | Whether to suppress configuration warnings produced by the built-in parameter validation for the Stacks Collection Directory parameter. | false |
role_config_suppression_stacks_collection_directory
|
true | |
Suppress Health Test: Audit Pipeline Test | Whether to suppress the results of the Audit Pipeline Test heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_llama_audit_health
|
true | |
Suppress Health Test: File Descriptors | Whether to suppress the results of the File Descriptors heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_llama_file_descriptor
|
true | |
Suppress Health Test: Heap Dump Directory Free Space | Whether to suppress the results of the Heap Dump Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_llama_heap_dump_directory_free_space
|
true | |
Suppress Health Test: Host Health | Whether to suppress the results of the Host Health heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_llama_host_health
|
true | |
Suppress Health Test: Log Directory Free Space | Whether to suppress the results of the Log Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_llama_log_directory_free_space
|
true | |
Suppress Health Test: Process Status | Whether to suppress the results of the Process Status heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_llama_scm_health
|
true | |
Suppress Health Test: Swap Memory Usage | Whether to suppress the results of the Swap Memory Usage heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_llama_swap_memory_usage
|
true | |
Suppress Health Test: Unexpected Exits | Whether to suppress the results of the Unexpected Exits heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_llama_unexpected_exits
|
true |
Impala StateStore
Categories:
Advanced
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
StateStore Core Dump Directory | Directory where a StateStore core dump is placed. |
core_dump_dir
|
/var/log/statestore |
core_dump_dir
|
false |
Statestore Max Breakpad Dump Files | Maximum number of Breakpad dump files stored by Statestore Role. |
max_minidumps
|
9 |
max_minidumps
|
false |
Statestore Breakpad Dump Directory | Directory for storing Statestore Breakpad dumps. |
minidump_path
|
/var/log/impala-minidumps |
minidump_path
|
false |
Automatically Restart Process | When set, this role's process is automatically (and transparently) restarted in the event of an unexpected failure. This configuration applies in the time after the Start Wait Timeout period. | true |
process_auto_restart
|
true | |
Enable Metric Collection | Cloudera Manager agent monitors each service and each of its role by publishing metrics to the Cloudera Manager Service Monitor. Setting it to false will stop Cloudera Manager agent from publishing any metric for corresponding service/roles. This is usually helpful for services that generate large amount of metrics which Service Monitor is not able to process. | true |
process_should_monitor
|
true | |
Process Start Retry Attempts | Number of times to try starting a role's process when the process exits before the Start Wait Timeout period. After a process is running beyond the Start Wait Timeout, the retry count is reset. Setting this configuration to zero will prevent restart of the process during the Start Wait Timeout period. | 3 |
process_start_retries
|
false | |
Process Start Wait Timeout | The time in seconds to wait for a role's process to start successfully on a host. Processes which exit/crash before this time will be restarted until reaching the limit specified by the Start Retry Attempts count parameter. Setting this configuration to zero will turn off this feature. | 20 |
process_start_secs
|
false | |
Statestore Command Line Argument Advanced Configuration Snippet (Safety Valve) | For advanced use only, key-value pairs (one on each line) to be added (verbatim) to StateStore command line flags. |
statestore_cmd_args_safety_valve
|
false | ||
Impala StateStore Environment Advanced Configuration Snippet (Safety Valve) | For advanced use only, key-value pairs (one on each line) to be inserted into a role's environment. Applies to configurations of this role except client configuration. |
STATESTORE_role_env_safety_valve
|
false |
Logs
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
StateStore Log Directory | Directory where StateStore will place its log files. |
log_dir
|
/var/log/statestore |
log_dir
|
false |
Impala StateStore Logging Threshold | The minimum log level for Impala StateStore logs | INFO |
log_threshold
|
false | |
StateStore Verbose Log Level | Verbose logging level for the GLog logger. These messages are always logged at 'INFO' log level, so this setting has no effect if Logging Threshold is set to 'WARN' or above. |
GLOG_v
|
1 |
log_verbose_level
|
false |
StateStore Log Buffer Level | Buffer log messages logged at this level or lower (-1 means don't buffer; 0 means buffer INFO only; 1 means buffer WARNING only, ...) |
logbuflevel
|
0 |
logbuflevel
|
false |
StateStore Maximum Log Files | The number of log files that are kept for each severity level before all older log files are removed. The number has to be greater than 1 to keep at least the current log file open. If set to 0, all log files are retained and log rotation is effectively disabled. |
max_log_files
|
10 |
max_log_files
|
false |
Impala StateStore Max Log Size | The maximum size, in megabytes, per log file for Impala StateStore logs. Typically used by log4j or logback. | 200 MiB |
max_log_size
|
false |
Monitoring
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Enable Health Alerts for this Role | When set, Cloudera Manager will send alerts when the health of this role reaches the threshold specified by the EventServer setting eventserver_health_events_alert_threshold | true |
enable_alerts
|
false | |
Enable Configuration Change Alerts | When set, Cloudera Manager will send alerts when this entity's configuration changes. | false |
enable_config_alerts
|
false | |
Heap Dump Directory Free Space Monitoring Absolute Thresholds | The health test thresholds for monitoring of free space on the filesystem that contains this role's heap dump directory. | Warning: 10 GiB, Critical: 5 GiB |
heap_dump_directory_free_space_absolute_thresholds
|
false | |
Heap Dump Directory Free Space Monitoring Percentage Thresholds | The health test thresholds for monitoring of free space on the filesystem that contains this role's heap dump directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Heap Dump Directory Free Space Monitoring Absolute Thresholds setting is configured. | Warning: Never, Critical: Never |
heap_dump_directory_free_space_percentage_thresholds
|
false | |
Log Directory Free Space Monitoring Absolute Thresholds | The health test thresholds for monitoring of free space on the filesystem that contains this role's log directory. | Warning: 10 GiB, Critical: 5 GiB |
log_directory_free_space_absolute_thresholds
|
false | |
Log Directory Free Space Monitoring Percentage Thresholds | The health test thresholds for monitoring of free space on the filesystem that contains this role's log directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Log Directory Free Space Monitoring Absolute Thresholds setting is configured. | Warning: Never, Critical: Never |
log_directory_free_space_percentage_thresholds
|
false | |
Navigator Audit Failure Thresholds | The health test thresholds for failures encountered when monitoring audits within a recent period specified by the mgmt_navigator_failure_window configuration for the role. The value that can be specified for this threshold is the number of bytes of audits data that is left to be sent to audit server. |
mgmt.navigator.failure.thresholds
|
Warning: Never, Critical: Any |
mgmt_navigator_failure_thresholds
|
false |
Monitoring Period For Audit Failures | The period to review when checking if audits are blocked and not getting processed. |
mgmt.navigator.failure.window
|
20 minute(s) |
mgmt_navigator_failure_window
|
false |
Navigator Audit Pipeline Health Check | Enable test of audit events processing pipeline. This will test if audit events are not getting processed by Audit Server for a role that generates audit. |
mgmt.navigator.status.check.enabled
|
true |
mgmt_navigator_status_check_enabled
|
false |
Metric Filter | Defines a Metric Filter for this role. Cloudera Manager Agents will not send filtered metrics to the Service Monitor. Define the following fields:
jvm_heap_used_mb metric:
{
"includeHealthTestMetricSet": true,
"filterType": "whitelist",
"metrics": ["jvm_heap_used_mb"]
} |
monitoring_metric_filter
|
false | ||
Resident Set Size Thresholds | The health test thresholds on the resident size of the process. | Warning: Never, Critical: Never |
process_resident_set_size_thresholds
|
false | |
Process Swap Memory Thresholds | The health test thresholds on the swap memory usage of the process. This takes precedence over the host level threshold. | Warning: 200 B, Critical: Never |
process_swap_memory_thresholds
|
false | |
Role Triggers | The configured triggers for this role. This is a JSON-formatted list of triggers. These triggers are evaluated as part as the health system. Every trigger expression is parsed, and if the trigger condition is met, the list of actions provided in the trigger expression is executed. Each trigger has the following fields:
[{"triggerName": "sample-trigger",
"triggerExpression": "IF (SELECT fd_open WHERE roleName=$ROLENAME and last(fd_open) > 1500) DO health:bad",
"streamThreshold": 0, "enabled": "true"}] See the trigger rules documentation for more details on how to write triggers using tsquery.The JSON format is evolving and may change and, as a result, backward compatibility is not guaranteed between releases. |
[] |
role_triggers
|
true | |
File Descriptor Monitoring Thresholds | The health test thresholds of the number of file descriptors used. Specified as a percentage of file descriptor limit. | Warning: 50.0 %, Critical: 70.0 % |
statestore_fd_thresholds
|
false | |
Impala StateStore Host Health Test | When computing the overall Impala StateStore health, consider the host's health. | true |
statestore_host_health_enabled
|
false | |
Impala StateStore Process Health Test | Enables the health test that the Impala StateStore's process state is consistent with the role configuration | true |
statestore_scm_health_enabled
|
false | |
Health Test Startup Tolerance | The amount of time allowed after this role is started that failures of health tests that rely on communication with this role will be tolerated. | 5 minute(s) |
statestore_startup_tolerance
|
false | |
Web Metric Collection | Enables the health test that the Cloudera Manager Agent can successfully contact and gather metrics from the web server. | true |
statestore_web_metric_collection_enabled
|
false | |
Web Metric Collection Duration | The health test thresholds on the duration of the metrics request to the web server. | Warning: 10 second(s), Critical: Never |
statestore_web_metric_collection_thresholds
|
false | |
Unexpected Exits Thresholds | The health test thresholds for unexpected exits encountered within a recent period specified by the unexpected_exits_window configuration for the role. | Warning: Never, Critical: Any |
unexpected_exits_thresholds
|
false | |
Unexpected Exits Monitoring Period | The period to review when computing unexpected exits. | 5 minute(s) |
unexpected_exits_window
|
false |
Other
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Enable StateStore Web Server | Enable/Disable StateStore web server. This web server contains useful information about StateStore daemon. |
enable_webserver
|
true |
statestore_enable_webserver
|
false |
Performance
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Maximum Process File Descriptors | If configured, overrides the process soft and hard rlimits (also called ulimits) for file descriptors to the configured value. |
rlimit_fds
|
false | ||
StateStore Worker Threads | Number of worker threads for the thread manager underlying the StateStore Thrift server. |
state_store_num_server_worker_threads
|
4 |
state_store_num_server_worker_threads
|
false |
Maximum StateStore Pending Tasks | Maximum number of tasks allowed to be pending at the thread manager underlying the StateStore Thrift server (0 allows infinitely many pending tasks) |
state_store_pending_task_count_max
|
0 |
state_store_pending_task_count_max
|
false |
Ports and Addresses
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
StateStore Service Port | Port where StateStoreService is exported. |
state_store_port
|
24000 |
state_store_port
|
false |
StateStore HTTP Server Port | Port where StateStore debug web server runs. |
webserver_port
|
25010 |
statestore_webserver_port
|
false |
Resource Management
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Cgroup CPU Shares | Number of CPU shares to assign to this role. The greater the number of shares, the larger the share of the host's CPUs that will be given to this role when the host experiences CPU contention. Must be between 2 and 262144. Defaults to 1024 for processes not managed by Cloudera Manager. |
cpu.shares
|
1024 |
rm_cpu_shares
|
true |
Custom Control Group Resources (overrides Cgroup settings) | Custom control group resources to assign to this role, which will be enforced by the Linux kernel. These resources should exist on the target hosts, otherwise an error will occur when the process starts. Use the same format as used for arguments to the cgexec command: resource1,resource2:path1 or resource3:path2 For example: 'cpu,memory:my/path blkio:my2/path2' ***These settings override other cgroup settings.*** |
custom.cgroups
|
rm_custom_resources
|
false | |
Cgroup I/O Weight | Weight for the read I/O requests issued by this role. The greater the weight, the higher the priority of the requests when the host experiences I/O contention. Must be between 100 and 1000. Defaults to 1000 for processes not managed by Cloudera Manager. |
blkio.weight
|
500 |
rm_io_weight
|
true |
Cgroup Memory Hard Limit | Hard memory limit to assign to this role, enforced by the Linux kernel. When the limit is reached, the kernel will reclaim pages charged to the process. If reclaiming fails, the kernel may kill the process. Both anonymous as well as page cache pages contribute to the limit. Use a value of -1 to specify no limit. By default processes not managed by Cloudera Manager will have no limit. If the value is -1, Cloudera Manager will not monitor Cgroup memory usage therefore some of the charts will show 'No Data' |
memory.limit_in_bytes
|
-1 MiB |
rm_memory_hard_limit
|
true |
Cgroup Memory Soft Limit | Soft memory limit to assign to this role, enforced by the Linux kernel. When the limit is reached, the kernel will reclaim pages charged to the process if and only if the host is facing memory pressure. If reclaiming fails, the kernel may kill the process. Both anonymous as well as page cache pages contribute to the limit. Use a value of -1 to specify no limit. By default processes not managed by Cloudera Manager will have no limit. If the value is -1, Cloudera Manager will not monitor Cgroup memory usage therefore some of the charts will show 'No Data' |
memory.soft_limit_in_bytes
|
-1 MiB |
rm_memory_soft_limit
|
true |
Security
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
StateStore Webserver TLS/SSL Server Certificate File (PEM Format) | The path to the TLS/SSL file containing the server certificate key used for TLS/SSL. Used when StateStore Webserver is acting as a TLS/SSL server. The certificate file must be in PEM format. |
webserver_certificate_file
|
webserver_certificate_file
|
false | |
Statestore Web Server User Password | Password for Statestore webserver authentication. |
webserver_htpassword_password
|
webserver_htpassword_password
|
false | |
Statestore Web Server Username | Username for Statestore webserver authentication. |
webserver_htpassword_user
|
webserver_htpassword_user
|
false | |
StateStore Webserver TLS/SSL Server Private Key File (PEM Format) | The path to the TLS/SSL file containing the private key used for TLS/SSL. Used when StateStore Webserver is acting as a TLS/SSL server. The certificate file must be in PEM format. |
webserver_private_key_file
|
webserver_private_key_file
|
false | |
StateStore Webserver TLS/SSL Private Key Password | The password for the private key in the StateStore Webserver TLS/SSL Server Certificate and Private Key file. If left blank, the private key is not protected by a password. |
webserver_private_key_password_cmd
|
webserver_private_key_password_cmd
|
false |
Suppressions
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Suppress Configuration Validator: CDH Version Validator | Whether to suppress configuration warnings produced by the CDH Version Validator configuration validator. | false |
role_config_suppression_cdh_version_validator
|
true | |
Suppress Parameter Validation: StateStore Core Dump Directory | Whether to suppress configuration warnings produced by the built-in parameter validation for the StateStore Core Dump Directory parameter. | false |
role_config_suppression_core_dump_dir
|
true | |
Suppress Parameter Validation: StateStore Log Directory | Whether to suppress configuration warnings produced by the built-in parameter validation for the StateStore Log Directory parameter. | false |
role_config_suppression_log_dir
|
true | |
Suppress Parameter Validation: Statestore Breakpad Dump Directory | Whether to suppress configuration warnings produced by the built-in parameter validation for the Statestore Breakpad Dump Directory parameter. | false |
role_config_suppression_minidump_path
|
true | |
Suppress Parameter Validation: Custom Control Group Resources (overrides Cgroup settings) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Custom Control Group Resources (overrides Cgroup settings) parameter. | false |
role_config_suppression_rm_custom_resources
|
true | |
Suppress Parameter Validation: Role Triggers | Whether to suppress configuration warnings produced by the built-in parameter validation for the Role Triggers parameter. | false |
role_config_suppression_role_triggers
|
true | |
Suppress Parameter Validation: StateStore Service Port | Whether to suppress configuration warnings produced by the built-in parameter validation for the StateStore Service Port parameter. | false |
role_config_suppression_state_store_port
|
true | |
Suppress Parameter Validation: Statestore Command Line Argument Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Statestore Command Line Argument Advanced Configuration Snippet (Safety Valve) parameter. | false |
role_config_suppression_statestore_cmd_args_safety_valve
|
true | |
Suppress Parameter Validation: Impala StateStore Environment Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala StateStore Environment Advanced Configuration Snippet (Safety Valve) parameter. | false |
role_config_suppression_statestore_role_env_safety_valve
|
true | |
Suppress Parameter Validation: StateStore HTTP Server Port | Whether to suppress configuration warnings produced by the built-in parameter validation for the StateStore HTTP Server Port parameter. | false |
role_config_suppression_statestore_webserver_port
|
true | |
Suppress Parameter Validation: StateStore Webserver TLS/SSL Server Certificate File (PEM Format) | Whether to suppress configuration warnings produced by the built-in parameter validation for the StateStore Webserver TLS/SSL Server Certificate File (PEM Format) parameter. | false |
role_config_suppression_webserver_certificate_file
|
true | |
Suppress Parameter Validation: Statestore Web Server User Password | Whether to suppress configuration warnings produced by the built-in parameter validation for the Statestore Web Server User Password parameter. | false |
role_config_suppression_webserver_htpassword_password
|
true | |
Suppress Parameter Validation: Statestore Web Server Username | Whether to suppress configuration warnings produced by the built-in parameter validation for the Statestore Web Server Username parameter. | false |
role_config_suppression_webserver_htpassword_user
|
true | |
Suppress Parameter Validation: StateStore Webserver TLS/SSL Server Private Key File (PEM Format) | Whether to suppress configuration warnings produced by the built-in parameter validation for the StateStore Webserver TLS/SSL Server Private Key File (PEM Format) parameter. | false |
role_config_suppression_webserver_private_key_file
|
true | |
Suppress Parameter Validation: StateStore Webserver TLS/SSL Private Key Password | Whether to suppress configuration warnings produced by the built-in parameter validation for the StateStore Webserver TLS/SSL Private Key Password parameter. | false |
role_config_suppression_webserver_private_key_password_cmd
|
true | |
Suppress Health Test: Audit Pipeline Test | Whether to suppress the results of the Audit Pipeline Test heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_statestore_audit_health
|
true | |
Suppress Health Test: File Descriptors | Whether to suppress the results of the File Descriptors heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_statestore_file_descriptor
|
true | |
Suppress Health Test: Heap Dump Directory Free Space | Whether to suppress the results of the Heap Dump Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_statestore_heap_dump_directory_free_space
|
true | |
Suppress Health Test: Host Health | Whether to suppress the results of the Host Health heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_statestore_host_health
|
true | |
Suppress Health Test: Log Directory Free Space | Whether to suppress the results of the Log Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_statestore_log_directory_free_space
|
true | |
Suppress Health Test: Resident Set Size | Whether to suppress the results of the Resident Set Size heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_statestore_memory_rss_health
|
true | |
Suppress Health Test: Process Status | Whether to suppress the results of the Process Status heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_statestore_scm_health
|
true | |
Suppress Health Test: Swap Memory Usage | Whether to suppress the results of the Swap Memory Usage heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_statestore_swap_memory_usage
|
true | |
Suppress Health Test: Unexpected Exits | Whether to suppress the results of the Unexpected Exits heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_statestore_unexpected_exits
|
true | |
Suppress Health Test: Web Server Status | Whether to suppress the results of the Web Server Status heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
role_health_suppression_statestore_web_metric_collection
|
true |
Service-Wide
Categories:
Admission Control
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Enable Dynamic Resource Pools | Use Dynamic Resource Pools to configure Impala admission control or RM for this Impala service. These features are only supported in Impala 1.3 or higher deployments. | true |
admission_control_enabled
|
false | |
Admission Control Queue Timeout | Maximum amount of time (in milliseconds) that a request waits to be admitted before timing out. Must be a positive integer. |
queue_wait_timeout_ms
|
1 minute(s) |
admission_control_queue_timeout
|
false |
Single Pool Max Queued Queries | Configures the maximum number of queued queries for admission control when using a single pool. -1 or 0 disables queuing, i.e. incoming requests are rejected if they can not be executed immediately. Ignored when Dynamic Resource Pools for Admission Control is enabled. |
default_pool_max_queued
|
200 |
admission_control_single_pool_max_queued
|
false |
Single Pool Max Running Queries | Configures the maximum number of concurrently running queries for admission control when using a single pool. -1 indicates no limit and 0 indicates all incoming requests will be rejected. Ignored when Dynamic Resource Pools for Admission Control is enabled. |
default_pool_max_requests
|
200 |
admission_control_single_pool_max_requests
|
false |
Single Pool Mem Limit | Configures the max memory of running queries for admission control when using a single pool. -1 or 0 indicates no limit. Ignored when Dynamic Resource Pools for Admission Control is enabled. |
default_pool_mem_limit
|
-1 B |
admission_control_single_pool_mem_limit
|
false |
Enable Impala Admission Control | Use Impala Admission Control to throttle Impala requests. Unless 'Enable Dynamic Resource Pools' is enabled, Impala uses a single, default pool that is configured using the Single Pool configurations below. These features are only supported in Impala 1.3 or higher deployments. | true |
all_admission_control_enabled
|
false |
Advanced
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Impala Service Advanced Configuration Snippet (Safety Valve) for atlas-application.properties | For advanced use only, a string to be inserted into atlas-application.properties. Applies to configurations of all roles in this service except client configuration. |
application_properties_safety_valve
|
false | ||
Enable Core Dump | Used to generate a core dump to get more information about an Impala crash. Unless otherwise configured systemwide using /proc/sys/kernel/core_pattern, the dump is generated in the 'current directory' of the Impala process (usually a subdirectory of the /var/run/cloudera-scm-agent/process directory). The core file can be very large. | false |
enable_core_dump
|
false | |
Maximum HBase Client Retries | Maximum number of HBase client retries for Impala. Used as a maximum for all operations such as fetching of the root region from the root RegionServer, getting a cell's value, and starting a row update. Overrides configuration in the HBase service. |
hbase.client.retries.number
|
3 |
hbase_client_retries_number
|
false |
HBase RPC Timeout | Timeout in milliseconds for all HBase RPCs made by Impala. Overrides configuration in HBase service. |
hbase.rpc.timeout
|
3 second(s) |
hbase_rpc_timeout
|
false |
Impala Command Line Argument Advanced Configuration Snippet (Safety Valve) | For advanced use only, key-value pairs (one on each line) to be added (verbatim) to Impala Daemon command-line flags. Applies to all roles in this service. Key names should begin with a hyphen(-). For example: -log_filename=foo.log |
impala_cmd_args_safety_valve
|
false | ||
Fair Scheduler Configuration Rules (Deployed) | A list specifying the rules to run to determine which Fair Scheduler configuration to use. The value specified here is deployed to all hosts. This configuration has effect only on Impala versions 1.3 or greater. | [] |
impala_schedule_rules
|
false | |
Fair Scheduler Configuration Rules (Staged) | A list specifying the rules to run to determine which Fair Scheduler configuration to use. Typically edited using the Rules configuration UI. This configuration only has effect on Impala versions 1.3 or greater. |
impala_schedule_rules_draft
|
false | ||
Fair Scheduler Allocations (Deployed) | JSON representation of all the configurations that the Fair Scheduler can take across all schedules. This configuration has effect only on Impala versions 1.3 or greater. | queues: [ name: root, queues: [ name: default, queues: [], schedulablePropertiesList: [ scheduleName: default ] ], schedulablePropertiesList: [ scheduleName: default ] ], users: [] |
impala_scheduled_allocations
|
false | |
Fair Scheduler Allocations (Staged) | JSON representation of all the configurations that the Fair Scheduler can take across all schedules. Typically edited using the Pools configuration UI. This configuration only has effect on Impala versions 1.3 or greater. |
impala_scheduled_allocations_draft
|
false | ||
Impala Service Environment Advanced Configuration Snippet (Safety Valve) | For advanced use only, key-value pairs (one on each line) to be inserted into a role's environment. Applies to configurations of all roles in this service except client configuration. |
impala_service_env_safety_valve
|
false | ||
Impala Service Advanced Configuration Snippet (Safety Valve) for sentry-site.xml | For advanced use only, a string to be inserted into sentry-site.xml. Applies to configurations of all roles in this service except client configuration. |
impalad_sentry_safety_valve
|
false | ||
Use HDFS Rules to Map Kerberos Principals to Short Names | If checked and Impala is using Kerberos, Impala will use the hadoop.security.auth_to_local rules from HDFS configuration. The relevant HDFS configuration is derived from Additional Rules to Map Kerberos Principals to Short Names. |
load_auth_to_local_rules
|
false |
load_hdfs_auth_to_local_rules
|
false |
Impala Client Advanced Configuration Snippet (Safety Valve) for navigator.client.properties | For advanced use only, a string to be inserted into the client configuration for navigator.client.properties. |
navigator_client_config_safety_valve
|
false | ||
Impala Client Advanced Configuration Snippet (Safety Valve) for navigator.lineage.client.properties | For advanced use only, a string to be inserted into the client configuration for navigator.lineage.client.properties. |
navigator_lineage_client_config_safety_valve
|
false | ||
Impala System Group (except Llama) | The group that this Impala's processes should run as (except Llama, which has its own group). | impala |
process_groupname
|
true | |
Impala System User (except Llama) | The user that this Impala's processes should run as (except Llama, which has its own user). | impala |
process_username
|
true | |
Use Debug Build | Use debug build of Impala binaries when starting roles. Useful when performing diagnostic activities to get more information in the stacktrace or core dump. | false |
use_debug_build
|
false |
Monitoring
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Admin Users Query List Visibility Settings | Controls which queries admin users can see in the queries list view | ALL |
admin_query_list_settings
|
true | |
Enable Service Level Health Alerts | When set, Cloudera Manager will send alerts when the health of this service reaches the threshold specified by the EventServer setting eventserver_health_events_alert_threshold | true |
enable_alerts
|
false | |
Enable Configuration Change Alerts | When set, Cloudera Manager will send alerts when this entity's configuration changes. | false |
enable_config_alerts
|
false | |
Impala Catalog Server Role Health Test | When computing the overall IMPALA health, consider Impala Catalog Server's health | true |
impala_catalogserver_health_enabled
|
false | |
Healthy Impala Daemon Monitoring Thresholds | The health test thresholds of the overall Impala Daemon health. The check returns "Concerning" health if the percentage of "Healthy" Impala Daemons falls below the warning threshold. The check is unhealthy if the total percentage of "Healthy" and "Concerning" Impala Daemons falls below the critical threshold. | Warning: 95.0 %, Critical: 90.0 % |
impala_impalads_healthy_thresholds
|
false | |
Healthy Impala Llama ApplicationMaster Monitoring Thresholds | The health test thresholds of the overall Impala Llama ApplicationMaster health. The check returns "Concerning" health if the percentage of "Healthy" Impala Llama ApplicationMasters falls below the warning threshold. The check is unhealthy if the total percentage of "Healthy" and "Concerning" Impala Llama ApplicationMasters falls below the critical threshold. | Warning: 99.0 %, Critical: 51.0 % |
impala_llamas_healthy_thresholds
|
false | |
Impala Query Aggregates | Controls the aggregate metrics generated for Impala queries. The structure is a JSON list of the attributes to aggregate and the entities to aggregate to. For example, if the attributeName is 'hdfs_bytes_read' and the aggregationTargets is ['USER'] then the Service Monitor will create the metric 'impala_query_hdfs_bytes_read_rate' and, every ten minutes, will record the total hdfs bytes read for each user across all their Impala queries. By default it will also record the number of queries issues ('num_impala_queries_rate') for both users and pool. For a full list of the supported attributes see the Impala search page. Note that the valid aggregation targets are USER, YARN_POOL, and IMPALA (the service), and that these aggregate metrics can be viewed on both the reports and charts search pages. | [ attributeName: hdfs_bytes_read, aggregationTargets: [USER, IMPALA_POOL_USER, IMPALA_POOL, IMPALA, CLUSTER] , attributeName: hdfs_bytes_written, aggregationTargets: [USER, IMPALA_POOL_USER, IMPALA_POOL, IMPALA, CLUSTER] , attributeName: thread_cpu_time, aggregationTargets: [USER, IMPALA_POOL_USER, IMPALA_POOL, IMPALA, CLUSTER] , attributeName: bytes_streamed, aggregationTargets: [USER, IMPALA_POOL_USER, IMPALA_POOL, IMPALA, CLUSTER] , attributeName: cm_cpu_milliseconds, aggregationTargets: [USER, IMPALA_POOL_USER, IMPALA_POOL, IMPALA, CLUSTER] , attributeName: query_duration, aggregationTargets: [USER, IMPALA_POOL_USER, IMPALA_POOL, IMPALA, CLUSTER] , attributeName: admission_wait, aggregationTargets: [USER, IMPALA_POOL_USER, IMPALA_POOL, IMPALA, CLUSTER] , attributeName: memory_accrual, aggregationTargets: [USER, IMPALA_POOL_USER, IMPALA_POOL, IMPALA, CLUSTER] , attributeName: thread_cpu_time, aggregationTargets: [USER, IMPALA_POOL_USER, IMPALA_POOL, IMPALA, CLUSTER] , attributeName: memory_spilled, aggregationTargets: [USER, IMPALA_POOL_USER, IMPALA_POOL, IMPALA, CLUSTER] ] |
impala_query_aggregates
|
false | |
Impala StateStore Role Health Test | When computing the overall IMPALA health, consider Impala StateStore's health | true |
impala_statestore_health_enabled
|
false | |
Service Triggers | The configured triggers for this service. This is a JSON-formatted list of triggers. These triggers are evaluated as part as the health system. Every trigger expression is parsed, and if the trigger condition is met, the list of actions provided in the trigger expression is executed. Each trigger has the following fields:
[{"triggerName": "sample-trigger",
"triggerExpression": "IF (SELECT fd_open WHERE roleType = DataNode and last(fd_open) > 500) DO health:bad",
"streamThreshold": 10, "enabled": "true"}] See the trigger rules documentation for more details on how to write triggers using tsquery.The JSON format is evolving and may change and, as a result, backward compatibility is not guaranteed between releases. |
[] |
service_triggers
|
true | |
Service Monitor Derived Configs Advanced Configuration Snippet (Safety Valve) | For advanced use only, a list of derived configuration properties that will be used by the Service Monitor instead of the default ones. |
smon_derived_configs_safety_valve
|
false | ||
Non-Admin Users Query List Visibility Settings | Controls which queries a non-admin user can see in the queries list view | ALL |
user_query_list_settings
|
true |
Other
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Enable Profile Collection | Enable collection of profile from the service's roles. | true |
enable_telepub_profile_collection
|
false | |
HBase Service | Name of the HBase service that this Impala service instance depends on |
hbase_service
|
false | ||
HDFS Service | Name of the HDFS service that this Impala service instance depends on |
hdfs_service
|
true | ||
Hive Service | Name of the Hive service that this Impala service instance depends on |
hive_service
|
true | ||
Kudu Service | Name of the Kudu service that this Impala service instance depends on |
kudu_service
|
false | ||
Sentry Service | Name of the Sentry service that this Impala service instance depends on. If selected, Impala uses this Sentry service to look up authorization privileges. Before enabling Sentry, read the requirements and configuration steps in Setting Up The Sentry Service . |
sentry_service
|
false | ||
YARN Service for Resource Management | Name of YARN service to use for resource management integration between Impala and YARN. This service dependency and the existence of a Llama role is required for using said integration. |
yarn_service
|
false | ||
ZooKeeper Service for Llama HA | Name of the ZooKeeper service to use for leader election and fencing when Llama is configured for high availability. This service dependency is required when more than one Llama role is present. |
zookeeper_service
|
false |
Performance
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Enable HDFS Short-Circuit Read | Enable HDFS short-circuit read. This allows a client colocated with the DataNode to read HDFS file blocks directly. This gives a performance boost to distributed clients that are aware of locality. |
dfs.client.read.shortcircuit
|
true |
dfs_client_read_shortcircuit
|
false |
StateStoreSubscriber Timeout | Time in seconds before Impala Daemon or Catalog Server times out with the StateStore. |
statestore_subscriber_timeout_seconds
|
30 second(s) |
statestore_subscriber_timeout
|
false |
Policy File-Based Sentry
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Enable Sentry Authorization using Policy Files | Use Sentry to enable role-based, fine-grained authorization. This configuration enables Sentry using policy files. To enable Sentry using Sentry service instead, add Sentry service as a dependency to Impala service. Sentry service provides concurrent and secure access to authorization policy metadata and is the recommended option for enabling Sentry. Sentry is supported only on Impala 1.1 or later deployments. |
impala.sentry.enabled
|
false |
sentry_enabled
|
false |
Security
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Enable TLS/SSL for Impala | Encrypt communication between clients and Impala using Transport Layer Security (TLS) (formerly known as Secure Socket Layer (SSL)). |
client_services_ssl_enabled
|
false |
client_services_ssl_enabled
|
false |
Enable LDAP Authentication | When checked, LDAP-based authentication for users is enabled. |
enable_ldap_auth
|
false |
enable_ldap_auth
|
false |
Enable LDAP TLS | If true, attempts to establish a TLS (Transport Layer Security) connection with an LDAP server that was specified with ldap://. Not required when using an LDAP URL with prefix ldaps://, because that already specifies TLS. This option is also known as "Use StartTLS". |
ldap_tls
|
false |
enable_ldap_tls
|
false |
Enable Kerberos Authentication for HTTP Web-Consoles | Enables Kerberos authentication for Hadoop HTTP web consoles for all roles of this service using the SPNEGO protocol. Note: This is effective only if Kerberos is enabled for the HDFS service. | false |
hadoop_secure_web_ui
|
false | |
Proxy User Configuration | Specifies the set of authorized proxy users (users who can impersonate other users during authorization) and whom they are allowed to impersonate. Input is a semicolon-separated list of key=value pairs of authorized proxy users to the user(s) they can impersonate. These users are specified as a comma separated list of short usernames, or '*' to indicate all users. For example: joe=alice,bob;hue=*;admin=*. Only valid when Sentry is enabled. |
authorized_proxy_user_config
|
hue=* |
impala_authorized_proxy_user_config
|
false |
LDAP URL | The URL of the LDAP Server. The URL must be prefixed with ldap:// or ldaps:// . The URL can optionally specify a custom port if necessary, but by default the ldap:// will connect to port 389, and the ldaps:// will connect to port 636. Note that passwords will be in the clear if ldap:// is used, and by fall 2020 Active directory servers will no longer allow non LDAPS connections to bind to AD hosts with LDAP signing enabled. See microsoft knowledge document 935834 for more information. |
ldap_uri
|
impala_ldap_uri
|
false | |
impala TLS/SSL Client Trust Store File | The location on disk of the trust store, in .jks format, used to confirm the authenticity of TLS/SSL servers that impala might connect to. This is used when impala is the client in a TLS/SSL connection. This trust store must contain the certificate(s) used to sign the service(s) connected to. If this parameter is not provided, the default list of well-known certificate authorities is used instead. |
impala_truststore_file
|
false | ||
impala TLS/SSL Client Trust Store Password | The password for the impala TLS/SSL Certificate Trust Store File. This password is not required to access the trust store; this field can be left blank. This password provides optional integrity checking of the file. The contents of trust stores are certificates, and certificates are public information. |
impala_truststore_password
|
false | ||
Kerberos Principal | Kerberos principal short name used by all roles of this service. | impala |
kerberos_princ_name
|
true | |
Kerberos Re-init Interval | Number of minutes between reestablishing our ticket with the Kerberos server. |
kerberos_reinit_interval
|
1 hour(s) |
kerberos_reinit_interval
|
false |
LDAP BaseDN | This parameter is useful when authenticating against a non-Active Directory server, such as OpenLDAP. When set, this parameter is used to convert the username into the LDAP Distinguished Name (DN), so that the resulting DN looks like uid=username,this parameter. For example, if this parameter is set to "ou=People,dc=cloudera,dc=com", and the username passed in is "mike", the resulting authentication passed to the LDAP server look like "uid=mike,ou=People,dc=cloudera,dc=com". This parameter is mutually exclusive with Active Directory Domain. |
ldap_baseDN
|
ldap_baseDN
|
false | |
LDAP Pattern | When set, this parameter allows arbitrary mapping from usernames into a Distinguished Name (DN). The string specified must have a placeholder named "#UID" inside it, and that #UID is replaced with the username. For example, you could mimic the behavior of LDAP BaseDN by specifying "uid=#UID,ou=People,dc=cloudera,dc=com". When the username of "mike" comes in, it replaces the #UID and the result is "uid=mike,ou=People,dc=cloudera,dc=com". This option should be used when more control over the DN is needed. This parameter is mutually exclusive with LDAP Domain and LDAP BaseDN. |
ldap_bind_pattern
|
ldap_bind_pattern
|
false | |
Active Directory Domain | Use this field for Active Directory configurations only, when combined with a simple username value in the "LDAP Bind User Distinguished Name" field, it will result in a UPM of user@example.com used for search/bind operations for authenticated user lookups. |
ldap_domain
|
ldap_domain
|
false | |
Impala TLS/SSL CA Certificate | The location on disk of the certificate, in PEM format, used to confirm the authenticity of SSL/TLS servers that the Impala daemons might connect to. Because the Impala daemons connect to each other, this should also include the CA certificate used to sign all the SSL/TLS Certificates. Without this parameter, SSL/TLS between Impala daemons will not be enabled. |
ssl_client_ca_certificate
|
ssl_client_ca_certificate
|
false | |
Impala TLS/SSL Server Private Key File (PEM Format) | The path to the TLS/SSL file containing the private key used for TLS/SSL. Used when Impala is acting as a TLS/SSL server. The certificate file must be in PEM format. |
ssl_private_key
|
ssl_private_key
|
false | |
Impala TLS/SSL Private Key Password | The password for the private key in the Impala TLS/SSL Server Certificate and Private Key file. If left blank, the private key is not protected by a password. |
ssl_private_key_password_cmd
|
ssl_private_key_password
|
false | |
Impala TLS/SSL Server Certificate File (PEM Format) | The path to the TLS/SSL file containing the server certificate key used for TLS/SSL. Used when Impala is acting as a TLS/SSL server. The certificate file must be in PEM format. |
ssl_server_certificate
|
ssl_server_certificate
|
false |
Suppressions
Display Name | Description | Property Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Suppress Configuration Validator: Impala Daemon Audit Log Directory | Whether to suppress configuration warnings produced by the Impala Daemon Audit Log Directory configuration validator. | false |
role_config_suppression_audit_event_log_dir
|
true | |
Suppress Configuration Validator: Impala Daemon Backend Port | Whether to suppress configuration warnings produced by the Impala Daemon Backend Port configuration validator. | false |
role_config_suppression_be_port
|
true | |
Suppress Configuration Validator: Impala Daemon Beeswax Port | Whether to suppress configuration warnings produced by the Impala Daemon Beeswax Port configuration validator. | false |
role_config_suppression_beeswax_port
|
true | |
Suppress Configuration Validator: Catalog Server Service Port | Whether to suppress configuration warnings produced by the Catalog Server Service Port configuration validator. | false |
role_config_suppression_catalog_service_port
|
true | |
Suppress Configuration Validator: Catalog Server Command Line Argument Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the Catalog Server Command Line Argument Advanced Configuration Snippet (Safety Valve) configuration validator. | false |
role_config_suppression_catalogd_cmd_args_safety_valve
|
true | |
Suppress Configuration Validator: Impala Catalog Server Advanced Configuration Snippet (Safety Valve) for core-site.xml | Whether to suppress configuration warnings produced by the Impala Catalog Server Advanced Configuration Snippet (Safety Valve) for core-site.xml configuration validator. | false |
role_config_suppression_catalogd_core_site_safety_valve
|
true | |
Suppress Configuration Validator: Catalog Server HBase Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the Catalog Server HBase Advanced Configuration Snippet (Safety Valve) configuration validator. | false |
role_config_suppression_catalogd_hbase_conf_safety_valve
|
true | |
Suppress Configuration Validator: Catalog Server HDFS Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the Catalog Server HDFS Advanced Configuration Snippet (Safety Valve) configuration validator. | false |
role_config_suppression_catalogd_hdfs_site_conf_safety_valve
|
true | |
Suppress Configuration Validator: Catalog Server Hive Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the Catalog Server Hive Advanced Configuration Snippet (Safety Valve) configuration validator. | false |
role_config_suppression_catalogd_hive_conf_safety_valve
|
true | |
Suppress Configuration Validator: Java Configuration Options for Catalog Server | Whether to suppress configuration warnings produced by the Java Configuration Options for Catalog Server configuration validator. | false |
role_config_suppression_catalogd_java_opts
|
true | |
Suppress Configuration Validator: Impala Catalog Server Environment Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the Impala Catalog Server Environment Advanced Configuration Snippet (Safety Valve) configuration validator. | false |
role_config_suppression_catalogserver_role_env_safety_valve
|
true | |
Suppress Configuration Validator: Catalog Server HTTP Server Port | Whether to suppress configuration warnings produced by the Catalog Server HTTP Server Port configuration validator. | false |
role_config_suppression_catalogserver_webserver_port
|
true | |
Suppress Configuration Validator: CDH Version Validator | Whether to suppress configuration warnings produced by the CDH Version Validator configuration validator. | false |
role_config_suppression_cdh_version_validator
|
true | |
Suppress Configuration Validator: Impala Daemon Core Dump Directory | Whether to suppress configuration warnings produced by the Impala Daemon Core Dump Directory configuration validator. | false |
role_config_suppression_core_dump_dir
|
true | |
Suppress Configuration Validator: Impala Daemon Default Memory Limit Validator | Whether to suppress configuration warnings produced by the Impala Daemon Default Memory Limit Validator configuration validator. | false |
role_config_suppression_default_impalad_memory_limit_validator
|
true | |
Suppress Configuration Validator: Impala Daemon Query Options Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the Impala Daemon Query Options Advanced Configuration Snippet (Safety Valve) configuration validator. | false |
role_config_suppression_default_query_options
|
true | |
Suppress Configuration Validator: Impala Daemon HiveServer2 Port | Whether to suppress configuration warnings produced by the Impala Daemon HiveServer2 Port configuration validator. | false |
role_config_suppression_hs2_port
|
true | |
Suppress Configuration Validator: Impala Audit Enabled Validator | Whether to suppress configuration warnings produced by the Impala Audit Enabled Validator configuration validator. | false |
role_config_suppression_impala_audit_enabled_validator
|
true | |
Suppress Configuration Validator: Impala Daemon HDFS Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the Impala Daemon HDFS Advanced Configuration Snippet (Safety Valve) configuration validator. | false |
role_config_suppression_impala_hdfs_site_conf_safety_valve
|
true | |
Suppress Configuration Validator: Impala Daemon Hive Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the Impala Daemon Hive Advanced Configuration Snippet (Safety Valve) configuration validator. | false |
role_config_suppression_impala_hive_conf_safety_valve
|
true | |
Suppress Configuration Validator: Impala Lineage Enabled Validator | Whether to suppress configuration warnings produced by the Impala Lineage Enabled Validator configuration validator. | false |
role_config_suppression_impala_lineage_enabled_validator
|
true | |
Suppress Configuration Validator: Impala Daemon Llama Site Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the Impala Daemon Llama Site Advanced Configuration Snippet (Safety Valve) configuration validator. | false |
role_config_suppression_impala_llama_site_conf_safety_valve
|
true | |
Suppress Configuration Validator: Impala Daemon Command Line Argument Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the Impala Daemon Command Line Argument Advanced Configuration Snippet (Safety Valve) configuration validator. | false |
role_config_suppression_impalad_cmd_args_safety_valve
|
true | |
Suppress Configuration Validator: Impala Daemon Command Line Arguments Safety Valve Validator | Whether to suppress configuration warnings produced by the Impala Daemon Command Line Arguments Safety Valve Validator configuration validator. | false |
role_config_suppression_impalad_cmd_args_safety_valve_validator
|
true | |
Suppress Configuration Validator: Impala Daemon Advanced Configuration Snippet (Safety Valve) for core-site.xml | Whether to suppress configuration warnings produced by the Impala Daemon Advanced Configuration Snippet (Safety Valve) for core-site.xml configuration validator. | false |
role_config_suppression_impalad_core_site_safety_valve
|
true | |
Suppress Configuration Validator: Impala Daemon Fair Scheduler Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the Impala Daemon Fair Scheduler Advanced Configuration Snippet (Safety Valve) configuration validator. | false |
role_config_suppression_impalad_fair_scheduler_safety_valve
|
true | |
Suppress Configuration Validator: Impala Daemon HBase Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the Impala Daemon HBase Advanced Configuration Snippet (Safety Valve) configuration validator. | false |
role_config_suppression_impalad_hbase_conf_safety_valve
|
true | |
Suppress Configuration Validator: LDAP Server CA Certificate | Whether to suppress configuration warnings produced by the LDAP Server CA Certificate configuration validator. | false |
role_config_suppression_impalad_ldap_ca_certificate
|
true | |
Suppress Configuration Validator: Impala Daemons Load Balancer | Whether to suppress configuration warnings produced by the Impala Daemons Load Balancer configuration validator. | false |
role_config_suppression_impalad_load_balancer
|
true | |
Suppress Configuration Validator: Impala Daemon Environment Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the Impala Daemon Environment Advanced Configuration Snippet (Safety Valve) configuration validator. | false |
role_config_suppression_impalad_role_env_safety_valve
|
true | |
Suppress Configuration Validator: Impala Daemon HTTP Server Port | Whether to suppress configuration warnings produced by the Impala Daemon HTTP Server Port configuration validator. | false |
role_config_suppression_impalad_webserver_port
|
true | |
Suppress Configuration Validator: Role-Specific Kerberos Principal | Whether to suppress configuration warnings produced by the Role-Specific Kerberos Principal configuration validator. | false |
role_config_suppression_kerberos_role_princ_name
|
true | |
Suppress Configuration Validator: Impala Daemon Lineage Log Directory | Whether to suppress configuration warnings produced by the Impala Daemon Lineage Log Directory configuration validator. | false |
role_config_suppression_lineage_event_log_dir
|
true | |
Suppress Configuration Validator: Core Queues | Whether to suppress configuration warnings produced by the Core Queues configuration validator. | false |
role_config_suppression_llama_am_core_queues
|
true | |
Suppress Configuration Validator: Administrative Interface ACLs | Whether to suppress configuration warnings produced by the Administrative Interface ACLs configuration validator. | false |
role_config_suppression_llama_am_server_thrift_admin_acl
|
true | |
Suppress Configuration Validator: Llama Thrift Admin Port | Whether to suppress configuration warnings produced by the Llama Thrift Admin Port configuration validator. | false |
role_config_suppression_llama_am_server_thrift_admin_address
|
true | |
Suppress Configuration Validator: Client ACLs | Whether to suppress configuration warnings produced by the Client ACLs configuration validator. | false |
role_config_suppression_llama_am_server_thrift_client_acl
|
true | |
Suppress Configuration Validator: Llama Callback Port | Whether to suppress configuration warnings produced by the Llama Callback Port configuration validator. | false |
role_config_suppression_llama_callback_port
|
true | |
Suppress Configuration Validator: Impala Llama ApplicationMaster Advanced Configuration Snippet (Safety Valve) for llama-site.xml | Whether to suppress configuration warnings produced by the Impala Llama ApplicationMaster Advanced Configuration Snippet (Safety Valve) for llama-site.xml configuration validator. | false |
role_config_suppression_llama_config_valve
|
true | |
Suppress Configuration Validator: Fair Scheduler XML Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the Fair Scheduler XML Advanced Configuration Snippet (Safety Valve) configuration validator. | false |
role_config_suppression_llama_fair_scheduler_safety_valve
|
true | |
Suppress Configuration Validator: Llama HTTP Port | Whether to suppress configuration warnings produced by the Llama HTTP Port configuration validator. | false |
role_config_suppression_llama_http_port
|
true | |
Suppress Configuration Validator: Java Configuration Options for Llama Server | Whether to suppress configuration warnings produced by the Java Configuration Options for Llama Server configuration validator. | false |
role_config_suppression_llama_java_opts
|
true | |
Suppress Configuration Validator: Llama Log Directory | Whether to suppress configuration warnings produced by the Llama Log Directory configuration validator. | false |
role_config_suppression_llama_log_dir
|
true | |
Suppress Configuration Validator: Llama Thrift Port | Whether to suppress configuration warnings produced by the Llama Thrift Port configuration validator. | false |
role_config_suppression_llama_port
|
true | |
Suppress Configuration Validator: Impala Llama ApplicationMaster Environment Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the Impala Llama ApplicationMaster Environment Advanced Configuration Snippet (Safety Valve) configuration validator. | false |
role_config_suppression_llama_role_env_safety_valve
|
true | |
Suppress Configuration Validator: Local UDF Library Dir | Whether to suppress configuration warnings produced by the Local UDF Library Dir configuration validator. | false |
role_config_suppression_local_library_dir
|
true | |
Suppress Configuration Validator: Impala Daemon Logging Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the Impala Daemon Logging Advanced Configuration Snippet (Safety Valve) configuration validator. | false |
role_config_suppression_log4j_safety_valve
|
true | |
Suppress Configuration Validator: Impala Daemon Log Directory | Whether to suppress configuration warnings produced by the Impala Daemon Log Directory configuration validator. | false |
role_config_suppression_log_dir
|
true | |
Suppress Configuration Validator: Impala Daemon Breakpad Dump Directory | Whether to suppress configuration warnings produced by the Impala Daemon Breakpad Dump Directory configuration validator. | false |
role_config_suppression_minidump_path
|
true | |
Suppress Configuration Validator: Heap Dump Directory | Whether to suppress configuration warnings produced by the Heap Dump Directory configuration validator. | false |
role_config_suppression_oom_heap_dump_dir
|
true | |
Suppress Configuration Validator: Llama System Group | Whether to suppress configuration warnings produced by the Llama System Group configuration validator. | false |
role_config_suppression_process_groupname
|
true | |
Suppress Configuration Validator: Llama System User | Whether to suppress configuration warnings produced by the Llama System User configuration validator. | false |
role_config_suppression_process_username
|
true | |
Suppress Configuration Validator: Custom Control Group Resources (overrides Cgroup settings) | Whether to suppress configuration warnings produced by the Custom Control Group Resources (overrides Cgroup settings) configuration validator. | false |
role_config_suppression_rm_custom_resources
|
true | |
Suppress Configuration Validator: Role Triggers | Whether to suppress configuration warnings produced by the Role Triggers configuration validator. | false |
role_config_suppression_role_triggers
|
true | |
Suppress Configuration Validator: Impala Daemon Scratch Directories | Whether to suppress configuration warnings produced by the Impala Daemon Scratch Directories configuration validator. | false |
role_config_suppression_scratch_dirs
|
true | |
Suppress Configuration Validator: Stacks Collection Directory | Whether to suppress configuration warnings produced by the Stacks Collection Directory configuration validator. | false |
role_config_suppression_stacks_collection_directory
|
true | |
Suppress Configuration Validator: StateStore Service Port | Whether to suppress configuration warnings produced by the StateStore Service Port configuration validator. | false |
role_config_suppression_state_store_port
|
true | |
Suppress Configuration Validator: StateStoreSubscriber Service Port | Whether to suppress configuration warnings produced by the StateStoreSubscriber Service Port configuration validator. | false |
role_config_suppression_state_store_subscriber_port
|
true | |
Suppress Configuration Validator: Statestore Command Line Argument Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the Statestore Command Line Argument Advanced Configuration Snippet (Safety Valve) configuration validator. | false |
role_config_suppression_statestore_cmd_args_safety_valve
|
true | |
Suppress Configuration Validator: Impala StateStore Environment Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the Impala StateStore Environment Advanced Configuration Snippet (Safety Valve) configuration validator. | false |
role_config_suppression_statestore_role_env_safety_valve
|
true | |
Suppress Configuration Validator: StateStore HTTP Server Port | Whether to suppress configuration warnings produced by the StateStore HTTP Server Port configuration validator. | false |
role_config_suppression_statestore_webserver_port
|
true | |
Suppress Configuration Validator: Impala Daemon Unlimited Memory Limit Validator | Whether to suppress configuration warnings produced by the Impala Daemon Unlimited Memory Limit Validator configuration validator. | false |
role_config_suppression_unlimited_impalad_memory_limit_validator
|
true | |
Suppress Configuration Validator: Impala Daemon Webserver TLS/SSL Server Certificate File (PEM Format) | Whether to suppress configuration warnings produced by the Impala Daemon Webserver TLS/SSL Server Certificate File (PEM Format) configuration validator. | false |
role_config_suppression_webserver_certificate_file
|
true | |
Suppress Configuration Validator: Impala Daemon Web Server User Password | Whether to suppress configuration warnings produced by the Impala Daemon Web Server User Password configuration validator. | false |
role_config_suppression_webserver_htpassword_password
|
true | |
Suppress Configuration Validator: Impala Daemon Web Server Username | Whether to suppress configuration warnings produced by the Impala Daemon Web Server Username configuration validator. | false |
role_config_suppression_webserver_htpassword_user
|
true | |
Suppress Configuration Validator: Impala Daemon Webserver TLS/SSL Server Private Key File (PEM Format) | Whether to suppress configuration warnings produced by the Impala Daemon Webserver TLS/SSL Server Private Key File (PEM Format) configuration validator. | false |
role_config_suppression_webserver_private_key_file
|
true | |
Suppress Configuration Validator: Impala Daemon Webserver TLS/SSL Private Key Password | Whether to suppress configuration warnings produced by the Impala Daemon Webserver TLS/SSL Private Key Password configuration validator. | false |
role_config_suppression_webserver_private_key_password_cmd
|
true | |
Suppress Parameter Validation: Impala Service Advanced Configuration Snippet (Safety Valve) for atlas-application.properties | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Service Advanced Configuration Snippet (Safety Valve) for atlas-application.properties parameter. | false |
service_config_suppression_application_properties_safety_valve
|
true | |
Suppress Configuration Validator: Impala Catalog Server Count Validator | Whether to suppress configuration warnings produced by the Impala Catalog Server Count Validator configuration validator. | false |
service_config_suppression_catalogserver_count_validator
|
true | |
Suppress Configuration Validator: Secure Web UI Validator | Whether to suppress configuration warnings produced by the Secure Web UI Validator configuration validator. | false |
service_config_suppression_hadoop_secure_web_ui
|
true | |
Suppress Parameter Validation: Proxy User Configuration | Whether to suppress configuration warnings produced by the built-in parameter validation for the Proxy User Configuration parameter. | false |
service_config_suppression_impala_authorized_proxy_user_config
|
true | |
Suppress Configuration Validator: Bypass Hive Metastore Validator | Whether to suppress configuration warnings produced by the Bypass Hive Metastore Validator configuration validator. | false |
service_config_suppression_impala_bypass_hms_validator
|
true | |
Suppress Parameter Validation: Impala Command Line Argument Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Command Line Argument Advanced Configuration Snippet (Safety Valve) parameter. | false |
service_config_suppression_impala_cmd_args_safety_valve
|
true | |
Suppress Configuration Validator: Impala Command Line Arguments Safety Valve Validator | Whether to suppress configuration warnings produced by the Impala Command Line Arguments Safety Valve Validator configuration validator. | false |
service_config_suppression_impala_cmd_args_safety_valve_validator
|
true | |
Suppress Configuration Validator: Impala Short-Circuit Read Validator | Whether to suppress configuration warnings produced by the Impala Short-Circuit Read Validator configuration validator. | false |
service_config_suppression_impala_dfs_client_read_shortcircuit_validator
|
true | |
Suppress Configuration Validator: Enable HDFS Block Metadata API Configuration Validator | Whether to suppress configuration warnings produced by the Enable HDFS Block Metadata API Configuration Validator configuration validator. | false |
service_config_suppression_impala_hdfs_dfs_datanode_hdfs_blocks_metadata_enabled_set_validator
|
true | |
Suppress Parameter Validation: LDAP URL | Whether to suppress configuration warnings produced by the built-in parameter validation for the LDAP URL parameter. | false |
service_config_suppression_impala_ldap_uri
|
true | |
Suppress Configuration Validator: LDAP Configuration Validator | Whether to suppress configuration warnings produced by the LDAP Configuration Validator configuration validator. | false |
service_config_suppression_impala_ldap_validator
|
true | |
Suppress Configuration Validator: Impala Llama Supported Validator | Whether to suppress configuration warnings produced by the Impala Llama Supported Validator configuration validator. | false |
service_config_suppression_impala_llama_supported_validator
|
true | |
Suppress Parameter Validation: Impala Query Aggregates | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Query Aggregates parameter. | false |
service_config_suppression_impala_query_aggregates
|
true | |
Suppress Configuration Validator: Impala Sentry Validator | Whether to suppress configuration warnings produced by the Impala Sentry Validator configuration validator. | false |
service_config_suppression_impala_sentry_validator
|
true | |
Suppress Parameter Validation: Impala Service Environment Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Service Environment Advanced Configuration Snippet (Safety Valve) parameter. | false |
service_config_suppression_impala_service_env_safety_valve
|
true | |
Suppress Parameter Validation: impala TLS/SSL Client Trust Store File | Whether to suppress configuration warnings produced by the built-in parameter validation for the impala TLS/SSL Client Trust Store File parameter. | false |
service_config_suppression_impala_truststore_file
|
true | |
Suppress Parameter Validation: impala TLS/SSL Client Trust Store Password | Whether to suppress configuration warnings produced by the built-in parameter validation for the impala TLS/SSL Client Trust Store Password parameter. | false |
service_config_suppression_impala_truststore_password
|
true | |
Suppress Configuration Validator: Impala Daemon Count Validator | Whether to suppress configuration warnings produced by the Impala Daemon Count Validator configuration validator. | false |
service_config_suppression_impalad_count_validator
|
true | |
Suppress Parameter Validation: Impala Service Advanced Configuration Snippet (Safety Valve) for sentry-site.xml | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Service Advanced Configuration Snippet (Safety Valve) for sentry-site.xml parameter. | false |
service_config_suppression_impalad_sentry_safety_valve
|
true | |
Suppress Parameter Validation: Kerberos Principal | Whether to suppress configuration warnings produced by the built-in parameter validation for the Kerberos Principal parameter. | false |
service_config_suppression_kerberos_princ_name
|
true | |
Suppress Parameter Validation: LDAP BaseDN | Whether to suppress configuration warnings produced by the built-in parameter validation for the LDAP BaseDN parameter. | false |
service_config_suppression_ldap_basedn
|
true | |
Suppress Parameter Validation: LDAP Pattern | Whether to suppress configuration warnings produced by the built-in parameter validation for the LDAP Pattern parameter. | false |
service_config_suppression_ldap_bind_pattern
|
true | |
Suppress Parameter Validation: Active Directory Domain | Whether to suppress configuration warnings produced by the built-in parameter validation for the Active Directory Domain parameter. | false |
service_config_suppression_ldap_domain
|
true | |
Suppress Configuration Validator: Impala Llama ApplicationMaster Count Validator | Whether to suppress configuration warnings produced by the Impala Llama ApplicationMaster Count Validator configuration validator. | false |
service_config_suppression_llama_count_validator
|
true | |
Suppress Parameter Validation: Audit Event Filter | Whether to suppress configuration warnings produced by the built-in parameter validation for the Audit Event Filter parameter. | false |
service_config_suppression_navigator_audit_event_filter
|
true | |
Suppress Parameter Validation: Impala Client Advanced Configuration Snippet (Safety Valve) for navigator.client.properties | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Client Advanced Configuration Snippet (Safety Valve) for navigator.client.properties parameter. | false |
service_config_suppression_navigator_client_config_safety_valve
|
true | |
Suppress Parameter Validation: Audit Event Tracker | Whether to suppress configuration warnings produced by the built-in parameter validation for the Audit Event Tracker parameter. | false |
service_config_suppression_navigator_event_tracker
|
true | |
Suppress Parameter Validation: Impala Client Advanced Configuration Snippet (Safety Valve) for navigator.lineage.client.properties | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala Client Advanced Configuration Snippet (Safety Valve) for navigator.lineage.client.properties parameter. | false |
service_config_suppression_navigator_lineage_client_config_safety_valve
|
true | |
Suppress Configuration Validator: CA Certificate File Validator | Whether to suppress configuration warnings produced by the CA Certificate File Validator configuration validator. | false |
service_config_suppression_pem_ca_cert_recommended_for_ssl
|
true | |
Suppress Parameter Validation: Impala System Group (except Llama) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala System Group (except Llama) parameter. | false |
service_config_suppression_process_groupname
|
true | |
Suppress Parameter Validation: Impala System User (except Llama) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala System User (except Llama) parameter. | false |
service_config_suppression_process_username
|
true | |
Suppress Configuration Validator: Sentry Policy Files Validator | Whether to suppress configuration warnings produced by the Sentry Policy Files Validator configuration validator. | false |
service_config_suppression_sentry_policy_files_validator
|
true | |
Suppress Parameter Validation: Service Triggers | Whether to suppress configuration warnings produced by the built-in parameter validation for the Service Triggers parameter. | false |
service_config_suppression_service_triggers
|
true | |
Suppress Configuration Validator: Short-Circuit Read Enabled Validator | Whether to suppress configuration warnings produced by the Short-Circuit Read Enabled Validator configuration validator. | false |
service_config_suppression_short_circuit_read_validator
|
true | |
Suppress Configuration Validator: Short-Circuit Read Permissions Validator | Whether to suppress configuration warnings produced by the Short-Circuit Read Permissions Validator configuration validator. | false |
service_config_suppression_short_circuit_reads_data_directory_permissions_validator
|
true | |
Suppress Parameter Validation: Service Monitor Derived Configs Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Service Monitor Derived Configs Advanced Configuration Snippet (Safety Valve) parameter. | false |
service_config_suppression_smon_derived_configs_safety_valve
|
true | |
Suppress Parameter Validation: Impala TLS/SSL CA Certificate | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala TLS/SSL CA Certificate parameter. | false |
service_config_suppression_ssl_client_ca_certificate
|
true | |
Suppress Parameter Validation: Impala TLS/SSL Server Private Key File (PEM Format) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala TLS/SSL Server Private Key File (PEM Format) parameter. | false |
service_config_suppression_ssl_private_key
|
true | |
Suppress Parameter Validation: Impala TLS/SSL Private Key Password | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala TLS/SSL Private Key Password parameter. | false |
service_config_suppression_ssl_private_key_password
|
true | |
Suppress Parameter Validation: Impala TLS/SSL Server Certificate File (PEM Format) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Impala TLS/SSL Server Certificate File (PEM Format) parameter. | false |
service_config_suppression_ssl_server_certificate
|
true | |
Suppress Configuration Validator: Impala StateStore Count Validator | Whether to suppress configuration warnings produced by the Impala StateStore Count Validator configuration validator. | false |
service_config_suppression_statestore_count_validator
|
true | |
Suppress Health Test: Impala Catalog Server Health | Whether to suppress the results of the Impala Catalog Server Health heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
service_health_suppression_impala_catalogserver_health
|
true | |
Suppress Health Test: Impala Daemon Health | Whether to suppress the results of the Impala Daemon Health heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
service_health_suppression_impala_impalads_healthy
|
true | |
Suppress Health Test: Impala Llama ApplicationMaster Health | Whether to suppress the results of the Impala Llama ApplicationMaster Health heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
service_health_suppression_impala_llamas_healthy
|
true | |
Suppress Health Test: Impala StateStore Health | Whether to suppress the results of the Impala StateStore Health heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. | false |
service_health_suppression_impala_statestore_health
|
true |