Hive LLAP Properties in Cloudera Runtime in 7.2.18

Role groups:

Gateway

Advanced

Deploy Directory

Description
The directory where the client configs will be deployed
Related Name
Default Value
/etc/hive
API Name
client_config_root_dir
Required
true

Hive Client Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
For advanced use only, a string to be inserted into the client configuration for hive-site.xml.
Related Name
Default Value
API Name
hive_client_config_safety_valve
Required
false

Gateway Client Environment Advanced Configuration Snippet (Safety Valve) for hive-env.sh

Description
For advanced use only, key-value pairs (one on each line) to be inserted into the client configuration for hive-env.sh
Related Name
Default Value
API Name
hive_client_env_safety_valve
Required
false

Client Java Configuration Options

Description
These are Java command-line arguments. Commonly, garbage collection flags, PermGen, or extra debugging flags would be passed here.
Related Name
Default Value
-Djava.net.preferIPv4Stack=true
API Name
hive_client_java_opts
Required
false

Hive Metastore Connection Timeout

Description
Timeout for requests to the Hive Metastore Server. Consider increasing this if you have tables with a lot of metadata and see timeout errors. Used by most Hive Metastore clients such as Hive CLI and HiveServer2, but not by Impala. Impala has a separately configured timeout.
Related Name
hive.metastore.client.socket.timeout
Default Value
5 minute(s)
API Name
hive_metastore_timeout
Required
false

Gateway Logging Advanced Configuration Snippet (Safety Valve)

Description
For advanced use only, a string to be inserted into log4j.properties for this role only.
Related Name
Default Value
API Name
log4j_safety_valve
Required
false

Logs

Gateway Logging Threshold

Description
The minimum log level for Gateway logs
Related Name
Default Value
INFO
API Name
log_threshold
Required
false

Monitoring

Enable Configuration Change Alerts

Description
When set, Cloudera Manager will send alerts when this entity's configuration changes.
Related Name
Default Value
false
API Name
enable_config_alerts
Required
false

Other

Alternatives Priority

Description
The priority level that the client configuration will have in the Alternatives system on the hosts. Higher priority levels will cause Alternatives to prefer this configuration over any others.
Related Name
Default Value
91
API Name
client_config_priority
Required
true

Resource Management

Client Java Heap Size in Bytes

Description
Maximum size in bytes for the Java process heap memory. Passed to Java -Xmx.
Related Name
Default Value
2 GiB
API Name
hive_client_java_heapsize
Required
false

Suppressions

Suppress Configuration Validator: CDH Version Validator

Description
Whether to suppress configuration warnings produced by the CDH Version Validator configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_cdh_version_validator
Required
true

Suppress Parameter Validation: Deploy Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Deploy Directory parameter.
Related Name
Default Value
false
API Name
role_config_suppression_client_config_root_dir
Required
true

Suppress Parameter Validation: Hive Client Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Client Advanced Configuration Snippet (Safety Valve) for hive-site.xml parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_client_config_safety_valve
Required
true

Suppress Parameter Validation: Gateway Client Environment Advanced Configuration Snippet (Safety Valve) for hive-env.sh

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Gateway Client Environment Advanced Configuration Snippet (Safety Valve) for hive-env.sh parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_client_env_safety_valve
Required
true

Suppress Parameter Validation: Client Java Configuration Options

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Client Java Configuration Options parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_client_java_opts
Required
true

Suppress Parameter Validation: Gateway Logging Advanced Configuration Snippet (Safety Valve)

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Gateway Logging Advanced Configuration Snippet (Safety Valve) parameter.
Related Name
Default Value
false
API Name
role_config_suppression_log4j_safety_valve
Required
true

HiveServer2

Advanced

HiveServer2 Environment Advanced Configuration Snippet (Safety Valve)

Description
For advanced use only, key-value pairs (one on each line) to be inserted into a role's environment. Applies to configurations of this role except client configuration.
Related Name
Default Value
API Name
hive_hs2_env_safety_valve
Required
false

Hive Metastore Connection Retries Count

Description
Number of retries while opening a connection to the Hive Metastore Server
Related Name
hive.metastore.connect.retries
Default Value
10
API Name
hive_metastore_connection_retries
Required
false

Enable Metrics Subsystem

Description
Controls whether the Hive metrics subsystem is enabled for the role.
Related Name
hive.server2.metrics.enabled
Default Value
true
API Name
hive_metrics_enabled
Required
false

Metrics Sample File Location

Description
The full path to a file with a sample of metrics exposed by the role. The sample is updated at the frequency configured by Metrics Sample File Logging Frequency. By default, the sample file is logged to a directory under the role log directory, e.g., /var/log/hive/metrics-hivemetastore/metrics.log. The setting only has an effect if "Enable Metrics Subsystem" is set to true.
Related Name
hive.service.metrics.file.location
Default Value
API Name
hive_metrics_sample_file_location
Required
false

Metrics Sample File Logging Frequency

Description
The frequency at which the metrics are logged to the sample file. The setting only has an effect if "Enable Metrics Subsystem" is set to true.
Related Name
hive.service.metrics.file.frequency
Default Value
30 second(s)
API Name
hive_metrics_sample_logging_frequency
Required
false

Allow User Substitution

Description
Allow alternate user to be specified as part of HiveServer2 open connection request.
Related Name
hive.server2.allow.user.substitution
Default Value
true
API Name
hive_server2_allow_user_substitution
Required
false

HiveServer2 Transport Mode

Description
The server transport mode.
Related Name
hive.server2.transport.mode
Default Value
binary
API Name
hive_server2_transport_mode
Required
false

HiveServer2 Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
For advanced use only. A string to be inserted into hive-site.xml for this role only.
Related Name
Default Value
API Name
hivellap_hs2_config_safety_valve
Required
false

Hive Downloaded Resources Directory

Description
Local directory where Hive stores jars downloaded for remote file systems (HDFS). If not specified, Hive uses a default location.
Related Name
hive.downloaded.resources.dir
Default Value
API Name
hiveserver2_downloaded_resources_dir
Required
false

Enable Explain Logging

Description
When enabled, HiveServer2 logs EXPLAIN EXTENDED output for every query at INFO log4j level.
Related Name
hive.log.explain.output
Default Value
false
API Name
hiveserver2_enable_explain_output
Required
false

Hive Local Scratch Directory

Description
Local Directory where Hive stores jars and data when performing a MapJoin optimization. If not specified, Hive uses a default location.
Related Name
hive.exec.local.scratchdir
Default Value
API Name
hiveserver2_exec_local_scratchdir
Required
false

Hive HDFS Scratch Directory

Description
Directory in HDFS where Hive writes intermediate data between MapReduce jobs. If not specified, Hive uses a default location.
Related Name
hive.exec.scratchdir
Default Value
API Name
hiveserver2_exec_scratchdir
Required
false

Fair Scheduler XML Advanced Configuration Snippet (Safety Valve)

Description
An XML string that will be inserted verbatim into the Fair Scheduler allocations file. This configuration only has effect in CDH 5.8 or later.
Related Name
Default Value
API Name
hiveserver2_fair_scheduler_safety_valve
Required
false

Idle Operation Timeout

Description
Operation will be closed when not accessed for this duration of time, in milliseconds; disable by setting to zero. For a positive value, checked for operations in terminal state only (FINISHED, CANCELED, CLOSED, ERROR). For a negative value, checked for all of the operations regardless of state.
Related Name
hive.server2.idle.operation.timeout
Default Value
6 hour(s)
API Name
hiveserver2_idle_operation_timeout
Required
false

Idle Session Timeout

Description
Session will be closed when not accessed for this duration of time, in milliseconds; disable by setting to zero or a negative value.
Related Name
hive.server2.idle.session.timeout
Default Value
1 day(s)
API Name
hiveserver2_idle_session_timeout
Required
false

Exclude Live Operations From Session Idle Time

Description
Session will be considered to be idle only if there is no activity, and there is no pending operation. This setting takes effect only if session idle timeout (hive.server2.idle.session.timeout) and checking (hive.server2.session.check.interval) are enabled.
Related Name
hive.server2.idle.session.check.operation
Default Value
true
API Name
hiveserver2_idle_session_timeout_check_operation
Required
false

Java Configuration Options for HiveServer2

Description
These arguments will be passed as part of the Java command line. Commonly, garbage collection flags, PermGen, or extra debugging flags would be passed here. Note: When CM version is 6.3.0 or greater, {{JAVA_GC_ARGS}} will be replaced by JVM Garbage Collection arguments based on the runtime Java JVM version.
Related Name
Default Value
JAVA_GC_ARGS
API Name
hiveserver2_java_opts
Required
false

Maximum Query String Length for Show Locks

Description
The maximum length allowed for the query string when the SHOW LOCKS EXTENDED command is executed. Important: The query string is truncated at the length set for this property. Setting this property to a large value puts pressure on ZooKeeper and might cause out-of-memory issues.
Related Name
hive.lock.query.string.max.length
Default Value
10000
API Name
hiveserver2_lock_query_string_max_length
Required
false

Max HiveServer2 Threads

Description
Maximum number of worker threads in HiveServer2's thread pool
Related Name
hive.server2.thrift.max.worker.threads
Default Value
500
API Name
hiveserver2_max_threads
Required
true

Min HiveServer2 Threads

Description
Minimum number of worker threads in HiveServer2's thread pool
Related Name
hive.server2.thrift.min.worker.threads
Default Value
5
API Name
hiveserver2_min_threads
Required
true

Session Check Interval

Description
The check interval for session/operation timeout, in milliseconds, which can be disabled by setting to zero or a negative value.
Related Name
hive.server2.session.check.interval
Default Value
15 minute(s)
API Name
hiveserver2_session_check_interval
Required
false

HiveServer2 WebUI Max Threads

Description
The max threads for the HiveServer2 WebUI.
Related Name
hive.server2.webui.max.threads
Default Value
50
API Name
hiveserver2_webui_max_threads
Required
false

HiveServer2 Advanced Configuration Snippet (Safety Valve) for core-site.xml

Description
For advanced use only. A string to be inserted into core-site.xml for this role only.
Related Name
Default Value
API Name
hs2_core_site_safety_valve
Required
false

HiveServer2 Logging Advanced Configuration Snippet (Safety Valve)

Description
For advanced use only, a string to be inserted into log4j.properties for this role only.
Related Name
Default Value
API Name
log4j_safety_valve
Required
false

Enable auto refresh for metric configurations

Description
When true, Enable Metric Collection and Metric Filter parameters will be set automatically if they're changed. Otherwise, a refresh by hand is required.
Related Name
Default Value
false
API Name
metric_config_auto_refresh
Required
false

Heap Dump Directory

Description
Path to directory where heap dumps are generated when java.lang.OutOfMemoryError error is thrown. This directory is automatically created if it does not exist. If this directory already exists, it will be owned by the current role user with 1777 permissions. Sharing the same directory among multiple roles will cause an ownership race. The heap dump files are created with 600 permissions and are owned by the role user. The amount of free space in this directory should be greater than the maximum Java Process heap size configured for this role.
Related Name
oom_heap_dump_dir
Default Value
/tmp
API Name
oom_heap_dump_dir
Required
false

Dump Heap When Out of Memory

Description
When set, generates a heap dump file when when an out-of-memory error occurs.
Related Name
Default Value
true
API Name
oom_heap_dump_enabled
Required
true

Kill When Out of Memory

Description
When set, a SIGKILL signal is sent to the role process when java.lang.OutOfMemoryError is thrown.
Related Name
Default Value
true
API Name
oom_sigkill_enabled
Required
true

Automatically Restart Process

Description
When set, this role's process is automatically (and transparently) restarted in the event of an unexpected failure. This configuration applies in the time after the Start Wait Timeout period.
Related Name
Default Value
false
API Name
process_auto_restart
Required
true

Enable Metric Collection

Description
Cloudera Manager agent monitors each service and each of its role by publishing metrics to the Cloudera Manager Service Monitor. Setting it to false will stop Cloudera Manager agent from publishing any metric for corresponding service/roles. This is usually helpful for services that generate large amount of metrics which Service Monitor is not able to process.
Related Name
Default Value
true
API Name
process_should_monitor
Required
true

Process Start Retry Attempts

Description
Number of times to try starting a role's process when the process exits before the Start Wait Timeout period. After a process is running beyond the Start Wait Timeout, the retry count is reset. Setting this configuration to zero will prevent restart of the process during the Start Wait Timeout period.
Related Name
Default Value
3
API Name
process_start_retries
Required
false

Process Start Wait Timeout

Description
The time in seconds to wait for a role's process to start successfully on a host. Processes which exit/crash before this time will be restarted until reaching the limit specified by the Start Retry Attempts count parameter. Setting this configuration to zero will turn off this feature.
Related Name
Default Value
20
API Name
process_start_secs
Required
false

Logs

HiveServer2 Log Directory

Description
Directory where HiveServer2 will place its log files.
Related Name
Default Value
/var/log/hive
API Name
hive_log_dir
Required
false

Enable HiveServer2 Operations Logging

Description
When enabled, HiveServer2 will temporarily save logs associated with ongoing operations. This enables clients like beeline and Hue to request and display logs for a particular ongoing operation. Logs are removed upon completion of operation.
Related Name
hive.server2.logging.operation.enabled
Default Value
true
API Name
hive_server2_logging_operation_enabled
Required
false

HiveServer2 Operations Log Directory

Description
Top level directory where operation logs are temporarily stored if Enable HiveServer2 Operations Logging is true. Logs are stored in session and operation level subdirectories under this location and are removed on completion of operation.
Related Name
hive.server2.logging.operation.log.location
Default Value
/var/log/hive/operation_logs
API Name
hive_server2_logging_operation_log_location
Required
false

HiveServer2 Logging Threshold

Description
The minimum log level for HiveServer2 logs
Related Name
Default Value
INFO
API Name
log_threshold
Required
false

HiveServer2 Maximum Log File Backups

Description
The maximum number of rolled log files to keep for HiveServer2 logs. Typically used by log4j or logback.
Related Name
Default Value
10
API Name
max_log_backup_index
Required
false

HiveServer2 Max Log Size

Description
The maximum size, in megabytes, per log file for HiveServer2 logs. Typically used by log4j or logback.
Related Name
Default Value
200 MiB
API Name
max_log_size
Required
false

Monitoring

Enable Health Alerts for this Role

Description
When set, Cloudera Manager will send alerts when the health of this role reaches the threshold specified by the EventServer setting eventserver_health_events_alert_threshold
Related Name
Default Value
true
API Name
enable_alerts
Required
false

Enable Configuration Change Alerts

Description
When set, Cloudera Manager will send alerts when this entity's configuration changes.
Related Name
Default Value
false
API Name
enable_config_alerts
Required
false

Heap Dump Directory Free Space Monitoring Absolute Thresholds

Description
The health test thresholds for monitoring of free space on the filesystem that contains this role's heap dump directory.
Related Name
Default Value
Warning: 10 GiB, Critical: 5 GiB
API Name
heap_dump_directory_free_space_absolute_thresholds
Required
false

Heap Dump Directory Free Space Monitoring Percentage Thresholds

Description
The health test thresholds for monitoring of free space on the filesystem that contains this role's heap dump directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Heap Dump Directory Free Space Monitoring Absolute Thresholds setting is configured.
Related Name
Default Value
Warning: Never, Critical: Never
API Name
heap_dump_directory_free_space_percentage_thresholds
Required
false

Hive Downloaded Resources Directory Free Space Monitoring Absolute Thresholds

Description
The health test thresholds for monitoring of free space on the filesystem that contains this role's Hive Downloaded Resources Directory.
Related Name
Default Value
Warning: 10 GiB, Critical: 5 GiB
API Name
hive_llap_hs2_downloaded_resources_directory_free_space_absolute_thresholds
Required
false

Hive Downloaded Resources Directory Free Space Monitoring Percentage Thresholds

Description
The health test thresholds for monitoring of free space on the filesystem that contains this role's Hive Downloaded Resources Directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Hive Downloaded Resources Directory Free Space Monitoring Absolute Thresholds setting is configured.
Related Name
Default Value
Warning: Never, Critical: Never
API Name
hive_llap_hs2_downloaded_resources_directory_free_space_percentage_thresholds
Required
false

Hive Local Scratch Directory Free Space Monitoring Absolute Thresholds

Description
The health test thresholds for monitoring of free space on the filesystem that contains this role's Hive Local Scratch Directory.
Related Name
Default Value
Warning: 10 GiB, Critical: 5 GiB
API Name
hive_llap_hs2_exec_local_scratch_directory_free_space_absolute_thresholds
Required
false

Hive Local Scratch Directory Free Space Monitoring Percentage Thresholds

Description
The health test thresholds for monitoring of free space on the filesystem that contains this role's Hive Local Scratch Directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Hive Local Scratch Directory Free Space Monitoring Absolute Thresholds setting is configured.
Related Name
Default Value
Warning: Never, Critical: Never
API Name
hive_llap_hs2_exec_local_scratch_directory_free_space_percentage_thresholds
Required
false

File Descriptor Monitoring Thresholds

Description
The health test thresholds of the number of file descriptors used. Specified as a percentage of file descriptor limit.
Related Name
Default Value
Warning: 50.0 %, Critical: 70.0 %
API Name
hiveserver2_fd_thresholds
Required
false

HiveServer2 Host Health Test

Description
When computing the overall HiveServer2 health, consider the host's health.
Related Name
Default Value
true
API Name
hiveserver2_host_health_enabled
Required
false

Pause Duration Thresholds

Description
The health test thresholds for the weighted average extra time the pause monitor spent paused. Specified as a percentage of elapsed wall clock time.
Related Name
Default Value
Warning: 30.0, Critical: 60.0
API Name
hiveserver2_pause_duration_thresholds
Required
false

Pause Duration Monitoring Period

Description
The period to review when computing the moving average of extra time the pause monitor spent paused.
Related Name
Default Value
5 minute(s)
API Name
hiveserver2_pause_duration_window
Required
false

HiveServer2 Process Health Test

Description
Enables the health test that the HiveServer2's process state is consistent with the role configuration
Related Name
Default Value
true
API Name
hiveserver2_scm_health_enabled
Required
false

Enable JMX Exporter (beta)

Description
JMX Exporter support is a beta feature. If enabled, CM configures the role to run JMX Exporter in agent mode with the provided port and YAML configuration. This exporter then can be used with the OpenTelemetry Collector feature. See the JMX Exporter documentation.
Related Name
Default Value
false
API Name
jmx_exporter_enabled
Required
true

JMX Exporter Port

Description
JMX Exporter needs a port to implement a Prometheus exporter.
Related Name
Default Value
11121
API Name
jmx_exporter_port
Required
false

JMX Exporter configuration YAML

Description
This configuration is passed to JMX Exporter as it is. See the JMX Exporter documentation.
Related Name
Default Value
startDelaySeconds: 10 ssl: false lowercaseOutputName: true lowercaseOutputLabelNames: true rules: - pattern: 'metrics<name=(jvm\.pause.*)><>(.*): (\d+)' name: $1_$2 value: $3
API Name
jmx_exporter_yaml
Required
false

Log Directory Free Space Monitoring Absolute Thresholds

Description
The health test thresholds for monitoring of free space on the filesystem that contains this role's log directory.
Related Name
Default Value
Warning: 10 GiB, Critical: 5 GiB
API Name
log_directory_free_space_absolute_thresholds
Required
false

Log Directory Free Space Monitoring Percentage Thresholds

Description
The health test thresholds for monitoring of free space on the filesystem that contains this role's log directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Log Directory Free Space Monitoring Absolute Thresholds setting is configured.
Related Name
Default Value
Warning: Never, Critical: Never
API Name
log_directory_free_space_percentage_thresholds
Required
false

Navigator Audit Failure Thresholds

Description
The health test thresholds for failures encountered when monitoring audits within a recent period specified by the mgmt_navigator_failure_window configuration for the role. The value that can be specified for this threshold is the number of bytes of audits data that is left to be sent to audit server.
Related Name
mgmt.navigator.failure.thresholds
Default Value
Warning: Never, Critical: Any
API Name
mgmt_navigator_failure_thresholds
Required
false

Monitoring Period For Audit Failures

Description
The period to review when checking if audits are blocked and not getting processed.
Related Name
mgmt.navigator.failure.window
Default Value
20 minute(s)
API Name
mgmt_navigator_failure_window
Required
false

Navigator Audit Pipeline Health Check

Description
Enable test of audit events processing pipeline. This will test if audit events are not getting processed by Audit Server for a role that generates audit.
Related Name
mgmt.navigator.status.check.enabled
Default Value
true
API Name
mgmt_navigator_status_check_enabled
Required
false

Metric Filter

Description
Defines a Metric Filter for this role. Cloudera Manager Agents will not send filtered metrics to the Service Monitor. Define the following fields:
  • Health Test Metric Set - Select this parameter to collect only metrics required for health tests.
  • Default Dashboard Metric Set - Select this parameter to collect only metrics required for the default dashboards. For user-defined charts, you must add the metrics you require for the chart using the Custom Metrics parameter.
  • Include/Exclude Custom Metrics - Select Include to specify metrics that should be collected. Select Exclude to specify metrics that should not be collected. Enter the metric names to be included or excluded using the Metric Name parameter.
  • Metric Name - The name of a metric that will be included or excluded during metric collection.
If you do not select Health Test Metric Set or Default Dashboard Metric Set, or specify metrics by name, metric filtering will be turned off (this is the default behavior).For example, the following configuration enables the collection of metrics required for Health Tests and the jvm_heap_used_mb metric:
  • Include only Health Test Metric Set: Selected.
  • Include/Exclude Custom Metrics: Set to Include.
  • Metric Name: jvm_heap_used_mb
You can also view the JSON representation for this parameter by clicking View as JSON. In this example, the JSON looks like this:{ "includeHealthTestMetricSet": true, "filterType": "whitelist", "metrics": ["jvm_heap_used_mb"] }
Related Name
Default Value
API Name
monitoring_metric_filter
Required
false

OpenTelemetry Collector Exporters Section

Description
Define the exporters settings as a yaml snippet according to the OpenTelemetry Collector standards. Variable substitution available, see the receivers' help.
Related Name
Default Value
exporters: prometheusremotewrite/$ROLE_NAME: endpoint: $ROLE_PARAM(otelcol_remote_write_url) auth: authenticator: basicauth/common tls: insecure_skip_verify: true retry_on_failure: enabled: true initial_interval: 10s max_interval: 40s max_elapsed_time: 300s
API Name
otelcol_exporters
Required
false

OpenTelemetry Collector Extensions Section

Description
Define the extensions settings as a yaml snippet according to the OpenTelemetry Collector standards. Variable substitution available, see the receivers' help.
Related Name
Default Value
extensions: basicauth/common: client_auth: username: $ROLE_PARAM(otelcol_remote_write_user) password: '$ROLE_PARAM(otelcol_remote_write_password)'
API Name
otelcol_extensions
Required
false

OpenTelemetry Collector Processors Section

Description
Define the processors settings as a yaml snippet according to the OpenTelemetry Collector standards. Variable substitution available, see the receivers' help.
Related Name
Default Value
processors: filter/$ROLE_NAME: metrics: include: match_type: strict metric_names: #memory - jvm_buffer_pool_used_bytes - jvm_buffer_pool_capacity_bytes - jvm_buffer_pool_used_buffers - jvm_memory_bytes_used - jvm_memory_bytes_committed - jvm_memory_bytes_max - jvm_memory_bytes_init #gc - jvm_gc_collection_seconds #threads - jvm_threads_current - jvm_threads_daemon - jvm_threads_peak - jvm_threads_started_total - jvm_threads_deadlocked - jvm_threads_deadlocked_monitor - jvm_threads_state #classes - jvm_classes_currently_loaded #process - process_cpu_seconds_total - process_start_time_seconds - process_open_fds - process_virtual_memory_bytes - jvm_pause_extrasleeptime_count
API Name
otelcol_processors
Required
false

OpenTelemetry Collector Receivers Section

Description
Define the receivers settings as a yaml snippet according to the OpenTelemetry Collector standards. A number of variables can help to use the same config everywhere. The follow strings or expressions will be substituted: $HOST_NAME, $CLUSTER_NAME, $CLUSTER_ID, $SERVICE_TYPE, $SERVICE_NAME, $ROLE_NAME, $ROLE_TYPE, $ROLE_PARAM(my_parameter_name) - e.g.: a port parameter for the role's metrics, $DECODE_B64(...) and $DECODE_URL(...) to decode encoded parameters, $ENV_PARAM(name) to fetch params from the process' environment, $SYS_PARAM(name) to fetch java system properties.
Related Name
Default Value
receivers: prometheus/$ROLE_NAME: config: scrape_configs: - job_name: 'DMP-$ROLE_NAME' scrape_interval: 60s scheme: 'http' static_configs: - targets: ['localhost:$ROLE_PARAM(jmx_exporter_port)'] labels: host: $HOST_NAME cm_cluster_id: $CLUSTER_ID service_type: $SERVICE_TYPE service_name: $SERVICE_NAME role_type: $ROLE_TYPE role_name: $ROLE_NAME node_instance_id: $INFRA(instance_id) resource_crn: $INFRA(resource_crn) platform: $INFRA(platform) formfactor: paas-vm relabel_configs: - source_labels: [resource_crn] regex: 'crn:cdp:([^:]+):.*' replacement: '$$1' target_label: app_type action: replace
API Name
otelcol_receivers
Required
false

OpenTelemetry Collector Remote Write Password

Description
Remote write password for the OpenTelemetry Collector. This param is for convenience and intended to be used at the extensions section of Otelcol settings using the $ROLE_PARAM(otelcol_remote_write_password) expression. Specify $INFRA(cdp_request_signer_password) when forwarding to Cloudera Observability central monitoring. (This is the default.)
Related Name
Default Value
******
API Name
otelcol_remote_write_password
Required
false

OpenTelemetry Collector Remote Write URL

Description
Remote write URL for the OpenTelemetry Collector. This param is for convenience and intended to be used at the exporters section of Otelcol settings using the $ROLE_PARAM(otelcol_remote_write_url) expression. Specify $INFRA(cdp_request_signer_url) when forwarding to Cloudera Observability central monitoring.
Related Name
Default Value
$INFRA(cdp_request_signer_url)
API Name
otelcol_remote_write_url
Required
false

OpenTelemetry Collector Remote Write Username

Description
Remote write username for the OpenTelemetry Collector. This param is for convenience and intended to be used at the extensions section of Otelcol settings using the $ROLE_PARAM(otelcol_remote_write_user) expression. Specify $INFRA(cdp_request_signer_username) when forwarding to Cloudera Observability central monitoring.
Related Name
Default Value
$INFRA(cdp_request_signer_username)
API Name
otelcol_remote_write_user
Required
false

OpenTelemetry Collector Service Section

Description
Define the service settings as a yaml snippet according to the OpenTelemetry Collector standards. Variable substitution available, see the receivers' help.
Related Name
Default Value
service: pipelines: metrics/$ROLE_NAME: receivers: [prometheus/$ROLE_NAME] processors: [filter/$ROLE_NAME] exporters: [prometheusremotewrite/$ROLE_NAME]
API Name
otelcol_service
Required
false

Enable OpenTelemetry Collector (beta)

Description
OpenTelemetry Collector support is a new beta feature (will change without notice) which can run OpenTelemetry Collector as an agent together with the CM Agent to forward metrics to a Prometheus like storage.
Related Name
Default Value
false
API Name
otelcol_should_collect
Required
true

Swap Memory Usage Rate Thresholds

Description
The health test thresholds on the swap memory usage rate of the process. Specified as the change of the used swap memory during the predefined period.
Related Name
Default Value
Warning: Never, Critical: Never
API Name
process_swap_memory_rate_thresholds
Required
false

Swap Memory Usage Rate Window

Description
The period to review when computing unexpected swap memory usage change of the process.
Related Name
common.process.swap_memory_rate_window
Default Value
5 minute(s)
API Name
process_swap_memory_rate_window
Required
false

Process Swap Memory Thresholds

Description
The health test thresholds on the swap memory usage of the process. This takes precedence over the host level threshold.
Related Name
Default Value
Warning: 200 B, Critical: Never
API Name
process_swap_memory_thresholds
Required
false

Role Triggers

Description
The configured triggers for this role. This is a JSON-formatted list of triggers. These triggers are evaluated as part as the health system. Every trigger expression is parsed, and if the trigger condition is met, the list of actions provided in the trigger expression is executed. Each trigger has the following fields:
  • triggerName (mandatory) - The name of the trigger. This value must be unique for the specific role.
  • triggerExpression (mandatory) - A tsquery expression representing the trigger.
  • streamThreshold (optional) - The maximum number of streams that can satisfy a condition of a trigger before the condition fires. By default set to 0, and any stream returned causes the condition to fire.
  • enabled (optional) - By default set to 'true'. If set to 'false', the trigger is not evaluated.
  • expressionEditorConfig (optional) - Metadata for the trigger editor. If present, the trigger should only be edited from the Edit Trigger page; editing the trigger here can lead to inconsistencies.
For example, the following JSON formatted trigger configured for a DataNode fires if the DataNode has more than 1500 file descriptors opened:[{"triggerName": "sample-trigger", "triggerExpression": "IF (SELECT fd_open WHERE roleName=$ROLENAME and last(fd_open) > 1500) DO health:bad", "streamThreshold": 0, "enabled": "true"}]See the trigger rules documentation for more details on how to write triggers using tsquery.The JSON format is evolving and may change and, as a result, backward compatibility is not guaranteed between releases.
Related Name
Default Value
[]
API Name
role_triggers
Required
true

Unexpected Exits Thresholds

Description
The health test thresholds for unexpected exits encountered within a recent period specified by the unexpected_exits_window configuration for the role.
Related Name
Default Value
Warning: Never, Critical: Any
API Name
unexpected_exits_thresholds
Required
false

Unexpected Exits Monitoring Period

Description
The period to review when computing unexpected exits.
Related Name
Default Value
5 minute(s)
API Name
unexpected_exits_window
Required
false

Other

Restrict Cross Joins (Cartesian Products)

Description
Whether to allow queries with cross joins. If set to true, queries that contain this pattern throw a compile-time error.
Related Name
hive.strict.checks.cartesian.product
Default Value
false
API Name
hive_restrict_cross_joins
Required
false

Restrict LOAD Queries Against Bucketed Tables

Description
Whether to allow LOAD queries against bucketed tables. If set to true, queries that contain this pattern throw a compile-time error.
Related Name
hive.strict.checks.bucketing
Default Value
true
API Name
hive_restrict_load_bucketed_table
Required
false

Restrict Queries with ORDER BY but no LIMIT clause

Description
Whether to allow queries with an ORDER BY clause, but no LIMIT clause. If set to true, queries that contain this pattern throw a compile-time error.
Related Name
hive.strict.checks.orderby.no.limit
Default Value
false
API Name
hive_restrict_orderby_with_no_limit
Required
false

Restrict Partitioned Table Scans with no Partitioned Column Filter

Description
Whether to allow queries that scan a partitioned table but don't filter on the partition column. If set to true, queries that contain this pattern throw a compile-time error.
Related Name
hive.strict.checks.no.partition.filter
Default Value
false
API Name
hive_restrict_partitioned_scans_no_filter
Required
false

Restrict Unsafe Data Type Comparisons

Description
Whether to allow queries that compare bigints to strings or doubles. If set to true, queries that contain this pattern throw a compile-time error.
Related Name
hive.strict.checks.type.safety
Default Value
true
API Name
hive_restrict_unsafe_comparison
Required
false

Support Dynamic Service Discovery

Description
Whether HiveServer2 supports dynamic service discovery for its clients. To support this, each instance of HiveServer2 currently uses ZooKeeper to register itself, when it is brought up. JDBC/ODBC clients should use the ZooKeeper ensemble: hive.zookeeper.quorum in their connection string.
Related Name
hive.server2.support.dynamic.service.discovery
Default Value
true
API Name
hive_server2_support_dynamic_service_discovery
Required
false

Hive Server Zookeeper Namespace

Description
The parent node in ZooKeeper used by HiveServer2 when supporting dynamic service discovery.
Related Name
hive.server2.zookeeper.namespace
Default Value
hiveserver2-interactive
API Name
hive_server2_zookeeper_namespace
Required
false

Default query queues

Description
A list of comma separated values corresponding to YARN queues of the same name. When HiveServer2 is launched in Tez mode, this configuration needs to be set for multiple Tez sessions to run in parallel on the cluster.
Related Name
hive.server2.tez.default.queues
Default Value
llap
API Name
hivellap_default_query_queues
Required
false

hive.prewarm.enabled

Description
Enables container prewarm for Tez
Related Name
hive.prewarm.enabled
Default Value
false
API Name
hivellap_prewarm_enabled
Required
false

Number of Containers Held

Description
Controls the number of containers to prewarm for Tez
Related Name
hive.prewarm.numcontainers
Default Value
2
API Name
hivellap_prewarm_numcontainers
Required
false

Start Tez session at Initialization

Description
This flag is used in HiveServer2 to enable a user to use HiveServer2 without turning on Tez for HiveServer2. The user could potentially want to run queries over Tez without the pool of sessions.
Related Name
hive.server2.tez.initialize.default.sessions
Default Value
true
API Name
hivellap_tez_initialize_default_sessions
Required
false

Allow custom queues

Description
Whether to allow the users of this HS2 to specify custom queues - yes, no (fail if specified), ignore (use the default queues even if a custom one is specified)
Related Name
hive.server2.tez.sessions.custom.queue.allowed
Default Value
ignore
API Name
hivellap_tez_sessions_custom_queue_allowed
Required
false

HiveServer2 Enable Impersonation

Description
HiveServer2 will impersonate the beeline client user when talking to other services such as MapReduce and HDFS.
Related Name
hive.server2.enable.doAs
Default Value
true
API Name
hiveserver2_enable_impersonation
Required
false

HiveServer2 Load Balancer

Description
Address of the load balancer used for HiveServer2 roles, specified in host:port format. If port is not specified, the port used by HiveServer2 is used. Note: Changing this property regenerates Kerberos keytabs for all HiveServer2 roles.
Related Name
Default Value
API Name
hiveserver2_load_balancer
Required
false

Performance

Enable Dynamic Partitions

Description
Whether or not to allow dynamic partitions in DML/DDL.
Related Name
hive.exec.dynamic.partition
Default Value
true
API Name
hive_exec_dynamic_partition
Required
false

Hive Auto Convert Join Noconditional Size

Description
If Hive auto convert join is on, and the sum of the size for n-1 of the tables/partitions for a n-way join is smaller than the specified size, the join is directly converted to a MapJoin (there is no conditional task).
Related Name
hive.auto.convert.join.noconditionaltask.size
Default Value
50 MiB
API Name
hiveserver2_auto_convert_join_noconditionaltask_size
Required
false

Store Intermediate Data on Blobstore

Description
When writing data to a table on a blobstore (such as S3), whether or not the blobstore should be used to store intermediate data during Hive query execution. Setting this to true can degrade performance for queries that spawn multiple MR / Spark jobs, but is useful for queries whose intermediate data cannot fit in the allocated HDFS cluster.
Related Name
hive.blobstore.use.blobstore.as.scratchdir
Default Value
false
API Name
hiveserver2_blobstore_use_blobstore_as_scratchdir
Required
false

Enable Stats Optimization

Description
Enable optimization that checks if a query can be answered using statistics. If so, answers the query using only statistics stored in metastore.
Related Name
hive.compute.query.using.stats
Default Value
true
API Name
hiveserver2_compute_query_using_stats
Required
false

Enable Cost-Based Optimizer for Hive

Description
Enabled the Calcite-based Cost-Based Optimizer for HiveServer2.
Related Name
hive.cbo.enable
Default Value
true
API Name
hiveserver2_enable_cbo
Required
false

Enable MapJoin Optimization

Description
Enable optimization that converts common join into MapJoin based on input file size.
Related Name
hive.auto.convert.join
Default Value
true
API Name
hiveserver2_enable_mapjoin
Required
false

Fetch Task Query Conversion

Description
Some select queries can be converted to a single FETCH task instead of a MapReduce task, minimizing latency. A value of none disables all conversion, minimal converts simple queries such as SELECT * and filter on partition columns, and more converts SELECT queries including FILTERS.
Related Name
hive.fetch.task.conversion
Default Value
more
API Name
hiveserver2_fetch_task_conversion
Required
false

Fetch Task Query Conversion Threshold

Description
Above this size, queries are converted to fetch tasks.
Related Name
hive.fetch.task.conversion.threshold
Default Value
1 GiB
API Name
hiveserver2_fetch_task_conversion_threshold
Required
false

Input Listing Max Threads

Description
Maximum number of threads that Hive uses to list input files. Increasing this value can improve performance when there are a lot of partitions being read, or when running on blobstores.
Related Name
hive.exec.input.listing.max.threads
Default Value
15
API Name
hiveserver2_input_listing_max_threads
Required
false

Maximum ReduceSink Top-K Memory Usage

Description
The maximum percentage of heap to be used for hash in ReduceSink operator for Top-K selection. 0 means the optimization is disabled. Accepted values are between 0 and 1.
Related Name
hive.limit.pushdown.memory.usage
Default Value
0.04
API Name
hiveserver2_limit_pushdown_memory_usage
Required
false

Load Dynamic Partitions Thread Count

Description
Number of threads used to load dynamically generated partitions. Loading requires renaming the file its final location, and updating some metadata about the new partition. Increasing this can improve performance when there are a lot of partitions dynamically generated.
Related Name
hive.load.dynamic.partitions.thread
Default Value
15
API Name
hiveserver2_load_dynamic_partitions_thread_count
Required
false

Enable Map-Side Aggregation

Description
Enable map-side partial aggregation, which cause the mapper to generate fewer rows. This reduces the data to be sorted and distributed to reducers.
Related Name
hive.map.aggr
Default Value
true
API Name
hiveserver2_map_aggr
Required
false

Ratio of Memory Usage for Map-Side Aggregation

Description
Portion of total memory used in map-side partial aggregation. When exceeded, the partially aggregated results will be flushed from the map task to the reducers.
Related Name
hive.map.aggr.hash.percentmemory
Default Value
0.5
API Name
hiveserver2_map_aggr_hash_memory_ratio
Required
false

Enable Merging Small Files - Map-Only Job

Description
Merge small files at the end of a map-only job. When enabled, a map-only job is created to merge the files in the destination table/partitions.
Related Name
hive.merge.mapfiles
Default Value
true
API Name
hiveserver2_merge_mapfiles
Required
false

Enable Merging Small Files - Map-Reduce Job

Description
Merge small files at the end of a map-reduce job. When enabled, a map-only job is created to merge the files in the destination table/partitions.
Related Name
hive.merge.mapredfiles
Default Value
false
API Name
hiveserver2_merge_mapredfiles
Required
false

Desired File Size After Merging

Description
The desired file size after merging. This should be larger than hive.merge.smallfiles.avgsize.
Related Name
hive.merge.size.per.task
Default Value
256 MiB
API Name
hiveserver2_merge_size_per_task
Required
false

Small File Average Size Merge Threshold

Description
When the average output file size of a job is less than the value of this property, Hive will start an additional map-only job to merge the output files into bigger files. This is only done for map-only jobs if hive.merge.mapfiles is true, for map-reduce jobs if hive.merge.mapredfiles is true, and for Spark jobs if hive.merge.sparkfiles is true.
Related Name
hive.merge.smallfiles.avgsize
Default Value
16 MiB
API Name
hiveserver2_merge_smallfiles_avgsize
Required
false

MSCK Repair Batch Size

Description
Batch size for the msck repair command (recover partitions command). If the value is greater than zero, new partition information will be sent from HiveServer2 to the Metastore in batches, which can potentially improve memory usage in the Metastore and avoid client read timeout exceptions. If this value is 0, all partition information will sent in a single Thrift call.
Related Name
hive.msck.repair.batch.size
Default Value
3000
API Name
hiveserver2_msck_repair_batch_size
Required
false

Move Files Thread Count

Description
The number of threads used by HiveServer2 to move data from the staging directory to another location (typically to the final table location). A separate thread pool of workers of this size is used for each query, which means this configuration can be set on a per-query basis too.
Related Name
hive.mv.files.thread
Default Value
15
API Name
hiveserver2_mv_files_thread
Required
false

Hive Optimize Sorted Merge Bucket Join

Description
Whether to try sorted merge bucket (SMB) join.
Related Name
hive.optimize.bucketmapjoin.sortedmerge
Default Value
false
API Name
hiveserver2_optimize_bucketmapjoin_sortedmerge
Required
false

Enable Automatic Use of Indexes

Description
Whether to use the indexing optimization for all queries.
Related Name
hive.optimize.index.filter
Default Value
true
API Name
hiveserver2_optimize_index_filter
Required
false

Enable ReduceDeDuplication Optimization

Description
Remove extra map-reduce jobs if the data is already clustered by the same key, eliminating the need to repartition the dataset again.
Related Name
hive.optimize.reducededuplication
Default Value
true
API Name
hiveserver2_optimize_reducededuplication
Required
false

Mininum Reducers for ReduceDeDuplication Optimization

Description
When the number of ReduceSink operators after merging is less than this number, the ReduceDeDuplication optimization will be disabled.
Related Name
hive.optimize.reducededuplication.min.reducer
Default Value
4
API Name
hiveserver2_optimize_reducededuplication_min_reducer
Required
false

Enable Sorted Dynamic Partition Optimizer

Description
When dynamic partition is enabled, reducers keep only one record writer at all times, which lowers the memory pressure on reducers.
Related Name
hive.optimize.sort.dynamic.partition
Default Value
false
API Name
hiveserver2_optimize_sort_dynamic_partition
Required
false

Enable Parallel Compilation of Queries

Description
When activated, individual sessions can compile queries simultaneously. Within each session, queries compile one at a time.
Related Name
hive.driver.parallel.compilation
Default Value
true
API Name
hiveserver2_parallel_compilation_enabled
Required
false

Query Compilation Degree of Parallelism

Description
Determines the maximum number of queries that can compile in parallel on a HiveServer2 instance. Use negative values or zero to set unlimited parallelism. Use a positive value to set the number of queries that can compile simultaneously. This setting can be fine-tuned based on the current cluster load. Monitor cluster load using the 'waiting_compile_ops' metric and the 'Waiting Compile Operations' graph in the HiveServer2 graph library.
Related Name
hive.driver.parallel.compilation.global.limit
Default Value
5
API Name
hiveserver2_parallel_compilation_global_limit
Required
false

Hive SMB Join Cache Rows

Description
The number of rows with the same key value to be cached in memory per SMB-joined table.
Related Name
hive.smbjoin.cache.rows
Default Value
10000
API Name
hiveserver2_smbjoin_cache_rows
Required
false

Load Column Statistics

Description
Whether column stats for a table are fetched during explain.
Related Name
hive.stats.fetch.column.stats
Default Value
true
API Name
hiveserver2_stats_fetch_column_stats
Required
false

Sessions Per Queue

Description
The number of Tez sessions that should be launched on each of the queues specified by "hive.server2.tez.default.queues". Determines the parallelism on each queue.
Related Name
hive.server2.tez.sessions.per.default.queue
Default Value
4
API Name
hiveserver2_tez_sessions_per_default_queue
Required
false

Vectorized Adapter Usage Mode

Description
Vectorized Adaptor Usage Mode specifies the extent to which the vectorization engine tries to vectorize UDFs that do not have native vectorized versions available. Selecting the "none" option specifies that only queries using native vectorized UDFs are vectorized. Selecting the "chosen" option specifies that Hive choses to vectorize a subset of the UDFs based on performance benefits using the Vectorized Adaptor. Selecting the "all" option specifies that the Vectorized Adaptor be used for all UDFs even when native vectorized versions are not available.
Related Name
hive.vectorized.adaptor.usage.mode
Default Value
chosen
API Name
hiveserver2_vectorized_adaptor_usage_mode
Required
false

Enable Vectorization Optimization

Description
Enable optimization that vectorizes query execution by streamlining operations by processing a block of 1024 rows at a time.
Related Name
hive.vectorized.execution.enabled
Default Value
true
API Name
hiveserver2_vectorized_enabled
Required
false

Vectorized GroupBy Check Interval

Description
In vectorized group-by, the number of row entries added to the hash table before re-checking average variable size for memory usage estimation.
Related Name
hive.vectorized.groupby.checkinterval
Default Value
4096
API Name
hiveserver2_vectorized_groupby_checkinterval
Required
false

Vectorized GroupBy Flush Ratio

Description
Ratio between 0.0 and 1.0 of entries in the vectorized group-by aggregation hash that is flushed when the memory threshold is exceeded.
Related Name
hive.vectorized.groupby.flush.percent
Default Value
0.1
API Name
hiveserver2_vectorized_groupby_flush_ratio
Required
false

Enable Vectorized Input Format

Description
If enabled, Hive uses the native vectorized input format for vectorized query execution when it is available.
Related Name
hive.vectorized.use.vectorized.input.format
Default Value
true
API Name
hiveserver2_vectorized_input_format_enabled
Required
false

Exclude Vectorized Input Formats

Description
Specifies a list of file input format classnames to exclude from vectorized query execution using the vectorized input format. Note that vectorized execution can still occur for an excluded input format based on whether row SerDes or vector SerDes are enabled.
Related Name
hive.vectorized.input.format.excludes
Default Value
API Name
hiveserver2_vectorized_input_format_excludes
Required
false

Enable Reduce-Side Vectorization

Description
Whether to vectorize the reduce side of query execution.
Related Name
hive.vectorized.execution.reduce.enabled
Default Value
true
API Name
hiveserver2_vectorized_reduce_enabled
Required
false

Enable Overflow-checked Vector Expressions

Description
To enhance performance, vectorized expressions operate using wide data types like long and double. When wide data types are used, numeric overflows can occur during expression evaluation in a different manner for vectorized expressions than they do for non-vectorized expressions. Consequently, different query results can be returned for vectorized expressions compared to results returned for non-vectorized expressions. When this configuration is enabled, Hive uses vectorized expressions that handle numeric overflows in the same way as non-vectorized expressions are handled.
Related Name
hive.vectorized.use.checked.expressions
Default Value
true
API Name
hiveserver2_vectorized_use_checked_expressions
Required
false

Vectorize Using Vector SerDes

Description
If enabled, Hive uses built-in vector SerDes to process text and sequencefile tables for vectorized query execution.
Related Name
hive.vectorized.use.vector.serde.deserialize
Default Value
false
API Name
hiveserver2_vectorized_use_vector_serde_deserialize
Required
false

Maximum Process File Descriptors

Description
If configured, overrides the process soft and hard rlimits (also called ulimits) for file descriptors to the configured value.
Related Name
Default Value
API Name
rlimit_fds
Required
false

Ports and Addresses

Thrift port

Description
TCP port number to listen on.
Related Name
hive.server2.thrift.http.port
Default Value
10501
API Name
hive_server2_thrift_http_port
Required
false

Bind HiveServer2 to Wildcard Address

Description
If enabled, the HiveServer2 binds to the wildcard address ("0.0.0.0") on all of its ports.
Related Name
hive.server2.webui.host
Default Value
true
API Name
hiveserver2_webui_bind_wildcard
Required
false

HiveServer2 WebUI Port

Description
The port the HiveServer2 WebUI will listen on. This can be set to 0 to disable the WebUI.
Related Name
hive.server2.webui.port
Default Value
10502
API Name
hiveserver2_webui_port
Required
false

HiveServer2 Port

Description
Port on which HiveServer2 will listen for connections.
Related Name
hive.server2.thrift.port
Default Value
10500
API Name
hs2_thrift_address_port
Required
false

Resource Management

Java Heap Size of HiveServer2 in Bytes

Description
Maximum size in bytes for the Java Process heap memory. Passed to Java -Xmx.
Related Name
Default Value
4 GiB
API Name
hiveserver2_java_heapsize
Required
false

Cgroup CPU Shares

Description
Number of CPU shares to assign to this role. The greater the number of shares, the larger the share of the host's CPUs that will be given to this role when the host experiences CPU contention. Must be between 2 and 262144. Defaults to 1024 for processes not managed by Cloudera Manager.
Related Name
cpu.shares
Default Value
1024
API Name
rm_cpu_shares
Required
true

Custom Control Group Resources (overrides Cgroup settings)

Description
Custom control group resources to assign to this role, which will be enforced by the Linux kernel. These resources should exist on the target hosts, otherwise an error will occur when the process starts. Use the same format as used for arguments to the cgexec command: resource1,resource2:path1 or resource3:path2 For example: 'cpu,memory:my/path blkio:my2/path2' ***These settings override other cgroup settings.***
Related Name
custom.cgroups
Default Value
API Name
rm_custom_resources
Required
false

Cgroup I/O Weight

Description
Weight for the read I/O requests issued by this role. The greater the weight, the higher the priority of the requests when the host experiences I/O contention. Must be between 100 and 1000. Defaults to 1000 for processes not managed by Cloudera Manager.
Related Name
blkio.weight
Default Value
500
API Name
rm_io_weight
Required
true

Cgroup Memory Hard Limit

Description
Hard memory limit to assign to this role, enforced by the Linux kernel. When the limit is reached, the kernel will reclaim pages charged to the process. If reclaiming fails, the kernel may kill the process. Both anonymous as well as page cache pages contribute to the limit. Use a value of -1 to specify no limit. By default processes not managed by Cloudera Manager will have no limit. If the value is -1, Cloudera Manager will not monitor Cgroup memory usage therefore some of the charts will show 'No Data'
Related Name
memory.limit_in_bytes
Default Value
-1 MiB
API Name
rm_memory_hard_limit
Required
true

Cgroup Memory Soft Limit

Description
Soft memory limit to assign to this role, enforced by the Linux kernel. When the limit is reached, the kernel will reclaim pages charged to the process if and only if the host is facing memory pressure. If reclaiming fails, the kernel may kill the process. Both anonymous as well as page cache pages contribute to the limit. Use a value of -1 to specify no limit. By default processes not managed by Cloudera Manager will have no limit. If the value is -1, Cloudera Manager will not monitor Cgroup memory usage therefore some of the charts will show 'No Data'
Related Name
memory.soft_limit_in_bytes
Default Value
-1 MiB
API Name
rm_memory_soft_limit
Required
true

Security

HiveServer2 WebUI SSL Exclude Cipher Suites

Description
The cipher suites should be excluded from WebUI SSL.
Related Name
hive.server2.webui.exclude.ciphersuites
Default Value
modern2018
API Name
hiveserver2_webui_exclude_ciphersuites
Required
false

Enable TLS/SSL for HiveServer2 WebUI

Description
Encrypt communication between clients and HiveServer2 WebUI using Transport Layer Security (TLS) (formerly known as Secure Socket Layer (SSL)).
Related Name
hive.server2.webui.use.ssl
Default Value
false
API Name
ssl_enabled
Required
false

HiveServer2 WebUI TLS/SSL Server Keystore File Location

Description
The path to the TLS/SSL keystore file containing the server certificate and private key used for TLS/SSL. Used when HiveServer2 WebUI is acting as a TLS/SSL server. The keystore must be in the format specified in Administration > Settings > Java Keystore Type.
Related Name
hive.server2.webui.keystore.path
Default Value
API Name
ssl_server_keystore_location
Required
false

HiveServer2 WebUI TLS/SSL Server Keystore File Password

Description
The password for the HiveServer2 WebUI keystore file.
Related Name
hive.server2.webui.keystore.password
Default Value
API Name
ssl_server_keystore_password
Required
false

Stacks Collection

Stacks Collection Data Retention

Description
The amount of stacks data that is retained. After the retention limit is reached, the oldest data is deleted.
Related Name
stacks_collection_data_retention
Default Value
100 MiB
API Name
stacks_collection_data_retention
Required
false

Stacks Collection Directory

Description
The directory in which stacks logs are placed. If not set, stacks are logged into a stacks subdirectory of the role's log directory. If this directory already exists, it will be owned by the current role user with 755 permissions. Sharing the same directory among multiple roles will cause an ownership race.
Related Name
stacks_collection_directory
Default Value
API Name
stacks_collection_directory
Required
false

Stacks Collection Enabled

Description
Whether or not periodic stacks collection is enabled.
Related Name
stacks_collection_enabled
Default Value
false
API Name
stacks_collection_enabled
Required
true

Stacks Collection Frequency

Description
The frequency with which stacks are collected.
Related Name
stacks_collection_frequency
Default Value
5.0 second(s)
API Name
stacks_collection_frequency
Required
false

Stacks Collection Method

Description
The method used to collect stacks. The jstack option involves periodically running the jstack command against the role's daemon process. The servlet method is available for those roles that have an HTTP server endpoint exposing the current stacks traces of all threads. When the servlet method is selected, that HTTP endpoint is periodically scraped.
Related Name
stacks_collection_method
Default Value
jstack
API Name
stacks_collection_method
Required
false

Suppressions

Suppress Configuration Validator: CDH Version Validator

Description
Whether to suppress configuration warnings produced by the CDH Version Validator configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_cdh_version_validator
Required
true

Suppress Parameter Validation: HiveServer2 Environment Advanced Configuration Snippet (Safety Valve)

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 Environment Advanced Configuration Snippet (Safety Valve) parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_hs2_env_safety_valve
Required
true

Suppress Parameter Validation: HiveServer2 Log Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 Log Directory parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_log_dir
Required
true

Suppress Parameter Validation: Metrics Sample File Location

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Metrics Sample File Location parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_metrics_sample_file_location
Required
true

Suppress Configuration Validator: Restrict Load Bucketed Table Validator

Description
Whether to suppress configuration warnings produced by the Restrict Load Bucketed Table Validator configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_restrict_load_bucketed_table_validator
Required
true

Suppress Configuration Validator: Restrict Unsafe Comparison Validator

Description
Whether to suppress configuration warnings produced by the Restrict Unsafe Comparison Validator configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_restrict_unsafe_comparison_validator
Required
true

Suppress Parameter Validation: HiveServer2 Operations Log Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 Operations Log Directory parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_server2_logging_operation_log_location
Required
true

Suppress Parameter Validation: Thrift port

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Thrift port parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_server2_thrift_http_port
Required
true

Suppress Parameter Validation: Hive Server Zookeeper Namespace

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Server Zookeeper Namespace parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_server2_zookeeper_namespace
Required
true

Suppress Parameter Validation: Default query queues

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Default query queues parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hivellap_default_query_queues
Required
true

Suppress Parameter Validation: HiveServer2 Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 Advanced Configuration Snippet (Safety Valve) for hive-site.xml parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hivellap_hs2_config_safety_valve
Required
true

Suppress Parameter Validation: Allow custom queues

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Allow custom queues parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hivellap_tez_sessions_custom_queue_allowed
Required
true

Suppress Parameter Validation: Hive Downloaded Resources Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Downloaded Resources Directory parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_downloaded_resources_dir
Required
true

Suppress Parameter Validation: Hive Local Scratch Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Local Scratch Directory parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_exec_local_scratchdir
Required
true

Suppress Parameter Validation: Hive HDFS Scratch Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive HDFS Scratch Directory parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_exec_scratchdir
Required
true

Suppress Parameter Validation: Fair Scheduler XML Advanced Configuration Snippet (Safety Valve)

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Fair Scheduler XML Advanced Configuration Snippet (Safety Valve) parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_fair_scheduler_safety_valve
Required
true

Suppress Parameter Validation: Java Configuration Options for HiveServer2

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Java Configuration Options for HiveServer2 parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_java_opts
Required
true

Suppress Parameter Validation: HiveServer2 Load Balancer

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 Load Balancer parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_load_balancer
Required
true

Suppress Parameter Validation: Exclude Vectorized Input Formats

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Exclude Vectorized Input Formats parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_vectorized_input_format_excludes
Required
true

Suppress Parameter Validation: HiveServer2 WebUI Port

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 WebUI Port parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_webui_port
Required
true

Suppress Parameter Validation: HiveServer2 Advanced Configuration Snippet (Safety Valve) for core-site.xml

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 Advanced Configuration Snippet (Safety Valve) for core-site.xml parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hs2_core_site_safety_valve
Required
true

Suppress Parameter Validation: HiveServer2 Port

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 Port parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hs2_thrift_address_port
Required
true

Suppress Parameter Validation: JMX Exporter Port

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the JMX Exporter Port parameter.
Related Name
Default Value
false
API Name
role_config_suppression_jmx_exporter_port
Required
true

Suppress Parameter Validation: JMX Exporter configuration YAML

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the JMX Exporter configuration YAML parameter.
Related Name
Default Value
false
API Name
role_config_suppression_jmx_exporter_yaml
Required
true

Suppress Parameter Validation: HiveServer2 Logging Advanced Configuration Snippet (Safety Valve)

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 Logging Advanced Configuration Snippet (Safety Valve) parameter.
Related Name
Default Value
false
API Name
role_config_suppression_log4j_safety_valve
Required
true

Suppress Parameter Validation: Heap Dump Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Heap Dump Directory parameter.
Related Name
Default Value
false
API Name
role_config_suppression_oom_heap_dump_dir
Required
true

Suppress Parameter Validation: OpenTelemetry Collector Exporters Section

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Exporters Section parameter.
Related Name
Default Value
false
API Name
role_config_suppression_otelcol_exporters
Required
true

Suppress Parameter Validation: OpenTelemetry Collector Extensions Section

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Extensions Section parameter.
Related Name
Default Value
false
API Name
role_config_suppression_otelcol_extensions
Required
true

Suppress Parameter Validation: OpenTelemetry Collector Processors Section

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Processors Section parameter.
Related Name
Default Value
false
API Name
role_config_suppression_otelcol_processors
Required
true

Suppress Parameter Validation: OpenTelemetry Collector Receivers Section

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Receivers Section parameter.
Related Name
Default Value
false
API Name
role_config_suppression_otelcol_receivers
Required
true

Suppress Parameter Validation: OpenTelemetry Collector Remote Write Password

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Remote Write Password parameter.
Related Name
Default Value
false
API Name
role_config_suppression_otelcol_remote_write_password
Required
true

Suppress Parameter Validation: OpenTelemetry Collector Remote Write URL

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Remote Write URL parameter.
Related Name
Default Value
false
API Name
role_config_suppression_otelcol_remote_write_url
Required
true

Suppress Parameter Validation: OpenTelemetry Collector Remote Write Username

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Remote Write Username parameter.
Related Name
Default Value
false
API Name
role_config_suppression_otelcol_remote_write_user
Required
true

Suppress Parameter Validation: OpenTelemetry Collector Service Section

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Service Section parameter.
Related Name
Default Value
false
API Name
role_config_suppression_otelcol_service
Required
true

Suppress Parameter Validation: Custom Control Group Resources (overrides Cgroup settings)

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Custom Control Group Resources (overrides Cgroup settings) parameter.
Related Name
Default Value
false
API Name
role_config_suppression_rm_custom_resources
Required
true

Suppress Parameter Validation: Role Triggers

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Role Triggers parameter.
Related Name
Default Value
false
API Name
role_config_suppression_role_triggers
Required
true

Suppress Parameter Validation: HiveServer2 WebUI TLS/SSL Server Keystore File Location

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 WebUI TLS/SSL Server Keystore File Location parameter.
Related Name
Default Value
false
API Name
role_config_suppression_ssl_server_keystore_location
Required
true

Suppress Parameter Validation: HiveServer2 WebUI TLS/SSL Server Keystore File Password

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 WebUI TLS/SSL Server Keystore File Password parameter.
Related Name
Default Value
false
API Name
role_config_suppression_ssl_server_keystore_password
Required
true

Suppress Parameter Validation: Stacks Collection Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Stacks Collection Directory parameter.
Related Name
Default Value
false
API Name
role_config_suppression_stacks_collection_directory
Required
true

Suppress Parameter Validation: tez.history.logging.taskattempt-filters

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the tez.history.logging.taskattempt-filters parameter.
Related Name
Default Value
false
API Name
role_config_suppression_tez_interactive_history_logging_taskattempt_filters
Required
true

Suppress Health Test: Audit Pipeline Test

Description
Whether to suppress the results of the Audit Pipeline Test heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hive_llap_hiveserver2_audit_health
Required
true

Suppress Health Test: File Descriptors

Description
Whether to suppress the results of the File Descriptors heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hive_llap_hiveserver2_file_descriptor
Required
true

Suppress Health Test: Heap Dump Directory Free Space

Description
Whether to suppress the results of the Heap Dump Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hive_llap_hiveserver2_heap_dump_directory_free_space
Required
true

Suppress Health Test: Host Health

Description
Whether to suppress the results of the Host Health heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hive_llap_hiveserver2_host_health
Required
true

Suppress Health Test: Log Directory Free Space

Description
Whether to suppress the results of the Log Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hive_llap_hiveserver2_log_directory_free_space
Required
true

Suppress Health Test: Otelcol Health

Description
Whether to suppress the results of the Otelcol Health heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hive_llap_hiveserver2_otelcol_health
Required
true

Suppress Health Test: Pause Duration

Description
Whether to suppress the results of the Pause Duration heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hive_llap_hiveserver2_pause_duration
Required
true

Suppress Health Test: Process Status

Description
Whether to suppress the results of the Process Status heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hive_llap_hiveserver2_scm_health
Required
true

Suppress Health Test: Swap Memory Usage

Description
Whether to suppress the results of the Swap Memory Usage heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hive_llap_hiveserver2_swap_memory_usage
Required
true

Suppress Health Test: Swap Memory Usage Rate Beta

Description
Whether to suppress the results of the Swap Memory Usage Rate Beta heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hive_llap_hiveserver2_swap_memory_usage_rate
Required
true

Suppress Health Test: Unexpected Exits

Description
Whether to suppress the results of the Unexpected Exits heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hive_llap_hiveserver2_unexpected_exits
Required
true

Suppress Health Test: Hive Downloaded Resources Directory Free Space

Description
Whether to suppress the results of the Hive Downloaded Resources Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hive_llap_hs2_downloaded_resources_directory_free_space
Required
true

Suppress Health Test: Hive Local Scratch Directory Free Space

Description
Whether to suppress the results of the Hive Local Scratch Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hive_llap_hs2_exec_local_scratch_directory_free_space
Required
true

Tez interactive

tez.am.am-rm.heartbeat.interval-ms.max

Description
The heartbeat interval between the tez AM and YARN RM
Related Name
tez.am.am-rm.heartbeat.interval-ms.max
Default Value
10 second(s)
API Name
tez_interactive_am_am_rm_heartbeat_interval_ms_max
Required
false

tez.am.client.heartbeat.poll.interval.millis

Description
The interval at which the AM checks for a client heartbeat timeout
Related Name
tez.am.client.heartbeat.poll.interval.millis
Default Value
6 second(s)
API Name
tez_interactive_am_client_heartbeat_poll_interval_millis
Required
false

tez.am.client.heartbeat.timeout.secs

Description
The time interval, after which an AM will kill itself, if it does not receive a heartbeat from the client.
Related Name
tez.am.client.heartbeat.timeout.secs
Default Value
1 minute(s), 30 second(s)
API Name
tez_interactive_am_client_heartbeat_timeout_secs
Required
false

tez.am.node-blacklisting.enabled

Description
Whether to enable blacklisting in Tez AMs. Disable for LLAP
Related Name
tez.am.node-blacklisting.enabled
Default Value
false
API Name
tez_interactive_am_node_blacklisting_enabled
Required
false

tez.am.resource.memory.mb

Description
The amount of memory to be used by the AppMaster
Related Name
tez.am.resource.memory.mb
Default Value
1 GiB
API Name
tez_interactive_am_resource_memory_mb
Required
false

tez.am.task.listener.thread-count

Description
Number of IPC server thread for Tez task listener. Should be minimized for LLAP
Related Name
tez.am.task.listener.thread-count
Default Value
1
API Name
tez_interactive_am_task_listener_thread_count
Required
false

tez.am.task.reschedule.higher.priority

Description
Whether rescheduled tasks should be treated at higher priority
Related Name
tez.am.task.reschedule.higher.priority
Default Value
false
API Name
tez_interactive_am_task_reschedule_higher_priority
Required
false

tez.container.max.java.heap.fraction

Description
Setting this to -1 so that Tez can auto determine different Xmx for different container size
Related Name
tez.container.max.java.heap.fraction
Default Value
-1.0
API Name
tez_interactive_container_max_java_heap_fraction
Required
false

tez.dag.recovery.enabled

Description
tez.dag.recovery.enabled
Related Name
tez.dag.recovery.enabled
Default Value
false
API Name
tez_interactive_dag_recovery_enabled
Required
false

tez.grouping.node.local.only

Description
tez.grouping.node.local.only
Related Name
tez.grouping.node.local.only
Default Value
true
API Name
tez_interactive_grouping_node_local_only
Required
false

tez.history.logging.log.level

Description
Set the log level to TASK_ATTEMPT.
Related Name
tez.history.logging.log.level
Default Value
TASK_ATTEMPT
API Name
tez_interactive_history_logging_log_level
Required
false

tez.history.logging.taskattempt-filters

Description
TASK_ATTEMPT events to be ignored.
Related Name
tez.history.logging.taskattempt-filters
Default Value
SERVICE_BUSY, EXTERNAL_PREEMPTION
API Name
tez_interactive_history_logging_taskattempt_filters
Required
false

tez.history.logging.timeline.num-dags-per-group

Description
Maximum number of dags per group.
Related Name
tez.history.logging.timeline.num-dags-per-group
Default Value
5
API Name
tez_interactive_history_logging_timeline_num_dags_per_group
Required
false

tez.runtime.enable.final-merge.in.output

Description
Whether to enable a map side merge of outputs
Related Name
tez.runtime.enable.final-merge.in.output
Default Value
false
API Name
tez_interactive_runtime_enable_final_merge_in_output
Required
false

tez.runtime.io.sort.mb

Description
The size of the sort buffer when output needs to be sorted
Related Name
tez.runtime.io.sort.mb
Default Value
512 MiB
API Name
tez_interactive_runtime_io_sort_mb
Required
false

tez.runtime.pipelined-shuffle.enabled

Description
tez.runtime.pipelined-shuffle.enabled
Related Name
tez.runtime.pipelined-shuffle.enabled
Default Value
false
API Name
tez_interactive_runtime_pipelined_shuffle_enabled
Required
false

tez.runtime.pipelined.sorter.lazy-allocate.memory

Description
tez.runtime.pipelined.sorter.lazy-allocate.memory
Related Name
tez.runtime.pipelined.sorter.lazy-allocate.memory
Default Value
true
API Name
tez_interactive_runtime_pipelined_sorter_lazy_allocate_memory
Required
false

tez.runtime.report.partition.stats

Description
tez.runtime.report.partition.stats
Related Name
tez.runtime.report.partition.stats
Default Value
true
API Name
tez_interactive_runtime_report_partition_stats
Required
false

tez.runtime.shuffle.connect.timeout

Description
Shuffle connect timeouts (ms)
Related Name
tez.runtime.shuffle.connect.timeout
Default Value
30 second(s)
API Name
tez_interactive_runtime_shuffle_connect_timeout
Required
false

tez.runtime.shuffle.fetch.buffer.percent

Description
Fraction (0-1) of the available memory which can be used to retain shuffled data
Related Name
tez.runtime.shuffle.fetch.buffer.percent
Default Value
0.6
API Name
tez_interactive_runtime_shuffle_fetch_buffer_percent
Required
false

tez.runtime.shuffle.fetch.verify-disk-checksum

Description
tez.runtime.shuffle.fetch.verify-disk-checksum
Related Name
tez.runtime.shuffle.fetch.verify-disk-checksum
Default Value
false
API Name
tez_interactive_runtime_shuffle_fetch_verify_disk_checksum
Required
false

tez.runtime.shuffle.keep-alive.enabled

Description
Connection keep-alive for shuffle
Related Name
tez.runtime.shuffle.keep-alive.enabled
Default Value
true
API Name
tez_interactive_runtime_shuffle_keep_alive_enabled
Required
false

tez.runtime.shuffle.memory.limit.percent

Description
This property determines the maximum size of a shuffle segment which can be fetched to memory. Fraction (0-1) of shuffle memory (after applying tez.runtime.shuffle.fetch.buffer.percent)
Related Name
tez.runtime.shuffle.memory.limit.percent
Default Value
0.25
API Name
tez_interactive_runtime_shuffle_memory_limit_percent
Required
false

tez.runtime.shuffle.parallel.copies

Description
tez.runtime.shuffle.parallel.copies
Related Name
tez.runtime.shuffle.parallel.copies
Default Value
8
API Name
tez_interactive_runtime_shuffle_parallel_copies
Required
false

tez.runtime.shuffle.read.timeout

Description
Shuffle read timeout (ms)
Related Name
tez.runtime.shuffle.read.timeout
Default Value
30 second(s)
API Name
tez_interactive_runtime_shuffle_read_timeout
Required
false

tez.runtime.shuffle.ssl.enable

Description
tez.runtime.shuffle.ssl.enable
Related Name
tez.runtime.shuffle.ssl.enable
Default Value
false
API Name
tez_interactive_runtime_shuffle_ssl_enable
Required
false

tez.runtime.unordered.output.buffer.size-mb

Description
The size of the buffer when output does not require to be sorted
Related Name
tez.runtime.unordered.output.buffer.size-mb
Default Value
100 MiB
API Name
tez_interactive_runtime_unordered_output_buffer_size_mb
Required
false

tez.runtime.unordered.output.max-per-buffer.size-bytes

Description
tez.runtime.unordered.output.max-per-buffer.size-bytes
Related Name
tez.runtime.unordered.output.max-per-buffer.size-bytes
Default Value
128 MiB
API Name
tez_interactive_runtime_unordered_output_max_per_buffer_size_bytes
Required
false

tez.session.am.dag.submit.timeout.secs

Description
The amount of time an AM will wait, before killing itself, if not DAG is submitted.
Related Name
tez.session.am.dag.submit.timeout.secs
Default Value
14 day(s)
API Name
tez_interactive_session_am_dag_submit_timeout_secs
Required
false

tez.task.heartbeat.timeout.check-ms

Description
The time interval, in milliseconds, at which the AM will check for timed out tasks
Related Name
tez.task.heartbeat.timeout.check-ms
Default Value
15 second(s)
API Name
tez_interactive_task_heartbeat_timeout_check_ms
Required
false

tez.task.timeout-ms

Description
mount of time the Tez AM waits before marking a task which has not sent in a heartbeat, as timed out
Related Name
tez.task.timeout-ms
Default Value
1 minute(s), 30 second(s)
API Name
tez_interactive_task_timeout_ms
Required
false

LLAP Proxy

Advanced

Metrics Sample File Location

Description
The full path to a file with a sample of metrics exposed by the role. The sample is updated at the frequency configured by Metrics Sample File Logging Frequency. By default, the sample file is logged to a directory under the role log directory, e.g., /var/log/hive/metrics-hivemetastore/metrics.log. The setting only has an effect if "Enable Metrics Subsystem" is set to true.
Related Name
hive.service.metrics.file.location
Default Value
API Name
hive_metrics_sample_file_location
Required
false

LLAP Daemon Java Options

Description
Extra Java options that will be applied on the JVM processes of LLAP Daemons.
Related Name
Default Value
API Name
hivellap_daemon_opts
Required
false

LLAP Proxy Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
For advanced use only. A string to be inserted into hive-site.xml for this role only.
Related Name
Default Value
API Name
hivellap_llapproxy_config_safety_valve
Required
false

LLAP Proxy Environment Advanced Configuration Snippet (Safety Valve)

Description
For advanced use only, key-value pairs (one on each line) to be inserted into a role's environment. Applies to configurations of this role except client configuration.
Related Name
Default Value
API Name
LLAPPROXY_role_env_safety_valve
Required
false

Enable auto refresh for metric configurations

Description
When true, Enable Metric Collection and Metric Filter parameters will be set automatically if they're changed. Otherwise, a refresh by hand is required.
Related Name
Default Value
false
API Name
metric_config_auto_refresh
Required
false

Heap Dump Directory

Description
Path to directory where heap dumps are generated when java.lang.OutOfMemoryError error is thrown. This directory is automatically created if it does not exist. If this directory already exists, it will be owned by the current role user with 1777 permissions. Sharing the same directory among multiple roles will cause an ownership race. The heap dump files are created with 600 permissions and are owned by the role user. The amount of free space in this directory should be greater than the maximum Java Process heap size configured for this role.
Related Name
oom_heap_dump_dir
Default Value
/tmp
API Name
oom_heap_dump_dir
Required
false

Dump Heap When Out of Memory

Description
When set, generates a heap dump file when when an out-of-memory error occurs.
Related Name
Default Value
true
API Name
oom_heap_dump_enabled
Required
true

Kill When Out of Memory

Description
When set, a SIGKILL signal is sent to the role process when java.lang.OutOfMemoryError is thrown.
Related Name
Default Value
true
API Name
oom_sigkill_enabled
Required
true

Automatically Restart Process

Description
When set, this role's process is automatically (and transparently) restarted in the event of an unexpected failure. This configuration applies in the time after the Start Wait Timeout period.
Related Name
Default Value
false
API Name
process_auto_restart
Required
true

Enable Metric Collection

Description
Cloudera Manager agent monitors each service and each of its role by publishing metrics to the Cloudera Manager Service Monitor. Setting it to false will stop Cloudera Manager agent from publishing any metric for corresponding service/roles. This is usually helpful for services that generate large amount of metrics which Service Monitor is not able to process.
Related Name
Default Value
true
API Name
process_should_monitor
Required
true

Process Start Retry Attempts

Description
Number of times to try starting a role's process when the process exits before the Start Wait Timeout period. After a process is running beyond the Start Wait Timeout, the retry count is reset. Setting this configuration to zero will prevent restart of the process during the Start Wait Timeout period.
Related Name
Default Value
3
API Name
process_start_retries
Required
false

Process Start Wait Timeout

Description
The time in seconds to wait for a role's process to start successfully on a host. Processes which exit/crash before this time will be restarted until reaching the limit specified by the Start Retry Attempts count parameter. Setting this configuration to zero will turn off this feature.
Related Name
Default Value
20
API Name
process_start_secs
Required
false

Logs

LLAP Proxy Log Directory

Description
Directory where LLAP Proxy will place its log files.
Related Name
Default Value
/var/log/hive
API Name
hive_log_dir
Required
false

Monitoring

Enable Health Alerts for this Role

Description
When set, Cloudera Manager will send alerts when the health of this role reaches the threshold specified by the EventServer setting eventserver_health_events_alert_threshold
Related Name
Default Value
true
API Name
enable_alerts
Required
false

Enable Configuration Change Alerts

Description
When set, Cloudera Manager will send alerts when this entity's configuration changes.
Related Name
Default Value
false
API Name
enable_config_alerts
Required
false

Heap Dump Directory Free Space Monitoring Absolute Thresholds

Description
The health test thresholds for monitoring of free space on the filesystem that contains this role's heap dump directory.
Related Name
Default Value
Warning: 10 GiB, Critical: 5 GiB
API Name
heap_dump_directory_free_space_absolute_thresholds
Required
false

Heap Dump Directory Free Space Monitoring Percentage Thresholds

Description
The health test thresholds for monitoring of free space on the filesystem that contains this role's heap dump directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Heap Dump Directory Free Space Monitoring Absolute Thresholds setting is configured.
Related Name
Default Value
Warning: Never, Critical: Never
API Name
heap_dump_directory_free_space_percentage_thresholds
Required
false

Enable JMX Exporter (beta)

Description
JMX Exporter support is a beta feature. If enabled, CM configures the role to run JMX Exporter in agent mode with the provided port and YAML configuration. This exporter then can be used with the OpenTelemetry Collector feature. See the JMX Exporter documentation.
Related Name
Default Value
false
API Name
jmx_exporter_enabled
Required
true

JMX Exporter Port

Description
JMX Exporter needs a port to implement a Prometheus exporter.
Related Name
Default Value
API Name
jmx_exporter_port
Required
false

JMX Exporter configuration YAML

Description
This configuration is passed to JMX Exporter as it is. See the JMX Exporter documentation.
Related Name
Default Value
API Name
jmx_exporter_yaml
Required
false

Hive LLAP Daemons Ready Status Startup Tolerance

Description
Bad health state will be shown if, after this amount of time (after starting LLAP proxy role), 0 LLAP daemons are running.
Related Name
Default Value
5 minute(s)
API Name
llapd_ready_status_check_daemon_startup_tolerance
Required
false

Hive LLAP Proxy Role Ready Status Startup Tolerance

Description
Startup Tolerance time of the LLAP proxy role in which no health test is run. This is recommended to be kept minimal.
Related Name
Default Value
1 second(s)
API Name
llapd_ready_status_check_role_startup_tolerance
Required
false

Hive LLAP Daemons Ready Status Thresholds

Description
The health test thresholds for monitoring the number of active LLAP daemons.
Related Name
Default Value
Warning: 75.0, Critical: 25.0
API Name
llapd_ready_status_thresholds
Required
false

File Descriptor Monitoring Thresholds

Description
The health test thresholds of the number of file descriptors used. Specified as a percentage of file descriptor limit.
Related Name
Default Value
Warning: 50.0 %, Critical: 70.0 %
API Name
llapproxy_fd_thresholds
Required
false

LLAP Proxy Host Health Test

Description
When computing the overall LLAP Proxy health, consider the host's health.
Related Name
Default Value
true
API Name
llapproxy_host_health_enabled
Required
false

Pause Duration Thresholds

Description
The health test thresholds for the weighted average extra time the pause monitor spent paused. Specified as a percentage of elapsed wall clock time.
Related Name
Default Value
Warning: 30.0, Critical: 60.0
API Name
llapproxy_pause_duration_thresholds
Required
false

Pause Duration Monitoring Period

Description
The period to review when computing the moving average of extra time the pause monitor spent paused.
Related Name
Default Value
5 minute(s)
API Name
llapproxy_pause_duration_window
Required
false

LLAP Proxy Process Health Test

Description
Enables the health test that the LLAP Proxy's process state is consistent with the role configuration
Related Name
Default Value
true
API Name
llapproxy_scm_health_enabled
Required
false

Log Directory Free Space Monitoring Absolute Thresholds

Description
The health test thresholds for monitoring of free space on the filesystem that contains this role's log directory.
Related Name
Default Value
Warning: 10 GiB, Critical: 5 GiB
API Name
log_directory_free_space_absolute_thresholds
Required
false

Log Directory Free Space Monitoring Percentage Thresholds

Description
The health test thresholds for monitoring of free space on the filesystem that contains this role's log directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Log Directory Free Space Monitoring Absolute Thresholds setting is configured.
Related Name
Default Value
Warning: Never, Critical: Never
API Name
log_directory_free_space_percentage_thresholds
Required
false

Navigator Audit Failure Thresholds

Description
The health test thresholds for failures encountered when monitoring audits within a recent period specified by the mgmt_navigator_failure_window configuration for the role. The value that can be specified for this threshold is the number of bytes of audits data that is left to be sent to audit server.
Related Name
mgmt.navigator.failure.thresholds
Default Value
Warning: Never, Critical: Any
API Name
mgmt_navigator_failure_thresholds
Required
false

Monitoring Period For Audit Failures

Description
The period to review when checking if audits are blocked and not getting processed.
Related Name
mgmt.navigator.failure.window
Default Value
20 minute(s)
API Name
mgmt_navigator_failure_window
Required
false

Navigator Audit Pipeline Health Check

Description
Enable test of audit events processing pipeline. This will test if audit events are not getting processed by Audit Server for a role that generates audit.
Related Name
mgmt.navigator.status.check.enabled
Default Value
true
API Name
mgmt_navigator_status_check_enabled
Required
false

Metric Filter

Description
Defines a Metric Filter for this role. Cloudera Manager Agents will not send filtered metrics to the Service Monitor. Define the following fields:
  • Health Test Metric Set - Select this parameter to collect only metrics required for health tests.
  • Default Dashboard Metric Set - Select this parameter to collect only metrics required for the default dashboards. For user-defined charts, you must add the metrics you require for the chart using the Custom Metrics parameter.
  • Include/Exclude Custom Metrics - Select Include to specify metrics that should be collected. Select Exclude to specify metrics that should not be collected. Enter the metric names to be included or excluded using the Metric Name parameter.
  • Metric Name - The name of a metric that will be included or excluded during metric collection.
If you do not select Health Test Metric Set or Default Dashboard Metric Set, or specify metrics by name, metric filtering will be turned off (this is the default behavior).For example, the following configuration enables the collection of metrics required for Health Tests and the jvm_heap_used_mb metric:
  • Include only Health Test Metric Set: Selected.
  • Include/Exclude Custom Metrics: Set to Include.
  • Metric Name: jvm_heap_used_mb
You can also view the JSON representation for this parameter by clicking View as JSON. In this example, the JSON looks like this:{ "includeHealthTestMetricSet": true, "filterType": "whitelist", "metrics": ["jvm_heap_used_mb"] }
Related Name
Default Value
API Name
monitoring_metric_filter
Required
false

OpenTelemetry Collector Exporters Section

Description
Define the exporters settings as a yaml snippet according to the OpenTelemetry Collector standards. Variable substitution available, see the receivers' help.
Related Name
Default Value
exporters: prometheusremotewrite/$ROLE_NAME: endpoint: $ROLE_PARAM(otelcol_remote_write_url) auth: authenticator: basicauth/common tls: insecure_skip_verify: true retry_on_failure: enabled: true initial_interval: 10s max_interval: 40s max_elapsed_time: 300s
API Name
otelcol_exporters
Required
false

OpenTelemetry Collector Extensions Section

Description
Define the extensions settings as a yaml snippet according to the OpenTelemetry Collector standards. Variable substitution available, see the receivers' help.
Related Name
Default Value
extensions: basicauth/common: client_auth: username: $ROLE_PARAM(otelcol_remote_write_user) password: '$ROLE_PARAM(otelcol_remote_write_password)'
API Name
otelcol_extensions
Required
false

OpenTelemetry Collector Processors Section

Description
Define the processors settings as a yaml snippet according to the OpenTelemetry Collector standards. Variable substitution available, see the receivers' help.
Related Name
Default Value
API Name
otelcol_processors
Required
false

OpenTelemetry Collector Receivers Section

Description
Define the receivers settings as a yaml snippet according to the OpenTelemetry Collector standards. A number of variables can help to use the same config everywhere. The follow strings or expressions will be substituted: $HOST_NAME, $CLUSTER_NAME, $CLUSTER_ID, $SERVICE_TYPE, $SERVICE_NAME, $ROLE_NAME, $ROLE_TYPE, $ROLE_PARAM(my_parameter_name) - e.g.: a port parameter for the role's metrics, $DECODE_B64(...) and $DECODE_URL(...) to decode encoded parameters, $ENV_PARAM(name) to fetch params from the process' environment, $SYS_PARAM(name) to fetch java system properties.
Related Name
Default Value
API Name
otelcol_receivers
Required
false

OpenTelemetry Collector Remote Write Password

Description
Remote write password for the OpenTelemetry Collector. This param is for convenience and intended to be used at the extensions section of Otelcol settings using the $ROLE_PARAM(otelcol_remote_write_password) expression. Specify $INFRA(cdp_request_signer_password) when forwarding to Cloudera Observability central monitoring. (This is the default.)
Related Name
Default Value
******
API Name
otelcol_remote_write_password
Required
false

OpenTelemetry Collector Remote Write URL

Description
Remote write URL for the OpenTelemetry Collector. This param is for convenience and intended to be used at the exporters section of Otelcol settings using the $ROLE_PARAM(otelcol_remote_write_url) expression. Specify $INFRA(cdp_request_signer_url) when forwarding to Cloudera Observability central monitoring.
Related Name
Default Value
$INFRA(cdp_request_signer_url)
API Name
otelcol_remote_write_url
Required
false

OpenTelemetry Collector Remote Write Username

Description
Remote write username for the OpenTelemetry Collector. This param is for convenience and intended to be used at the extensions section of Otelcol settings using the $ROLE_PARAM(otelcol_remote_write_user) expression. Specify $INFRA(cdp_request_signer_username) when forwarding to Cloudera Observability central monitoring.
Related Name
Default Value
$INFRA(cdp_request_signer_username)
API Name
otelcol_remote_write_user
Required
false

OpenTelemetry Collector Service Section

Description
Define the service settings as a yaml snippet according to the OpenTelemetry Collector standards. Variable substitution available, see the receivers' help.
Related Name
Default Value
API Name
otelcol_service
Required
false

Enable OpenTelemetry Collector (beta)

Description
OpenTelemetry Collector support is a new beta feature (will change without notice) which can run OpenTelemetry Collector as an agent together with the CM Agent to forward metrics to a Prometheus like storage.
Related Name
Default Value
false
API Name
otelcol_should_collect
Required
true

Swap Memory Usage Rate Thresholds

Description
The health test thresholds on the swap memory usage rate of the process. Specified as the change of the used swap memory during the predefined period.
Related Name
Default Value
Warning: Never, Critical: Never
API Name
process_swap_memory_rate_thresholds
Required
false

Swap Memory Usage Rate Window

Description
The period to review when computing unexpected swap memory usage change of the process.
Related Name
common.process.swap_memory_rate_window
Default Value
5 minute(s)
API Name
process_swap_memory_rate_window
Required
false

Process Swap Memory Thresholds

Description
The health test thresholds on the swap memory usage of the process. This takes precedence over the host level threshold.
Related Name
Default Value
Warning: 200 B, Critical: Never
API Name
process_swap_memory_thresholds
Required
false

Role Triggers

Description
The configured triggers for this role. This is a JSON-formatted list of triggers. These triggers are evaluated as part as the health system. Every trigger expression is parsed, and if the trigger condition is met, the list of actions provided in the trigger expression is executed. Each trigger has the following fields:
  • triggerName (mandatory) - The name of the trigger. This value must be unique for the specific role.
  • triggerExpression (mandatory) - A tsquery expression representing the trigger.
  • streamThreshold (optional) - The maximum number of streams that can satisfy a condition of a trigger before the condition fires. By default set to 0, and any stream returned causes the condition to fire.
  • enabled (optional) - By default set to 'true'. If set to 'false', the trigger is not evaluated.
  • expressionEditorConfig (optional) - Metadata for the trigger editor. If present, the trigger should only be edited from the Edit Trigger page; editing the trigger here can lead to inconsistencies.
For example, the following JSON formatted trigger configured for a DataNode fires if the DataNode has more than 1500 file descriptors opened:[{"triggerName": "sample-trigger", "triggerExpression": "IF (SELECT fd_open WHERE roleName=$ROLENAME and last(fd_open) > 1500) DO health:bad", "streamThreshold": 0, "enabled": "true"}]See the trigger rules documentation for more details on how to write triggers using tsquery.The JSON format is evolving and may change and, as a result, backward compatibility is not guaranteed between releases.
Related Name
Default Value
[]
API Name
role_triggers
Required
true

Unexpected Exits Thresholds

Description
The health test thresholds for unexpected exits encountered within a recent period specified by the unexpected_exits_window configuration for the role.
Related Name
Default Value
Warning: Never, Critical: Any
API Name
unexpected_exits_thresholds
Required
false

Unexpected Exits Monitoring Period

Description
The period to review when computing unexpected exits.
Related Name
Default Value
5 minute(s)
API Name
unexpected_exits_window
Required
false

Other

hive.llap.auto.allow.uber

Description
Whether or not to allow the planner to run vertices in the AM
Related Name
hive.llap.auto.allow.uber
Default Value
false
API Name
hivellap_auto_allow_uber
Required
false

In-Memory Cache per Daemon

Description
The amount of memory reserved for Hive's optimized in-memory cache.
Related Name
hive.llap.io.memory.size
Default Value
512 MiB
API Name
hivellap_cache_per_llap_daemon
Required
false

hive.llap.client.consistent.splits

Description
Whether to setup split locations to match nodes on which llap daemons are running, instead of using the locations provided by the split itself.
Related Name
hive.llap.client.consistent.splits
Default Value
true
API Name
hivellap_client_consistent_splits
Required
false

hive.llap.daemon.am.liveness.heartbeat.interval.ms

Description
Tez AM-LLAP heartbeat interval. This should be below the task timeout.
Related Name
hive.llap.daemon.am.liveness.heartbeat.interval.ms
Default Value
10 second(s)
API Name
hivellap_daemon_am_heartbeat_interval
Required
false

Number of nodes used by Hive's LLAP

Description
Number of nodes used by Hive's LLAP, which includes LLAP nodes running. Yarn native service container and Tez App Master(s) are not part of this.
Related Name
num_llap_nodes
Default Value
1
API Name
hivellap_daemon_count
Required
false

hive.llap.daemon.logger

Description
Logger to be used by LLAP. (query-routing, RFA)
Related Name
hive.llap.daemon.logger
Default Value
llap
API Name
hivellap_daemon_logger
Required
false

hive.llap.daemon.rpc.port

Description
The LLAP daemon RPC port.
Related Name
hive.llap.daemon.rpc.port
Default Value
0
API Name
hivellap_daemon_rpc_port
Required
false

hive.llap.daemon.task.scheduler.enable.preemption

Description
hive.llap.daemon.task.scheduler.enable.preemption
Related Name
hive.llap.daemon.task.scheduler.enable.preemption
Default Value
true
API Name
hivellap_daemon_task_scheduler_enable_preemption
Required
false

hive.llap.daemon.vcpus.per.instance

Description
The total number of vcpus to use for the executors inside LLAP.
Related Name
hive.llap.daemon.vcpus.per.instance
Default Value
0
API Name
hivellap_daemon_vcpus_per_instance
Required
false

hive.llap.daemon.yarn.shuffle.port

Description
YARN shuffle port for LLAP-daemon-hosted shuffle.
Related Name
hive.llap.daemon.yarn.shuffle.port
Default Value
15551
API Name
hivellap_daemon_yarn_shuffle_port
Required
false

dfs.client.mmap.enabled

Description
Disable HDFS caching fo LLAP
Related Name
dfs.client.mmap.enabled
Default Value
false
API Name
hivellap_dfs_client_mmap_enabled
Required
false

dfs.short.circuit.shared.memory.watcher.interrupt.check.ms

Description
Disable HDFS caching fo LLAP
Related Name
dfs.short.circuit.shared.memory.watcher.interrupt.check.ms
Default Value
0 second(s)
API Name
hivellap_dfs_shared_mem_watcher_interrupt
Required
false

hive.llap.enable.grace.join.in.llap

Description
Override if grace join should be allowed to run in llap for regular map joins. Dynamic partitioned joins will honor the hive.mapjoin.hybridgrace.hashtable property in LLAP
Related Name
hive.llap.enable.grace.join.in.llap
Default Value
false
API Name
hivellap_enable_grace_join_in_llap
Required
false

hive.execution.mode

Description
Chooses whether query fragments will run in container or in llap
Related Name
hive.execution.mode
Default Value
llap
API Name
hivellap_execution_mode
Required
false

Number of executors per LLAP Daemon

Description
The number of fragments that a single LLAP daemon will run concurrently. Usually, this will be the same as the number of available CPUs
Related Name
hive.llap.daemon.num.executors
Default Value
2
API Name
hivellap_executors_per_llap_daemon
Required
false

LLAP Daemon Heap Size in MB.

Description
LLAP Daemon Heap Size in MB.
Related Name
llap_heap_size
Default Value
1280 MiB
API Name
hivellap_heap_per_llap_daemon
Required
false

hive.llap.io.enabled

Description
Whether the LLAP IO layer is enabled.
Related Name
hive.llap.io.enabled
Default Value
true
API Name
hivellap_io_enabled
Required
false

hive.llap.io.memory.mode

Description
LLAP IO memory usage; 'cache' (the default) uses data and metadata cache with a custom off-heap allocator, 'allocator' uses the custom allocator without the caches, 'none' doesn't use either (this mode may result in significant performance degradation)
Related Name
hive.llap.io.memory.mode
Default Value
cache
API Name
hivellap_io_memory_mode
Required
false

hive.llap.io.threadpool.size

Description
Specify the number of threads to use for low-level IO thread pool.
Related Name
hive.llap.io.threadpool.size
Default Value
2
API Name
hivellap_io_threadpool_size
Required
false

hive.llap.io.use.lrfu

Description
Whether ORC low-level cache should use LRFU cache policy instead of default (FIFO).
Related Name
hive.llap.io.use.lrfu
Default Value
true
API Name
hivellap_io_use_lrfu
Required
false

hive.llap.execution.mode

Description
Chooses which fragments of a query will run in llap
Related Name
hive.llap.execution.mode
Default Value
only
API Name
hivellap_llap_execution_mode
Required
false

hive.llap.management.rpc.port

Description
RPC port for LLAP daemon management service.
Related Name
hive.llap.management.rpc.port
Default Value
15004
API Name
hivellap_management_rpc_port
Required
false

hive.llap.mapjoin.memory.oversubscribe.factor

Description
hive.llap.mapjoin.memory.oversubscribe.factor
Related Name
hive.llap.mapjoin.memory.oversubscribe.factor
Default Value
0.3
API Name
hivellap_mapjoin_memory_oversubscribe_factor
Required
false

Maximum Total Concurrent Queries

Description
The maximum number of queries the Hive Interactive cluster will be able to handle concurrently.
Related Name
hive.server2.tez.sessions.per.default.queue
Default Value
1
API Name
hivellap_max_total_concurrent_queries
Required
false

Memory per Daemon

Description
Total memory used by individual LLAP daemons (YARN Container size). This includes memory for the cache as well as for the query execution. Should be larger than the sum of the Daemon cache size and the daemon heap size, and should leave some headroom after this (In most cases: cache size + heap size + headroom = Memory Per Daemon).
Related Name
hive.llap.daemon.yarn.container.mb
Default Value
2 GiB
API Name
hivellap_memory_per_llap_daemon
Required
false

hive.llap.object.cache.enabled

Description
Cache objects (plans, hashtables, etc) in llap.
Related Name
hive.llap.object.cache.enabled
Default Value
true
API Name
hivellap_object_cache_enabled
Required
false

Interactive Query Queue

Description
Choose the YARN queue in this cluster that is dedicated to interactive query.
Related Name
hive.llap.daemon.queue.name
Default Value
llap
API Name
hivellap_queue_name
Required
false

llap.shuffle.connection-keep-alive.enable

Description
llap.shuffle.connection-keep-alive.enable
Related Name
llap.shuffle.connection-keep-alive.enable
Default Value
true
API Name
hivellap_shuffle_connection_keep_alive_enable
Required
false

llap.shuffle.connection-keep-alive.timeout

Description
llap.shuffle.connection-keep-alive.timeout
Related Name
llap.shuffle.connection-keep-alive.timeout
Default Value
1 minute(s)
API Name
hivellap_shuffle_connection_keep_alive_timeout
Required
false

Turn SSD Cache On?

Description
Turn SSD Cache On?
Related Name
hive.llap.io.allocator.mmap
Default Value
false
API Name
hivellap_ssd_cache_on
Required
false

hive.llap.task.scheduler.locality.delay

Description
Amount of time to wait before allocating a request which contains location information, to a location other than the ones requested. Set to -1 for an infinite delay, 0 for no delay.
Related Name
hive.llap.task.scheduler.locality.delay
Default Value
1
API Name
hivellap_task_scheduler_locality_delay
Required
false

Performance

Maximum Process File Descriptors

Description
If configured, overrides the process soft and hard rlimits (also called ulimits) for file descriptors to the configured value.
Related Name
Default Value
API Name
rlimit_fds
Required
false

Resource Management

Cgroup CPU Shares

Description
Number of CPU shares to assign to this role. The greater the number of shares, the larger the share of the host's CPUs that will be given to this role when the host experiences CPU contention. Must be between 2 and 262144. Defaults to 1024 for processes not managed by Cloudera Manager.
Related Name
cpu.shares
Default Value
1024
API Name
rm_cpu_shares
Required
true

Custom Control Group Resources (overrides Cgroup settings)

Description
Custom control group resources to assign to this role, which will be enforced by the Linux kernel. These resources should exist on the target hosts, otherwise an error will occur when the process starts. Use the same format as used for arguments to the cgexec command: resource1,resource2:path1 or resource3:path2 For example: 'cpu,memory:my/path blkio:my2/path2' ***These settings override other cgroup settings.***
Related Name
custom.cgroups
Default Value
API Name
rm_custom_resources
Required
false

Cgroup I/O Weight

Description
Weight for the read I/O requests issued by this role. The greater the weight, the higher the priority of the requests when the host experiences I/O contention. Must be between 100 and 1000. Defaults to 1000 for processes not managed by Cloudera Manager.
Related Name
blkio.weight
Default Value
500
API Name
rm_io_weight
Required
true

Cgroup Memory Hard Limit

Description
Hard memory limit to assign to this role, enforced by the Linux kernel. When the limit is reached, the kernel will reclaim pages charged to the process. If reclaiming fails, the kernel may kill the process. Both anonymous as well as page cache pages contribute to the limit. Use a value of -1 to specify no limit. By default processes not managed by Cloudera Manager will have no limit. If the value is -1, Cloudera Manager will not monitor Cgroup memory usage therefore some of the charts will show 'No Data'
Related Name
memory.limit_in_bytes
Default Value
-1 MiB
API Name
rm_memory_hard_limit
Required
true

Cgroup Memory Soft Limit

Description
Soft memory limit to assign to this role, enforced by the Linux kernel. When the limit is reached, the kernel will reclaim pages charged to the process if and only if the host is facing memory pressure. If reclaiming fails, the kernel may kill the process. Both anonymous as well as page cache pages contribute to the limit. Use a value of -1 to specify no limit. By default processes not managed by Cloudera Manager will have no limit. If the value is -1, Cloudera Manager will not monitor Cgroup memory usage therefore some of the charts will show 'No Data'
Related Name
memory.soft_limit_in_bytes
Default Value
-1 MiB
API Name
rm_memory_soft_limit
Required
true

Stacks Collection

Stacks Collection Data Retention

Description
The amount of stacks data that is retained. After the retention limit is reached, the oldest data is deleted.
Related Name
stacks_collection_data_retention
Default Value
100 MiB
API Name
stacks_collection_data_retention
Required
false

Stacks Collection Directory

Description
The directory in which stacks logs are placed. If not set, stacks are logged into a stacks subdirectory of the role's log directory. If this directory already exists, it will be owned by the current role user with 755 permissions. Sharing the same directory among multiple roles will cause an ownership race.
Related Name
stacks_collection_directory
Default Value
API Name
stacks_collection_directory
Required
false

Stacks Collection Enabled

Description
Whether or not periodic stacks collection is enabled.
Related Name
stacks_collection_enabled
Default Value
false
API Name
stacks_collection_enabled
Required
true

Stacks Collection Frequency

Description
The frequency with which stacks are collected.
Related Name
stacks_collection_frequency
Default Value
5.0 second(s)
API Name
stacks_collection_frequency
Required
false

Stacks Collection Method

Description
The method used to collect stacks. The jstack option involves periodically running the jstack command against the role's daemon process. The servlet method is available for those roles that have an HTTP server endpoint exposing the current stacks traces of all threads. When the servlet method is selected, that HTTP endpoint is periodically scraped.
Related Name
stacks_collection_method
Default Value
jstack
API Name
stacks_collection_method
Required
false

Suppressions

Suppress Configuration Validator: CDH Version Validator

Description
Whether to suppress configuration warnings produced by the CDH Version Validator configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_cdh_version_validator
Required
true

Suppress Parameter Validation: LLAP Proxy Log Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the LLAP Proxy Log Directory parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_log_dir
Required
true

Suppress Parameter Validation: Metrics Sample File Location

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Metrics Sample File Location parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_metrics_sample_file_location
Required
true

Suppress Parameter Validation: hive.llap.daemon.logger

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the hive.llap.daemon.logger parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hivellap_daemon_logger
Required
true

Suppress Parameter Validation: LLAP Daemon Java Options

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the LLAP Daemon Java Options parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hivellap_daemon_opts
Required
true

Suppress Parameter Validation: hive.execution.mode

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the hive.execution.mode parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hivellap_execution_mode
Required
true

Suppress Parameter Validation: hive.llap.io.memory.mode

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the hive.llap.io.memory.mode parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hivellap_io_memory_mode
Required
true

Suppress Parameter Validation: hive.llap.execution.mode

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the hive.llap.execution.mode parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hivellap_llap_execution_mode
Required
true

Suppress Parameter Validation: LLAP Proxy Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the LLAP Proxy Advanced Configuration Snippet (Safety Valve) for hive-site.xml parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hivellap_llapproxy_config_safety_valve
Required
true

Suppress Parameter Validation: Interactive Query Queue

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Interactive Query Queue parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hivellap_queue_name
Required
true

Suppress Parameter Validation: JMX Exporter Port

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the JMX Exporter Port parameter.
Related Name
Default Value
false
API Name
role_config_suppression_jmx_exporter_port
Required
true

Suppress Parameter Validation: JMX Exporter configuration YAML

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the JMX Exporter configuration YAML parameter.
Related Name
Default Value
false
API Name
role_config_suppression_jmx_exporter_yaml
Required
true

Suppress Parameter Validation: LLAP Proxy Environment Advanced Configuration Snippet (Safety Valve)

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the LLAP Proxy Environment Advanced Configuration Snippet (Safety Valve) parameter.
Related Name
Default Value
false
API Name
role_config_suppression_llapproxy_role_env_safety_valve
Required
true

Suppress Parameter Validation: Heap Dump Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Heap Dump Directory parameter.
Related Name
Default Value
false
API Name
role_config_suppression_oom_heap_dump_dir
Required
true

Suppress Parameter Validation: OpenTelemetry Collector Exporters Section

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Exporters Section parameter.
Related Name
Default Value
false
API Name
role_config_suppression_otelcol_exporters
Required
true

Suppress Parameter Validation: OpenTelemetry Collector Extensions Section

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Extensions Section parameter.
Related Name
Default Value
false
API Name
role_config_suppression_otelcol_extensions
Required
true

Suppress Parameter Validation: OpenTelemetry Collector Processors Section

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Processors Section parameter.
Related Name
Default Value
false
API Name
role_config_suppression_otelcol_processors
Required
true

Suppress Parameter Validation: OpenTelemetry Collector Receivers Section

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Receivers Section parameter.
Related Name
Default Value
false
API Name
role_config_suppression_otelcol_receivers
Required
true

Suppress Parameter Validation: OpenTelemetry Collector Remote Write Password

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Remote Write Password parameter.
Related Name
Default Value
false
API Name
role_config_suppression_otelcol_remote_write_password
Required
true

Suppress Parameter Validation: OpenTelemetry Collector Remote Write URL

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Remote Write URL parameter.
Related Name
Default Value
false
API Name
role_config_suppression_otelcol_remote_write_url
Required
true

Suppress Parameter Validation: OpenTelemetry Collector Remote Write Username

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Remote Write Username parameter.
Related Name
Default Value
false
API Name
role_config_suppression_otelcol_remote_write_user
Required
true

Suppress Parameter Validation: OpenTelemetry Collector Service Section

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Service Section parameter.
Related Name
Default Value
false
API Name
role_config_suppression_otelcol_service
Required
true

Suppress Parameter Validation: Custom Control Group Resources (overrides Cgroup settings)

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Custom Control Group Resources (overrides Cgroup settings) parameter.
Related Name
Default Value
false
API Name
role_config_suppression_rm_custom_resources
Required
true

Suppress Parameter Validation: Role Triggers

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Role Triggers parameter.
Related Name
Default Value
false
API Name
role_config_suppression_role_triggers
Required
true

Suppress Parameter Validation: Stacks Collection Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Stacks Collection Directory parameter.
Related Name
Default Value
false
API Name
role_config_suppression_stacks_collection_directory
Required
true

Suppress Health Test: Audit Pipeline Test

Description
Whether to suppress the results of the Audit Pipeline Test heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hive_llap_llapproxy_audit_health
Required
true

Suppress Health Test: File Descriptors

Description
Whether to suppress the results of the File Descriptors heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hive_llap_llapproxy_file_descriptor
Required
true

Suppress Health Test: Heap Dump Directory Free Space

Description
Whether to suppress the results of the Heap Dump Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hive_llap_llapproxy_heap_dump_directory_free_space
Required
true

Suppress Health Test: Host Health

Description
Whether to suppress the results of the Host Health heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hive_llap_llapproxy_host_health
Required
true

Suppress Health Test: Log Directory Free Space

Description
Whether to suppress the results of the Log Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hive_llap_llapproxy_log_directory_free_space
Required
true

Suppress Health Test: Otelcol Health

Description
Whether to suppress the results of the Otelcol Health heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hive_llap_llapproxy_otelcol_health
Required
true

Suppress Health Test: Pause Duration

Description
Whether to suppress the results of the Pause Duration heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hive_llap_llapproxy_pause_duration
Required
true

Suppress Health Test: Process Status

Description
Whether to suppress the results of the Process Status heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hive_llap_llapproxy_scm_health
Required
true

Suppress Health Test: Swap Memory Usage

Description
Whether to suppress the results of the Swap Memory Usage heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hive_llap_llapproxy_swap_memory_usage
Required
true

Suppress Health Test: Swap Memory Usage Rate Beta

Description
Whether to suppress the results of the Swap Memory Usage Rate Beta heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hive_llap_llapproxy_swap_memory_usage_rate
Required
true

Suppress Health Test: Unexpected Exits

Description
Whether to suppress the results of the Unexpected Exits heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hive_llap_llapproxy_unexpected_exits
Required
true

Suppress Health Test: LLAP Daemons Ready Check

Description
Whether to suppress the results of the LLAP Daemons Ready Check heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_llapd_ready_status
Required
true

Service-Wide

Advanced

Hive Auxiliary JARs Directory

Description
Directory containing auxiliary JARs used by Hive. This should be a directory location and not a classpath containing one or more JARs. This directory must be created and managed manually on hosts that run the Hive Metastore Server, HiveServer2, or the Hive CLI. The directory location is set in the environment as HIVE_AUX_JARS_PATH and will generally override the hive.aux.jars.path property set in XML files, even if hive.aux.jars.path is set in an advanced configuration snippet.
Related Name
Default Value
API Name
hive_aux_jars_path_dir
Required
false

Bypass Hive Metastore Server

Description
Instead of talking to Hive Metastore Server for Metastore information, Hive clients will talk directly to the Metastore database.
Related Name
Default Value
false
API Name
hive_bypass_metastore_server
Required
false

Aborted Transaction Threshold

Description
Number of aborted transactions involving a particular table or partition before major compaction is initiated.
Related Name
hive.compactor.abortedtxn.threshold
Default Value
1000
API Name
hive_compactor_abortedtxn_threshold
Required
true

Number of Threads Used by Compactor

Description
Number of compactor worker threads to run on this metastore instance. Can be different values on different Metastore instances.
Related Name
hive.compactor.worker.threads
Default Value
5
API Name
hive_compactor_worker_threads
Required
true

Hive Service Advanced Configuration Snippet (Safety Valve) for core-site.xml

Description
For advanced use only, a string to be inserted into core-site.xml. Applies to configurations of all roles in this service except client configuration.
Related Name
Default Value
API Name
hive_core_site_safety_valve
Required
false

Default Table Format - Create Tables as Full ACID

Description
Whether the eligible tables should be created as full ACID by default. Does not apply to external tables, the ones using storage handlers, etc.
Related Name
hive.create.as.acid
Default Value
true
API Name
hive_create_as_acid
Required
false

Default Table Format - Create Tables as ACID Insert Only

Description
Whether the eligible tables should be created as ACID insert-only by default. Does not apply to external tables, the ones using storage handlers, etc.
Related Name
hive.create.as.insert.only
Default Value
true
API Name
hive_create_as_insert_only
Required
false

Hive Copy Large File Size

Description
Smaller than this size, Hive uses a single-threaded copy; larger than this size, Hive uses DistCp.
Related Name
hive.exec.copyfile.maxsize
Default Value
32 MiB
API Name
hive_exec_copyfile_maxsize
Required
false

Base Directory for Hive Proto Hook

Description
The directory where hive proto hooks should write the events, should generally be location of query_data table under sys.db database.
Related Name
hive.hook.proto.base-directory
Default Value
/warehouse/tablespace/managed/hive/sys.db/query_data/
API Name
hive_hook_proto_base_directory
Required
false

Hive LLAP Service Environment Advanced Configuration Snippet (Safety Valve)

Description
For advanced use only, key-value pairs (one on each line) to be inserted into a role's environment. Applies to configurations of all roles in this service except client configuration.
Related Name
Default Value
API Name
HIVE_LLAP_service_env_safety_valve
Required
false

Metastore Transactional Listener List

Description
A comma separated list of Java classes that implement the org.apache.hadoop.hive.metastore.MetaStoreEventListener interface. Both the metastore event and corresponding listener method will be invoked in the same JDO transaction.
Related Name
hive.metastore.transactional.event.listeners
Default Value
org.apache.hive.hcatalog.listener.DbNotificationListener
API Name
hive_metastore_transactional_event_listeners
Required
false

Hive Replication Environment Advanced Configuration Snippet (Safety Valve)

Description
For advanced use only, key-value pairs (one on each line) to be inserted into the environment of Hive replication jobs.
Related Name
Default Value
API Name
hive_replication_env_safety_valve
Required
false

Hive Service Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
For advanced use only, a string to be inserted into hive-site.xml. Applies to configurations of all roles in this service except client configuration.
Related Name
Default Value
API Name
hive_service_config_safety_valve
Required
false

Hive Replication Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
For advanced use only, a string to be inserted into hive-site.xml. Applies to all Hive Replication jobs.
Related Name
Default Value
API Name
hive_service_replication_config_safety_valve
Required
false

Use Locking

Description
Support concurrency and use locks, needed for Transactions. Requires Zookeeper.
Related Name
hive.support.concurrency
Default Value
true
API Name
hive_support_concurrency
Required
false

Transaction Manager

Description
HiveTxnManager implementation used for managing transactions.
Related Name
hive.txn.manager
Default Value
org.apache.hadoop.hive.ql.lockmgr.DbTxnManager
API Name
hive_txn_manager
Required
true

Transaction Maximum Open Batch

Description
Maximum number of transactions that can be fetched in one call to open_txns(). Increasing this will decrease the number of delta files created when streaming data into Hive. But it will also increase the number of open transactions at any given time, possibly impacting read performance.
Related Name
hive.txn.max.open.batch
Default Value
1000
API Name
hive_txn_max_open_batch
Required
true

Transaction Strict Locking Mode

Description
In strict locking non-ACID resources use standard R/W lock semantics.
Related Name
hive.txn.strict.locking.mode
Default Value
false
API Name
hive_txn_strict_locking_mode
Required
false

Transaction Timeout

Description
Time after which transactions are declared aborted if the client has not sent a heartbeat.
Related Name
hive.txn.timeout
Default Value
5 minute(s)
API Name
hive_txn_timeout
Required
true

Hive Client Advanced Configuration Snippet (Safety Valve) for navigator.client.properties

Description
For advanced use only, a string to be inserted into the client configuration for navigator.client.properties.
Related Name
Default Value
API Name
navigator_client_config_safety_valve
Required
false

Hive Client Advanced Configuration Snippet (Safety Valve) for navigator.lineage.client.properties

Description
For advanced use only, a string to be inserted into the client configuration for navigator.lineage.client.properties.
Related Name
Default Value
API Name
navigator_lineage_client_config_safety_valve
Required
false

System Group

Description
The group that this service's processes should run as.
Related Name
Default Value
hive
API Name
process_groupname
Required
true

System User

Description
The user that this service's processes should run as.
Related Name
Default Value
hive
API Name
process_username
Required
true

Hive Service Advanced Configuration Snippet (Safety Valve) for ranger-hive-audit.xml

Description
For advanced use only, a string to be inserted into ranger-hive-audit.xml. Applies to configurations of all roles in this service except client configuration.
Related Name
Default Value
API Name
ranger_audit_safety_valve
Required
false

Hive Service Advanced Configuration Snippet (Safety Valve) for ranger-hive-policymgr-ssl.xml

Description
For advanced use only, a string to be inserted into ranger-hive-policymgr-ssl.xml. Applies to configurations of all roles in this service except client configuration.
Related Name
Default Value
API Name
ranger_policymgr_ssl_safety_valve
Required
false

Hive Service Advanced Configuration Snippet (Safety Valve) for ranger-hive-security.xml

Description
For advanced use only, a string to be inserted into ranger-hive-security.xml. Applies to configurations of all roles in this service except client configuration.
Related Name
Default Value
API Name
ranger_security_safety_valve
Required
false

Cloudera Navigator

Enable Audit Collection

Description
Enable collection of audit events from the service's roles.
Related Name
navigator.audit.enabled
Default Value
true
API Name
navigator_audit_enabled
Required
false

Audit Event Filter

Description
Event filters are defined in a JSON object like the following: { "defaultAction" : ("accept", "discard"), "rules" : [ { "action" : ("accept", "discard"), "fields" : [ { "name" : "fieldName", "match" : "regex" } ] } ] } A filter has a default action and a list of rules, in order of precedence. Each rule defines an action, and a list of fields to match against the audit event. A rule is "accepted" if all the listed field entries match the audit event. At that point, the action declared by the rule is taken. If no rules match the event, the default action is taken. Actions default to "accept" if not defined in the JSON object. The following is the list of fields that can be filtered for Hive events:
  • userName: the user performing the action.
  • ipAddress: the IP from where the request originated.
  • operation: the Hive operation being performed.
  • databaseName: the databaseName for the operation.
  • tableName: the tableName for the operation.
The default Hive audit event filter discards HDFS directory events generated by Hive jobs that reference the /tmp directory.
Related Name
navigator.event.filter
Default Value
comment: [ The default Hive audit event filter discards HDFS directory events , generated by Hive jobs that reference the /tmp directory. ], defaultAction: accept, rules: [ action: discard, fields: [ name: operation, match: QUERY , name: objectType, match: DFS_DIR , name: resourcePath, match: /tmp/hive-(?:.+)?/hive_(?:.+)?/-mr-.* ] ]
API Name
navigator_audit_event_filter
Required
false

Audit Queue Policy

Description
Action to take when the audit event queue is full. Drop the event or shutdown the affected process.
Related Name
navigator.batch.queue_policy
Default Value
DROP
API Name
navigator_audit_queue_policy
Required
false

Audit Event Tracker

Description
Configures the rules for event tracking and coalescing. This feature is used to define equivalency between different audit events. When events match, according to a set of configurable parameters, only one entry in the audit list is generated for all the matching events. Tracking works by keeping a reference to events when they first appear, and comparing other incoming events against the "tracked" events according to the rules defined here. Event trackers are defined in a JSON object like the following: { "timeToLive" : [integer], "fields" : [ { "type" : [string], "name" : [string] } ] } Where:
  • timeToLive: maximum amount of time an event will be tracked, in milliseconds. Must be provided. This defines how long, since it's first seen, an event will be tracked. A value of 0 disables tracking.
  • fields: list of fields to compare when matching events against tracked events.
Each field has an evaluator type associated with it. The evaluator defines how the field data is to be compared. The following evaluators are available:
  • value: uses the field value for comparison.
  • userName: treats the field value as a userNname, and ignores any host-specific data. This is useful for environment using Kerberos, so that only the principal name and realm are compared.
The following is the list of fields that can be used to compare Hive events:
  • operation: the Hive operation being performed.
  • username: the user performing the action.
  • ipAddress: the IP from where the request originated.
  • allowed: whether the operation was allowed or denied.
  • databaseName: the database affected by the operation.
  • tableName: the table or view affected by the operation.
  • objectType: the type of object affected by the operation.
  • resourcePath: the path of the resource affected by the operation.
Related Name
navigator_event_tracker
Default Value
API Name
navigator_event_tracker
Required
false

Enable Lineage Collection

Description
Enable collection of lineage from the service's roles.
Related Name
Default Value
true
API Name
navigator_lineage_enabled
Required
false

Logs

Audit Log Directory

Description
Path to the directory where audit logs will be written. The directory will be created if it doesn't exist.
Related Name
audit_event_log_dir
Default Value
/var/log/hive/audit
API Name
audit_event_log_dir
Required
false

Hive Lineage Log Directory

Description
The directory in which Hive lineage log files are written.
Related Name
lineage_event_log_dir
Default Value
/var/log/hive/lineage
API Name
lineage_event_log_dir
Required
true

Hive Maximum Lineage Log File Size

Description
The maximum size, in megabytes, per log file for Hive lineage logs. Typically used by log4j or logback.
Related Name
max_lineage_log_file_size
Default Value
100 MiB
API Name
max_lineage_log_file_size
Required
false

Maximum Audit Log File Size

Description
Maximum size of audit log file in MB before it is rolled over.
Related Name
navigator.audit_log_max_file_size
Default Value
100 MiB
API Name
navigator_audit_log_max_file_size
Required
false

Number of Audit Logs to Retain

Description
Maximum number of rolled-over audit logs to retain. The logs are not deleted if they contain audit events that have not yet been propagated to the Audit Server.
Related Name
navigator.client.max_num_audit_log
Default Value
10
API Name
navigator_client_max_num_audit_log
Required
false

Monitoring

Enable Service Level Health Alerts

Description
When set, Cloudera Manager will send alerts when the health of this service reaches the threshold specified by the EventServer setting eventserver_health_events_alert_threshold
Related Name
Default Value
true
API Name
enable_alerts
Required
false

Enable Configuration Change Alerts

Description
When set, Cloudera Manager will send alerts when this entity's configuration changes.
Related Name
Default Value
false
API Name
enable_config_alerts
Required
false

Healthy HiveServer2 Monitoring Thresholds

Description
The health test thresholds of the overall HiveServer2 health. The check returns "Concerning" health if the percentage of "Healthy" HiveServer2s falls below the warning threshold. The check is unhealthy if the total percentage of "Healthy" and "Concerning" HiveServer2s falls below the critical threshold.
Related Name
Default Value
Warning: 99.0 %, Critical: 51.0 %
API Name
hive_llap_hiveserver2s_healthy_thresholds
Required
false

LLAP Proxy Role Health Test

Description
When computing the overall HIVE_LLAP health, consider LLAP Proxy's health
Related Name
Default Value
true
API Name
hive_llap_llapproxy_health_enabled
Required
false

Service Triggers

Description
The configured triggers for this service. This is a JSON-formatted list of triggers. These triggers are evaluated as part as the health system. Every trigger expression is parsed, and if the trigger condition is met, the list of actions provided in the trigger expression is executed. Each trigger has the following fields:
  • triggerName (mandatory) - The name of the trigger. This value must be unique for the specific service.
  • triggerExpression (mandatory) - A tsquery expression representing the trigger.
  • streamThreshold (optional) - The maximum number of streams that can satisfy a condition of a trigger before the condition fires. By default set to 0, and any stream returned causes the condition to fire.
  • enabled (optional) - By default set to 'true'. If set to 'false', the trigger is not evaluated.
  • expressionEditorConfig (optional) - Metadata for the trigger editor. If present, the trigger should only be edited from the Edit Trigger page; editing the trigger here can lead to inconsistencies.
For example, the following JSON formatted trigger fires if there are more than 10 DataNodes with more than 500 file descriptors opened:[{"triggerName": "sample-trigger", "triggerExpression": "IF (SELECT fd_open WHERE roleType = DataNode and last(fd_open) > 500) DO health:bad", "streamThreshold": 10, "enabled": "true"}]See the trigger rules documentation for more details on how to write triggers using tsquery.The JSON format is evolving and may change and, as a result, backward compatibility is not guaranteed between releases.
Related Name
Default Value
[]
API Name
service_triggers
Required
true

Service Monitor Client Config Overrides

Description
For advanced use only, a list of configuration properties that will be used by the Service Monitor instead of the current client configuration for the service.
Related Name
Default Value
<property> <name>hive.metastore.client.socket.timeout</name> <value>60</value> </property>
API Name
smon_client_config_overrides
Required
false

Service Monitor Derived Configs Advanced Configuration Snippet (Safety Valve)

Description
For advanced use only, a list of derived configuration properties that will be used by the Service Monitor instead of the default ones.
Related Name
Default Value
API Name
smon_derived_configs_safety_valve
Required
false

Other

HBase Service

Description
Name of the HBase service that this Hive service instance depends on.
Related Name
Default Value
API Name
hbase_service
Required
false

HDFS Service

Description
Name of the HDFS service that this Hive service instance depends on
Related Name
Default Value
API Name
hdfs_service
Required
true

Enable Asynchronous Logging

Description
Asynchronous Log4j2 logging can give a significant performance improvement as logging will be handled in a separate thread that uses an LMAX disruptor queue for buffering log messages. Refer to https://logging.apache.org/log4j/2.x/manual/async.html for benefits and drawbacks. For debugging issues we recommend setting this to false.
Related Name
hive.async.log.enabled
Default Value
false
API Name
hive_async_log_enabled
Required
false

Hive Bytes Per Reducer

Description
Size per reducer. If the input size is 10GiB and this is set to 1GiB, Hive will use 10 reducers.
Related Name
hive.exec.reducers.bytes.per.reducer
Default Value
64 MiB
API Name
hive_bytes_per_reducer
Required
false

Default File Format

Description
Default file format for CREATE TABLE statement.
Related Name
hive.default.fileformat
Default Value
TextFile
API Name
hive_default_fileformat
Required
true

Default File Format for Managed Tables

Description
Default file format for CREATE TABLE statement applied to managed tables only. External tables will be created with default file format. Leaving this null will result in using the default file format for all tables.
Related Name
hive.default.fileformat.managed
Default Value
ORC
API Name
hive_default_fileformat_managed
Required
false

Hive Max Reducers

Description
Max number of reducers to use. If the configuration parameter Hive Reduce Tasks is negative, Hive will limit the number of reducers to the value of this parameter.
Related Name
hive.exec.reducers.max
Default Value
1009
API Name
hive_max_reducers
Required
false

Hive Reduce Tasks

Description
Default number of reduce tasks per job. Usually set to a prime number close to the number of available hosts. Ignored when mapred.job.tracker is "local". Hadoop sets this to 1 by default, while Hive uses -1 as the default. When set to -1, Hive will automatically determine an appropriate number of reducers for each job.
Related Name
mapred.reduce.tasks
Default Value
-1
API Name
hive_reduce_tasks
Required
false

Set User and Group Information

Description
In unsecure mode, setting this property to true will cause the Metastore Server to execute DFS operations using the client's reported user and group permissions. Cloudera Manager will set this for all clients and servers.
Related Name
hive.metastore.execute.setugi
Default Value
true
API Name
hive_set_ugi
Required
true

LLAP app name

Description
LLAP app name
Related Name
llap_app_name
Default Value
llap0
API Name
hivellap_app_name
Required
false

hive.llap.daemon.service.hosts

Description
Explicitly specified hosts to use for LLAP scheduling. If it's left empty, LLAP app name will be used instead with a ZooKeeper based registry.
Related Name
hive.llap.daemon.service.hosts
Default Value
API Name
hivellap_daemon_service_hosts
Required
false

Hive Metastore Connector

Description
Name of the Hive Metastore Connector from the data context that this service instance depends on.
Related Name
Default Value
API Name
hms_connector
Required
true

MapReduce Service

Description
MapReduce jobs are run against this service.
Related Name
Default Value
API Name
mapreduce_yarn_service
Required
true

Ranger Plugin Trusted Proxy IP Address

Description
Accepts a list of IP addresses of proxy servers for trusting.
Related Name
ranger.plugin.hive.trusted.proxy.ipaddress
Default Value
API Name
ranger_plugin_trusted_proxy_ipaddress
Required
false

Ranger Plugin Use X-Forwarded for IP Address

Description
The parameter is used for identifying the originating IP address of a user connecting to a component through proxy for audit logs.
Related Name
ranger.plugin.hive.use.x-forwarded-for.ipaddress
Default Value
false
API Name
ranger_plugin_use_x_forwarded_for_ipaddress
Required
false

Ranger Service

Description
Name of the Ranger service that this Hive service instance depends on
Related Name
Default Value
API Name
ranger_service
Required
false

Tez Service

Description
Tez Service that the Hive on Tez uses for execution
Related Name
Default Value
API Name
tez_service
Required
true

ZooKeeper Service

Description
Name of the ZooKeeper service that this Hive service instance depends on.
Related Name
Default Value
API Name
zookeeper_service
Required
false

Proxy

Hive Metastore Access Control and Proxy User Groups Override

Description
This configuration overrides the value set for Hive Proxy User Groups configuration in HDFS service for use by Hive Metastore Server. Specify a comma-delimited list of groups that you want to allow access to Hive Metastore metadata and allow the Hive user to impersonate. A value of '*' allows all groups. The default value of empty inherits the value set for Hive Proxy User Groups configuration in the HDFS service.
Related Name
hadoop.proxyuser.hive.groups
Default Value
API Name
hive_proxy_user_groups_list
Required
false

Replication

Replica functions root directory

Description
Root directory on the replica warehouse where the repl sub-system will store jars from the primary warehouse
Related Name
hive.repl.replica.functions.root.dir
Default Value
API Name
hive_repl_replica_functions_root_dir
Required
false

Security

Enable LDAP Authentication for HiveServer2

Description
When checked, LDAP-based authentication for users is enabled.
Related Name
Default Value
false
API Name
hiveserver2_enable_ldap_auth
Required
false

Enable TLS/SSL for HiveServer2

Description
Encrypt communication between clients and HiveServer2 using Transport Layer Security (TLS) (formerly known as Secure Socket Layer (SSL)).
Related Name
hive.server2.use.SSL
Default Value
false
API Name
hiveserver2_enable_ssl
Required
false

HiveServer2 SSL Exclude Cipher Suites

Description
The cipher suites should be excluded from Hiveserver2 SSL.
Related Name
hive.server2.http.exclude.ciphersuites
Default Value
modern2018
API Name
hiveserver2_exclude_ciphersuites
Required
false

HiveServer2 SSL Include Cipher Suites

Description
The cipher suites should be included in Hiverserver2 SSL.
Related Name
hive.server2.binary.include.ciphersuites
Default Value
modern2018
API Name
hiveserver2_include_ciphersuites
Required
false

HiveServer2 TLS/SSL Server Keystore File Password

Description
The password for the HiveServer2 keystore file.
Related Name
hive.server2.keystore.password
Default Value
API Name
hiveserver2_keystore_password
Required
false

HiveServer2 TLS/SSL Server Keystore File Location

Description
The path to the TLS/SSL keystore file containing the server certificate and private key used for TLS/SSL. Used when HiveServer2 is acting as a TLS/SSL server. The keystore must be in the format specified in Administration > Settings > Java Keystore Type.
Related Name
hive.server2.keystore.path
Default Value
API Name
hiveserver2_keystore_path
Required
false

LDAP BaseDN

Description
This parameter is useful when authenticating against a non-Active Directory server, such as OpenLDAP. When set, this parameter is used to convert the username into the LDAP Distinguished Name (DN), so that the resulting DN looks like uid=username,*this parameter*. For example, if this parameter is set to "ou=People,dc=cloudera,dc=com", and the username passed in is "mike", the resulting authentication passed to the LDAP server look like "uid=mike,ou=People,dc=cloudera,dc=com". This parameter is mutually exclusive with Active Directory Domain.
Related Name
hive.server2.authentication.ldap.baseDN
Default Value
API Name
hiveserver2_ldap_basedn
Required
false

Active Directory Domain

Description
Use this field for Active Directory configurations only, when combined with a simple username value in the "LDAP Bind User Distinguished Name" field, it will result in a UPM of user@example.com used for search/bind operations for authenticated user lookups.
Related Name
hive.server2.authentication.ldap.Domain
Default Value
API Name
hiveserver2_ldap_domain
Required
false

LDAP URL

Description
The URL of the LDAP Server. The URL must be prefixed with ldap:// or ldaps:// . The URL can optionally specify a custom port if necessary, but by default the ldap:// will connect to port 389, and the ldaps:// will connect to port 636. Note that passwords will be in the clear if ldap:// is used, and by fall 2020 Active directory servers will no longer allow non LDAPS connections to bind to AD hosts with LDAP signing enabled. See microsoft knowledge document 935834 for more information.
Related Name
hive.server2.authentication.ldap.url
Default Value
API Name
hiveserver2_ldap_uri
Required
false

HiveServer2 TLS/SSL Trust Store File

Description
The location on disk of the trust store, in .jks format, used to confirm the authenticity of TLS/SSL servers that HiveServer2 might connect to. This trust store must contain the certificate(s) used to sign the service(s) connected to. If this parameter is not provided, the default list of well-known certificate authorities is used instead.
Related Name
Default Value
API Name
hiveserver2_truststore_file
Required
false

HiveServer2 TLS/SSL Trust Store Password

Description
The password for the HiveServer2 TLS/SSL Trust Store File. This password is not required to access the trust store; this field can be left blank. This password provides optional integrity checking of the file. The contents of trust stores are certificates, and certificates are public information.
Related Name
Default Value
API Name
hiveserver2_truststore_password
Required
false

Kerberos Principal

Description
Kerberos principal short name used by all roles of this service.
Related Name
Default Value
hive
API Name
kerberos_princ_name
Required
true

Ranger DFS Audit Path

Description
The DFS path on which Ranger audits are written. The special placeholder '${ranger_base_audit_url}' should be used as the prefix, in order to use the centralized location defined in the Ranger service.
Related Name
xasecure.audit.destination.hdfs.dir
Default Value
$ranger_base_audit_url/hive
API Name
ranger_audit_hdfs_dir
Required
false

Ranger Audit DFS Spool Dir

Description
Spool directory for Ranger audits being written to DFS.
Related Name
xasecure.audit.destination.hdfs.batch.filespool.dir
Default Value
/var/log/hive/audit/hdfs/spool
API Name
ranger_audit_hdfs_spool_dir
Required
false

Ranger Audit Solr Spool Dir

Description
Spool directory for Ranger audits being written to Solr.
Related Name
xasecure.audit.destination.solr.batch.filespool.dir
Default Value
/var/log/hive/audit/solr/spool
API Name
ranger_audit_solr_spool_dir
Required
false

Ranger Policy Cache Directory

Description
The directory where Ranger security policies are cached locally.
Related Name
ranger.plugin.hive.policy.cache.dir
Default Value
/var/lib/ranger/hive/policy-cache
API Name
ranger_policy_cache_dir
Required
false

Suppressions

Suppress Configuration Validator: CDH Version Validator

Description
Whether to suppress configuration warnings produced by the CDH Version Validator configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_cdh_version_validator
Required
true

Suppress Configuration Validator: Deploy Directory

Description
Whether to suppress configuration warnings produced by the Deploy Directory configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_client_config_root_dir
Required
true

Suppress Configuration Validator: Hive Client Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
Whether to suppress configuration warnings produced by the Hive Client Advanced Configuration Snippet (Safety Valve) for hive-site.xml configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_client_config_safety_valve
Required
true

Suppress Configuration Validator: Gateway Client Environment Advanced Configuration Snippet (Safety Valve) for hive-env.sh

Description
Whether to suppress configuration warnings produced by the Gateway Client Environment Advanced Configuration Snippet (Safety Valve) for hive-env.sh configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_client_env_safety_valve
Required
true

Suppress Configuration Validator: Client Java Configuration Options

Description
Whether to suppress configuration warnings produced by the Client Java Configuration Options configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_client_java_opts
Required
true

Suppress Configuration Validator: HiveServer2 Environment Advanced Configuration Snippet (Safety Valve)

Description
Whether to suppress configuration warnings produced by the HiveServer2 Environment Advanced Configuration Snippet (Safety Valve) configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_hs2_env_safety_valve
Required
true

Suppress Configuration Validator: HiveServer2 Log Directory

Description
Whether to suppress configuration warnings produced by the HiveServer2 Log Directory configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_log_dir
Required
true

Suppress Configuration Validator: Metrics Sample File Location

Description
Whether to suppress configuration warnings produced by the Metrics Sample File Location configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_metrics_sample_file_location
Required
true

Suppress Configuration Validator: Restrict Load Bucketed Table Validator

Description
Whether to suppress configuration warnings produced by the Restrict Load Bucketed Table Validator configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_restrict_load_bucketed_table_validator
Required
true

Suppress Configuration Validator: Restrict Unsafe Comparison Validator

Description
Whether to suppress configuration warnings produced by the Restrict Unsafe Comparison Validator configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_restrict_unsafe_comparison_validator
Required
true

Suppress Configuration Validator: HiveServer2 Operations Log Directory

Description
Whether to suppress configuration warnings produced by the HiveServer2 Operations Log Directory configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_server2_logging_operation_log_location
Required
true

Suppress Configuration Validator: Thrift port

Description
Whether to suppress configuration warnings produced by the Thrift port configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_server2_thrift_http_port
Required
true

Suppress Configuration Validator: Hive Server Zookeeper Namespace

Description
Whether to suppress configuration warnings produced by the Hive Server Zookeeper Namespace configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_server2_zookeeper_namespace
Required
true

Suppress Configuration Validator: hive.llap.daemon.logger

Description
Whether to suppress configuration warnings produced by the hive.llap.daemon.logger configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hivellap_daemon_logger
Required
true

Suppress Configuration Validator: LLAP Daemon Java Options

Description
Whether to suppress configuration warnings produced by the LLAP Daemon Java Options configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hivellap_daemon_opts
Required
true

Suppress Configuration Validator: Default query queues

Description
Whether to suppress configuration warnings produced by the Default query queues configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hivellap_default_query_queues
Required
true

Suppress Configuration Validator: hive.execution.mode

Description
Whether to suppress configuration warnings produced by the hive.execution.mode configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hivellap_execution_mode
Required
true

Suppress Configuration Validator: HiveServer2 Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
Whether to suppress configuration warnings produced by the HiveServer2 Advanced Configuration Snippet (Safety Valve) for hive-site.xml configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hivellap_hs2_config_safety_valve
Required
true

Suppress Configuration Validator: hive.llap.io.memory.mode

Description
Whether to suppress configuration warnings produced by the hive.llap.io.memory.mode configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hivellap_io_memory_mode
Required
true

Suppress Configuration Validator: hive.llap.execution.mode

Description
Whether to suppress configuration warnings produced by the hive.llap.execution.mode configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hivellap_llap_execution_mode
Required
true

Suppress Configuration Validator: LLAP Proxy Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
Whether to suppress configuration warnings produced by the LLAP Proxy Advanced Configuration Snippet (Safety Valve) for hive-site.xml configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hivellap_llapproxy_config_safety_valve
Required
true

Suppress Configuration Validator: Interactive Query Queue

Description
Whether to suppress configuration warnings produced by the Interactive Query Queue configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hivellap_queue_name
Required
true

Suppress Configuration Validator: Allow custom queues

Description
Whether to suppress configuration warnings produced by the Allow custom queues configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hivellap_tez_sessions_custom_queue_allowed
Required
true

Suppress Configuration Validator: Hive Downloaded Resources Directory

Description
Whether to suppress configuration warnings produced by the Hive Downloaded Resources Directory configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_downloaded_resources_dir
Required
true

Suppress Configuration Validator: Hive Local Scratch Directory

Description
Whether to suppress configuration warnings produced by the Hive Local Scratch Directory configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_exec_local_scratchdir
Required
true

Suppress Configuration Validator: Hive HDFS Scratch Directory

Description
Whether to suppress configuration warnings produced by the Hive HDFS Scratch Directory configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_exec_scratchdir
Required
true

Suppress Configuration Validator: Fair Scheduler XML Advanced Configuration Snippet (Safety Valve)

Description
Whether to suppress configuration warnings produced by the Fair Scheduler XML Advanced Configuration Snippet (Safety Valve) configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_fair_scheduler_safety_valve
Required
true

Suppress Configuration Validator: Java Configuration Options for HiveServer2

Description
Whether to suppress configuration warnings produced by the Java Configuration Options for HiveServer2 configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_java_opts
Required
true

Suppress Configuration Validator: HiveServer2 Load Balancer

Description
Whether to suppress configuration warnings produced by the HiveServer2 Load Balancer configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_load_balancer
Required
true

Suppress Configuration Validator: Exclude Vectorized Input Formats

Description
Whether to suppress configuration warnings produced by the Exclude Vectorized Input Formats configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_vectorized_input_format_excludes
Required
true

Suppress Configuration Validator: HiveServer2 WebUI Port

Description
Whether to suppress configuration warnings produced by the HiveServer2 WebUI Port configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_webui_port
Required
true

Suppress Configuration Validator: HiveServer2 Advanced Configuration Snippet (Safety Valve) for core-site.xml

Description
Whether to suppress configuration warnings produced by the HiveServer2 Advanced Configuration Snippet (Safety Valve) for core-site.xml configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hs2_core_site_safety_valve
Required
true

Suppress Configuration Validator: HiveServer2 Port

Description
Whether to suppress configuration warnings produced by the HiveServer2 Port configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hs2_thrift_address_port
Required
true

Suppress Configuration Validator: JMX Exporter Port

Description
Whether to suppress configuration warnings produced by the JMX Exporter Port configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_jmx_exporter_port
Required
true

Suppress Configuration Validator: JMX Exporter configuration YAML

Description
Whether to suppress configuration warnings produced by the JMX Exporter configuration YAML configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_jmx_exporter_yaml
Required
true

Suppress Configuration Validator: LLAP Proxy Environment Advanced Configuration Snippet (Safety Valve)

Description
Whether to suppress configuration warnings produced by the LLAP Proxy Environment Advanced Configuration Snippet (Safety Valve) configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_llapproxy_role_env_safety_valve
Required
true

Suppress Configuration Validator: HiveServer2 Logging Advanced Configuration Snippet (Safety Valve)

Description
Whether to suppress configuration warnings produced by the HiveServer2 Logging Advanced Configuration Snippet (Safety Valve) configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_log4j_safety_valve
Required
true

Suppress Configuration Validator: Heap Dump Directory

Description
Whether to suppress configuration warnings produced by the Heap Dump Directory configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_oom_heap_dump_dir
Required
true

Suppress Configuration Validator: OpenTelemetry Collector Exporters Section

Description
Whether to suppress configuration warnings produced by the OpenTelemetry Collector Exporters Section configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_otelcol_exporters
Required
true

Suppress Configuration Validator: OpenTelemetry Collector Extensions Section

Description
Whether to suppress configuration warnings produced by the OpenTelemetry Collector Extensions Section configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_otelcol_extensions
Required
true

Suppress Configuration Validator: OpenTelemetry Collector Processors Section

Description
Whether to suppress configuration warnings produced by the OpenTelemetry Collector Processors Section configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_otelcol_processors
Required
true

Suppress Configuration Validator: OpenTelemetry Collector Receivers Section

Description
Whether to suppress configuration warnings produced by the OpenTelemetry Collector Receivers Section configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_otelcol_receivers
Required
true

Suppress Configuration Validator: OpenTelemetry Collector Remote Write Password

Description
Whether to suppress configuration warnings produced by the OpenTelemetry Collector Remote Write Password configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_otelcol_remote_write_password
Required
true

Suppress Configuration Validator: OpenTelemetry Collector Remote Write URL

Description
Whether to suppress configuration warnings produced by the OpenTelemetry Collector Remote Write URL configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_otelcol_remote_write_url
Required
true

Suppress Configuration Validator: OpenTelemetry Collector Remote Write Username

Description
Whether to suppress configuration warnings produced by the OpenTelemetry Collector Remote Write Username configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_otelcol_remote_write_user
Required
true

Suppress Configuration Validator: OpenTelemetry Collector Service Section

Description
Whether to suppress configuration warnings produced by the OpenTelemetry Collector Service Section configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_otelcol_service
Required
true

Suppress Configuration Validator: Custom Control Group Resources (overrides Cgroup settings)

Description
Whether to suppress configuration warnings produced by the Custom Control Group Resources (overrides Cgroup settings) configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_rm_custom_resources
Required
true

Suppress Configuration Validator: Role Triggers

Description
Whether to suppress configuration warnings produced by the Role Triggers configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_role_triggers
Required
true

Suppress Configuration Validator: HiveServer2 WebUI TLS/SSL Server Keystore File Location

Description
Whether to suppress configuration warnings produced by the HiveServer2 WebUI TLS/SSL Server Keystore File Location configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_ssl_server_keystore_location
Required
true

Suppress Configuration Validator: HiveServer2 WebUI TLS/SSL Server Keystore File Password

Description
Whether to suppress configuration warnings produced by the HiveServer2 WebUI TLS/SSL Server Keystore File Password configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_ssl_server_keystore_password
Required
true

Suppress Configuration Validator: Stacks Collection Directory

Description
Whether to suppress configuration warnings produced by the Stacks Collection Directory configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_stacks_collection_directory
Required
true

Suppress Configuration Validator: tez.history.logging.taskattempt-filters

Description
Whether to suppress configuration warnings produced by the tez.history.logging.taskattempt-filters configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_tez_interactive_history_logging_taskattempt_filters
Required
true

Suppress Parameter Validation: Audit Log Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Audit Log Directory parameter.
Related Name
Default Value
false
API Name
service_config_suppression_audit_event_log_dir
Required
true

Suppress Configuration Validator: Gateway Count Validator

Description
Whether to suppress configuration warnings produced by the Gateway Count Validator configuration validator.
Related Name
Default Value
false
API Name
service_config_suppression_gateway_count_validator
Required
true

Suppress Parameter Validation: Hive Auxiliary JARs Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Auxiliary JARs Directory parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_aux_jars_path_dir
Required
true

Suppress Configuration Validator: Client TLS/SSL In Use With LDAP Authentication Validator

Description
Whether to suppress configuration warnings produced by the Client TLS/SSL In Use With LDAP Authentication Validator configuration validator.
Related Name
Default Value
false
API Name
service_config_suppression_hive_client_ssl_recommended_with_ldap_auth_validator
Required
true

Suppress Parameter Validation: Hive Service Advanced Configuration Snippet (Safety Valve) for core-site.xml

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Service Advanced Configuration Snippet (Safety Valve) for core-site.xml parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_core_site_safety_valve
Required
true

Suppress Parameter Validation: Default File Format for Managed Tables

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Default File Format for Managed Tables parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_default_fileformat_managed
Required
true

Suppress Parameter Validation: Base Directory for Hive Proto Hook

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Base Directory for Hive Proto Hook parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_hook_proto_base_directory
Required
true

Suppress Parameter Validation: Hive LLAP Service Environment Advanced Configuration Snippet (Safety Valve)

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive LLAP Service Environment Advanced Configuration Snippet (Safety Valve) parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_llap_service_env_safety_valve
Required
true

Suppress Parameter Validation: Metastore Transactional Listener List

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Metastore Transactional Listener List parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_metastore_transactional_event_listeners
Required
true

Suppress Configuration Validator: Hive Proxy Groups Validator

Description
Whether to suppress configuration warnings produced by the Hive Proxy Groups Validator configuration validator.
Related Name
Default Value
false
API Name
service_config_suppression_hive_proxy_groups_validator
Required
true

Suppress Parameter Validation: Hive Metastore Access Control and Proxy User Groups Override

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Metastore Access Control and Proxy User Groups Override parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_proxy_user_groups_list
Required
true

Suppress Configuration Validator: Hive Ranger Validator

Description
Whether to suppress configuration warnings produced by the Hive Ranger Validator configuration validator.
Related Name
Default Value
false
API Name
service_config_suppression_hive_ranger_validator
Required
true

Suppress Parameter Validation: Replica functions root directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Replica functions root directory parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_repl_replica_functions_root_dir
Required
true

Suppress Parameter Validation: Hive Replication Environment Advanced Configuration Snippet (Safety Valve)

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Replication Environment Advanced Configuration Snippet (Safety Valve) parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_replication_env_safety_valve
Required
true

Suppress Configuration Validator: Hive Sentry Validator

Description
Whether to suppress configuration warnings produced by the Hive Sentry Validator configuration validator.
Related Name
Default Value
false
API Name
service_config_suppression_hive_sentry_validator
Required
true

Suppress Parameter Validation: Hive Service Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Service Advanced Configuration Snippet (Safety Valve) for hive-site.xml parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_service_config_safety_valve
Required
true

Suppress Parameter Validation: Hive Replication Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Replication Advanced Configuration Snippet (Safety Valve) for hive-site.xml parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_service_replication_config_safety_valve
Required
true

Suppress Parameter Validation: LLAP app name

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the LLAP app name parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hivellap_app_name
Required
true

Suppress Parameter Validation: hive.llap.daemon.service.hosts

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the hive.llap.daemon.service.hosts parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hivellap_daemon_service_hosts
Required
true

Suppress Configuration Validator: HiveServer2 Count Validator

Description
Whether to suppress configuration warnings produced by the HiveServer2 Count Validator configuration validator.
Related Name
Default Value
false
API Name
service_config_suppression_hiveserver2_count_validator
Required
true

Suppress Parameter Validation: HiveServer2 TLS/SSL Server Keystore File Password

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 TLS/SSL Server Keystore File Password parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hiveserver2_keystore_password
Required
true

Suppress Parameter Validation: HiveServer2 TLS/SSL Server Keystore File Location

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 TLS/SSL Server Keystore File Location parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hiveserver2_keystore_path
Required
true

Suppress Parameter Validation: LDAP BaseDN

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the LDAP BaseDN parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hiveserver2_ldap_basedn
Required
true

Suppress Parameter Validation: Active Directory Domain

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Active Directory Domain parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hiveserver2_ldap_domain
Required
true

Suppress Parameter Validation: LDAP URL

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the LDAP URL parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hiveserver2_ldap_uri
Required
true

Suppress Parameter Validation: HiveServer2 TLS/SSL Trust Store File

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 TLS/SSL Trust Store File parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hiveserver2_truststore_file
Required
true

Suppress Parameter Validation: HiveServer2 TLS/SSL Trust Store Password

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 TLS/SSL Trust Store Password parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hiveserver2_truststore_password
Required
true

Suppress Parameter Validation: Kerberos Principal

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Kerberos Principal parameter.
Related Name
Default Value
false
API Name
service_config_suppression_kerberos_princ_name
Required
true

Suppress Parameter Validation: Hive Lineage Log Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Lineage Log Directory parameter.
Related Name
Default Value
false
API Name
service_config_suppression_lineage_event_log_dir
Required
true

Suppress Configuration Validator: LLAP Proxy Count Validator

Description
Whether to suppress configuration warnings produced by the LLAP Proxy Count Validator configuration validator.
Related Name
Default Value
false
API Name
service_config_suppression_llapproxy_count_validator
Required
true

Suppress Parameter Validation: Audit Event Filter

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Audit Event Filter parameter.
Related Name
Default Value
false
API Name
service_config_suppression_navigator_audit_event_filter
Required
true

Suppress Parameter Validation: Hive Client Advanced Configuration Snippet (Safety Valve) for navigator.client.properties

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Client Advanced Configuration Snippet (Safety Valve) for navigator.client.properties parameter.
Related Name
Default Value
false
API Name
service_config_suppression_navigator_client_config_safety_valve
Required
true

Suppress Parameter Validation: Audit Event Tracker

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Audit Event Tracker parameter.
Related Name
Default Value
false
API Name
service_config_suppression_navigator_event_tracker
Required
true

Suppress Parameter Validation: Hive Client Advanced Configuration Snippet (Safety Valve) for navigator.lineage.client.properties

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Client Advanced Configuration Snippet (Safety Valve) for navigator.lineage.client.properties parameter.
Related Name
Default Value
false
API Name
service_config_suppression_navigator_lineage_client_config_safety_valve
Required
true

Suppress Parameter Validation: System Group

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the System Group parameter.
Related Name
Default Value
false
API Name
service_config_suppression_process_groupname
Required
true

Suppress Parameter Validation: System User

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the System User parameter.
Related Name
Default Value
false
API Name
service_config_suppression_process_username
Required
true

Suppress Parameter Validation: Ranger DFS Audit Path

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Ranger DFS Audit Path parameter.
Related Name
Default Value
false
API Name
service_config_suppression_ranger_audit_hdfs_dir
Required
true

Suppress Parameter Validation: Ranger Audit DFS Spool Dir

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Ranger Audit DFS Spool Dir parameter.
Related Name
Default Value
false
API Name
service_config_suppression_ranger_audit_hdfs_spool_dir
Required
true

Suppress Parameter Validation: Hive Service Advanced Configuration Snippet (Safety Valve) for ranger-hive-audit.xml

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Service Advanced Configuration Snippet (Safety Valve) for ranger-hive-audit.xml parameter.
Related Name
Default Value
false
API Name
service_config_suppression_ranger_audit_safety_valve
Required
true

Suppress Parameter Validation: Ranger Audit Solr Spool Dir

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Ranger Audit Solr Spool Dir parameter.
Related Name
Default Value
false
API Name
service_config_suppression_ranger_audit_solr_spool_dir
Required
true

Suppress Parameter Validation: Ranger Plugin Trusted Proxy IP Address

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Ranger Plugin Trusted Proxy IP Address parameter.
Related Name
Default Value
false
API Name
service_config_suppression_ranger_plugin_trusted_proxy_ipaddress
Required
true

Suppress Parameter Validation: Ranger Policy Cache Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Ranger Policy Cache Directory parameter.
Related Name
Default Value
false
API Name
service_config_suppression_ranger_policy_cache_dir
Required
true

Suppress Parameter Validation: Hive Service Advanced Configuration Snippet (Safety Valve) for ranger-hive-policymgr-ssl.xml

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Service Advanced Configuration Snippet (Safety Valve) for ranger-hive-policymgr-ssl.xml parameter.
Related Name
Default Value
false
API Name
service_config_suppression_ranger_policymgr_ssl_safety_valve
Required
true

Suppress Parameter Validation: Hive Service Advanced Configuration Snippet (Safety Valve) for ranger-hive-security.xml

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Service Advanced Configuration Snippet (Safety Valve) for ranger-hive-security.xml parameter.
Related Name
Default Value
false
API Name
service_config_suppression_ranger_security_safety_valve
Required
true

Suppress Parameter Validation: Service Triggers

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Service Triggers parameter.
Related Name
Default Value
false
API Name
service_config_suppression_service_triggers
Required
true

Suppress Parameter Validation: Service Monitor Client Config Overrides

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Service Monitor Client Config Overrides parameter.
Related Name
Default Value
false
API Name
service_config_suppression_smon_client_config_overrides
Required
true

Suppress Parameter Validation: Service Monitor Derived Configs Advanced Configuration Snippet (Safety Valve)

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Service Monitor Derived Configs Advanced Configuration Snippet (Safety Valve) parameter.
Related Name
Default Value
false
API Name
service_config_suppression_smon_derived_configs_safety_valve
Required
true

Suppress Health Test: LLAP Proxy Health

Description
Whether to suppress the results of the LLAP Proxy Health heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
service_health_suppression_hive_llap_hive_llap_llapproxy_health
Required
true

Suppress Health Test: HiveServer2 Health

Description
Whether to suppress the results of the HiveServer2 Health heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
service_health_suppression_hive_llap_hiveserver2s_healthy
Required
true