Hive LLAP Properties in Cloudera Runtime in 7.2.18

Role groups:

Gateway

Advanced

Deploy Directory

Description: The directory where the client configs will be deployed
Related Name
Default Value: /etc/hive
API Name: client_config_root_dir
Required: true

Hive Client Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description: For advanced use only, a string to be inserted into the client configuration for hive-site.xml.
Related Name
Default Value
API Name: hive_client_config_safety_valve
Required: false

Gateway Client Environment Advanced Configuration Snippet (Safety Valve) for hive-env.sh

Description: For advanced use only, key-value pairs (one on each line) to be inserted into the client configuration for hive-env.sh
Related Name
Default Value
API Name: hive_client_env_safety_valve
Required: false

Client Java Configuration Options

Description: These are Java command-line arguments. Commonly, garbage collection flags, PermGen, or extra debugging flags would be passed here.
Related Name
Default Value: -Djava.net.preferIPv4Stack=true
API Name: hive_client_java_opts
Required: false

Hive Metastore Connection Timeout

Description: Timeout for requests to the Hive Metastore Server. Consider increasing this if you have tables with a lot of metadata and see timeout errors. Used by most Hive Metastore clients such as Hive CLI and HiveServer2, but not by Impala. Impala has a separately configured timeout.
Related Name: hive.metastore.client.socket.timeout
Default Value: 5 minute(s)
API Name: hive_metastore_timeout
Required: false

Gateway Logging Advanced Configuration Snippet (Safety Valve)

Description: For advanced use only, a string to be inserted into log4j.properties for this role only.
Related Name
Default Value
API Name: log4j_safety_valve
Required: false

Logs

Gateway Logging Threshold

Description: The minimum log level for Gateway logs
Related Name
Default Value: INFO
API Name: log_threshold
Required: false

Monitoring

Enable Configuration Change Alerts

Description: When set, Cloudera Manager will send alerts when this entity's configuration changes.
Related Name
Default Value: false
API Name: enable_config_alerts
Required: false

Other

Alternatives Priority

Description: The priority level that the client configuration will have in the Alternatives system on the hosts. Higher priority levels will cause Alternatives to prefer this configuration over any others.
Related Name
Default Value: 91
API Name: client_config_priority
Required: true

Resource Management

Client Java Heap Size in Bytes

Description: Maximum size in bytes for the Java process heap memory. Passed to Java -Xmx.
Related Name
Default Value: 2 GiB
API Name: hive_client_java_heapsize
Required: false

Suppressions

Suppress Configuration Validator: CDH Version Validator

Description: Whether to suppress configuration warnings produced by the CDH Version Validator configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_cdh_version_validator
Required: true

Suppress Parameter Validation: Deploy Directory

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Deploy Directory parameter.
Related Name
Default Value: false
API Name: role_config_suppression_client_config_root_dir
Required: true

Suppress Parameter Validation: Hive Client Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Client Advanced Configuration Snippet (Safety Valve) for hive-site.xml parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hive_client_config_safety_valve
Required: true

Suppress Parameter Validation: Gateway Client Environment Advanced Configuration Snippet (Safety Valve) for hive-env.sh

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Gateway Client Environment Advanced Configuration Snippet (Safety Valve) for hive-env.sh parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hive_client_env_safety_valve
Required: true

Suppress Parameter Validation: Client Java Configuration Options

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Client Java Configuration Options parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hive_client_java_opts
Required: true

Suppress Parameter Validation: Gateway Logging Advanced Configuration Snippet (Safety Valve)

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Gateway Logging Advanced Configuration Snippet (Safety Valve) parameter.
Related Name
Default Value: false
API Name: role_config_suppression_log4j_safety_valve
Required: true

HiveServer2

Advanced

HiveServer2 Environment Advanced Configuration Snippet (Safety Valve)

Description: For advanced use only, key-value pairs (one on each line) to be inserted into a role's environment. Applies to configurations of this role except client configuration.
Related Name
Default Value
API Name: hive_hs2_env_safety_valve
Required: false

Hive Metastore Connection Retries Count

Description: Number of retries while opening a connection to the Hive Metastore Server
Related Name: hive.metastore.connect.retries
Default Value: 10
API Name: hive_metastore_connection_retries
Required: false

Enable Metrics Subsystem

Description: Controls whether the Hive metrics subsystem is enabled for the role.
Related Name: hive.server2.metrics.enabled
Default Value: true
API Name: hive_metrics_enabled
Required: false

Metrics Sample File Location

Description: The full path to a file with a sample of metrics exposed by the role. The sample is updated at the frequency configured by Metrics Sample File Logging Frequency. By default, the sample file is logged to a directory under the role log directory, e.g., /var/log/hive/metrics-hivemetastore/metrics.log. The setting only has an effect if "Enable Metrics Subsystem" is set to true.
Related Name: hive.service.metrics.file.location
Default Value
API Name: hive_metrics_sample_file_location
Required: false

Metrics Sample File Logging Frequency

Description: The frequency at which the metrics are logged to the sample file. The setting only has an effect if "Enable Metrics Subsystem" is set to true.
Related Name: hive.service.metrics.file.frequency
Default Value: 30 second(s)
API Name: hive_metrics_sample_logging_frequency
Required: false

Allow User Substitution

Description: Allow alternate user to be specified as part of HiveServer2 open connection request.
Related Name: hive.server2.allow.user.substitution
Default Value: true
API Name: hive_server2_allow_user_substitution
Required: false

HiveServer2 Transport Mode

Description: The server transport mode.
Related Name: hive.server2.transport.mode
Default Value: binary
API Name: hive_server2_transport_mode
Required: false

HiveServer2 Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description: For advanced use only. A string to be inserted into hive-site.xml for this role only.
Related Name
Default Value
API Name: hivellap_hs2_config_safety_valve
Required: false

Hive Downloaded Resources Directory

Description: Local directory where Hive stores jars downloaded for remote file systems (HDFS). If not specified, Hive uses a default location.
Related Name: hive.downloaded.resources.dir
Default Value
API Name: hiveserver2_downloaded_resources_dir
Required: false

Enable Explain Logging

Description: When enabled, HiveServer2 logs EXPLAIN EXTENDED output for every query at INFO log4j level.
Related Name: hive.log.explain.output
Default Value: false
API Name: hiveserver2_enable_explain_output
Required: false

Hive Local Scratch Directory

Description: Local Directory where Hive stores jars and data when performing a MapJoin optimization. If not specified, Hive uses a default location.
Related Name: hive.exec.local.scratchdir
Default Value
API Name: hiveserver2_exec_local_scratchdir
Required: false

Hive HDFS Scratch Directory

Description: Directory in HDFS where Hive writes intermediate data between MapReduce jobs. If not specified, Hive uses a default location.
Related Name: hive.exec.scratchdir
Default Value
API Name: hiveserver2_exec_scratchdir
Required: false

Fair Scheduler XML Advanced Configuration Snippet (Safety Valve)

Description: An XML string that will be inserted verbatim into the Fair Scheduler allocations file. This configuration only has effect in CDH 5.8 or later.
Related Name
Default Value
API Name: hiveserver2_fair_scheduler_safety_valve
Required: false

Idle Operation Timeout

Description: Operation will be closed when not accessed for this duration of time, in milliseconds; disable by setting to zero. For a positive value, checked for operations in terminal state only (FINISHED, CANCELED, CLOSED, ERROR). For a negative value, checked for all of the operations regardless of state.
Related Name: hive.server2.idle.operation.timeout
Default Value: 6 hour(s)
API Name: hiveserver2_idle_operation_timeout
Required: false

Idle Session Timeout

Description: Session will be closed when not accessed for this duration of time, in milliseconds; disable by setting to zero or a negative value.
Related Name: hive.server2.idle.session.timeout
Default Value: 1 day(s)
API Name: hiveserver2_idle_session_timeout
Required: false

Exclude Live Operations From Session Idle Time

Description: Session will be considered to be idle only if there is no activity, and there is no pending operation. This setting takes effect only if session idle timeout (hive.server2.idle.session.timeout) and checking (hive.server2.session.check.interval) are enabled.
Related Name: hive.server2.idle.session.check.operation
Default Value: true
API Name: hiveserver2_idle_session_timeout_check_operation
Required: false

Java Configuration Options for HiveServer2

Description: These arguments will be passed as part of the Java command line. Commonly, garbage collection flags, PermGen, or extra debugging flags would be passed here. Note: When CM version is 6.3.0 or greater, {{JAVA_GC_ARGS}} will be replaced by JVM Garbage Collection arguments based on the runtime Java JVM version.
Related Name
Default Value: JAVA_GC_ARGS
API Name: hiveserver2_java_opts
Required: false

Maximum Query String Length for Show Locks

Description: The maximum length allowed for the query string when the SHOW LOCKS EXTENDED command is executed. Important: The query string is truncated at the length set for this property. Setting this property to a large value puts pressure on ZooKeeper and might cause out-of-memory issues.
Related Name: hive.lock.query.string.max.length
Default Value: 10000
API Name: hiveserver2_lock_query_string_max_length
Required: false

Max HiveServer2 Threads

Description: Maximum number of worker threads in HiveServer2's thread pool
Related Name: hive.server2.thrift.max.worker.threads
Default Value: 500
API Name: hiveserver2_max_threads
Required: true

Min HiveServer2 Threads

Description: Minimum number of worker threads in HiveServer2's thread pool
Related Name: hive.server2.thrift.min.worker.threads
Default Value: 5
API Name: hiveserver2_min_threads
Required: true

Session Check Interval

Description: The check interval for session/operation timeout, in milliseconds, which can be disabled by setting to zero or a negative value.
Related Name: hive.server2.session.check.interval
Default Value: 15 minute(s)
API Name: hiveserver2_session_check_interval
Required: false

HiveServer2 WebUI Max Threads

Description: The max threads for the HiveServer2 WebUI.
Related Name: hive.server2.webui.max.threads
Default Value: 50
API Name: hiveserver2_webui_max_threads
Required: false

HiveServer2 Advanced Configuration Snippet (Safety Valve) for core-site.xml

Description: For advanced use only. A string to be inserted into core-site.xml for this role only.
Related Name
Default Value
API Name: hs2_core_site_safety_valve
Required: false

HiveServer2 Logging Advanced Configuration Snippet (Safety Valve)

Description: For advanced use only, a string to be inserted into log4j.properties for this role only.
Related Name
Default Value
API Name: log4j_safety_valve
Required: false

Enable auto refresh for metric configurations

Description: When true, Enable Metric Collection and Metric Filter parameters will be set automatically if they're changed. Otherwise, a refresh by hand is required.
Related Name
Default Value: false
API Name: metric_config_auto_refresh
Required: false

Heap Dump Directory

Description: Path to directory where heap dumps are generated when java.lang.OutOfMemoryError error is thrown. This directory is automatically created if it does not exist. If this directory already exists, it will be owned by the current role user with 1777 permissions. Sharing the same directory among multiple roles will cause an ownership race. The heap dump files are created with 600 permissions and are owned by the role user. The amount of free space in this directory should be greater than the maximum Java Process heap size configured for this role.
Related Name: oom_heap_dump_dir
Default Value: /tmp
API Name: oom_heap_dump_dir
Required: false

Dump Heap When Out of Memory

Description: When set, generates a heap dump file when when an out-of-memory error occurs.
Related Name
Default Value: true
API Name: oom_heap_dump_enabled
Required: true

Kill When Out of Memory

Description: When set, a SIGKILL signal is sent to the role process when java.lang.OutOfMemoryError is thrown.
Related Name
Default Value: true
API Name: oom_sigkill_enabled
Required: true

Automatically Restart Process

Description: When set, this role's process is automatically (and transparently) restarted in the event of an unexpected failure. This configuration applies in the time after the Start Wait Timeout period.
Related Name
Default Value: false
API Name: process_auto_restart
Required: true

Enable Metric Collection

Description: Cloudera Manager agent monitors each service and each of its role by publishing metrics to the Cloudera Manager Service Monitor. Setting it to false will stop Cloudera Manager agent from publishing any metric for corresponding service/roles. This is usually helpful for services that generate large amount of metrics which Service Monitor is not able to process.
Related Name
Default Value: true
API Name: process_should_monitor
Required: true

Process Start Retry Attempts

Description: Number of times to try starting a role's process when the process exits before the Start Wait Timeout period. After a process is running beyond the Start Wait Timeout, the retry count is reset. Setting this configuration to zero will prevent restart of the process during the Start Wait Timeout period.
Related Name
Default Value: 3
API Name: process_start_retries
Required: false

Process Start Wait Timeout

Description: The time in seconds to wait for a role's process to start successfully on a host. Processes which exit/crash before this time will be restarted until reaching the limit specified by the Start Retry Attempts count parameter. Setting this configuration to zero will turn off this feature.
Related Name
Default Value: 20
API Name: process_start_secs
Required: false

Logs

HiveServer2 Log Directory

Description: Directory where HiveServer2 will place its log files.
Related Name
Default Value: /var/log/hive
API Name: hive_log_dir
Required: false

Enable HiveServer2 Operations Logging

Description: When enabled, HiveServer2 will temporarily save logs associated with ongoing operations. This enables clients like beeline and Hue to request and display logs for a particular ongoing operation. Logs are removed upon completion of operation.
Related Name: hive.server2.logging.operation.enabled
Default Value: true
API Name: hive_server2_logging_operation_enabled
Required: false

HiveServer2 Operations Log Directory

Description: Top level directory where operation logs are temporarily stored if Enable HiveServer2 Operations Logging is true. Logs are stored in session and operation level subdirectories under this location and are removed on completion of operation.
Related Name: hive.server2.logging.operation.log.location
Default Value: /var/log/hive/operation_logs
API Name: hive_server2_logging_operation_log_location
Required: false

HiveServer2 Logging Threshold

Description: The minimum log level for HiveServer2 logs
Related Name
Default Value: INFO
API Name: log_threshold
Required: false

HiveServer2 Maximum Log File Backups

Description: The maximum number of rolled log files to keep for HiveServer2 logs. Typically used by log4j or logback.
Related Name
Default Value: 10
API Name: max_log_backup_index
Required: false

HiveServer2 Max Log Size

Description: The maximum size, in megabytes, per log file for HiveServer2 logs. Typically used by log4j or logback.
Related Name
Default Value: 200 MiB
API Name: max_log_size
Required: false

Monitoring

Enable Health Alerts for this Role

Description: When set, Cloudera Manager will send alerts when the health of this role reaches the threshold specified by the EventServer setting eventserver_health_events_alert_threshold
Related Name
Default Value: true
API Name: enable_alerts
Required: false

Enable Configuration Change Alerts

Description: When set, Cloudera Manager will send alerts when this entity's configuration changes.
Related Name
Default Value: false
API Name: enable_config_alerts
Required: false

Heap Dump Directory Free Space Monitoring Absolute Thresholds

Description: The health test thresholds for monitoring of free space on the filesystem that contains this role's heap dump directory.
Related Name
Default Value: Warning: 10 GiB, Critical: 5 GiB
API Name: heap_dump_directory_free_space_absolute_thresholds
Required: false

Heap Dump Directory Free Space Monitoring Percentage Thresholds

Description: The health test thresholds for monitoring of free space on the filesystem that contains this role's heap dump directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Heap Dump Directory Free Space Monitoring Absolute Thresholds setting is configured.
Related Name
Default Value: Warning: Never, Critical: Never
API Name: heap_dump_directory_free_space_percentage_thresholds
Required: false

Hive Downloaded Resources Directory Free Space Monitoring Absolute Thresholds

Description: The health test thresholds for monitoring of free space on the filesystem that contains this role's Hive Downloaded Resources Directory.
Related Name
Default Value: Warning: 10 GiB, Critical: 5 GiB
API Name: hive_llap_hs2_downloaded_resources_directory_free_space_absolute_thresholds
Required: false

Hive Downloaded Resources Directory Free Space Monitoring Percentage Thresholds

Description: The health test thresholds for monitoring of free space on the filesystem that contains this role's Hive Downloaded Resources Directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Hive Downloaded Resources Directory Free Space Monitoring Absolute Thresholds setting is configured.
Related Name
Default Value: Warning: Never, Critical: Never
API Name: hive_llap_hs2_downloaded_resources_directory_free_space_percentage_thresholds
Required: false

Hive Local Scratch Directory Free Space Monitoring Absolute Thresholds

Description: The health test thresholds for monitoring of free space on the filesystem that contains this role's Hive Local Scratch Directory.
Related Name
Default Value: Warning: 10 GiB, Critical: 5 GiB
API Name: hive_llap_hs2_exec_local_scratch_directory_free_space_absolute_thresholds
Required: false

Hive Local Scratch Directory Free Space Monitoring Percentage Thresholds

Description: The health test thresholds for monitoring of free space on the filesystem that contains this role's Hive Local Scratch Directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Hive Local Scratch Directory Free Space Monitoring Absolute Thresholds setting is configured.
Related Name
Default Value: Warning: Never, Critical: Never
API Name: hive_llap_hs2_exec_local_scratch_directory_free_space_percentage_thresholds
Required: false

File Descriptor Monitoring Thresholds

Description: The health test thresholds of the number of file descriptors used. Specified as a percentage of file descriptor limit.
Related Name
Default Value: Warning: 50.0 %, Critical: 70.0 %
API Name: hiveserver2_fd_thresholds
Required: false

HiveServer2 Host Health Test

Description: When computing the overall HiveServer2 health, consider the host's health.
Related Name
Default Value: true
API Name: hiveserver2_host_health_enabled
Required: false

Pause Duration Thresholds

Description: The health test thresholds for the weighted average extra time the pause monitor spent paused. Specified as a percentage of elapsed wall clock time.
Related Name
Default Value: Warning: 30.0, Critical: 60.0
API Name: hiveserver2_pause_duration_thresholds
Required: false

Pause Duration Monitoring Period

Description: The period to review when computing the moving average of extra time the pause monitor spent paused.
Related Name
Default Value: 5 minute(s)
API Name: hiveserver2_pause_duration_window
Required: false

HiveServer2 Process Health Test

Description: Enables the health test that the HiveServer2's process state is consistent with the role configuration
Related Name
Default Value: true
API Name: hiveserver2_scm_health_enabled
Required: false

Enable JMX Exporter (beta)

Description: JMX Exporter support is a beta feature. If enabled, CM configures the role to run JMX Exporter in agent mode with the provided port and YAML configuration. This exporter then can be used with the OpenTelemetry Collector feature. See the JMX Exporter documentation.
Related Name
Default Value: false
API Name: jmx_exporter_enabled
Required: true

JMX Exporter Port

Description: JMX Exporter needs a port to implement a Prometheus exporter.
Related Name
Default Value: 11121
API Name: jmx_exporter_port
Required: false

JMX Exporter configuration YAML

Description: This configuration is passed to JMX Exporter as it is. See the JMX Exporter documentation.
Related Name
Default Value: startDelaySeconds: 10 ssl: false lowercaseOutputName: true lowercaseOutputLabelNames: true rules: - pattern: 'metrics<name=(jvm\.pause.*)><>(.*): (\d+)' name: $1_$2 value: $3
API Name: jmx_exporter_yaml
Required: false

Log Directory Free Space Monitoring Absolute Thresholds

Description: The health test thresholds for monitoring of free space on the filesystem that contains this role's log directory.
Related Name
Default Value: Warning: 10 GiB, Critical: 5 GiB
API Name: log_directory_free_space_absolute_thresholds
Required: false

Log Directory Free Space Monitoring Percentage Thresholds

Description: The health test thresholds for monitoring of free space on the filesystem that contains this role's log directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Log Directory Free Space Monitoring Absolute Thresholds setting is configured.
Related Name
Default Value: Warning: Never, Critical: Never
API Name: log_directory_free_space_percentage_thresholds
Required: false

Navigator Audit Failure Thresholds

Description: The health test thresholds for failures encountered when monitoring audits within a recent period specified by the mgmt_navigator_failure_window configuration for the role. The value that can be specified for this threshold is the number of bytes of audits data that is left to be sent to audit server.
Related Name: mgmt.navigator.failure.thresholds
Default Value: Warning: Never, Critical: Any
API Name: mgmt_navigator_failure_thresholds
Required: false

Monitoring Period For Audit Failures

Description: The period to review when checking if audits are blocked and not getting processed.
Related Name: mgmt.navigator.failure.window
Default Value: 20 minute(s)
API Name: mgmt_navigator_failure_window
Required: false

Navigator Audit Pipeline Health Check

Description: Enable test of audit events processing pipeline. This will test if audit events are not getting processed by Audit Server for a role that generates audit.
Related Name: mgmt.navigator.status.check.enabled
Default Value: true
API Name: mgmt_navigator_status_check_enabled
Required: false

Metric Filter

Description

Defines a Metric Filter for this role. Cloudera Manager Agents will not send filtered metrics to the Service Monitor. Define the following fields:

Health Test Metric Set - Select this parameter to collect only metrics required for health tests.
Default Dashboard Metric Set - Select this parameter to collect only metrics required for the default dashboards. For user-defined charts, you must add the metrics you require for the chart using the Custom Metrics parameter.
Include/Exclude Custom Metrics - Select Include to specify metrics that should be collected. Select Exclude to specify metrics that should not be collected. Enter the metric names to be included or excluded using the Metric Name parameter.
Metric Name - The name of a metric that will be included or excluded during metric collection.

If you do not select Health Test Metric Set or Default Dashboard Metric Set, or specify metrics by name, metric filtering will be turned off (this is the default behavior).For example, the following configuration enables the collection of metrics required for Health Tests and the jvm_heap_used_mb metric:

Include only Health Test Metric Set: Selected.
Include/Exclude Custom Metrics: Set to Include.
Metric Name: jvm_heap_used_mb

You can also view the JSON representation for this parameter by clicking View as JSON. In this example, the JSON looks like this:

{
  "includeHealthTestMetricSet": true, 
  "filterType": "whitelist",
  "metrics": ["jvm_heap_used_mb"]
}

Related Name

Default Value

API Name

monitoring_metric_filter

Required

false

OpenTelemetry Collector Exporters Section

Description: Define the exporters settings as a yaml snippet according to the OpenTelemetry Collector standards. Variable substitution available, see the receivers' help.
Related Name
Default Value: exporters: prometheusremotewrite/$ROLE_NAME: endpoint: $ROLE_PARAM(otelcol_remote_write_url) auth: authenticator: basicauth/common tls: insecure_skip_verify: true retry_on_failure: enabled: true initial_interval: 10s max_interval: 40s max_elapsed_time: 300s
API Name: otelcol_exporters
Required: false

OpenTelemetry Collector Extensions Section

Description: Define the extensions settings as a yaml snippet according to the OpenTelemetry Collector standards. Variable substitution available, see the receivers' help.
Related Name
Default Value: extensions: basicauth/common: client_auth: username: $ROLE_PARAM(otelcol_remote_write_user) password: '$ROLE_PARAM(otelcol_remote_write_password)'
API Name: otelcol_extensions
Required: false

OpenTelemetry Collector Processors Section

Description: Define the processors settings as a yaml snippet according to the OpenTelemetry Collector standards. Variable substitution available, see the receivers' help.
Related Name
Default Value: processors: filter/$ROLE_NAME: metrics: include: match_type: strict metric_names: #memory - jvm_buffer_pool_used_bytes - jvm_buffer_pool_capacity_bytes - jvm_buffer_pool_used_buffers - jvm_memory_bytes_used - jvm_memory_bytes_committed - jvm_memory_bytes_max - jvm_memory_bytes_init #gc - jvm_gc_collection_seconds #threads - jvm_threads_current - jvm_threads_daemon - jvm_threads_peak - jvm_threads_started_total - jvm_threads_deadlocked - jvm_threads_deadlocked_monitor - jvm_threads_state #classes - jvm_classes_currently_loaded #process - process_cpu_seconds_total - process_start_time_seconds - process_open_fds - process_virtual_memory_bytes - jvm_pause_extrasleeptime_count
API Name: otelcol_processors
Required: false

OpenTelemetry Collector Receivers Section

Description: Define the receivers settings as a yaml snippet according to the OpenTelemetry Collector standards. A number of variables can help to use the same config everywhere. The follow strings or expressions will be substituted: $HOST_NAME, $CLUSTER_NAME, $CLUSTER_ID, $SERVICE_TYPE, $SERVICE_NAME, $ROLE_NAME, $ROLE_TYPE, $ROLE_PARAM(my_parameter_name) - e.g.: a port parameter for the role's metrics, $DECODE_B64(...) and $DECODE_URL(...) to decode encoded parameters, $ENV_PARAM(name) to fetch params from the process' environment, $SYS_PARAM(name) to fetch java system properties.
Related Name
Default Value: receivers: prometheus/$ROLE_NAME: config: scrape_configs: - job_name: 'DMP-$ROLE_NAME' scrape_interval: 60s scheme: 'http' static_configs: - targets: ['localhost:$ROLE_PARAM(jmx_exporter_port)'] labels: host: $HOST_NAME cm_cluster_id: $CLUSTER_ID service_type: $SERVICE_TYPE service_name: $SERVICE_NAME role_type: $ROLE_TYPE role_name: $ROLE_NAME node_instance_id: $INFRA(instance_id) resource_crn: $INFRA(resource_crn) platform: $INFRA(platform) formfactor: paas-vm relabel_configs: - source_labels: [resource_crn] regex: 'crn:cdp:([^:]+):.*' replacement: '$$1' target_label: app_type action: replace
API Name: otelcol_receivers
Required: false

OpenTelemetry Collector Remote Write Password

Description: Remote write password for the OpenTelemetry Collector. This param is for convenience and intended to be used at the extensions section of Otelcol settings using the $ROLE_PARAM(otelcol_remote_write_password) expression. Specify $INFRA(cdp_request_signer_password) when forwarding to Cloudera Observability central monitoring. (This is the default.)
Related Name
Default Value: ******
API Name: otelcol_remote_write_password
Required: false

OpenTelemetry Collector Remote Write URL

Description: Remote write URL for the OpenTelemetry Collector. This param is for convenience and intended to be used at the exporters section of Otelcol settings using the $ROLE_PARAM(otelcol_remote_write_url) expression. Specify $INFRA(cdp_request_signer_url) when forwarding to Cloudera Observability central monitoring.
Related Name
Default Value: $INFRA(cdp_request_signer_url)
API Name: otelcol_remote_write_url
Required: false

OpenTelemetry Collector Remote Write Username

Description: Remote write username for the OpenTelemetry Collector. This param is for convenience and intended to be used at the extensions section of Otelcol settings using the $ROLE_PARAM(otelcol_remote_write_user) expression. Specify $INFRA(cdp_request_signer_username) when forwarding to Cloudera Observability central monitoring.
Related Name
Default Value: $INFRA(cdp_request_signer_username)
API Name: otelcol_remote_write_user
Required: false

OpenTelemetry Collector Service Section

Description: Define the service settings as a yaml snippet according to the OpenTelemetry Collector standards. Variable substitution available, see the receivers' help.
Related Name
Default Value: service: pipelines: metrics/$ROLE_NAME: receivers: [prometheus/$ROLE_NAME] processors: [filter/$ROLE_NAME] exporters: [prometheusremotewrite/$ROLE_NAME]
API Name: otelcol_service
Required: false

Enable OpenTelemetry Collector (beta)

Description: OpenTelemetry Collector support is a new beta feature (will change without notice) which can run OpenTelemetry Collector as an agent together with the CM Agent to forward metrics to a Prometheus like storage.
Related Name
Default Value: false
API Name: otelcol_should_collect
Required: true

Swap Memory Usage Rate Thresholds

Description: The health test thresholds on the swap memory usage rate of the process. Specified as the change of the used swap memory during the predefined period.
Related Name
Default Value: Warning: Never, Critical: Never
API Name: process_swap_memory_rate_thresholds
Required: false

Swap Memory Usage Rate Window

Description: The period to review when computing unexpected swap memory usage change of the process.
Related Name: common.process.swap_memory_rate_window
Default Value: 5 minute(s)
API Name: process_swap_memory_rate_window
Required: false

Process Swap Memory Thresholds

Description: The health test thresholds on the swap memory usage of the process. This takes precedence over the host level threshold.
Related Name
Default Value: Warning: 200 B, Critical: Never
API Name: process_swap_memory_thresholds
Required: false

Role Triggers

Description

The configured triggers for this role. This is a JSON-formatted list of triggers. These triggers are evaluated as part as the health system. Every trigger expression is parsed, and if the trigger condition is met, the list of actions provided in the trigger expression is executed. Each trigger has the following fields:

triggerName (mandatory) - The name of the trigger. This value must be unique for the specific role.
triggerExpression (mandatory) - A tsquery expression representing the trigger.
streamThreshold (optional) - The maximum number of streams that can satisfy a condition of a trigger before the condition fires. By default set to 0, and any stream returned causes the condition to fire.
enabled (optional) - By default set to 'true'. If set to 'false', the trigger is not evaluated.
expressionEditorConfig (optional) - Metadata for the trigger editor. If present, the trigger should only be edited from the Edit Trigger page; editing the trigger here can lead to inconsistencies.

For example, the following JSON formatted trigger configured for a DataNode fires if the DataNode has more than 1500 file descriptors opened:

[{"triggerName": "sample-trigger",
  "triggerExpression": "IF (SELECT fd_open WHERE roleName=$ROLENAME and last(fd_open) > 1500) DO health:bad",
  "streamThreshold": 0, "enabled": "true"}]

See the trigger rules documentation for more details on how to write triggers using tsquery.The JSON format is evolving and may change and, as a result, backward compatibility is not guaranteed between releases.

Related Name

Default Value

[]

API Name

role_triggers

Required

true

Unexpected Exits Thresholds

Description: The health test thresholds for unexpected exits encountered within a recent period specified by the unexpected_exits_window configuration for the role.
Related Name
Default Value: Warning: Never, Critical: Any
API Name: unexpected_exits_thresholds
Required: false

Unexpected Exits Monitoring Period

Description: The period to review when computing unexpected exits.
Related Name
Default Value: 5 minute(s)
API Name: unexpected_exits_window
Required: false

Other

Restrict Cross Joins (Cartesian Products)

Description: Whether to allow queries with cross joins. If set to true, queries that contain this pattern throw a compile-time error.
Related Name: hive.strict.checks.cartesian.product
Default Value: false
API Name: hive_restrict_cross_joins
Required: false

Restrict LOAD Queries Against Bucketed Tables

Description: Whether to allow LOAD queries against bucketed tables. If set to true, queries that contain this pattern throw a compile-time error.
Related Name: hive.strict.checks.bucketing
Default Value: true
API Name: hive_restrict_load_bucketed_table
Required: false

Restrict Queries with ORDER BY but no LIMIT clause

Description: Whether to allow queries with an ORDER BY clause, but no LIMIT clause. If set to true, queries that contain this pattern throw a compile-time error.
Related Name: hive.strict.checks.orderby.no.limit
Default Value: false
API Name: hive_restrict_orderby_with_no_limit
Required: false

Restrict Partitioned Table Scans with no Partitioned Column Filter

Description: Whether to allow queries that scan a partitioned table but don't filter on the partition column. If set to true, queries that contain this pattern throw a compile-time error.
Related Name: hive.strict.checks.no.partition.filter
Default Value: false
API Name: hive_restrict_partitioned_scans_no_filter
Required: false

Restrict Unsafe Data Type Comparisons

Description: Whether to allow queries that compare bigints to strings or doubles. If set to true, queries that contain this pattern throw a compile-time error.
Related Name: hive.strict.checks.type.safety
Default Value: true
API Name: hive_restrict_unsafe_comparison
Required: false

Support Dynamic Service Discovery

Description: Whether HiveServer2 supports dynamic service discovery for its clients. To support this, each instance of HiveServer2 currently uses ZooKeeper to register itself, when it is brought up. JDBC/ODBC clients should use the ZooKeeper ensemble: hive.zookeeper.quorum in their connection string.
Related Name: hive.server2.support.dynamic.service.discovery
Default Value: true
API Name: hive_server2_support_dynamic_service_discovery
Required: false

Hive Server Zookeeper Namespace

Description: The parent node in ZooKeeper used by HiveServer2 when supporting dynamic service discovery.
Related Name: hive.server2.zookeeper.namespace
Default Value: hiveserver2-interactive
API Name: hive_server2_zookeeper_namespace
Required: false

Default query queues

Description: A list of comma separated values corresponding to YARN queues of the same name. When HiveServer2 is launched in Tez mode, this configuration needs to be set for multiple Tez sessions to run in parallel on the cluster.
Related Name: hive.server2.tez.default.queues
Default Value: llap
API Name: hivellap_default_query_queues
Required: false

hive.prewarm.enabled

Description: Enables container prewarm for Tez
Related Name: hive.prewarm.enabled
Default Value: false
API Name: hivellap_prewarm_enabled
Required: false

Number of Containers Held

Description: Controls the number of containers to prewarm for Tez
Related Name: hive.prewarm.numcontainers
Default Value: 2
API Name: hivellap_prewarm_numcontainers
Required: false

Start Tez session at Initialization

Description: This flag is used in HiveServer2 to enable a user to use HiveServer2 without turning on Tez for HiveServer2. The user could potentially want to run queries over Tez without the pool of sessions.
Related Name: hive.server2.tez.initialize.default.sessions
Default Value: true
API Name: hivellap_tez_initialize_default_sessions
Required: false

Allow custom queues

Description: Whether to allow the users of this HS2 to specify custom queues - yes, no (fail if specified), ignore (use the default queues even if a custom one is specified)
Related Name: hive.server2.tez.sessions.custom.queue.allowed
Default Value: ignore
API Name: hivellap_tez_sessions_custom_queue_allowed
Required: false

HiveServer2 Enable Impersonation

Description: HiveServer2 will impersonate the beeline client user when talking to other services such as MapReduce and HDFS.
Related Name: hive.server2.enable.doAs
Default Value: true
API Name: hiveserver2_enable_impersonation
Required: false

HiveServer2 Load Balancer

Description: Address of the load balancer used for HiveServer2 roles, specified in host:port format. If port is not specified, the port used by HiveServer2 is used. Note: Changing this property regenerates Kerberos keytabs for all HiveServer2 roles.
Related Name
Default Value
API Name: hiveserver2_load_balancer
Required: false

Performance

Enable Dynamic Partitions

Description: Whether or not to allow dynamic partitions in DML/DDL.
Related Name: hive.exec.dynamic.partition
Default Value: true
API Name: hive_exec_dynamic_partition
Required: false

Hive Auto Convert Join Noconditional Size

Description: If Hive auto convert join is on, and the sum of the size for n-1 of the tables/partitions for a n-way join is smaller than the specified size, the join is directly converted to a MapJoin (there is no conditional task).
Related Name: hive.auto.convert.join.noconditionaltask.size
Default Value: 50 MiB
API Name: hiveserver2_auto_convert_join_noconditionaltask_size
Required: false

Store Intermediate Data on Blobstore

Description: When writing data to a table on a blobstore (such as S3), whether or not the blobstore should be used to store intermediate data during Hive query execution. Setting this to true can degrade performance for queries that spawn multiple MR / Spark jobs, but is useful for queries whose intermediate data cannot fit in the allocated HDFS cluster.
Related Name: hive.blobstore.use.blobstore.as.scratchdir
Default Value: false
API Name: hiveserver2_blobstore_use_blobstore_as_scratchdir
Required: false

Enable Stats Optimization

Description: Enable optimization that checks if a query can be answered using statistics. If so, answers the query using only statistics stored in metastore.
Related Name: hive.compute.query.using.stats
Default Value: true
API Name: hiveserver2_compute_query_using_stats
Required: false

Enable Cost-Based Optimizer for Hive

Description: Enabled the Calcite-based Cost-Based Optimizer for HiveServer2.
Related Name: hive.cbo.enable
Default Value: true
API Name: hiveserver2_enable_cbo
Required: false

Enable MapJoin Optimization

Description: Enable optimization that converts common join into MapJoin based on input file size.
Related Name: hive.auto.convert.join
Default Value: true
API Name: hiveserver2_enable_mapjoin
Required: false

Fetch Task Query Conversion

Description: Some select queries can be converted to a single FETCH task instead of a MapReduce task, minimizing latency. A value of none disables all conversion, minimal converts simple queries such as SELECT * and filter on partition columns, and more converts SELECT queries including FILTERS.
Related Name: hive.fetch.task.conversion
Default Value: more
API Name: hiveserver2_fetch_task_conversion
Required: false

Fetch Task Query Conversion Threshold

Description: Above this size, queries are converted to fetch tasks.
Related Name: hive.fetch.task.conversion.threshold
Default Value: 1 GiB
API Name: hiveserver2_fetch_task_conversion_threshold
Required: false

Input Listing Max Threads

Description: Maximum number of threads that Hive uses to list input files. Increasing this value can improve performance when there are a lot of partitions being read, or when running on blobstores.
Related Name: hive.exec.input.listing.max.threads
Default Value: 15
API Name: hiveserver2_input_listing_max_threads
Required: false

Maximum ReduceSink Top-K Memory Usage

Description: The maximum percentage of heap to be used for hash in ReduceSink operator for Top-K selection. 0 means the optimization is disabled. Accepted values are between 0 and 1.
Related Name: hive.limit.pushdown.memory.usage
Default Value: 0.04
API Name: hiveserver2_limit_pushdown_memory_usage
Required: false

Load Dynamic Partitions Thread Count

Description: Number of threads used to load dynamically generated partitions. Loading requires renaming the file its final location, and updating some metadata about the new partition. Increasing this can improve performance when there are a lot of partitions dynamically generated.
Related Name: hive.load.dynamic.partitions.thread
Default Value: 15
API Name: hiveserver2_load_dynamic_partitions_thread_count
Required: false

Enable Map-Side Aggregation

Description: Enable map-side partial aggregation, which cause the mapper to generate fewer rows. This reduces the data to be sorted and distributed to reducers.
Related Name: hive.map.aggr
Default Value: true
API Name: hiveserver2_map_aggr
Required: false

Ratio of Memory Usage for Map-Side Aggregation

Description: Portion of total memory used in map-side partial aggregation. When exceeded, the partially aggregated results will be flushed from the map task to the reducers.
Related Name: hive.map.aggr.hash.percentmemory
Default Value: 0.5
API Name: hiveserver2_map_aggr_hash_memory_ratio
Required: false

Enable Merging Small Files - Map-Only Job

Description: Merge small files at the end of a map-only job. When enabled, a map-only job is created to merge the files in the destination table/partitions.
Related Name: hive.merge.mapfiles
Default Value: true
API Name: hiveserver2_merge_mapfiles
Required: false

Enable Merging Small Files - Map-Reduce Job

Description: Merge small files at the end of a map-reduce job. When enabled, a map-only job is created to merge the files in the destination table/partitions.
Related Name: hive.merge.mapredfiles
Default Value: false
API Name: hiveserver2_merge_mapredfiles
Required: false

Desired File Size After Merging

Description: The desired file size after merging. This should be larger than hive.merge.smallfiles.avgsize.
Related Name: hive.merge.size.per.task
Default Value: 256 MiB
API Name: hiveserver2_merge_size_per_task
Required: false

Small File Average Size Merge Threshold

Description: When the average output file size of a job is less than the value of this property, Hive will start an additional map-only job to merge the output files into bigger files. This is only done for map-only jobs if hive.merge.mapfiles is true, for map-reduce jobs if hive.merge.mapredfiles is true, and for Spark jobs if hive.merge.sparkfiles is true.
Related Name: hive.merge.smallfiles.avgsize
Default Value: 16 MiB
API Name: hiveserver2_merge_smallfiles_avgsize
Required: false

MSCK Repair Batch Size

Description: Batch size for the msck repair command (recover partitions command). If the value is greater than zero, new partition information will be sent from HiveServer2 to the Metastore in batches, which can potentially improve memory usage in the Metastore and avoid client read timeout exceptions. If this value is 0, all partition information will sent in a single Thrift call.
Related Name: hive.msck.repair.batch.size
Default Value: 3000
API Name: hiveserver2_msck_repair_batch_size
Required: false

Move Files Thread Count

Description: The number of threads used by HiveServer2 to move data from the staging directory to another location (typically to the final table location). A separate thread pool of workers of this size is used for each query, which means this configuration can be set on a per-query basis too.
Related Name: hive.mv.files.thread
Default Value: 15
API Name: hiveserver2_mv_files_thread
Required: false

Hive Optimize Sorted Merge Bucket Join

Description: Whether to try sorted merge bucket (SMB) join.
Related Name: hive.optimize.bucketmapjoin.sortedmerge
Default Value: false
API Name: hiveserver2_optimize_bucketmapjoin_sortedmerge
Required: false

Enable Automatic Use of Indexes

Description: Whether to use the indexing optimization for all queries.
Related Name: hive.optimize.index.filter
Default Value: true
API Name: hiveserver2_optimize_index_filter
Required: false

Enable ReduceDeDuplication Optimization

Description: Remove extra map-reduce jobs if the data is already clustered by the same key, eliminating the need to repartition the dataset again.
Related Name: hive.optimize.reducededuplication
Default Value: true
API Name: hiveserver2_optimize_reducededuplication
Required: false

Mininum Reducers for ReduceDeDuplication Optimization

Description: When the number of ReduceSink operators after merging is less than this number, the ReduceDeDuplication optimization will be disabled.
Related Name: hive.optimize.reducededuplication.min.reducer
Default Value: 4
API Name: hiveserver2_optimize_reducededuplication_min_reducer
Required: false

Enable Sorted Dynamic Partition Optimizer

Description: When dynamic partition is enabled, reducers keep only one record writer at all times, which lowers the memory pressure on reducers.
Related Name: hive.optimize.sort.dynamic.partition
Default Value: false
API Name: hiveserver2_optimize_sort_dynamic_partition
Required: false

Enable Parallel Compilation of Queries

Description: When activated, individual sessions can compile queries simultaneously. Within each session, queries compile one at a time.
Related Name: hive.driver.parallel.compilation
Default Value: true
API Name: hiveserver2_parallel_compilation_enabled
Required: false

Query Compilation Degree of Parallelism

Description: Determines the maximum number of queries that can compile in parallel on a HiveServer2 instance. Use negative values or zero to set unlimited parallelism. Use a positive value to set the number of queries that can compile simultaneously. This setting can be fine-tuned based on the current cluster load. Monitor cluster load using the 'waiting_compile_ops' metric and the 'Waiting Compile Operations' graph in the HiveServer2 graph library.
Related Name: hive.driver.parallel.compilation.global.limit
Default Value: 5
API Name: hiveserver2_parallel_compilation_global_limit
Required: false

Hive SMB Join Cache Rows

Description: The number of rows with the same key value to be cached in memory per SMB-joined table.
Related Name: hive.smbjoin.cache.rows
Default Value: 10000
API Name: hiveserver2_smbjoin_cache_rows
Required: false

Load Column Statistics

Description: Whether column stats for a table are fetched during explain.
Related Name: hive.stats.fetch.column.stats
Default Value: true
API Name: hiveserver2_stats_fetch_column_stats
Required: false

Sessions Per Queue

Description: The number of Tez sessions that should be launched on each of the queues specified by "hive.server2.tez.default.queues". Determines the parallelism on each queue.
Related Name: hive.server2.tez.sessions.per.default.queue
Default Value: 4
API Name: hiveserver2_tez_sessions_per_default_queue
Required: false

Vectorized Adapter Usage Mode

Description: Vectorized Adaptor Usage Mode specifies the extent to which the vectorization engine tries to vectorize UDFs that do not have native vectorized versions available. Selecting the "none" option specifies that only queries using native vectorized UDFs are vectorized. Selecting the "chosen" option specifies that Hive choses to vectorize a subset of the UDFs based on performance benefits using the Vectorized Adaptor. Selecting the "all" option specifies that the Vectorized Adaptor be used for all UDFs even when native vectorized versions are not available.
Related Name: hive.vectorized.adaptor.usage.mode
Default Value: chosen
API Name: hiveserver2_vectorized_adaptor_usage_mode
Required: false

Enable Vectorization Optimization

Description: Enable optimization that vectorizes query execution by streamlining operations by processing a block of 1024 rows at a time.
Related Name: hive.vectorized.execution.enabled
Default Value: true
API Name: hiveserver2_vectorized_enabled
Required: false

Vectorized GroupBy Check Interval

Description: In vectorized group-by, the number of row entries added to the hash table before re-checking average variable size for memory usage estimation.
Related Name: hive.vectorized.groupby.checkinterval
Default Value: 4096
API Name: hiveserver2_vectorized_groupby_checkinterval
Required: false

Vectorized GroupBy Flush Ratio

Description: Ratio between 0.0 and 1.0 of entries in the vectorized group-by aggregation hash that is flushed when the memory threshold is exceeded.
Related Name: hive.vectorized.groupby.flush.percent
Default Value: 0.1
API Name: hiveserver2_vectorized_groupby_flush_ratio
Required: false

Enable Vectorized Input Format

Description: If enabled, Hive uses the native vectorized input format for vectorized query execution when it is available.
Related Name: hive.vectorized.use.vectorized.input.format
Default Value: true
API Name: hiveserver2_vectorized_input_format_enabled
Required: false

Exclude Vectorized Input Formats

Description: Specifies a list of file input format classnames to exclude from vectorized query execution using the vectorized input format. Note that vectorized execution can still occur for an excluded input format based on whether row SerDes or vector SerDes are enabled.
Related Name: hive.vectorized.input.format.excludes
Default Value
API Name: hiveserver2_vectorized_input_format_excludes
Required: false

Enable Reduce-Side Vectorization

Description: Whether to vectorize the reduce side of query execution.
Related Name: hive.vectorized.execution.reduce.enabled
Default Value: true
API Name: hiveserver2_vectorized_reduce_enabled
Required: false

Enable Overflow-checked Vector Expressions

Description: To enhance performance, vectorized expressions operate using wide data types like long and double. When wide data types are used, numeric overflows can occur during expression evaluation in a different manner for vectorized expressions than they do for non-vectorized expressions. Consequently, different query results can be returned for vectorized expressions compared to results returned for non-vectorized expressions. When this configuration is enabled, Hive uses vectorized expressions that handle numeric overflows in the same way as non-vectorized expressions are handled.
Related Name: hive.vectorized.use.checked.expressions
Default Value: true
API Name: hiveserver2_vectorized_use_checked_expressions
Required: false

Vectorize Using Vector SerDes

Description: If enabled, Hive uses built-in vector SerDes to process text and sequencefile tables for vectorized query execution.
Related Name: hive.vectorized.use.vector.serde.deserialize
Default Value: false
API Name: hiveserver2_vectorized_use_vector_serde_deserialize
Required: false

Maximum Process File Descriptors

Description: If configured, overrides the process soft and hard rlimits (also called ulimits) for file descriptors to the configured value.
Related Name
Default Value
API Name: rlimit_fds
Required: false

Ports and Addresses

Thrift port

Description: TCP port number to listen on.
Related Name: hive.server2.thrift.http.port
Default Value: 10501
API Name: hive_server2_thrift_http_port
Required: false

Bind HiveServer2 to Wildcard Address

Description: If enabled, the HiveServer2 binds to the wildcard address ("0.0.0.0") on all of its ports.
Related Name: hive.server2.webui.host
Default Value: true
API Name: hiveserver2_webui_bind_wildcard
Required: false

HiveServer2 WebUI Port

Description: The port the HiveServer2 WebUI will listen on. This can be set to 0 to disable the WebUI.
Related Name: hive.server2.webui.port
Default Value: 10502
API Name: hiveserver2_webui_port
Required: false

HiveServer2 Port

Description: Port on which HiveServer2 will listen for connections.
Related Name: hive.server2.thrift.port
Default Value: 10500
API Name: hs2_thrift_address_port
Required: false

Resource Management

Java Heap Size of HiveServer2 in Bytes

Description: Maximum size in bytes for the Java Process heap memory. Passed to Java -Xmx.
Related Name
Default Value: 4 GiB
API Name: hiveserver2_java_heapsize
Required: false

Cgroup CPU Shares

Description: Number of CPU shares to assign to this role. The greater the number of shares, the larger the share of the host's CPUs that will be given to this role when the host experiences CPU contention. Must be between 2 and 262144. Defaults to 1024 for processes not managed by Cloudera Manager.
Related Name: cpu.shares
Default Value: 1024
API Name: rm_cpu_shares
Required: true

Custom Control Group Resources (overrides Cgroup settings)

Description: Custom control group resources to assign to this role, which will be enforced by the Linux kernel. These resources should exist on the target hosts, otherwise an error will occur when the process starts. Use the same format as used for arguments to the cgexec command: resource1,resource2:path1 or resource3:path2 For example: 'cpu,memory:my/path blkio:my2/path2' ***These settings override other cgroup settings.***
Related Name: custom.cgroups
Default Value
API Name: rm_custom_resources
Required: false

Cgroup I/O Weight

Description: Weight for the read I/O requests issued by this role. The greater the weight, the higher the priority of the requests when the host experiences I/O contention. Must be between 100 and 1000. Defaults to 1000 for processes not managed by Cloudera Manager.
Related Name: blkio.weight
Default Value: 500
API Name: rm_io_weight
Required: true

Cgroup Memory Hard Limit

Description: Hard memory limit to assign to this role, enforced by the Linux kernel. When the limit is reached, the kernel will reclaim pages charged to the process. If reclaiming fails, the kernel may kill the process. Both anonymous as well as page cache pages contribute to the limit. Use a value of -1 to specify no limit. By default processes not managed by Cloudera Manager will have no limit. If the value is -1, Cloudera Manager will not monitor Cgroup memory usage therefore some of the charts will show 'No Data'
Related Name: memory.limit_in_bytes
Default Value: -1 MiB
API Name: rm_memory_hard_limit
Required: true

Cgroup Memory Soft Limit

Description: Soft memory limit to assign to this role, enforced by the Linux kernel. When the limit is reached, the kernel will reclaim pages charged to the process if and only if the host is facing memory pressure. If reclaiming fails, the kernel may kill the process. Both anonymous as well as page cache pages contribute to the limit. Use a value of -1 to specify no limit. By default processes not managed by Cloudera Manager will have no limit. If the value is -1, Cloudera Manager will not monitor Cgroup memory usage therefore some of the charts will show 'No Data'
Related Name: memory.soft_limit_in_bytes
Default Value: -1 MiB
API Name: rm_memory_soft_limit
Required: true

Security

HiveServer2 WebUI SSL Exclude Cipher Suites

Description: The cipher suites should be excluded from WebUI SSL.
Related Name: hive.server2.webui.exclude.ciphersuites
Default Value: modern2018
API Name: hiveserver2_webui_exclude_ciphersuites
Required: false

Enable TLS/SSL for HiveServer2 WebUI

Description: Encrypt communication between clients and HiveServer2 WebUI using Transport Layer Security (TLS) (formerly known as Secure Socket Layer (SSL)).
Related Name: hive.server2.webui.use.ssl
Default Value: false
API Name: ssl_enabled
Required: false

HiveServer2 WebUI TLS/SSL Server Keystore File Location

Description: The path to the TLS/SSL keystore file containing the server certificate and private key used for TLS/SSL. Used when HiveServer2 WebUI is acting as a TLS/SSL server. The keystore must be in the format specified in Administration > Settings > Java Keystore Type.
Related Name: hive.server2.webui.keystore.path
Default Value
API Name: ssl_server_keystore_location
Required: false

HiveServer2 WebUI TLS/SSL Server Keystore File Password

Description: The password for the HiveServer2 WebUI keystore file.
Related Name: hive.server2.webui.keystore.password
Default Value
API Name: ssl_server_keystore_password
Required: false

Stacks Collection

Stacks Collection Data Retention

Description: The amount of stacks data that is retained. After the retention limit is reached, the oldest data is deleted.
Related Name: stacks_collection_data_retention
Default Value: 100 MiB
API Name: stacks_collection_data_retention
Required: false

Stacks Collection Directory

Description: The directory in which stacks logs are placed. If not set, stacks are logged into a stacks subdirectory of the role's log directory. If this directory already exists, it will be owned by the current role user with 755 permissions. Sharing the same directory among multiple roles will cause an ownership race.
Related Name: stacks_collection_directory
Default Value
API Name: stacks_collection_directory
Required: false

Stacks Collection Enabled

Description: Whether or not periodic stacks collection is enabled.
Related Name: stacks_collection_enabled
Default Value: false
API Name: stacks_collection_enabled
Required: true

Stacks Collection Frequency

Description: The frequency with which stacks are collected.
Related Name: stacks_collection_frequency
Default Value: 5.0 second(s)
API Name: stacks_collection_frequency
Required: false

Stacks Collection Method

Description: The method used to collect stacks. The jstack option involves periodically running the jstack command against the role's daemon process. The servlet method is available for those roles that have an HTTP server endpoint exposing the current stacks traces of all threads. When the servlet method is selected, that HTTP endpoint is periodically scraped.
Related Name: stacks_collection_method
Default Value: jstack
API Name: stacks_collection_method
Required: false

Suppressions

Suppress Configuration Validator: CDH Version Validator

Description: Whether to suppress configuration warnings produced by the CDH Version Validator configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_cdh_version_validator
Required: true

Suppress Parameter Validation: HiveServer2 Environment Advanced Configuration Snippet (Safety Valve)

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 Environment Advanced Configuration Snippet (Safety Valve) parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hive_hs2_env_safety_valve
Required: true

Suppress Parameter Validation: HiveServer2 Log Directory

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 Log Directory parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hive_log_dir
Required: true

Suppress Parameter Validation: Metrics Sample File Location

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Metrics Sample File Location parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hive_metrics_sample_file_location
Required: true

Suppress Configuration Validator: Restrict Load Bucketed Table Validator

Description: Whether to suppress configuration warnings produced by the Restrict Load Bucketed Table Validator configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hive_restrict_load_bucketed_table_validator
Required: true

Suppress Configuration Validator: Restrict Unsafe Comparison Validator

Description: Whether to suppress configuration warnings produced by the Restrict Unsafe Comparison Validator configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hive_restrict_unsafe_comparison_validator
Required: true

Suppress Parameter Validation: HiveServer2 Operations Log Directory

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 Operations Log Directory parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hive_server2_logging_operation_log_location
Required: true

Suppress Parameter Validation: Thrift port

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Thrift port parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hive_server2_thrift_http_port
Required: true

Suppress Parameter Validation: Hive Server Zookeeper Namespace

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Server Zookeeper Namespace parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hive_server2_zookeeper_namespace
Required: true

Suppress Parameter Validation: Default query queues

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Default query queues parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hivellap_default_query_queues
Required: true

Suppress Parameter Validation: HiveServer2 Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 Advanced Configuration Snippet (Safety Valve) for hive-site.xml parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hivellap_hs2_config_safety_valve
Required: true

Suppress Parameter Validation: Allow custom queues

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Allow custom queues parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hivellap_tez_sessions_custom_queue_allowed
Required: true

Suppress Parameter Validation: Hive Downloaded Resources Directory

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Downloaded Resources Directory parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hiveserver2_downloaded_resources_dir
Required: true

Suppress Parameter Validation: Hive Local Scratch Directory

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Local Scratch Directory parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hiveserver2_exec_local_scratchdir
Required: true

Suppress Parameter Validation: Hive HDFS Scratch Directory

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive HDFS Scratch Directory parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hiveserver2_exec_scratchdir
Required: true

Suppress Parameter Validation: Fair Scheduler XML Advanced Configuration Snippet (Safety Valve)

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Fair Scheduler XML Advanced Configuration Snippet (Safety Valve) parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hiveserver2_fair_scheduler_safety_valve
Required: true

Suppress Parameter Validation: Java Configuration Options for HiveServer2

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Java Configuration Options for HiveServer2 parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hiveserver2_java_opts
Required: true

Suppress Parameter Validation: HiveServer2 Load Balancer

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 Load Balancer parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hiveserver2_load_balancer
Required: true

Suppress Parameter Validation: Exclude Vectorized Input Formats

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Exclude Vectorized Input Formats parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hiveserver2_vectorized_input_format_excludes
Required: true

Suppress Parameter Validation: HiveServer2 WebUI Port

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 WebUI Port parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hiveserver2_webui_port
Required: true

Suppress Parameter Validation: HiveServer2 Advanced Configuration Snippet (Safety Valve) for core-site.xml

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 Advanced Configuration Snippet (Safety Valve) for core-site.xml parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hs2_core_site_safety_valve
Required: true

Suppress Parameter Validation: HiveServer2 Port

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 Port parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hs2_thrift_address_port
Required: true

Suppress Parameter Validation: JMX Exporter Port

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the JMX Exporter Port parameter.
Related Name
Default Value: false
API Name: role_config_suppression_jmx_exporter_port
Required: true

Suppress Parameter Validation: JMX Exporter configuration YAML

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the JMX Exporter configuration YAML parameter.
Related Name
Default Value: false
API Name: role_config_suppression_jmx_exporter_yaml
Required: true

Suppress Parameter Validation: HiveServer2 Logging Advanced Configuration Snippet (Safety Valve)

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 Logging Advanced Configuration Snippet (Safety Valve) parameter.
Related Name
Default Value: false
API Name: role_config_suppression_log4j_safety_valve
Required: true

Suppress Parameter Validation: Heap Dump Directory

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Heap Dump Directory parameter.
Related Name
Default Value: false
API Name: role_config_suppression_oom_heap_dump_dir
Required: true

Suppress Parameter Validation: OpenTelemetry Collector Exporters Section

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Exporters Section parameter.
Related Name
Default Value: false
API Name: role_config_suppression_otelcol_exporters
Required: true

Suppress Parameter Validation: OpenTelemetry Collector Extensions Section

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Extensions Section parameter.
Related Name
Default Value: false
API Name: role_config_suppression_otelcol_extensions
Required: true

Suppress Parameter Validation: OpenTelemetry Collector Processors Section

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Processors Section parameter.
Related Name
Default Value: false
API Name: role_config_suppression_otelcol_processors
Required: true

Suppress Parameter Validation: OpenTelemetry Collector Receivers Section

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Receivers Section parameter.
Related Name
Default Value: false
API Name: role_config_suppression_otelcol_receivers
Required: true

Suppress Parameter Validation: OpenTelemetry Collector Remote Write Password

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Remote Write Password parameter.
Related Name
Default Value: false
API Name: role_config_suppression_otelcol_remote_write_password
Required: true

Suppress Parameter Validation: OpenTelemetry Collector Remote Write URL

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Remote Write URL parameter.
Related Name
Default Value: false
API Name: role_config_suppression_otelcol_remote_write_url
Required: true

Suppress Parameter Validation: OpenTelemetry Collector Remote Write Username

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Remote Write Username parameter.
Related Name
Default Value: false
API Name: role_config_suppression_otelcol_remote_write_user
Required: true

Suppress Parameter Validation: OpenTelemetry Collector Service Section

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Service Section parameter.
Related Name
Default Value: false
API Name: role_config_suppression_otelcol_service
Required: true

Suppress Parameter Validation: Custom Control Group Resources (overrides Cgroup settings)

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Custom Control Group Resources (overrides Cgroup settings) parameter.
Related Name
Default Value: false
API Name: role_config_suppression_rm_custom_resources
Required: true

Suppress Parameter Validation: Role Triggers

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Role Triggers parameter.
Related Name
Default Value: false
API Name: role_config_suppression_role_triggers
Required: true

Suppress Parameter Validation: HiveServer2 WebUI TLS/SSL Server Keystore File Location

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 WebUI TLS/SSL Server Keystore File Location parameter.
Related Name
Default Value: false
API Name: role_config_suppression_ssl_server_keystore_location
Required: true

Suppress Parameter Validation: HiveServer2 WebUI TLS/SSL Server Keystore File Password

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 WebUI TLS/SSL Server Keystore File Password parameter.
Related Name
Default Value: false
API Name: role_config_suppression_ssl_server_keystore_password
Required: true

Suppress Parameter Validation: Stacks Collection Directory

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Stacks Collection Directory parameter.
Related Name
Default Value: false
API Name: role_config_suppression_stacks_collection_directory
Required: true

Suppress Parameter Validation: tez.history.logging.taskattempt-filters

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the tez.history.logging.taskattempt-filters parameter.
Related Name
Default Value: false
API Name: role_config_suppression_tez_interactive_history_logging_taskattempt_filters
Required: true

Suppress Health Test: Audit Pipeline Test

Description: Whether to suppress the results of the Audit Pipeline Test heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value: false
API Name: role_health_suppression_hive_llap_hiveserver2_audit_health
Required: true

Suppress Health Test: File Descriptors

Description: Whether to suppress the results of the File Descriptors heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value: false
API Name: role_health_suppression_hive_llap_hiveserver2_file_descriptor
Required: true

Suppress Health Test: Heap Dump Directory Free Space

Description: Whether to suppress the results of the Heap Dump Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value: false
API Name: role_health_suppression_hive_llap_hiveserver2_heap_dump_directory_free_space
Required: true

Suppress Health Test: Host Health

Description: Whether to suppress the results of the Host Health heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value: false
API Name: role_health_suppression_hive_llap_hiveserver2_host_health
Required: true

Suppress Health Test: Log Directory Free Space

Description: Whether to suppress the results of the Log Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value: false
API Name: role_health_suppression_hive_llap_hiveserver2_log_directory_free_space
Required: true

Suppress Health Test: Otelcol Health

Description: Whether to suppress the results of the Otelcol Health heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value: false
API Name: role_health_suppression_hive_llap_hiveserver2_otelcol_health
Required: true

Suppress Health Test: Pause Duration

Description: Whether to suppress the results of the Pause Duration heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value: false
API Name: role_health_suppression_hive_llap_hiveserver2_pause_duration
Required: true

Suppress Health Test: Process Status

Description: Whether to suppress the results of the Process Status heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value: false
API Name: role_health_suppression_hive_llap_hiveserver2_scm_health
Required: true

Suppress Health Test: Swap Memory Usage

Description: Whether to suppress the results of the Swap Memory Usage heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value: false
API Name: role_health_suppression_hive_llap_hiveserver2_swap_memory_usage
Required: true

Suppress Health Test: Swap Memory Usage Rate Beta

Description: Whether to suppress the results of the Swap Memory Usage Rate Beta heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value: false
API Name: role_health_suppression_hive_llap_hiveserver2_swap_memory_usage_rate
Required: true

Suppress Health Test: Unexpected Exits

Description: Whether to suppress the results of the Unexpected Exits heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value: false
API Name: role_health_suppression_hive_llap_hiveserver2_unexpected_exits
Required: true

Suppress Health Test: Hive Downloaded Resources Directory Free Space

Description: Whether to suppress the results of the Hive Downloaded Resources Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value: false
API Name: role_health_suppression_hive_llap_hs2_downloaded_resources_directory_free_space
Required: true

Suppress Health Test: Hive Local Scratch Directory Free Space

Description: Whether to suppress the results of the Hive Local Scratch Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value: false
API Name: role_health_suppression_hive_llap_hs2_exec_local_scratch_directory_free_space
Required: true

Tez interactive

tez.am.am-rm.heartbeat.interval-ms.max

Description: The heartbeat interval between the tez AM and YARN RM
Related Name: tez.am.am-rm.heartbeat.interval-ms.max
Default Value: 10 second(s)
API Name: tez_interactive_am_am_rm_heartbeat_interval_ms_max
Required: false

tez.am.client.heartbeat.poll.interval.millis

Description: The interval at which the AM checks for a client heartbeat timeout
Related Name: tez.am.client.heartbeat.poll.interval.millis
Default Value: 6 second(s)
API Name: tez_interactive_am_client_heartbeat_poll_interval_millis
Required: false

tez.am.client.heartbeat.timeout.secs

Description: The time interval, after which an AM will kill itself, if it does not receive a heartbeat from the client.
Related Name: tez.am.client.heartbeat.timeout.secs
Default Value: 1 minute(s), 30 second(s)
API Name: tez_interactive_am_client_heartbeat_timeout_secs
Required: false

tez.am.node-blacklisting.enabled

Description: Whether to enable blacklisting in Tez AMs. Disable for LLAP
Related Name: tez.am.node-blacklisting.enabled
Default Value: false
API Name: tez_interactive_am_node_blacklisting_enabled
Required: false

tez.am.resource.memory.mb

Description: The amount of memory to be used by the AppMaster
Related Name: tez.am.resource.memory.mb
Default Value: 1 GiB
API Name: tez_interactive_am_resource_memory_mb
Required: false

tez.am.task.listener.thread-count

Description: Number of IPC server thread for Tez task listener. Should be minimized for LLAP
Related Name: tez.am.task.listener.thread-count
Default Value: 1
API Name: tez_interactive_am_task_listener_thread_count
Required: false

tez.am.task.reschedule.higher.priority

Description: Whether rescheduled tasks should be treated at higher priority
Related Name: tez.am.task.reschedule.higher.priority
Default Value: false
API Name: tez_interactive_am_task_reschedule_higher_priority
Required: false

tez.container.max.java.heap.fraction

Description: Setting this to -1 so that Tez can auto determine different Xmx for different container size
Related Name: tez.container.max.java.heap.fraction
Default Value: -1.0
API Name: tez_interactive_container_max_java_heap_fraction
Required: false

tez.dag.recovery.enabled

Description: tez.dag.recovery.enabled
Related Name: tez.dag.recovery.enabled
Default Value: false
API Name: tez_interactive_dag_recovery_enabled
Required: false

tez.grouping.node.local.only

Description: tez.grouping.node.local.only
Related Name: tez.grouping.node.local.only
Default Value: true
API Name: tez_interactive_grouping_node_local_only
Required: false

tez.history.logging.log.level

Description: Set the log level to TASK_ATTEMPT.
Related Name: tez.history.logging.log.level
Default Value: TASK_ATTEMPT
API Name: tez_interactive_history_logging_log_level
Required: false

tez.history.logging.taskattempt-filters

Description: TASK_ATTEMPT events to be ignored.
Related Name: tez.history.logging.taskattempt-filters
Default Value: SERVICE_BUSY, EXTERNAL_PREEMPTION
API Name: tez_interactive_history_logging_taskattempt_filters
Required: false

tez.history.logging.timeline.num-dags-per-group

Description: Maximum number of dags per group.
Related Name: tez.history.logging.timeline.num-dags-per-group
Default Value: 5
API Name: tez_interactive_history_logging_timeline_num_dags_per_group
Required: false

tez.runtime.enable.final-merge.in.output

Description: Whether to enable a map side merge of outputs
Related Name: tez.runtime.enable.final-merge.in.output
Default Value: false
API Name: tez_interactive_runtime_enable_final_merge_in_output
Required: false

tez.runtime.io.sort.mb

Description: The size of the sort buffer when output needs to be sorted
Related Name: tez.runtime.io.sort.mb
Default Value: 512 MiB
API Name: tez_interactive_runtime_io_sort_mb
Required: false

tez.runtime.pipelined-shuffle.enabled

Description: tez.runtime.pipelined-shuffle.enabled
Related Name: tez.runtime.pipelined-shuffle.enabled
Default Value: false
API Name: tez_interactive_runtime_pipelined_shuffle_enabled
Required: false

tez.runtime.pipelined.sorter.lazy-allocate.memory

Description: tez.runtime.pipelined.sorter.lazy-allocate.memory
Related Name: tez.runtime.pipelined.sorter.lazy-allocate.memory
Default Value: true
API Name: tez_interactive_runtime_pipelined_sorter_lazy_allocate_memory
Required: false

tez.runtime.report.partition.stats

Description: tez.runtime.report.partition.stats
Related Name: tez.runtime.report.partition.stats
Default Value: true
API Name: tez_interactive_runtime_report_partition_stats
Required: false

tez.runtime.shuffle.connect.timeout

Description: Shuffle connect timeouts (ms)
Related Name: tez.runtime.shuffle.connect.timeout
Default Value: 30 second(s)
API Name: tez_interactive_runtime_shuffle_connect_timeout
Required: false

tez.runtime.shuffle.fetch.buffer.percent

Description: Fraction (0-1) of the available memory which can be used to retain shuffled data
Related Name: tez.runtime.shuffle.fetch.buffer.percent
Default Value: 0.6
API Name: tez_interactive_runtime_shuffle_fetch_buffer_percent
Required: false

tez.runtime.shuffle.fetch.verify-disk-checksum

Description: tez.runtime.shuffle.fetch.verify-disk-checksum
Related Name: tez.runtime.shuffle.fetch.verify-disk-checksum
Default Value: false
API Name: tez_interactive_runtime_shuffle_fetch_verify_disk_checksum
Required: false

tez.runtime.shuffle.keep-alive.enabled

Description: Connection keep-alive for shuffle
Related Name: tez.runtime.shuffle.keep-alive.enabled
Default Value: true
API Name: tez_interactive_runtime_shuffle_keep_alive_enabled
Required: false

tez.runtime.shuffle.memory.limit.percent

Description: This property determines the maximum size of a shuffle segment which can be fetched to memory. Fraction (0-1) of shuffle memory (after applying tez.runtime.shuffle.fetch.buffer.percent)
Related Name: tez.runtime.shuffle.memory.limit.percent
Default Value: 0.25
API Name: tez_interactive_runtime_shuffle_memory_limit_percent
Required: false

tez.runtime.shuffle.parallel.copies

Description: tez.runtime.shuffle.parallel.copies
Related Name: tez.runtime.shuffle.parallel.copies
Default Value: 8
API Name: tez_interactive_runtime_shuffle_parallel_copies
Required: false

tez.runtime.shuffle.read.timeout

Description: Shuffle read timeout (ms)
Related Name: tez.runtime.shuffle.read.timeout
Default Value: 30 second(s)
API Name: tez_interactive_runtime_shuffle_read_timeout
Required: false

tez.runtime.shuffle.ssl.enable

Description: tez.runtime.shuffle.ssl.enable
Related Name: tez.runtime.shuffle.ssl.enable
Default Value: false
API Name: tez_interactive_runtime_shuffle_ssl_enable
Required: false

tez.runtime.unordered.output.buffer.size-mb

Description: The size of the buffer when output does not require to be sorted
Related Name: tez.runtime.unordered.output.buffer.size-mb
Default Value: 100 MiB
API Name: tez_interactive_runtime_unordered_output_buffer_size_mb
Required: false

tez.runtime.unordered.output.max-per-buffer.size-bytes

Description: tez.runtime.unordered.output.max-per-buffer.size-bytes
Related Name: tez.runtime.unordered.output.max-per-buffer.size-bytes
Default Value: 128 MiB
API Name: tez_interactive_runtime_unordered_output_max_per_buffer_size_bytes
Required: false

tez.session.am.dag.submit.timeout.secs

Description: The amount of time an AM will wait, before killing itself, if not DAG is submitted.
Related Name: tez.session.am.dag.submit.timeout.secs
Default Value: 14 day(s)
API Name: tez_interactive_session_am_dag_submit_timeout_secs
Required: false

tez.task.heartbeat.timeout.check-ms

Description: The time interval, in milliseconds, at which the AM will check for timed out tasks
Related Name: tez.task.heartbeat.timeout.check-ms
Default Value: 15 second(s)
API Name: tez_interactive_task_heartbeat_timeout_check_ms
Required: false

tez.task.timeout-ms

Description: mount of time the Tez AM waits before marking a task which has not sent in a heartbeat, as timed out
Related Name: tez.task.timeout-ms
Default Value: 1 minute(s), 30 second(s)
API Name: tez_interactive_task_timeout_ms
Required: false

LLAP Proxy

Advanced

Metrics Sample File Location

Description: The full path to a file with a sample of metrics exposed by the role. The sample is updated at the frequency configured by Metrics Sample File Logging Frequency. By default, the sample file is logged to a directory under the role log directory, e.g., /var/log/hive/metrics-hivemetastore/metrics.log. The setting only has an effect if "Enable Metrics Subsystem" is set to true.
Related Name: hive.service.metrics.file.location
Default Value
API Name: hive_metrics_sample_file_location
Required: false

LLAP Daemon Java Options

Description: Extra Java options that will be applied on the JVM processes of LLAP Daemons.
Related Name
Default Value
API Name: hivellap_daemon_opts
Required: false

LLAP Proxy Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description: For advanced use only. A string to be inserted into hive-site.xml for this role only.
Related Name
Default Value
API Name: hivellap_llapproxy_config_safety_valve
Required: false

LLAP Proxy Environment Advanced Configuration Snippet (Safety Valve)

Description: For advanced use only, key-value pairs (one on each line) to be inserted into a role's environment. Applies to configurations of this role except client configuration.
Related Name
Default Value
API Name: LLAPPROXY_role_env_safety_valve
Required: false

Enable auto refresh for metric configurations

Description: When true, Enable Metric Collection and Metric Filter parameters will be set automatically if they're changed. Otherwise, a refresh by hand is required.
Related Name
Default Value: false
API Name: metric_config_auto_refresh
Required: false

Heap Dump Directory

Description: Path to directory where heap dumps are generated when java.lang.OutOfMemoryError error is thrown. This directory is automatically created if it does not exist. If this directory already exists, it will be owned by the current role user with 1777 permissions. Sharing the same directory among multiple roles will cause an ownership race. The heap dump files are created with 600 permissions and are owned by the role user. The amount of free space in this directory should be greater than the maximum Java Process heap size configured for this role.
Related Name: oom_heap_dump_dir
Default Value: /tmp
API Name: oom_heap_dump_dir
Required: false

Dump Heap When Out of Memory

Description: When set, generates a heap dump file when when an out-of-memory error occurs.
Related Name
Default Value: true
API Name: oom_heap_dump_enabled
Required: true

Kill When Out of Memory

Description: When set, a SIGKILL signal is sent to the role process when java.lang.OutOfMemoryError is thrown.
Related Name
Default Value: true
API Name: oom_sigkill_enabled
Required: true

Automatically Restart Process

Description: When set, this role's process is automatically (and transparently) restarted in the event of an unexpected failure. This configuration applies in the time after the Start Wait Timeout period.
Related Name
Default Value: false
API Name: process_auto_restart
Required: true

Enable Metric Collection

Description: Cloudera Manager agent monitors each service and each of its role by publishing metrics to the Cloudera Manager Service Monitor. Setting it to false will stop Cloudera Manager agent from publishing any metric for corresponding service/roles. This is usually helpful for services that generate large amount of metrics which Service Monitor is not able to process.
Related Name
Default Value: true
API Name: process_should_monitor
Required: true

Process Start Retry Attempts

Description: Number of times to try starting a role's process when the process exits before the Start Wait Timeout period. After a process is running beyond the Start Wait Timeout, the retry count is reset. Setting this configuration to zero will prevent restart of the process during the Start Wait Timeout period.
Related Name
Default Value: 3
API Name: process_start_retries
Required: false

Process Start Wait Timeout

Description: The time in seconds to wait for a role's process to start successfully on a host. Processes which exit/crash before this time will be restarted until reaching the limit specified by the Start Retry Attempts count parameter. Setting this configuration to zero will turn off this feature.
Related Name
Default Value: 20
API Name: process_start_secs
Required: false

Logs

LLAP Proxy Log Directory

Description: Directory where LLAP Proxy will place its log files.
Related Name
Default Value: /var/log/hive
API Name: hive_log_dir
Required: false

Monitoring

Enable Health Alerts for this Role

Description: When set, Cloudera Manager will send alerts when the health of this role reaches the threshold specified by the EventServer setting eventserver_health_events_alert_threshold
Related Name
Default Value: true
API Name: enable_alerts
Required: false

Enable Configuration Change Alerts

Description: When set, Cloudera Manager will send alerts when this entity's configuration changes.
Related Name
Default Value: false
API Name: enable_config_alerts
Required: false

Heap Dump Directory Free Space Monitoring Absolute Thresholds

Description: The health test thresholds for monitoring of free space on the filesystem that contains this role's heap dump directory.
Related Name
Default Value: Warning: 10 GiB, Critical: 5 GiB
API Name: heap_dump_directory_free_space_absolute_thresholds
Required: false

Heap Dump Directory Free Space Monitoring Percentage Thresholds

Description: The health test thresholds for monitoring of free space on the filesystem that contains this role's heap dump directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Heap Dump Directory Free Space Monitoring Absolute Thresholds setting is configured.
Related Name
Default Value: Warning: Never, Critical: Never
API Name: heap_dump_directory_free_space_percentage_thresholds
Required: false

Enable JMX Exporter (beta)

Description: JMX Exporter support is a beta feature. If enabled, CM configures the role to run JMX Exporter in agent mode with the provided port and YAML configuration. This exporter then can be used with the OpenTelemetry Collector feature. See the JMX Exporter documentation.
Related Name
Default Value: false
API Name: jmx_exporter_enabled
Required: true

JMX Exporter Port

Description: JMX Exporter needs a port to implement a Prometheus exporter.
Related Name
Default Value
API Name: jmx_exporter_port
Required: false

JMX Exporter configuration YAML

Description: This configuration is passed to JMX Exporter as it is. See the JMX Exporter documentation.
Related Name
Default Value
API Name: jmx_exporter_yaml
Required: false

Hive LLAP Daemons Ready Status Startup Tolerance

Description: Bad health state will be shown if, after this amount of time (after starting LLAP proxy role), 0 LLAP daemons are running.
Related Name
Default Value: 5 minute(s)
API Name: llapd_ready_status_check_daemon_startup_tolerance
Required: false

Hive LLAP Proxy Role Ready Status Startup Tolerance

Description: Startup Tolerance time of the LLAP proxy role in which no health test is run. This is recommended to be kept minimal.
Related Name
Default Value: 1 second(s)
API Name: llapd_ready_status_check_role_startup_tolerance
Required: false

Hive LLAP Daemons Ready Status Thresholds

Description: The health test thresholds for monitoring the number of active LLAP daemons.
Related Name
Default Value: Warning: 75.0, Critical: 25.0
API Name: llapd_ready_status_thresholds
Required: false

File Descriptor Monitoring Thresholds

Description: The health test thresholds of the number of file descriptors used. Specified as a percentage of file descriptor limit.
Related Name
Default Value: Warning: 50.0 %, Critical: 70.0 %
API Name: llapproxy_fd_thresholds
Required: false

LLAP Proxy Host Health Test

Description: When computing the overall LLAP Proxy health, consider the host's health.
Related Name
Default Value: true
API Name: llapproxy_host_health_enabled
Required: false

Pause Duration Thresholds

Description: The health test thresholds for the weighted average extra time the pause monitor spent paused. Specified as a percentage of elapsed wall clock time.
Related Name
Default Value: Warning: 30.0, Critical: 60.0
API Name: llapproxy_pause_duration_thresholds
Required: false

Pause Duration Monitoring Period

Description: The period to review when computing the moving average of extra time the pause monitor spent paused.
Related Name
Default Value: 5 minute(s)
API Name: llapproxy_pause_duration_window
Required: false

LLAP Proxy Process Health Test

Description: Enables the health test that the LLAP Proxy's process state is consistent with the role configuration
Related Name
Default Value: true
API Name: llapproxy_scm_health_enabled
Required: false

Log Directory Free Space Monitoring Absolute Thresholds

Description: The health test thresholds for monitoring of free space on the filesystem that contains this role's log directory.
Related Name
Default Value: Warning: 10 GiB, Critical: 5 GiB
API Name: log_directory_free_space_absolute_thresholds
Required: false

Log Directory Free Space Monitoring Percentage Thresholds

Description: The health test thresholds for monitoring of free space on the filesystem that contains this role's log directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Log Directory Free Space Monitoring Absolute Thresholds setting is configured.
Related Name
Default Value: Warning: Never, Critical: Never
API Name: log_directory_free_space_percentage_thresholds
Required: false

Navigator Audit Failure Thresholds

Description: The health test thresholds for failures encountered when monitoring audits within a recent period specified by the mgmt_navigator_failure_window configuration for the role. The value that can be specified for this threshold is the number of bytes of audits data that is left to be sent to audit server.
Related Name: mgmt.navigator.failure.thresholds
Default Value: Warning: Never, Critical: Any
API Name: mgmt_navigator_failure_thresholds
Required: false

Monitoring Period For Audit Failures

Description: The period to review when checking if audits are blocked and not getting processed.
Related Name: mgmt.navigator.failure.window
Default Value: 20 minute(s)
API Name: mgmt_navigator_failure_window
Required: false

Navigator Audit Pipeline Health Check

Description: Enable test of audit events processing pipeline. This will test if audit events are not getting processed by Audit Server for a role that generates audit.
Related Name: mgmt.navigator.status.check.enabled
Default Value: true
API Name: mgmt_navigator_status_check_enabled
Required: false

Metric Filter

Description

Defines a Metric Filter for this role. Cloudera Manager Agents will not send filtered metrics to the Service Monitor. Define the following fields:

Health Test Metric Set - Select this parameter to collect only metrics required for health tests.
Default Dashboard Metric Set - Select this parameter to collect only metrics required for the default dashboards. For user-defined charts, you must add the metrics you require for the chart using the Custom Metrics parameter.
Include/Exclude Custom Metrics - Select Include to specify metrics that should be collected. Select Exclude to specify metrics that should not be collected. Enter the metric names to be included or excluded using the Metric Name parameter.
Metric Name - The name of a metric that will be included or excluded during metric collection.

Include only Health Test Metric Set: Selected.
Include/Exclude Custom Metrics: Set to Include.
Metric Name: jvm_heap_used_mb

You can also view the JSON representation for this parameter by clicking View as JSON. In this example, the JSON looks like this:

{
  "includeHealthTestMetricSet": true, 
  "filterType": "whitelist",
  "metrics": ["jvm_heap_used_mb"]
}

Related Name

Default Value

API Name

monitoring_metric_filter

Required

false

OpenTelemetry Collector Exporters Section

Description: Define the exporters settings as a yaml snippet according to the OpenTelemetry Collector standards. Variable substitution available, see the receivers' help.
Related Name
Default Value: exporters: prometheusremotewrite/$ROLE_NAME: endpoint: $ROLE_PARAM(otelcol_remote_write_url) auth: authenticator: basicauth/common tls: insecure_skip_verify: true retry_on_failure: enabled: true initial_interval: 10s max_interval: 40s max_elapsed_time: 300s
API Name: otelcol_exporters
Required: false

OpenTelemetry Collector Extensions Section

Description: Define the extensions settings as a yaml snippet according to the OpenTelemetry Collector standards. Variable substitution available, see the receivers' help.
Related Name
Default Value: extensions: basicauth/common: client_auth: username: $ROLE_PARAM(otelcol_remote_write_user) password: '$ROLE_PARAM(otelcol_remote_write_password)'
API Name: otelcol_extensions
Required: false

OpenTelemetry Collector Processors Section

Description: Define the processors settings as a yaml snippet according to the OpenTelemetry Collector standards. Variable substitution available, see the receivers' help.
Related Name
Default Value
API Name: otelcol_processors
Required: false

OpenTelemetry Collector Receivers Section

Description: Define the receivers settings as a yaml snippet according to the OpenTelemetry Collector standards. A number of variables can help to use the same config everywhere. The follow strings or expressions will be substituted: $HOST_NAME, $CLUSTER_NAME, $CLUSTER_ID, $SERVICE_TYPE, $SERVICE_NAME, $ROLE_NAME, $ROLE_TYPE, $ROLE_PARAM(my_parameter_name) - e.g.: a port parameter for the role's metrics, $DECODE_B64(...) and $DECODE_URL(...) to decode encoded parameters, $ENV_PARAM(name) to fetch params from the process' environment, $SYS_PARAM(name) to fetch java system properties.
Related Name
Default Value
API Name: otelcol_receivers
Required: false

OpenTelemetry Collector Remote Write Password

Description: Remote write password for the OpenTelemetry Collector. This param is for convenience and intended to be used at the extensions section of Otelcol settings using the $ROLE_PARAM(otelcol_remote_write_password) expression. Specify $INFRA(cdp_request_signer_password) when forwarding to Cloudera Observability central monitoring. (This is the default.)
Related Name
Default Value: ******
API Name: otelcol_remote_write_password
Required: false

OpenTelemetry Collector Remote Write URL

Description: Remote write URL for the OpenTelemetry Collector. This param is for convenience and intended to be used at the exporters section of Otelcol settings using the $ROLE_PARAM(otelcol_remote_write_url) expression. Specify $INFRA(cdp_request_signer_url) when forwarding to Cloudera Observability central monitoring.
Related Name
Default Value: $INFRA(cdp_request_signer_url)
API Name: otelcol_remote_write_url
Required: false

OpenTelemetry Collector Remote Write Username

Description: Remote write username for the OpenTelemetry Collector. This param is for convenience and intended to be used at the extensions section of Otelcol settings using the $ROLE_PARAM(otelcol_remote_write_user) expression. Specify $INFRA(cdp_request_signer_username) when forwarding to Cloudera Observability central monitoring.
Related Name
Default Value: $INFRA(cdp_request_signer_username)
API Name: otelcol_remote_write_user
Required: false

OpenTelemetry Collector Service Section

Description: Define the service settings as a yaml snippet according to the OpenTelemetry Collector standards. Variable substitution available, see the receivers' help.
Related Name
Default Value
API Name: otelcol_service
Required: false

Enable OpenTelemetry Collector (beta)

Description: OpenTelemetry Collector support is a new beta feature (will change without notice) which can run OpenTelemetry Collector as an agent together with the CM Agent to forward metrics to a Prometheus like storage.
Related Name
Default Value: false
API Name: otelcol_should_collect
Required: true

Swap Memory Usage Rate Thresholds

Description: The health test thresholds on the swap memory usage rate of the process. Specified as the change of the used swap memory during the predefined period.
Related Name
Default Value: Warning: Never, Critical: Never
API Name: process_swap_memory_rate_thresholds
Required: false

Swap Memory Usage Rate Window

Description: The period to review when computing unexpected swap memory usage change of the process.
Related Name: common.process.swap_memory_rate_window
Default Value: 5 minute(s)
API Name: process_swap_memory_rate_window
Required: false

Process Swap Memory Thresholds

Description: The health test thresholds on the swap memory usage of the process. This takes precedence over the host level threshold.
Related Name
Default Value: Warning: 200 B, Critical: Never
API Name: process_swap_memory_thresholds
Required: false

Role Triggers

Description

triggerName (mandatory) - The name of the trigger. This value must be unique for the specific role.
triggerExpression (mandatory) - A tsquery expression representing the trigger.
streamThreshold (optional) - The maximum number of streams that can satisfy a condition of a trigger before the condition fires. By default set to 0, and any stream returned causes the condition to fire.
enabled (optional) - By default set to 'true'. If set to 'false', the trigger is not evaluated.
expressionEditorConfig (optional) - Metadata for the trigger editor. If present, the trigger should only be edited from the Edit Trigger page; editing the trigger here can lead to inconsistencies.

For example, the following JSON formatted trigger configured for a DataNode fires if the DataNode has more than 1500 file descriptors opened:

[{"triggerName": "sample-trigger",
  "triggerExpression": "IF (SELECT fd_open WHERE roleName=$ROLENAME and last(fd_open) > 1500) DO health:bad",
  "streamThreshold": 0, "enabled": "true"}]

Related Name

Default Value

[]

API Name

role_triggers

Required

true

Unexpected Exits Thresholds

Description: The health test thresholds for unexpected exits encountered within a recent period specified by the unexpected_exits_window configuration for the role.
Related Name
Default Value: Warning: Never, Critical: Any
API Name: unexpected_exits_thresholds
Required: false

Unexpected Exits Monitoring Period

Description: The period to review when computing unexpected exits.
Related Name
Default Value: 5 minute(s)
API Name: unexpected_exits_window
Required: false

Other

hive.llap.auto.allow.uber

Description: Whether or not to allow the planner to run vertices in the AM
Related Name: hive.llap.auto.allow.uber
Default Value: false
API Name: hivellap_auto_allow_uber
Required: false

In-Memory Cache per Daemon

Description: The amount of memory reserved for Hive's optimized in-memory cache.
Related Name: hive.llap.io.memory.size
Default Value: 512 MiB
API Name: hivellap_cache_per_llap_daemon
Required: false

hive.llap.client.consistent.splits

Description: Whether to setup split locations to match nodes on which llap daemons are running, instead of using the locations provided by the split itself.
Related Name: hive.llap.client.consistent.splits
Default Value: true
API Name: hivellap_client_consistent_splits
Required: false

hive.llap.daemon.am.liveness.heartbeat.interval.ms

Description: Tez AM-LLAP heartbeat interval. This should be below the task timeout.
Related Name: hive.llap.daemon.am.liveness.heartbeat.interval.ms
Default Value: 10 second(s)
API Name: hivellap_daemon_am_heartbeat_interval
Required: false

Number of nodes used by Hive's LLAP

Description: Number of nodes used by Hive's LLAP, which includes LLAP nodes running. Yarn native service container and Tez App Master(s) are not part of this.
Related Name: num_llap_nodes
Default Value: 1
API Name: hivellap_daemon_count
Required: false

hive.llap.daemon.logger

Description: Logger to be used by LLAP. (query-routing, RFA)
Related Name: hive.llap.daemon.logger
Default Value: llap
API Name: hivellap_daemon_logger
Required: false

hive.llap.daemon.rpc.port

Description: The LLAP daemon RPC port.
Related Name: hive.llap.daemon.rpc.port
Default Value: 0
API Name: hivellap_daemon_rpc_port
Required: false

hive.llap.daemon.task.scheduler.enable.preemption

Description: hive.llap.daemon.task.scheduler.enable.preemption
Related Name: hive.llap.daemon.task.scheduler.enable.preemption
Default Value: true
API Name: hivellap_daemon_task_scheduler_enable_preemption
Required: false

hive.llap.daemon.vcpus.per.instance

Description: The total number of vcpus to use for the executors inside LLAP.
Related Name: hive.llap.daemon.vcpus.per.instance
Default Value: 0
API Name: hivellap_daemon_vcpus_per_instance
Required: false

hive.llap.daemon.yarn.shuffle.port

Description: YARN shuffle port for LLAP-daemon-hosted shuffle.
Related Name: hive.llap.daemon.yarn.shuffle.port
Default Value: 15551
API Name: hivellap_daemon_yarn_shuffle_port
Required: false

dfs.client.mmap.enabled

Description: Disable HDFS caching fo LLAP
Related Name: dfs.client.mmap.enabled
Default Value: false
API Name: hivellap_dfs_client_mmap_enabled
Required: false

dfs.short.circuit.shared.memory.watcher.interrupt.check.ms

Description: Disable HDFS caching fo LLAP
Related Name: dfs.short.circuit.shared.memory.watcher.interrupt.check.ms
Default Value: 0 second(s)
API Name: hivellap_dfs_shared_mem_watcher_interrupt
Required: false

hive.llap.enable.grace.join.in.llap

Description: Override if grace join should be allowed to run in llap for regular map joins. Dynamic partitioned joins will honor the hive.mapjoin.hybridgrace.hashtable property in LLAP
Related Name: hive.llap.enable.grace.join.in.llap
Default Value: false
API Name: hivellap_enable_grace_join_in_llap
Required: false

hive.execution.mode

Description: Chooses whether query fragments will run in container or in llap
Related Name: hive.execution.mode
Default Value: llap
API Name: hivellap_execution_mode
Required: false

Number of executors per LLAP Daemon

Description: The number of fragments that a single LLAP daemon will run concurrently. Usually, this will be the same as the number of available CPUs
Related Name: hive.llap.daemon.num.executors
Default Value: 2
API Name: hivellap_executors_per_llap_daemon
Required: false

LLAP Daemon Heap Size in MB.

Description: LLAP Daemon Heap Size in MB.
Related Name: llap_heap_size
Default Value: 1280 MiB
API Name: hivellap_heap_per_llap_daemon
Required: false

hive.llap.io.enabled

Description: Whether the LLAP IO layer is enabled.
Related Name: hive.llap.io.enabled
Default Value: true
API Name: hivellap_io_enabled
Required: false

hive.llap.io.memory.mode

Description: LLAP IO memory usage; 'cache' (the default) uses data and metadata cache with a custom off-heap allocator, 'allocator' uses the custom allocator without the caches, 'none' doesn't use either (this mode may result in significant performance degradation)
Related Name: hive.llap.io.memory.mode
Default Value: cache
API Name: hivellap_io_memory_mode
Required: false

hive.llap.io.threadpool.size

Description: Specify the number of threads to use for low-level IO thread pool.
Related Name: hive.llap.io.threadpool.size
Default Value: 2
API Name: hivellap_io_threadpool_size
Required: false

hive.llap.io.use.lrfu

Description: Whether ORC low-level cache should use LRFU cache policy instead of default (FIFO).
Related Name: hive.llap.io.use.lrfu
Default Value: true
API Name: hivellap_io_use_lrfu
Required: false

hive.llap.execution.mode

Description: Chooses which fragments of a query will run in llap
Related Name: hive.llap.execution.mode
Default Value: only
API Name: hivellap_llap_execution_mode
Required: false

hive.llap.management.rpc.port

Description: RPC port for LLAP daemon management service.
Related Name: hive.llap.management.rpc.port
Default Value: 15004
API Name: hivellap_management_rpc_port
Required: false

hive.llap.mapjoin.memory.oversubscribe.factor

Description: hive.llap.mapjoin.memory.oversubscribe.factor
Related Name: hive.llap.mapjoin.memory.oversubscribe.factor
Default Value: 0.3
API Name: hivellap_mapjoin_memory_oversubscribe_factor
Required: false

Maximum Total Concurrent Queries

Description: The maximum number of queries the Hive Interactive cluster will be able to handle concurrently.
Related Name: hive.server2.tez.sessions.per.default.queue
Default Value: 1
API Name: hivellap_max_total_concurrent_queries
Required: false

Memory per Daemon

Description: Total memory used by individual LLAP daemons (YARN Container size). This includes memory for the cache as well as for the query execution. Should be larger than the sum of the Daemon cache size and the daemon heap size, and should leave some headroom after this (In most cases: cache size + heap size + headroom = Memory Per Daemon).
Related Name: hive.llap.daemon.yarn.container.mb
Default Value: 2 GiB
API Name: hivellap_memory_per_llap_daemon
Required: false

hive.llap.object.cache.enabled

Description: Cache objects (plans, hashtables, etc) in llap.
Related Name: hive.llap.object.cache.enabled
Default Value: true
API Name: hivellap_object_cache_enabled
Required: false

Interactive Query Queue

Description: Choose the YARN queue in this cluster that is dedicated to interactive query.
Related Name: hive.llap.daemon.queue.name
Default Value: llap
API Name: hivellap_queue_name
Required: false

llap.shuffle.connection-keep-alive.enable

Description: llap.shuffle.connection-keep-alive.enable
Related Name: llap.shuffle.connection-keep-alive.enable
Default Value: true
API Name: hivellap_shuffle_connection_keep_alive_enable
Required: false

llap.shuffle.connection-keep-alive.timeout

Description: llap.shuffle.connection-keep-alive.timeout
Related Name: llap.shuffle.connection-keep-alive.timeout
Default Value: 1 minute(s)
API Name: hivellap_shuffle_connection_keep_alive_timeout
Required: false

Turn SSD Cache On?

Description: Turn SSD Cache On?
Related Name: hive.llap.io.allocator.mmap
Default Value: false
API Name: hivellap_ssd_cache_on
Required: false

hive.llap.task.scheduler.locality.delay

Description: Amount of time to wait before allocating a request which contains location information, to a location other than the ones requested. Set to -1 for an infinite delay, 0 for no delay.
Related Name: hive.llap.task.scheduler.locality.delay
Default Value: 1
API Name: hivellap_task_scheduler_locality_delay
Required: false

Performance

Maximum Process File Descriptors

Description: If configured, overrides the process soft and hard rlimits (also called ulimits) for file descriptors to the configured value.
Related Name
Default Value
API Name: rlimit_fds
Required: false

Resource Management

Cgroup CPU Shares

Description: Number of CPU shares to assign to this role. The greater the number of shares, the larger the share of the host's CPUs that will be given to this role when the host experiences CPU contention. Must be between 2 and 262144. Defaults to 1024 for processes not managed by Cloudera Manager.
Related Name: cpu.shares
Default Value: 1024
API Name: rm_cpu_shares
Required: true

Custom Control Group Resources (overrides Cgroup settings)

Description: Custom control group resources to assign to this role, which will be enforced by the Linux kernel. These resources should exist on the target hosts, otherwise an error will occur when the process starts. Use the same format as used for arguments to the cgexec command: resource1,resource2:path1 or resource3:path2 For example: 'cpu,memory:my/path blkio:my2/path2' ***These settings override other cgroup settings.***
Related Name: custom.cgroups
Default Value
API Name: rm_custom_resources
Required: false

Cgroup I/O Weight

Description: Weight for the read I/O requests issued by this role. The greater the weight, the higher the priority of the requests when the host experiences I/O contention. Must be between 100 and 1000. Defaults to 1000 for processes not managed by Cloudera Manager.
Related Name: blkio.weight
Default Value: 500
API Name: rm_io_weight
Required: true

Cgroup Memory Hard Limit

Description: Hard memory limit to assign to this role, enforced by the Linux kernel. When the limit is reached, the kernel will reclaim pages charged to the process. If reclaiming fails, the kernel may kill the process. Both anonymous as well as page cache pages contribute to the limit. Use a value of -1 to specify no limit. By default processes not managed by Cloudera Manager will have no limit. If the value is -1, Cloudera Manager will not monitor Cgroup memory usage therefore some of the charts will show 'No Data'
Related Name: memory.limit_in_bytes
Default Value: -1 MiB
API Name: rm_memory_hard_limit
Required: true

Cgroup Memory Soft Limit

Description: Soft memory limit to assign to this role, enforced by the Linux kernel. When the limit is reached, the kernel will reclaim pages charged to the process if and only if the host is facing memory pressure. If reclaiming fails, the kernel may kill the process. Both anonymous as well as page cache pages contribute to the limit. Use a value of -1 to specify no limit. By default processes not managed by Cloudera Manager will have no limit. If the value is -1, Cloudera Manager will not monitor Cgroup memory usage therefore some of the charts will show 'No Data'
Related Name: memory.soft_limit_in_bytes
Default Value: -1 MiB
API Name: rm_memory_soft_limit
Required: true

Stacks Collection

Stacks Collection Data Retention

Description: The amount of stacks data that is retained. After the retention limit is reached, the oldest data is deleted.
Related Name: stacks_collection_data_retention
Default Value: 100 MiB
API Name: stacks_collection_data_retention
Required: false

Stacks Collection Directory

Description: The directory in which stacks logs are placed. If not set, stacks are logged into a stacks subdirectory of the role's log directory. If this directory already exists, it will be owned by the current role user with 755 permissions. Sharing the same directory among multiple roles will cause an ownership race.
Related Name: stacks_collection_directory
Default Value
API Name: stacks_collection_directory
Required: false

Stacks Collection Enabled

Description: Whether or not periodic stacks collection is enabled.
Related Name: stacks_collection_enabled
Default Value: false
API Name: stacks_collection_enabled
Required: true

Stacks Collection Frequency

Description: The frequency with which stacks are collected.
Related Name: stacks_collection_frequency
Default Value: 5.0 second(s)
API Name: stacks_collection_frequency
Required: false

Stacks Collection Method

Description: The method used to collect stacks. The jstack option involves periodically running the jstack command against the role's daemon process. The servlet method is available for those roles that have an HTTP server endpoint exposing the current stacks traces of all threads. When the servlet method is selected, that HTTP endpoint is periodically scraped.
Related Name: stacks_collection_method
Default Value: jstack
API Name: stacks_collection_method
Required: false

Suppressions

Suppress Configuration Validator: CDH Version Validator

Description: Whether to suppress configuration warnings produced by the CDH Version Validator configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_cdh_version_validator
Required: true

Suppress Parameter Validation: LLAP Proxy Log Directory

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the LLAP Proxy Log Directory parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hive_log_dir
Required: true

Suppress Parameter Validation: Metrics Sample File Location

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Metrics Sample File Location parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hive_metrics_sample_file_location
Required: true

Suppress Parameter Validation: hive.llap.daemon.logger

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the hive.llap.daemon.logger parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hivellap_daemon_logger
Required: true

Suppress Parameter Validation: LLAP Daemon Java Options

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the LLAP Daemon Java Options parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hivellap_daemon_opts
Required: true

Suppress Parameter Validation: hive.execution.mode

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the hive.execution.mode parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hivellap_execution_mode
Required: true

Suppress Parameter Validation: hive.llap.io.memory.mode

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the hive.llap.io.memory.mode parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hivellap_io_memory_mode
Required: true

Suppress Parameter Validation: hive.llap.execution.mode

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the hive.llap.execution.mode parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hivellap_llap_execution_mode
Required: true

Suppress Parameter Validation: LLAP Proxy Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the LLAP Proxy Advanced Configuration Snippet (Safety Valve) for hive-site.xml parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hivellap_llapproxy_config_safety_valve
Required: true

Suppress Parameter Validation: Interactive Query Queue

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Interactive Query Queue parameter.
Related Name
Default Value: false
API Name: role_config_suppression_hivellap_queue_name
Required: true

Suppress Parameter Validation: JMX Exporter Port

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the JMX Exporter Port parameter.
Related Name
Default Value: false
API Name: role_config_suppression_jmx_exporter_port
Required: true

Suppress Parameter Validation: JMX Exporter configuration YAML

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the JMX Exporter configuration YAML parameter.
Related Name
Default Value: false
API Name: role_config_suppression_jmx_exporter_yaml
Required: true

Suppress Parameter Validation: LLAP Proxy Environment Advanced Configuration Snippet (Safety Valve)

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the LLAP Proxy Environment Advanced Configuration Snippet (Safety Valve) parameter.
Related Name
Default Value: false
API Name: role_config_suppression_llapproxy_role_env_safety_valve
Required: true

Suppress Parameter Validation: Heap Dump Directory

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Heap Dump Directory parameter.
Related Name
Default Value: false
API Name: role_config_suppression_oom_heap_dump_dir
Required: true

Suppress Parameter Validation: OpenTelemetry Collector Exporters Section

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Exporters Section parameter.
Related Name
Default Value: false
API Name: role_config_suppression_otelcol_exporters
Required: true

Suppress Parameter Validation: OpenTelemetry Collector Extensions Section

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Extensions Section parameter.
Related Name
Default Value: false
API Name: role_config_suppression_otelcol_extensions
Required: true

Suppress Parameter Validation: OpenTelemetry Collector Processors Section

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Processors Section parameter.
Related Name
Default Value: false
API Name: role_config_suppression_otelcol_processors
Required: true

Suppress Parameter Validation: OpenTelemetry Collector Receivers Section

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Receivers Section parameter.
Related Name
Default Value: false
API Name: role_config_suppression_otelcol_receivers
Required: true

Suppress Parameter Validation: OpenTelemetry Collector Remote Write Password

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Remote Write Password parameter.
Related Name
Default Value: false
API Name: role_config_suppression_otelcol_remote_write_password
Required: true

Suppress Parameter Validation: OpenTelemetry Collector Remote Write URL

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Remote Write URL parameter.
Related Name
Default Value: false
API Name: role_config_suppression_otelcol_remote_write_url
Required: true

Suppress Parameter Validation: OpenTelemetry Collector Remote Write Username

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Remote Write Username parameter.
Related Name
Default Value: false
API Name: role_config_suppression_otelcol_remote_write_user
Required: true

Suppress Parameter Validation: OpenTelemetry Collector Service Section

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the OpenTelemetry Collector Service Section parameter.
Related Name
Default Value: false
API Name: role_config_suppression_otelcol_service
Required: true

Suppress Parameter Validation: Custom Control Group Resources (overrides Cgroup settings)

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Custom Control Group Resources (overrides Cgroup settings) parameter.
Related Name
Default Value: false
API Name: role_config_suppression_rm_custom_resources
Required: true

Suppress Parameter Validation: Role Triggers

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Role Triggers parameter.
Related Name
Default Value: false
API Name: role_config_suppression_role_triggers
Required: true

Suppress Parameter Validation: Stacks Collection Directory

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Stacks Collection Directory parameter.
Related Name
Default Value: false
API Name: role_config_suppression_stacks_collection_directory
Required: true

Suppress Health Test: Audit Pipeline Test

Description: Whether to suppress the results of the Audit Pipeline Test heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value: false
API Name: role_health_suppression_hive_llap_llapproxy_audit_health
Required: true

Suppress Health Test: File Descriptors

Description: Whether to suppress the results of the File Descriptors heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value: false
API Name: role_health_suppression_hive_llap_llapproxy_file_descriptor
Required: true

Suppress Health Test: Heap Dump Directory Free Space

Description: Whether to suppress the results of the Heap Dump Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value: false
API Name: role_health_suppression_hive_llap_llapproxy_heap_dump_directory_free_space
Required: true

Suppress Health Test: Host Health

Description: Whether to suppress the results of the Host Health heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value: false
API Name: role_health_suppression_hive_llap_llapproxy_host_health
Required: true

Suppress Health Test: Log Directory Free Space

Description: Whether to suppress the results of the Log Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value: false
API Name: role_health_suppression_hive_llap_llapproxy_log_directory_free_space
Required: true

Suppress Health Test: Otelcol Health

Description: Whether to suppress the results of the Otelcol Health heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value: false
API Name: role_health_suppression_hive_llap_llapproxy_otelcol_health
Required: true

Suppress Health Test: Pause Duration

Description: Whether to suppress the results of the Pause Duration heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value: false
API Name: role_health_suppression_hive_llap_llapproxy_pause_duration
Required: true

Suppress Health Test: Process Status

Description: Whether to suppress the results of the Process Status heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value: false
API Name: role_health_suppression_hive_llap_llapproxy_scm_health
Required: true

Suppress Health Test: Swap Memory Usage

Description: Whether to suppress the results of the Swap Memory Usage heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value: false
API Name: role_health_suppression_hive_llap_llapproxy_swap_memory_usage
Required: true

Suppress Health Test: Swap Memory Usage Rate Beta

Description: Whether to suppress the results of the Swap Memory Usage Rate Beta heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value: false
API Name: role_health_suppression_hive_llap_llapproxy_swap_memory_usage_rate
Required: true

Suppress Health Test: Unexpected Exits

Description: Whether to suppress the results of the Unexpected Exits heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value: false
API Name: role_health_suppression_hive_llap_llapproxy_unexpected_exits
Required: true

Suppress Health Test: LLAP Daemons Ready Check

Description: Whether to suppress the results of the LLAP Daemons Ready Check heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value: false
API Name: role_health_suppression_llapd_ready_status
Required: true

Service-Wide

Advanced

Hive Auxiliary JARs Directory

Description: Directory containing auxiliary JARs used by Hive. This should be a directory location and not a classpath containing one or more JARs. This directory must be created and managed manually on hosts that run the Hive Metastore Server, HiveServer2, or the Hive CLI. The directory location is set in the environment as HIVE_AUX_JARS_PATH and will generally override the hive.aux.jars.path property set in XML files, even if hive.aux.jars.path is set in an advanced configuration snippet.
Related Name
Default Value
API Name: hive_aux_jars_path_dir
Required: false

Bypass Hive Metastore Server

Description: Instead of talking to Hive Metastore Server for Metastore information, Hive clients will talk directly to the Metastore database.
Related Name
Default Value: false
API Name: hive_bypass_metastore_server
Required: false

Aborted Transaction Threshold

Description: Number of aborted transactions involving a particular table or partition before major compaction is initiated.
Related Name: hive.compactor.abortedtxn.threshold
Default Value: 1000
API Name: hive_compactor_abortedtxn_threshold
Required: true

Number of Threads Used by Compactor

Description: Number of compactor worker threads to run on this metastore instance. Can be different values on different Metastore instances.
Related Name: hive.compactor.worker.threads
Default Value: 5
API Name: hive_compactor_worker_threads
Required: true

Hive Service Advanced Configuration Snippet (Safety Valve) for core-site.xml

Description: For advanced use only, a string to be inserted into core-site.xml. Applies to configurations of all roles in this service except client configuration.
Related Name
Default Value
API Name: hive_core_site_safety_valve
Required: false

Default Table Format - Create Tables as Full ACID

Description: Whether the eligible tables should be created as full ACID by default. Does not apply to external tables, the ones using storage handlers, etc.
Related Name: hive.create.as.acid
Default Value: true
API Name: hive_create_as_acid
Required: false

Default Table Format - Create Tables as ACID Insert Only

Description: Whether the eligible tables should be created as ACID insert-only by default. Does not apply to external tables, the ones using storage handlers, etc.
Related Name: hive.create.as.insert.only
Default Value: true
API Name: hive_create_as_insert_only
Required: false

Hive Copy Large File Size

Description: Smaller than this size, Hive uses a single-threaded copy; larger than this size, Hive uses DistCp.
Related Name: hive.exec.copyfile.maxsize
Default Value: 32 MiB
API Name: hive_exec_copyfile_maxsize
Required: false

Base Directory for Hive Proto Hook

Description: The directory where hive proto hooks should write the events, should generally be location of query_data table under sys.db database.
Related Name: hive.hook.proto.base-directory
Default Value: /warehouse/tablespace/managed/hive/sys.db/query_data/
API Name: hive_hook_proto_base_directory
Required: false

Hive LLAP Service Environment Advanced Configuration Snippet (Safety Valve)

Description: For advanced use only, key-value pairs (one on each line) to be inserted into a role's environment. Applies to configurations of all roles in this service except client configuration.
Related Name
Default Value
API Name: HIVE_LLAP_service_env_safety_valve
Required: false

Metastore Transactional Listener List

Description: A comma separated list of Java classes that implement the org.apache.hadoop.hive.metastore.MetaStoreEventListener interface. Both the metastore event and corresponding listener method will be invoked in the same JDO transaction.
Related Name: hive.metastore.transactional.event.listeners
Default Value: org.apache.hive.hcatalog.listener.DbNotificationListener
API Name: hive_metastore_transactional_event_listeners
Required: false

Hive Replication Environment Advanced Configuration Snippet (Safety Valve)

Description: For advanced use only, key-value pairs (one on each line) to be inserted into the environment of Hive replication jobs.
Related Name
Default Value
API Name: hive_replication_env_safety_valve
Required: false

Hive Service Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description: For advanced use only, a string to be inserted into hive-site.xml. Applies to configurations of all roles in this service except client configuration.
Related Name
Default Value
API Name: hive_service_config_safety_valve
Required: false

Hive Replication Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description: For advanced use only, a string to be inserted into hive-site.xml. Applies to all Hive Replication jobs.
Related Name
Default Value
API Name: hive_service_replication_config_safety_valve
Required: false

Use Locking

Description: Support concurrency and use locks, needed for Transactions. Requires Zookeeper.
Related Name: hive.support.concurrency
Default Value: true
API Name: hive_support_concurrency
Required: false

Transaction Manager

Description: HiveTxnManager implementation used for managing transactions.
Related Name: hive.txn.manager
Default Value: org.apache.hadoop.hive.ql.lockmgr.DbTxnManager
API Name: hive_txn_manager
Required: true

Transaction Maximum Open Batch

Description: Maximum number of transactions that can be fetched in one call to open_txns(). Increasing this will decrease the number of delta files created when streaming data into Hive. But it will also increase the number of open transactions at any given time, possibly impacting read performance.
Related Name: hive.txn.max.open.batch
Default Value: 1000
API Name: hive_txn_max_open_batch
Required: true

Transaction Strict Locking Mode

Description: In strict locking non-ACID resources use standard R/W lock semantics.
Related Name: hive.txn.strict.locking.mode
Default Value: false
API Name: hive_txn_strict_locking_mode
Required: false

Transaction Timeout

Description: Time after which transactions are declared aborted if the client has not sent a heartbeat.
Related Name: hive.txn.timeout
Default Value: 5 minute(s)
API Name: hive_txn_timeout
Required: true

Hive Client Advanced Configuration Snippet (Safety Valve) for navigator.client.properties

Description: For advanced use only, a string to be inserted into the client configuration for navigator.client.properties.
Related Name
Default Value
API Name: navigator_client_config_safety_valve
Required: false

Hive Client Advanced Configuration Snippet (Safety Valve) for navigator.lineage.client.properties

Description: For advanced use only, a string to be inserted into the client configuration for navigator.lineage.client.properties.
Related Name
Default Value
API Name: navigator_lineage_client_config_safety_valve
Required: false

System Group

Description: The group that this service's processes should run as.
Related Name
Default Value: hive
API Name: process_groupname
Required: true

System User

Description: The user that this service's processes should run as.
Related Name
Default Value: hive
API Name: process_username
Required: true

Hive Service Advanced Configuration Snippet (Safety Valve) for ranger-hive-audit.xml

Description: For advanced use only, a string to be inserted into ranger-hive-audit.xml. Applies to configurations of all roles in this service except client configuration.
Related Name
Default Value
API Name: ranger_audit_safety_valve
Required: false

Hive Service Advanced Configuration Snippet (Safety Valve) for ranger-hive-policymgr-ssl.xml

Description: For advanced use only, a string to be inserted into ranger-hive-policymgr-ssl.xml. Applies to configurations of all roles in this service except client configuration.
Related Name
Default Value
API Name: ranger_policymgr_ssl_safety_valve
Required: false

Hive Service Advanced Configuration Snippet (Safety Valve) for ranger-hive-security.xml

Description: For advanced use only, a string to be inserted into ranger-hive-security.xml. Applies to configurations of all roles in this service except client configuration.
Related Name
Default Value
API Name: ranger_security_safety_valve
Required: false

Cloudera Navigator

Enable Audit Collection

Description: Enable collection of audit events from the service's roles.
Related Name: navigator.audit.enabled
Default Value: true
API Name: navigator_audit_enabled
Required: false

Audit Event Filter

Description

Event filters are defined in a JSON object like the following:


{
  "defaultAction" : ("accept", "discard"),
  "rules" : [
    {
      "action" : ("accept", "discard"),
      "fields" : [
        {
          "name" : "fieldName",
          "match" : "regex"
        }
      ]
    }
  ]
}

A filter has a default action and a list of rules, in order of precedence. Each rule defines an action, and a list of fields to match against the audit event. A rule is "accepted" if all the listed field entries match the audit event. At that point, the action declared by the rule is taken. If no rules match the event, the default action is taken. Actions default to "accept" if not defined in the JSON object. The following is the list of fields that can be filtered for Hive events:

userName: the user performing the action.
ipAddress: the IP from where the request originated.
operation: the Hive operation being performed.
databaseName: the databaseName for the operation.
tableName: the tableName for the operation.

The default Hive audit event filter discards HDFS directory events generated by Hive jobs that reference the /tmp directory.

Related Name

navigator.event.filter

Default Value

comment: [ The default Hive audit event filter discards HDFS directory events , generated by Hive jobs that reference the /tmp directory. ], defaultAction: accept, rules: [ action: discard, fields: [ name: operation, match: QUERY , name: objectType, match: DFS_DIR , name: resourcePath, match: /tmp/hive-(?:.+)?/hive_(?:.+)?/-mr-.* ] ]

API Name

navigator_audit_event_filter

Required

false

Audit Queue Policy

Description: Action to take when the audit event queue is full. Drop the event or shutdown the affected process.
Related Name: navigator.batch.queue_policy
Default Value: DROP
API Name: navigator_audit_queue_policy
Required: false

Audit Event Tracker

Description

Configures the rules for event tracking and coalescing. This feature is used to define equivalency between different audit events. When events match, according to a set of configurable parameters, only one entry in the audit list is generated for all the matching events. Tracking works by keeping a reference to events when they first appear, and comparing other incoming events against the "tracked" events according to the rules defined here. Event trackers are defined in a JSON object like the following:


{
  "timeToLive" : [integer],
  "fields" : [
    {
      "type" : [string],
      "name" : [string]
    }
  ]
}

Where:

timeToLive: maximum amount of time an event will be tracked, in milliseconds. Must be provided. This defines how long, since it's first seen, an event will be tracked. A value of 0 disables tracking.
fields: list of fields to compare when matching events against tracked events.

Each field has an evaluator type associated with it. The evaluator defines how the field data is to be compared. The following evaluators are available:

value: uses the field value for comparison.
userName: treats the field value as a userNname, and ignores any host-specific data. This is useful for environment using Kerberos, so that only the principal name and realm are compared.

The following is the list of fields that can be used to compare Hive events:

operation: the Hive operation being performed.
username: the user performing the action.
ipAddress: the IP from where the request originated.
allowed: whether the operation was allowed or denied.
databaseName: the database affected by the operation.
tableName: the table or view affected by the operation.
objectType: the type of object affected by the operation.
resourcePath: the path of the resource affected by the operation.

Related Name

navigator_event_tracker

Default Value

API Name

navigator_event_tracker

Required

false

Enable Lineage Collection

Description: Enable collection of lineage from the service's roles.
Related Name
Default Value: true
API Name: navigator_lineage_enabled
Required: false

Logs

Audit Log Directory

Description: Path to the directory where audit logs will be written. The directory will be created if it doesn't exist.
Related Name: audit_event_log_dir
Default Value: /var/log/hive/audit
API Name: audit_event_log_dir
Required: false

Hive Lineage Log Directory

Description: The directory in which Hive lineage log files are written.
Related Name: lineage_event_log_dir
Default Value: /var/log/hive/lineage
API Name: lineage_event_log_dir
Required: true

Hive Maximum Lineage Log File Size

Description: The maximum size, in megabytes, per log file for Hive lineage logs. Typically used by log4j or logback.
Related Name: max_lineage_log_file_size
Default Value: 100 MiB
API Name: max_lineage_log_file_size
Required: false

Maximum Audit Log File Size

Description: Maximum size of audit log file in MB before it is rolled over.
Related Name: navigator.audit_log_max_file_size
Default Value: 100 MiB
API Name: navigator_audit_log_max_file_size
Required: false

Number of Audit Logs to Retain

Description: Maximum number of rolled-over audit logs to retain. The logs are not deleted if they contain audit events that have not yet been propagated to the Audit Server.
Related Name: navigator.client.max_num_audit_log
Default Value: 10
API Name: navigator_client_max_num_audit_log
Required: false

Monitoring

Enable Service Level Health Alerts

Description: When set, Cloudera Manager will send alerts when the health of this service reaches the threshold specified by the EventServer setting eventserver_health_events_alert_threshold
Related Name
Default Value: true
API Name: enable_alerts
Required: false

Enable Configuration Change Alerts

Description: When set, Cloudera Manager will send alerts when this entity's configuration changes.
Related Name
Default Value: false
API Name: enable_config_alerts
Required: false

Healthy HiveServer2 Monitoring Thresholds

Description: The health test thresholds of the overall HiveServer2 health. The check returns "Concerning" health if the percentage of "Healthy" HiveServer2s falls below the warning threshold. The check is unhealthy if the total percentage of "Healthy" and "Concerning" HiveServer2s falls below the critical threshold.
Related Name
Default Value: Warning: 99.0 %, Critical: 51.0 %
API Name: hive_llap_hiveserver2s_healthy_thresholds
Required: false

LLAP Proxy Role Health Test

Description: When computing the overall HIVE_LLAP health, consider LLAP Proxy's health
Related Name
Default Value: true
API Name: hive_llap_llapproxy_health_enabled
Required: false

Service Triggers

Description

The configured triggers for this service. This is a JSON-formatted list of triggers. These triggers are evaluated as part as the health system. Every trigger expression is parsed, and if the trigger condition is met, the list of actions provided in the trigger expression is executed. Each trigger has the following fields:

triggerName (mandatory) - The name of the trigger. This value must be unique for the specific service.
triggerExpression (mandatory) - A tsquery expression representing the trigger.
streamThreshold (optional) - The maximum number of streams that can satisfy a condition of a trigger before the condition fires. By default set to 0, and any stream returned causes the condition to fire.
enabled (optional) - By default set to 'true'. If set to 'false', the trigger is not evaluated.
expressionEditorConfig (optional) - Metadata for the trigger editor. If present, the trigger should only be edited from the Edit Trigger page; editing the trigger here can lead to inconsistencies.

For example, the following JSON formatted trigger fires if there are more than 10 DataNodes with more than 500 file descriptors opened:

[{"triggerName": "sample-trigger",
  "triggerExpression": "IF (SELECT fd_open WHERE roleType = DataNode and last(fd_open) > 500) DO health:bad",
  "streamThreshold": 10, "enabled": "true"}]

Related Name

Default Value

[]

API Name

service_triggers

Required

true

Service Monitor Client Config Overrides

Description: For advanced use only, a list of configuration properties that will be used by the Service Monitor instead of the current client configuration for the service.
Related Name
Default Value: <property> <name>hive.metastore.client.socket.timeout</name> <value>60</value> </property>
API Name: smon_client_config_overrides
Required: false

Service Monitor Derived Configs Advanced Configuration Snippet (Safety Valve)

Description: For advanced use only, a list of derived configuration properties that will be used by the Service Monitor instead of the default ones.
Related Name
Default Value
API Name: smon_derived_configs_safety_valve
Required: false

Other

HBase Service

Description: Name of the HBase service that this Hive service instance depends on.
Related Name
Default Value
API Name: hbase_service
Required: false

HDFS Service

Description: Name of the HDFS service that this Hive service instance depends on
Related Name
Default Value
API Name: hdfs_service
Required: true

Enable Asynchronous Logging

Description: Asynchronous Log4j2 logging can give a significant performance improvement as logging will be handled in a separate thread that uses an LMAX disruptor queue for buffering log messages. Refer to https://logging.apache.org/log4j/2.x/manual/async.html for benefits and drawbacks. For debugging issues we recommend setting this to false.
Related Name: hive.async.log.enabled
Default Value: false
API Name: hive_async_log_enabled
Required: false

Hive Bytes Per Reducer

Description: Size per reducer. If the input size is 10GiB and this is set to 1GiB, Hive will use 10 reducers.
Related Name: hive.exec.reducers.bytes.per.reducer
Default Value: 64 MiB
API Name: hive_bytes_per_reducer
Required: false

Default File Format

Description: Default file format for CREATE TABLE statement.
Related Name: hive.default.fileformat
Default Value: TextFile
API Name: hive_default_fileformat
Required: true

Default File Format for Managed Tables

Description: Default file format for CREATE TABLE statement applied to managed tables only. External tables will be created with default file format. Leaving this null will result in using the default file format for all tables.
Related Name: hive.default.fileformat.managed
Default Value: ORC
API Name: hive_default_fileformat_managed
Required: false

Hive Max Reducers

Description: Max number of reducers to use. If the configuration parameter Hive Reduce Tasks is negative, Hive will limit the number of reducers to the value of this parameter.
Related Name: hive.exec.reducers.max
Default Value: 1009
API Name: hive_max_reducers
Required: false

Hive Reduce Tasks

Description: Default number of reduce tasks per job. Usually set to a prime number close to the number of available hosts. Ignored when mapred.job.tracker is "local". Hadoop sets this to 1 by default, while Hive uses -1 as the default. When set to -1, Hive will automatically determine an appropriate number of reducers for each job.
Related Name: mapred.reduce.tasks
Default Value: -1
API Name: hive_reduce_tasks
Required: false

Set User and Group Information

Description: In unsecure mode, setting this property to true will cause the Metastore Server to execute DFS operations using the client's reported user and group permissions. Cloudera Manager will set this for all clients and servers.
Related Name: hive.metastore.execute.setugi
Default Value: true
API Name: hive_set_ugi
Required: true

LLAP app name

Description: LLAP app name
Related Name: llap_app_name
Default Value: llap0
API Name: hivellap_app_name
Required: false

hive.llap.daemon.service.hosts

Description: Explicitly specified hosts to use for LLAP scheduling. If it's left empty, LLAP app name will be used instead with a ZooKeeper based registry.
Related Name: hive.llap.daemon.service.hosts
Default Value
API Name: hivellap_daemon_service_hosts
Required: false

Hive Metastore Connector

Description: Name of the Hive Metastore Connector from the data context that this service instance depends on.
Related Name
Default Value
API Name: hms_connector
Required: true

MapReduce Service

Description: MapReduce jobs are run against this service.
Related Name
Default Value
API Name: mapreduce_yarn_service
Required: true

Ranger Plugin Trusted Proxy IP Address

Description: Accepts a list of IP addresses of proxy servers for trusting.
Related Name: ranger.plugin.hive.trusted.proxy.ipaddress
Default Value
API Name: ranger_plugin_trusted_proxy_ipaddress
Required: false

Ranger Plugin Use X-Forwarded for IP Address

Description: The parameter is used for identifying the originating IP address of a user connecting to a component through proxy for audit logs.
Related Name: ranger.plugin.hive.use.x-forwarded-for.ipaddress
Default Value: false
API Name: ranger_plugin_use_x_forwarded_for_ipaddress
Required: false

Ranger Service

Description: Name of the Ranger service that this Hive service instance depends on
Related Name
Default Value
API Name: ranger_service
Required: false

Tez Service

Description: Tez Service that the Hive on Tez uses for execution
Related Name
Default Value
API Name: tez_service
Required: true

ZooKeeper Service

Description: Name of the ZooKeeper service that this Hive service instance depends on.
Related Name
Default Value
API Name: zookeeper_service
Required: false

Proxy

Hive Metastore Access Control and Proxy User Groups Override

Description: This configuration overrides the value set for Hive Proxy User Groups configuration in HDFS service for use by Hive Metastore Server. Specify a comma-delimited list of groups that you want to allow access to Hive Metastore metadata and allow the Hive user to impersonate. A value of '*' allows all groups. The default value of empty inherits the value set for Hive Proxy User Groups configuration in the HDFS service.
Related Name: hadoop.proxyuser.hive.groups
Default Value
API Name: hive_proxy_user_groups_list
Required: false

Replication

Replica functions root directory

Description: Root directory on the replica warehouse where the repl sub-system will store jars from the primary warehouse
Related Name: hive.repl.replica.functions.root.dir
Default Value
API Name: hive_repl_replica_functions_root_dir
Required: false

Security

Enable LDAP Authentication for HiveServer2

Description: When checked, LDAP-based authentication for users is enabled.
Related Name
Default Value: false
API Name: hiveserver2_enable_ldap_auth
Required: false

Enable TLS/SSL for HiveServer2

Description: Encrypt communication between clients and HiveServer2 using Transport Layer Security (TLS) (formerly known as Secure Socket Layer (SSL)).
Related Name: hive.server2.use.SSL
Default Value: false
API Name: hiveserver2_enable_ssl
Required: false

HiveServer2 SSL Exclude Cipher Suites

Description: The cipher suites should be excluded from Hiveserver2 SSL.
Related Name: hive.server2.http.exclude.ciphersuites
Default Value: modern2018
API Name: hiveserver2_exclude_ciphersuites
Required: false

HiveServer2 SSL Include Cipher Suites

Description: The cipher suites should be included in Hiverserver2 SSL.
Related Name: hive.server2.binary.include.ciphersuites
Default Value: modern2018
API Name: hiveserver2_include_ciphersuites
Required: false

HiveServer2 TLS/SSL Server Keystore File Password

Description: The password for the HiveServer2 keystore file.
Related Name: hive.server2.keystore.password
Default Value
API Name: hiveserver2_keystore_password
Required: false

HiveServer2 TLS/SSL Server Keystore File Location

Description: The path to the TLS/SSL keystore file containing the server certificate and private key used for TLS/SSL. Used when HiveServer2 is acting as a TLS/SSL server. The keystore must be in the format specified in Administration > Settings > Java Keystore Type.
Related Name: hive.server2.keystore.path
Default Value
API Name: hiveserver2_keystore_path
Required: false

LDAP BaseDN

Description: This parameter is useful when authenticating against a non-Active Directory server, such as OpenLDAP. When set, this parameter is used to convert the username into the LDAP Distinguished Name (DN), so that the resulting DN looks like uid=username,*this parameter*. For example, if this parameter is set to "ou=People,dc=cloudera,dc=com", and the username passed in is "mike", the resulting authentication passed to the LDAP server look like "uid=mike,ou=People,dc=cloudera,dc=com". This parameter is mutually exclusive with Active Directory Domain.
Related Name: hive.server2.authentication.ldap.baseDN
Default Value
API Name: hiveserver2_ldap_basedn
Required: false

Active Directory Domain

Description: Use this field for Active Directory configurations only, when combined with a simple username value in the "LDAP Bind User Distinguished Name" field, it will result in a UPM of user@example.com used for search/bind operations for authenticated user lookups.
Related Name: hive.server2.authentication.ldap.Domain
Default Value
API Name: hiveserver2_ldap_domain
Required: false

LDAP URL

Description: The URL of the LDAP Server. The URL must be prefixed with ldap:// or ldaps:// . The URL can optionally specify a custom port if necessary, but by default the ldap:// will connect to port 389, and the ldaps:// will connect to port 636. Note that passwords will be in the clear if ldap:// is used, and by fall 2020 Active directory servers will no longer allow non LDAPS connections to bind to AD hosts with LDAP signing enabled. See microsoft knowledge document 935834 for more information.
Related Name: hive.server2.authentication.ldap.url
Default Value
API Name: hiveserver2_ldap_uri
Required: false

HiveServer2 TLS/SSL Trust Store File

Description: The location on disk of the trust store, in .jks format, used to confirm the authenticity of TLS/SSL servers that HiveServer2 might connect to. This trust store must contain the certificate(s) used to sign the service(s) connected to. If this parameter is not provided, the default list of well-known certificate authorities is used instead.
Related Name
Default Value
API Name: hiveserver2_truststore_file
Required: false

HiveServer2 TLS/SSL Trust Store Password

Description: The password for the HiveServer2 TLS/SSL Trust Store File. This password is not required to access the trust store; this field can be left blank. This password provides optional integrity checking of the file. The contents of trust stores are certificates, and certificates are public information.
Related Name
Default Value
API Name: hiveserver2_truststore_password
Required: false

Kerberos Principal

Description: Kerberos principal short name used by all roles of this service.
Related Name
Default Value: hive
API Name: kerberos_princ_name
Required: true

Ranger DFS Audit Path

Description: The DFS path on which Ranger audits are written. The special placeholder '${ranger_base_audit_url}' should be used as the prefix, in order to use the centralized location defined in the Ranger service.
Related Name: xasecure.audit.destination.hdfs.dir
Default Value: $ranger_base_audit_url/hive
API Name: ranger_audit_hdfs_dir
Required: false

Ranger Audit DFS Spool Dir

Description: Spool directory for Ranger audits being written to DFS.
Related Name: xasecure.audit.destination.hdfs.batch.filespool.dir
Default Value: /var/log/hive/audit/hdfs/spool
API Name: ranger_audit_hdfs_spool_dir
Required: false

Ranger Audit Solr Spool Dir

Description: Spool directory for Ranger audits being written to Solr.
Related Name: xasecure.audit.destination.solr.batch.filespool.dir
Default Value: /var/log/hive/audit/solr/spool
API Name: ranger_audit_solr_spool_dir
Required: false

Ranger Policy Cache Directory

Description: The directory where Ranger security policies are cached locally.
Related Name: ranger.plugin.hive.policy.cache.dir
Default Value: /var/lib/ranger/hive/policy-cache
API Name: ranger_policy_cache_dir
Required: false

Suppressions

Suppress Configuration Validator: CDH Version Validator

Description: Whether to suppress configuration warnings produced by the CDH Version Validator configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_cdh_version_validator
Required: true

Suppress Configuration Validator: Deploy Directory

Description: Whether to suppress configuration warnings produced by the Deploy Directory configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_client_config_root_dir
Required: true

Suppress Configuration Validator: Hive Client Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description: Whether to suppress configuration warnings produced by the Hive Client Advanced Configuration Snippet (Safety Valve) for hive-site.xml configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hive_client_config_safety_valve
Required: true

Suppress Configuration Validator: Gateway Client Environment Advanced Configuration Snippet (Safety Valve) for hive-env.sh

Description: Whether to suppress configuration warnings produced by the Gateway Client Environment Advanced Configuration Snippet (Safety Valve) for hive-env.sh configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hive_client_env_safety_valve
Required: true

Suppress Configuration Validator: Client Java Configuration Options

Description: Whether to suppress configuration warnings produced by the Client Java Configuration Options configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hive_client_java_opts
Required: true

Suppress Configuration Validator: HiveServer2 Environment Advanced Configuration Snippet (Safety Valve)

Description: Whether to suppress configuration warnings produced by the HiveServer2 Environment Advanced Configuration Snippet (Safety Valve) configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hive_hs2_env_safety_valve
Required: true

Suppress Configuration Validator: HiveServer2 Log Directory

Description: Whether to suppress configuration warnings produced by the HiveServer2 Log Directory configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hive_log_dir
Required: true

Suppress Configuration Validator: Metrics Sample File Location

Description: Whether to suppress configuration warnings produced by the Metrics Sample File Location configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hive_metrics_sample_file_location
Required: true

Suppress Configuration Validator: Restrict Load Bucketed Table Validator

Description: Whether to suppress configuration warnings produced by the Restrict Load Bucketed Table Validator configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hive_restrict_load_bucketed_table_validator
Required: true

Suppress Configuration Validator: Restrict Unsafe Comparison Validator

Description: Whether to suppress configuration warnings produced by the Restrict Unsafe Comparison Validator configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hive_restrict_unsafe_comparison_validator
Required: true

Suppress Configuration Validator: HiveServer2 Operations Log Directory

Description: Whether to suppress configuration warnings produced by the HiveServer2 Operations Log Directory configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hive_server2_logging_operation_log_location
Required: true

Suppress Configuration Validator: Thrift port

Description: Whether to suppress configuration warnings produced by the Thrift port configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hive_server2_thrift_http_port
Required: true

Suppress Configuration Validator: Hive Server Zookeeper Namespace

Description: Whether to suppress configuration warnings produced by the Hive Server Zookeeper Namespace configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hive_server2_zookeeper_namespace
Required: true

Suppress Configuration Validator: hive.llap.daemon.logger

Description: Whether to suppress configuration warnings produced by the hive.llap.daemon.logger configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hivellap_daemon_logger
Required: true

Suppress Configuration Validator: LLAP Daemon Java Options

Description: Whether to suppress configuration warnings produced by the LLAP Daemon Java Options configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hivellap_daemon_opts
Required: true

Suppress Configuration Validator: Default query queues

Description: Whether to suppress configuration warnings produced by the Default query queues configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hivellap_default_query_queues
Required: true

Suppress Configuration Validator: hive.execution.mode

Description: Whether to suppress configuration warnings produced by the hive.execution.mode configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hivellap_execution_mode
Required: true

Suppress Configuration Validator: HiveServer2 Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description: Whether to suppress configuration warnings produced by the HiveServer2 Advanced Configuration Snippet (Safety Valve) for hive-site.xml configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hivellap_hs2_config_safety_valve
Required: true

Suppress Configuration Validator: hive.llap.io.memory.mode

Description: Whether to suppress configuration warnings produced by the hive.llap.io.memory.mode configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hivellap_io_memory_mode
Required: true

Suppress Configuration Validator: hive.llap.execution.mode

Description: Whether to suppress configuration warnings produced by the hive.llap.execution.mode configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hivellap_llap_execution_mode
Required: true

Suppress Configuration Validator: LLAP Proxy Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description: Whether to suppress configuration warnings produced by the LLAP Proxy Advanced Configuration Snippet (Safety Valve) for hive-site.xml configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hivellap_llapproxy_config_safety_valve
Required: true

Suppress Configuration Validator: Interactive Query Queue

Description: Whether to suppress configuration warnings produced by the Interactive Query Queue configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hivellap_queue_name
Required: true

Suppress Configuration Validator: Allow custom queues

Description: Whether to suppress configuration warnings produced by the Allow custom queues configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hivellap_tez_sessions_custom_queue_allowed
Required: true

Suppress Configuration Validator: Hive Downloaded Resources Directory

Description: Whether to suppress configuration warnings produced by the Hive Downloaded Resources Directory configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hiveserver2_downloaded_resources_dir
Required: true

Suppress Configuration Validator: Hive Local Scratch Directory

Description: Whether to suppress configuration warnings produced by the Hive Local Scratch Directory configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hiveserver2_exec_local_scratchdir
Required: true

Suppress Configuration Validator: Hive HDFS Scratch Directory

Description: Whether to suppress configuration warnings produced by the Hive HDFS Scratch Directory configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hiveserver2_exec_scratchdir
Required: true

Suppress Configuration Validator: Fair Scheduler XML Advanced Configuration Snippet (Safety Valve)

Description: Whether to suppress configuration warnings produced by the Fair Scheduler XML Advanced Configuration Snippet (Safety Valve) configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hiveserver2_fair_scheduler_safety_valve
Required: true

Suppress Configuration Validator: Java Configuration Options for HiveServer2

Description: Whether to suppress configuration warnings produced by the Java Configuration Options for HiveServer2 configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hiveserver2_java_opts
Required: true

Suppress Configuration Validator: HiveServer2 Load Balancer

Description: Whether to suppress configuration warnings produced by the HiveServer2 Load Balancer configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hiveserver2_load_balancer
Required: true

Suppress Configuration Validator: Exclude Vectorized Input Formats

Description: Whether to suppress configuration warnings produced by the Exclude Vectorized Input Formats configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hiveserver2_vectorized_input_format_excludes
Required: true

Suppress Configuration Validator: HiveServer2 WebUI Port

Description: Whether to suppress configuration warnings produced by the HiveServer2 WebUI Port configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hiveserver2_webui_port
Required: true

Suppress Configuration Validator: HiveServer2 Advanced Configuration Snippet (Safety Valve) for core-site.xml

Description: Whether to suppress configuration warnings produced by the HiveServer2 Advanced Configuration Snippet (Safety Valve) for core-site.xml configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hs2_core_site_safety_valve
Required: true

Suppress Configuration Validator: HiveServer2 Port

Description: Whether to suppress configuration warnings produced by the HiveServer2 Port configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_hs2_thrift_address_port
Required: true

Suppress Configuration Validator: JMX Exporter Port

Description: Whether to suppress configuration warnings produced by the JMX Exporter Port configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_jmx_exporter_port
Required: true

Suppress Configuration Validator: JMX Exporter configuration YAML

Description: Whether to suppress configuration warnings produced by the JMX Exporter configuration YAML configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_jmx_exporter_yaml
Required: true

Suppress Configuration Validator: LLAP Proxy Environment Advanced Configuration Snippet (Safety Valve)

Description: Whether to suppress configuration warnings produced by the LLAP Proxy Environment Advanced Configuration Snippet (Safety Valve) configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_llapproxy_role_env_safety_valve
Required: true

Suppress Configuration Validator: HiveServer2 Logging Advanced Configuration Snippet (Safety Valve)

Description: Whether to suppress configuration warnings produced by the HiveServer2 Logging Advanced Configuration Snippet (Safety Valve) configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_log4j_safety_valve
Required: true

Suppress Configuration Validator: Heap Dump Directory

Description: Whether to suppress configuration warnings produced by the Heap Dump Directory configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_oom_heap_dump_dir
Required: true

Suppress Configuration Validator: OpenTelemetry Collector Exporters Section

Description: Whether to suppress configuration warnings produced by the OpenTelemetry Collector Exporters Section configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_otelcol_exporters
Required: true

Suppress Configuration Validator: OpenTelemetry Collector Extensions Section

Description: Whether to suppress configuration warnings produced by the OpenTelemetry Collector Extensions Section configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_otelcol_extensions
Required: true

Suppress Configuration Validator: OpenTelemetry Collector Processors Section

Description: Whether to suppress configuration warnings produced by the OpenTelemetry Collector Processors Section configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_otelcol_processors
Required: true

Suppress Configuration Validator: OpenTelemetry Collector Receivers Section

Description: Whether to suppress configuration warnings produced by the OpenTelemetry Collector Receivers Section configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_otelcol_receivers
Required: true

Suppress Configuration Validator: OpenTelemetry Collector Remote Write Password

Description: Whether to suppress configuration warnings produced by the OpenTelemetry Collector Remote Write Password configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_otelcol_remote_write_password
Required: true

Suppress Configuration Validator: OpenTelemetry Collector Remote Write URL

Description: Whether to suppress configuration warnings produced by the OpenTelemetry Collector Remote Write URL configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_otelcol_remote_write_url
Required: true

Suppress Configuration Validator: OpenTelemetry Collector Remote Write Username

Description: Whether to suppress configuration warnings produced by the OpenTelemetry Collector Remote Write Username configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_otelcol_remote_write_user
Required: true

Suppress Configuration Validator: OpenTelemetry Collector Service Section

Description: Whether to suppress configuration warnings produced by the OpenTelemetry Collector Service Section configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_otelcol_service
Required: true

Suppress Configuration Validator: Custom Control Group Resources (overrides Cgroup settings)

Description: Whether to suppress configuration warnings produced by the Custom Control Group Resources (overrides Cgroup settings) configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_rm_custom_resources
Required: true

Suppress Configuration Validator: Role Triggers

Description: Whether to suppress configuration warnings produced by the Role Triggers configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_role_triggers
Required: true

Suppress Configuration Validator: HiveServer2 WebUI TLS/SSL Server Keystore File Location

Description: Whether to suppress configuration warnings produced by the HiveServer2 WebUI TLS/SSL Server Keystore File Location configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_ssl_server_keystore_location
Required: true

Suppress Configuration Validator: HiveServer2 WebUI TLS/SSL Server Keystore File Password

Description: Whether to suppress configuration warnings produced by the HiveServer2 WebUI TLS/SSL Server Keystore File Password configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_ssl_server_keystore_password
Required: true

Suppress Configuration Validator: Stacks Collection Directory

Description: Whether to suppress configuration warnings produced by the Stacks Collection Directory configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_stacks_collection_directory
Required: true

Suppress Configuration Validator: tez.history.logging.taskattempt-filters

Description: Whether to suppress configuration warnings produced by the tez.history.logging.taskattempt-filters configuration validator.
Related Name
Default Value: false
API Name: role_config_suppression_tez_interactive_history_logging_taskattempt_filters
Required: true

Suppress Parameter Validation: Audit Log Directory

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Audit Log Directory parameter.
Related Name
Default Value: false
API Name: service_config_suppression_audit_event_log_dir
Required: true

Suppress Configuration Validator: Gateway Count Validator

Description: Whether to suppress configuration warnings produced by the Gateway Count Validator configuration validator.
Related Name
Default Value: false
API Name: service_config_suppression_gateway_count_validator
Required: true

Suppress Parameter Validation: Hive Auxiliary JARs Directory

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Auxiliary JARs Directory parameter.
Related Name
Default Value: false
API Name: service_config_suppression_hive_aux_jars_path_dir
Required: true

Suppress Configuration Validator: Client TLS/SSL In Use With LDAP Authentication Validator

Description: Whether to suppress configuration warnings produced by the Client TLS/SSL In Use With LDAP Authentication Validator configuration validator.
Related Name
Default Value: false
API Name: service_config_suppression_hive_client_ssl_recommended_with_ldap_auth_validator
Required: true

Suppress Parameter Validation: Hive Service Advanced Configuration Snippet (Safety Valve) for core-site.xml

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Service Advanced Configuration Snippet (Safety Valve) for core-site.xml parameter.
Related Name
Default Value: false
API Name: service_config_suppression_hive_core_site_safety_valve
Required: true

Suppress Parameter Validation: Default File Format for Managed Tables

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Default File Format for Managed Tables parameter.
Related Name
Default Value: false
API Name: service_config_suppression_hive_default_fileformat_managed
Required: true

Suppress Parameter Validation: Base Directory for Hive Proto Hook

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Base Directory for Hive Proto Hook parameter.
Related Name
Default Value: false
API Name: service_config_suppression_hive_hook_proto_base_directory
Required: true

Suppress Parameter Validation: Hive LLAP Service Environment Advanced Configuration Snippet (Safety Valve)

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive LLAP Service Environment Advanced Configuration Snippet (Safety Valve) parameter.
Related Name
Default Value: false
API Name: service_config_suppression_hive_llap_service_env_safety_valve
Required: true

Suppress Parameter Validation: Metastore Transactional Listener List

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Metastore Transactional Listener List parameter.
Related Name
Default Value: false
API Name: service_config_suppression_hive_metastore_transactional_event_listeners
Required: true

Suppress Configuration Validator: Hive Proxy Groups Validator

Description: Whether to suppress configuration warnings produced by the Hive Proxy Groups Validator configuration validator.
Related Name
Default Value: false
API Name: service_config_suppression_hive_proxy_groups_validator
Required: true

Suppress Parameter Validation: Hive Metastore Access Control and Proxy User Groups Override

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Metastore Access Control and Proxy User Groups Override parameter.
Related Name
Default Value: false
API Name: service_config_suppression_hive_proxy_user_groups_list
Required: true

Suppress Configuration Validator: Hive Ranger Validator

Description: Whether to suppress configuration warnings produced by the Hive Ranger Validator configuration validator.
Related Name
Default Value: false
API Name: service_config_suppression_hive_ranger_validator
Required: true

Suppress Parameter Validation: Replica functions root directory

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Replica functions root directory parameter.
Related Name
Default Value: false
API Name: service_config_suppression_hive_repl_replica_functions_root_dir
Required: true

Suppress Parameter Validation: Hive Replication Environment Advanced Configuration Snippet (Safety Valve)

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Replication Environment Advanced Configuration Snippet (Safety Valve) parameter.
Related Name
Default Value: false
API Name: service_config_suppression_hive_replication_env_safety_valve
Required: true

Suppress Configuration Validator: Hive Sentry Validator

Description: Whether to suppress configuration warnings produced by the Hive Sentry Validator configuration validator.
Related Name
Default Value: false
API Name: service_config_suppression_hive_sentry_validator
Required: true

Suppress Parameter Validation: Hive Service Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Service Advanced Configuration Snippet (Safety Valve) for hive-site.xml parameter.
Related Name
Default Value: false
API Name: service_config_suppression_hive_service_config_safety_valve
Required: true

Suppress Parameter Validation: Hive Replication Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Replication Advanced Configuration Snippet (Safety Valve) for hive-site.xml parameter.
Related Name
Default Value: false
API Name: service_config_suppression_hive_service_replication_config_safety_valve
Required: true

Suppress Parameter Validation: LLAP app name

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the LLAP app name parameter.
Related Name
Default Value: false
API Name: service_config_suppression_hivellap_app_name
Required: true

Suppress Parameter Validation: hive.llap.daemon.service.hosts

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the hive.llap.daemon.service.hosts parameter.
Related Name
Default Value: false
API Name: service_config_suppression_hivellap_daemon_service_hosts
Required: true

Suppress Configuration Validator: HiveServer2 Count Validator

Description: Whether to suppress configuration warnings produced by the HiveServer2 Count Validator configuration validator.
Related Name
Default Value: false
API Name: service_config_suppression_hiveserver2_count_validator
Required: true

Suppress Parameter Validation: HiveServer2 TLS/SSL Server Keystore File Password

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 TLS/SSL Server Keystore File Password parameter.
Related Name
Default Value: false
API Name: service_config_suppression_hiveserver2_keystore_password
Required: true

Suppress Parameter Validation: HiveServer2 TLS/SSL Server Keystore File Location

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 TLS/SSL Server Keystore File Location parameter.
Related Name
Default Value: false
API Name: service_config_suppression_hiveserver2_keystore_path
Required: true

Suppress Parameter Validation: LDAP BaseDN

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the LDAP BaseDN parameter.
Related Name
Default Value: false
API Name: service_config_suppression_hiveserver2_ldap_basedn
Required: true

Suppress Parameter Validation: Active Directory Domain

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Active Directory Domain parameter.
Related Name
Default Value: false
API Name: service_config_suppression_hiveserver2_ldap_domain
Required: true

Suppress Parameter Validation: LDAP URL

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the LDAP URL parameter.
Related Name
Default Value: false
API Name: service_config_suppression_hiveserver2_ldap_uri
Required: true

Suppress Parameter Validation: HiveServer2 TLS/SSL Trust Store File

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 TLS/SSL Trust Store File parameter.
Related Name
Default Value: false
API Name: service_config_suppression_hiveserver2_truststore_file
Required: true

Suppress Parameter Validation: HiveServer2 TLS/SSL Trust Store Password

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 TLS/SSL Trust Store Password parameter.
Related Name
Default Value: false
API Name: service_config_suppression_hiveserver2_truststore_password
Required: true

Suppress Parameter Validation: Kerberos Principal

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Kerberos Principal parameter.
Related Name
Default Value: false
API Name: service_config_suppression_kerberos_princ_name
Required: true

Suppress Parameter Validation: Hive Lineage Log Directory

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Lineage Log Directory parameter.
Related Name
Default Value: false
API Name: service_config_suppression_lineage_event_log_dir
Required: true

Suppress Configuration Validator: LLAP Proxy Count Validator

Description: Whether to suppress configuration warnings produced by the LLAP Proxy Count Validator configuration validator.
Related Name
Default Value: false
API Name: service_config_suppression_llapproxy_count_validator
Required: true

Suppress Parameter Validation: Audit Event Filter

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Audit Event Filter parameter.
Related Name
Default Value: false
API Name: service_config_suppression_navigator_audit_event_filter
Required: true

Suppress Parameter Validation: Hive Client Advanced Configuration Snippet (Safety Valve) for navigator.client.properties

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Client Advanced Configuration Snippet (Safety Valve) for navigator.client.properties parameter.
Related Name
Default Value: false
API Name: service_config_suppression_navigator_client_config_safety_valve
Required: true

Suppress Parameter Validation: Audit Event Tracker

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Audit Event Tracker parameter.
Related Name
Default Value: false
API Name: service_config_suppression_navigator_event_tracker
Required: true

Suppress Parameter Validation: Hive Client Advanced Configuration Snippet (Safety Valve) for navigator.lineage.client.properties

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Client Advanced Configuration Snippet (Safety Valve) for navigator.lineage.client.properties parameter.
Related Name
Default Value: false
API Name: service_config_suppression_navigator_lineage_client_config_safety_valve
Required: true

Suppress Parameter Validation: System Group

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the System Group parameter.
Related Name
Default Value: false
API Name: service_config_suppression_process_groupname
Required: true

Suppress Parameter Validation: System User

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the System User parameter.
Related Name
Default Value: false
API Name: service_config_suppression_process_username
Required: true

Suppress Parameter Validation: Ranger DFS Audit Path

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Ranger DFS Audit Path parameter.
Related Name
Default Value: false
API Name: service_config_suppression_ranger_audit_hdfs_dir
Required: true

Suppress Parameter Validation: Ranger Audit DFS Spool Dir

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Ranger Audit DFS Spool Dir parameter.
Related Name
Default Value: false
API Name: service_config_suppression_ranger_audit_hdfs_spool_dir
Required: true

Suppress Parameter Validation: Hive Service Advanced Configuration Snippet (Safety Valve) for ranger-hive-audit.xml

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Service Advanced Configuration Snippet (Safety Valve) for ranger-hive-audit.xml parameter.
Related Name
Default Value: false
API Name: service_config_suppression_ranger_audit_safety_valve
Required: true

Suppress Parameter Validation: Ranger Audit Solr Spool Dir

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Ranger Audit Solr Spool Dir parameter.
Related Name
Default Value: false
API Name: service_config_suppression_ranger_audit_solr_spool_dir
Required: true

Suppress Parameter Validation: Ranger Plugin Trusted Proxy IP Address

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Ranger Plugin Trusted Proxy IP Address parameter.
Related Name
Default Value: false
API Name: service_config_suppression_ranger_plugin_trusted_proxy_ipaddress
Required: true

Suppress Parameter Validation: Ranger Policy Cache Directory

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Ranger Policy Cache Directory parameter.
Related Name
Default Value: false
API Name: service_config_suppression_ranger_policy_cache_dir
Required: true

Suppress Parameter Validation: Hive Service Advanced Configuration Snippet (Safety Valve) for ranger-hive-policymgr-ssl.xml

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Service Advanced Configuration Snippet (Safety Valve) for ranger-hive-policymgr-ssl.xml parameter.
Related Name
Default Value: false
API Name: service_config_suppression_ranger_policymgr_ssl_safety_valve
Required: true

Suppress Parameter Validation: Hive Service Advanced Configuration Snippet (Safety Valve) for ranger-hive-security.xml

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Service Advanced Configuration Snippet (Safety Valve) for ranger-hive-security.xml parameter.
Related Name
Default Value: false
API Name: service_config_suppression_ranger_security_safety_valve
Required: true

Suppress Parameter Validation: Service Triggers

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Service Triggers parameter.
Related Name
Default Value: false
API Name: service_config_suppression_service_triggers
Required: true

Suppress Parameter Validation: Service Monitor Client Config Overrides

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Service Monitor Client Config Overrides parameter.
Related Name
Default Value: false
API Name: service_config_suppression_smon_client_config_overrides
Required: true

Suppress Parameter Validation: Service Monitor Derived Configs Advanced Configuration Snippet (Safety Valve)

Description: Whether to suppress configuration warnings produced by the built-in parameter validation for the Service Monitor Derived Configs Advanced Configuration Snippet (Safety Valve) parameter.
Related Name
Default Value: false
API Name: service_config_suppression_smon_derived_configs_safety_valve
Required: true

Suppress Health Test: LLAP Proxy Health

Description: Whether to suppress the results of the LLAP Proxy Health heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value: false
API Name: service_health_suppression_hive_llap_hive_llap_llapproxy_health
Required: true

Suppress Health Test: HiveServer2 Health

Description: Whether to suppress the results of the HiveServer2 Health heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value: false
API Name: service_health_suppression_hive_llap_hiveserver2s_healthy
Required: true