Hive Properties in Cloudera Runtime 7.1

Role groups:

Gateway

Advanced

Deploy Directory

Description
The directory where the client configs will be deployed
Related Name
Default Value
/etc/hive
API Name
client_config_root_dir
Required
true

Hive Client Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
For advanced use only, a string to be inserted into the client configuration for hive-site.xml.
Related Name
Default Value
API Name
hive_client_config_safety_valve
Required
false

Gateway Client Environment Advanced Configuration Snippet (Safety Valve) for hive-env.sh

Description
For advanced use only, key-value pairs (one on each line) to be inserted into the client configuration for hive-env.sh
Related Name
Default Value
API Name
hive_client_env_safety_valve
Required
false

Client Java Configuration Options

Description
These are Java command-line arguments. Commonly, garbage collection flags, PermGen, or extra debugging flags would be passed here.
Related Name
Default Value
-Djava.net.preferIPv4Stack=true
API Name
hive_client_java_opts
Required
false

Hive Metastore Connection Timeout

Description
Timeout for requests to the Hive Metastore Server. Consider increasing this if you have tables with a lot of metadata and see timeout errors. Used by most Hive Metastore clients such as Hive CLI and HiveServer2, but not by Impala. Impala has a separately configured timeout.
Related Name
hive.metastore.client.socket.timeout
Default Value
5 minute(s)
API Name
hive_metastore_timeout
Required
false

Gateway Logging Advanced Configuration Snippet (Safety Valve)

Description
For advanced use only, a string to be inserted into log4j.properties for this role only.
Related Name
Default Value
API Name
log4j_safety_valve
Required
false

Logs

Gateway Logging Threshold

Description
The minimum log level for Gateway logs
Related Name
Default Value
INFO
API Name
log_threshold
Required
false

Monitoring

Enable Configuration Change Alerts

Description
When set, Cloudera Manager will send alerts when this entity's configuration changes.
Related Name
Default Value
false
API Name
enable_config_alerts
Required
false

Other

Alternatives Priority

Description
The priority level that the client configuration will have in the Alternatives system on the hosts. Higher priority levels will cause Alternatives to prefer this configuration over any others.
Related Name
Default Value
90
API Name
client_config_priority
Required
true

Resource Management

Client Java Heap Size in Bytes

Description
Maximum size in bytes for the Java process heap memory. Passed to Java -Xmx.
Related Name
Default Value
2 GiB
API Name
hive_client_java_heapsize
Required
false

Suppressions

Suppress Configuration Validator: CDH Version Validator

Description
Whether to suppress configuration warnings produced by the CDH Version Validator configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_cdh_version_validator
Required
true

Suppress Parameter Validation: Deploy Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Deploy Directory parameter.
Related Name
Default Value
false
API Name
role_config_suppression_client_config_root_dir
Required
true

Suppress Parameter Validation: Hive Client Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Client Advanced Configuration Snippet (Safety Valve) for hive-site.xml parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_client_config_safety_valve
Required
true

Suppress Parameter Validation: Gateway Client Environment Advanced Configuration Snippet (Safety Valve) for hive-env.sh

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Gateway Client Environment Advanced Configuration Snippet (Safety Valve) for hive-env.sh parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_client_env_safety_valve
Required
true

Suppress Parameter Validation: Client Java Configuration Options

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Client Java Configuration Options parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_client_java_opts
Required
true

Suppress Parameter Validation: Gateway Logging Advanced Configuration Snippet (Safety Valve)

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Gateway Logging Advanced Configuration Snippet (Safety Valve) parameter.
Related Name
Default Value
false
API Name
role_config_suppression_log4j_safety_valve
Required
true

Hive Metastore Server

Advanced

Number of Threads Used by Compactor

Description
Number of compactor worker threads to run on this metastore instance. Can be different values on different Metastore instances.
Related Name
hive.compactor.worker.threads
Default Value
5
API Name
hive_compactor_worker_threads
Required
true

Hive Metastore Server Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
For advanced use only. A string to be inserted into hive-site.xml for this role only.
Related Name
Default Value
API Name
hive_metastore_config_safety_valve
Required
false

Hive Metastore Delegation Token Store

Description
The delegation token store implementation class. Use DBTokenStore for Highly Available Metastore Configuration.
Related Name
hive.cluster.delegation.token.store.class
Default Value
org.apache.hadoop.hive.thrift.MemoryTokenStore
API Name
hive_metastore_delegation_token_store
Required
false

Hive Metastore Server Environment Advanced Configuration Snippet (Safety Valve)

Description
For advanced use only, key-value pairs (one on each line) to be inserted into a role's environment. Applies to configurations of this role except client configuration.
Related Name
Default Value
API Name
hive_metastore_env_safety_valve
Required
false

Java Configuration Options for Hive Metastore Server

Description
These arguments will be passed as part of the Java command line. Commonly, garbage collection flags, PermGen, or extra debugging flags would be passed here. Note: When CM version is 6.3.0 or greater, {{JAVA_GC_ARGS}} will be replaced by JVM Garbage Collection arguments based on the runtime Java JVM version.
Related Name
Default Value
JAVA_GC_ARGS
API Name
hive_metastore_java_opts
Required
false

Max Hive Metastore Server Threads

Description
Maximum number of worker threads in the Hive Metastore Server's thread pool
Related Name
hive.metastore.server.max.threads
Default Value
100000
API Name
hive_metastore_max_threads
Required
true

Min Hive Metastore Server Threads

Description
Minimum number of worker threads in the Hive Metastore Server's thread pool
Related Name
hive.metastore.server.min.threads
Default Value
200
API Name
hive_metastore_min_threads
Required
true

Max Message Size for Hive MetaStore

Description
Maximum message size Hive MetaStore accepts.
Related Name
hive.metastore.server.max.message.size
Default Value
100 MiB
API Name
hive_metastore_server_max_message_size
Required
false

Enable Metrics Subsystem

Description
Controls whether the Hive metrics subsystem is enabled for the role.
Related Name
hive.metastore.metrics.enabled
Default Value
true
API Name
hive_metrics_enabled
Required
false

Metrics Sample File Location

Description
The full path to a file with a sample of metrics exposed by the role. The sample is updated at the frequency configured by Metrics Sample File Logging Frequency. By default, the sample file is logged to a directory under the role log directory, e.g., /var/log/hive/metrics-hivemetastore/metrics.log. The setting only has an effect if "Enable Metrics Subsystem" is set to true.
Related Name
hive.service.metrics.file.location
Default Value
API Name
hive_metrics_sample_file_location
Required
false

Metrics Sample File Logging Frequency

Description
The frequency at which the metrics are logged to the sample file. The setting only has an effect if "Enable Metrics Subsystem" is set to true.
Related Name
hive.service.metrics.file.frequency
Default Value
30 second(s)
API Name
hive_metrics_sample_logging_frequency
Required
false

Hive Metastore Server Advanced Configuration Snippet (Safety Valve) for core-site.xml

Description
For advanced use only. A string to be inserted into core-site.xml for this role only.
Related Name
Default Value
API Name
hms_core_site_safety_valve
Required
false

Hive Metastore Server Logging Advanced Configuration Snippet (Safety Valve)

Description
For advanced use only, a string to be inserted into log4j.properties for this role only.
Related Name
Default Value
API Name
log4j_safety_valve
Required
false

Heap Dump Directory

Description
Path to directory where heap dumps are generated when java.lang.OutOfMemoryError error is thrown. This directory is automatically created if it does not exist. If this directory already exists, role user must have write access to this directory. If this directory is shared among multiple roles, it should have 1777 permissions. The heap dump files are created with 600 permissions and are owned by the role user. The amount of free space in this directory should be greater than the maximum Java Process heap size configured for this role.
Related Name
oom_heap_dump_dir
Default Value
/tmp
API Name
oom_heap_dump_dir
Required
false

Dump Heap When Out of Memory

Description
When set, generates heap dump file when java.lang.OutOfMemoryError is thrown.
Related Name
Default Value
true
API Name
oom_heap_dump_enabled
Required
true

Kill When Out of Memory

Description
When set, a SIGKILL signal is sent to the role process when java.lang.OutOfMemoryError is thrown.
Related Name
Default Value
true
API Name
oom_sigkill_enabled
Required
true

Automatically Restart Process

Description
When set, this role's process is automatically (and transparently) restarted in the event of an unexpected failure. This configuration applies in the time after the Start Wait Timeout period.
Related Name
Default Value
false
API Name
process_auto_restart
Required
true

Enable Metric Collection

Description
Cloudera Manager agent monitors each service and each of its role by publishing metrics to the Cloudera Manager Service Monitor. Setting it to false will stop Cloudera Manager agent from publishing any metric for corresponding service/roles. This is usually helpful for services that generate large amount of metrics which Service Monitor is not able to process.
Related Name
Default Value
true
API Name
process_should_monitor
Required
true

Process Start Retry Attempts

Description
Number of times to try starting a role's process when the process exits before the Start Wait Timeout period. After a process is running beyond the Start Wait Timeout, the retry count is reset. Setting this configuration to zero will prevent restart of the process during the Start Wait Timeout period.
Related Name
Default Value
3
API Name
process_start_retries
Required
false

Process Start Wait Timeout

Description
The time in seconds to wait for a role's process to start successfully on a host. Processes which exit/crash before this time will be restarted until reaching the limit specified by the Start Retry Attempts count parameter. Setting this configuration to zero will turn off this feature.
Related Name
Default Value
20
API Name
process_start_secs
Required
false

Logs

Hive Metastore Server Log Directory

Description
Directory where Hive Metastore Server will place its log files.
Related Name
Default Value
/var/log/hive
API Name
hive_log_dir
Required
false

Hive Metastore Server Logging Threshold

Description
The minimum log level for Hive Metastore Server logs
Related Name
Default Value
INFO
API Name
log_threshold
Required
false

Hive Metastore Server Maximum Log File Backups

Description
The maximum number of rolled log files to keep for Hive Metastore Server logs. Typically used by log4j or logback.
Related Name
Default Value
10
API Name
max_log_backup_index
Required
false

Hive Metastore Server Max Log Size

Description
The maximum size, in megabytes, per log file for Hive Metastore Server logs. Typically used by log4j or logback.
Related Name
Default Value
200 MiB
API Name
max_log_size
Required
false

Monitoring

Enable Health Alerts for this Role

Description
When set, Cloudera Manager will send alerts when the health of this role reaches the threshold specified by the EventServer setting eventserver_health_events_alert_threshold
Related Name
Default Value
true
API Name
enable_alerts
Required
false

Enable Configuration Change Alerts

Description
When set, Cloudera Manager will send alerts when this entity's configuration changes.
Related Name
Default Value
false
API Name
enable_config_alerts
Required
false

Heap Dump Directory Free Space Monitoring Absolute Thresholds

Description
The health test thresholds for monitoring of free space on the filesystem that contains this role's heap dump directory.
Related Name
Default Value
Warning: 10 GiB, Critical: 5 GiB
API Name
heap_dump_directory_free_space_absolute_thresholds
Required
false

Heap Dump Directory Free Space Monitoring Percentage Thresholds

Description
The health test thresholds for monitoring of free space on the filesystem that contains this role's heap dump directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Heap Dump Directory Free Space Monitoring Absolute Thresholds setting is configured.
Related Name
Default Value
Warning: Never, Critical: Never
API Name
heap_dump_directory_free_space_percentage_thresholds
Required
false

File Descriptor Monitoring Thresholds

Description
The health test thresholds of the number of file descriptors used. Specified as a percentage of file descriptor limit.
Related Name
Default Value
Warning: 50.0 %, Critical: 70.0 %
API Name
hivemetastore_fd_thresholds
Required
false

Hive Metastore Server Host Health Test

Description
When computing the overall Hive Metastore Server health, consider the host's health.
Related Name
Default Value
true
API Name
hivemetastore_host_health_enabled
Required
false

Pause Duration Thresholds

Description
The health test thresholds for the weighted average extra time the pause monitor spent paused. Specified as a percentage of elapsed wall clock time.
Related Name
Default Value
Warning: 30.0, Critical: 60.0
API Name
hivemetastore_pause_duration_thresholds
Required
false

Pause Duration Monitoring Period

Description
The period to review when computing the moving average of extra time the pause monitor spent paused.
Related Name
Default Value
5 minute(s)
API Name
hivemetastore_pause_duration_window
Required
false

Hive Metastore Server Process Health Test

Description
Enables the health test that the Hive Metastore Server's process state is consistent with the role configuration
Related Name
Default Value
true
API Name
hivemetastore_scm_health_enabled
Required
false

Log Directory Free Space Monitoring Absolute Thresholds

Description
The health test thresholds for monitoring of free space on the filesystem that contains this role's log directory.
Related Name
Default Value
Warning: 10 GiB, Critical: 5 GiB
API Name
log_directory_free_space_absolute_thresholds
Required
false

Log Directory Free Space Monitoring Percentage Thresholds

Description
The health test thresholds for monitoring of free space on the filesystem that contains this role's log directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Log Directory Free Space Monitoring Absolute Thresholds setting is configured.
Related Name
Default Value
Warning: Never, Critical: Never
API Name
log_directory_free_space_percentage_thresholds
Required
false

Hive Metastore Canary Health Test

Description
Enables the health test that checks that basic Hive Metastore operations succeed
Related Name
Default Value
true
API Name
metastore_canary_health_enabled
Required
false

Navigator Audit Failure Thresholds

Description
The health test thresholds for failures encountered when monitoring audits within a recent period specified by the mgmt_navigator_failure_window configuration for the role. The value that can be specified for this threshold is the number of bytes of audits data that is left to be sent to audit server.
Related Name
mgmt.navigator.failure.thresholds
Default Value
Warning: Never, Critical: Any
API Name
mgmt_navigator_failure_thresholds
Required
false

Monitoring Period For Audit Failures

Description
The period to review when checking if audits are blocked and not getting processed.
Related Name
mgmt.navigator.failure.window
Default Value
20 minute(s)
API Name
mgmt_navigator_failure_window
Required
false

Navigator Audit Pipeline Health Check

Description
Enable test of audit events processing pipeline. This will test if audit events are not getting processed by Audit Server for a role that generates audit.
Related Name
mgmt.navigator.status.check.enabled
Default Value
true
API Name
mgmt_navigator_status_check_enabled
Required
false

Metric Filter

Description
Defines a Metric Filter for this role. Cloudera Manager Agents will not send filtered metrics to the Service Monitor. Define the following fields:
  • Health Test Metric Set - Select this parameter to collect only metrics required for health tests.
  • Default Dashboard Metric Set - Select this parameter to collect only metrics required for the default dashboards. For user-defined charts, you must add the metrics you require for the chart using the Custom Metrics parameter.
  • Include/Exclude Custom Metrics - Select Include to specify metrics that should be collected. Select Exclude to specify metrics that should not be collected. Enter the metric names to be included or excluded using the Metric Name parameter.
  • Metric Name - The name of a metric that will be included or excluded during metric collection.
If you do not select Health Test Metric Set or Default Dashboard Metric Set, or specify metrics by name, metric filtering will be turned off (this is the default behavior).For example, the following configuration enables the collection of metrics required for Health Tests and the jvm_heap_used_mb metric:
  • Include only Health Test Metric Set: Selected.
  • Include/Exclude Custom Metrics: Set to Include.
  • Metric Name: jvm_heap_used_mb
You can also view the JSON representation for this parameter by clicking View as JSON. In this example, the JSON looks like this:{ "includeHealthTestMetricSet": true, "filterType": "whitelist", "metrics": ["jvm_heap_used_mb"] }
Related Name
Default Value
API Name
monitoring_metric_filter
Required
false

Process Swap Memory Thresholds

Description
The health test thresholds on the swap memory usage of the process. This takes precedence over the host level threshold.
Related Name
Default Value
Warning: 200 B, Critical: Never
API Name
process_swap_memory_thresholds
Required
false

Role Triggers

Description
The configured triggers for this role. This is a JSON-formatted list of triggers. These triggers are evaluated as part as the health system. Every trigger expression is parsed, and if the trigger condition is met, the list of actions provided in the trigger expression is executed. Each trigger has the following fields:
  • triggerName (mandatory) - The name of the trigger. This value must be unique for the specific role.
  • triggerExpression (mandatory) - A tsquery expression representing the trigger.
  • streamThreshold (optional) - The maximum number of streams that can satisfy a condition of a trigger before the condition fires. By default set to 0, and any stream returned causes the condition to fire.
  • enabled (optional) - By default set to 'true'. If set to 'false', the trigger is not evaluated.
  • expressionEditorConfig (optional) - Metadata for the trigger editor. If present, the trigger should only be edited from the Edit Trigger page; editing the trigger here can lead to inconsistencies.
For example, the following JSON formatted trigger configured for a DataNode fires if the DataNode has more than 1500 file descriptors opened:[{"triggerName": "sample-trigger", "triggerExpression": "IF (SELECT fd_open WHERE roleName=$ROLENAME and last(fd_open) > 1500) DO health:bad", "streamThreshold": 0, "enabled": "true"}]See the trigger rules documentation for more details on how to write triggers using tsquery.The JSON format is evolving and may change and, as a result, backward compatibility is not guaranteed between releases.
Related Name
Default Value
[]
API Name
role_triggers
Required
true

Unexpected Exits Thresholds

Description
The health test thresholds for unexpected exits encountered within a recent period specified by the unexpected_exits_window configuration for the role.
Related Name
Default Value
Warning: Never, Critical: Any
API Name
unexpected_exits_thresholds
Required
false

Unexpected Exits Monitoring Period

Description
The period to review when computing unexpected exits.
Related Name
Default Value
5 minute(s)
API Name
unexpected_exits_window
Required
false

Other

Enable Stored Notifications in Database

Description
Enable stored notifications of metadata changes. When enabled, each metadata change will be stored in NOTIFICATION_LOG.
Related Name
Default Value
true
API Name
hive_enable_db_notification
Required
false

Time-to-live for Database Notifications

Description
Time-to-live in seconds for notifications present in NOTIFICATION_LOG. Only used when Enable Stored Notifications in Database is enabled.
Related Name
hive.metastore.event.db.listener.timetolive
Default Value
2 day(s)
API Name
hive_metastore_event_db_listener_timetolive
Required
false

Performance

Maximum Process File Descriptors

Description
If configured, overrides the process soft and hard rlimits (also called ulimits) for file descriptors to the configured value.
Related Name
Default Value
API Name
rlimit_fds
Required
false

Ports and Addresses

Hive Metastore Server Port

Description
Port on which Hive Metastore Server will listen for connections.
Related Name
hive.metastore.port
Default Value
9083
API Name
hive_metastore_port
Required
false

Resource Management

Java Heap Size of Hive Metastore Server in Bytes

Description
Maximum size in bytes for the Java Process heap memory. Passed to Java -Xmx.
Related Name
Default Value
8 GiB
API Name
hive_metastore_java_heapsize
Required
false

Cgroup CPU Shares

Description
Number of CPU shares to assign to this role. The greater the number of shares, the larger the share of the host's CPUs that will be given to this role when the host experiences CPU contention. Must be between 2 and 262144. Defaults to 1024 for processes not managed by Cloudera Manager.
Related Name
cpu.shares
Default Value
1024
API Name
rm_cpu_shares
Required
true

Custom Control Group Resources (overrides Cgroup settings)

Description
Custom control group resources to assign to this role, which will be enforced by the Linux kernel. These resources should exist on the target hosts, otherwise an error will occur when the process starts. Use the same format as used for arguments to the cgexec command: resource1,resource2:path1 or resource3:path2 For example: 'cpu,memory:my/path blkio:my2/path2' ***These settings override other cgroup settings.***
Related Name
custom.cgroups
Default Value
API Name
rm_custom_resources
Required
false

Cgroup I/O Weight

Description
Weight for the read I/O requests issued by this role. The greater the weight, the higher the priority of the requests when the host experiences I/O contention. Must be between 100 and 1000. Defaults to 1000 for processes not managed by Cloudera Manager.
Related Name
blkio.weight
Default Value
500
API Name
rm_io_weight
Required
true

Cgroup Memory Hard Limit

Description
Hard memory limit to assign to this role, enforced by the Linux kernel. When the limit is reached, the kernel will reclaim pages charged to the process. If reclaiming fails, the kernel may kill the process. Both anonymous as well as page cache pages contribute to the limit. Use a value of -1 to specify no limit. By default processes not managed by Cloudera Manager will have no limit. If the value is -1, Cloudera Manager will not monitor Cgroup memory usage therefore some of the charts will show 'No Data'
Related Name
memory.limit_in_bytes
Default Value
-1 MiB
API Name
rm_memory_hard_limit
Required
true

Cgroup Memory Soft Limit

Description
Soft memory limit to assign to this role, enforced by the Linux kernel. When the limit is reached, the kernel will reclaim pages charged to the process if and only if the host is facing memory pressure. If reclaiming fails, the kernel may kill the process. Both anonymous as well as page cache pages contribute to the limit. Use a value of -1 to specify no limit. By default processes not managed by Cloudera Manager will have no limit. If the value is -1, Cloudera Manager will not monitor Cgroup memory usage therefore some of the charts will show 'No Data'
Related Name
memory.soft_limit_in_bytes
Default Value
-1 MiB
API Name
rm_memory_soft_limit
Required
true

Stacks Collection

Stacks Collection Data Retention

Description
The amount of stacks data that is retained. After the retention limit is reached, the oldest data is deleted.
Related Name
stacks_collection_data_retention
Default Value
100 MiB
API Name
stacks_collection_data_retention
Required
false

Stacks Collection Directory

Description
The directory in which stacks logs are placed. If not set, stacks are logged into a stacks subdirectory of the role's log directory.
Related Name
stacks_collection_directory
Default Value
API Name
stacks_collection_directory
Required
false

Stacks Collection Enabled

Description
Whether or not periodic stacks collection is enabled.
Related Name
stacks_collection_enabled
Default Value
false
API Name
stacks_collection_enabled
Required
true

Stacks Collection Frequency

Description
The frequency with which stacks are collected.
Related Name
stacks_collection_frequency
Default Value
5.0 second(s)
API Name
stacks_collection_frequency
Required
false

Stacks Collection Method

Description
The method used to collect stacks. The jstack option involves periodically running the jstack command against the role's daemon process. The servlet method is available for those roles that have an HTTP server endpoint exposing the current stacks traces of all threads. When the servlet method is selected, that HTTP endpoint is periodically scraped.
Related Name
stacks_collection_method
Default Value
jstack
API Name
stacks_collection_method
Required
false

Suppressions

Suppress Configuration Validator: CDH Version Validator

Description
Whether to suppress configuration warnings produced by the CDH Version Validator configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_cdh_version_validator
Required
true

Suppress Configuration Validator: Hive Metastore Max Message Size Validator

Description
Whether to suppress configuration warnings produced by the Hive Metastore Max Message Size Validator configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_hms_max_message_size_validator
Required
true

Suppress Parameter Validation: Hive Metastore Server Log Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Metastore Server Log Directory parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_log_dir
Required
true

Suppress Parameter Validation: Hive Metastore Server Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Metastore Server Advanced Configuration Snippet (Safety Valve) for hive-site.xml parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_metastore_config_safety_valve
Required
true

Suppress Parameter Validation: Hive Metastore Server Environment Advanced Configuration Snippet (Safety Valve)

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Metastore Server Environment Advanced Configuration Snippet (Safety Valve) parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_metastore_env_safety_valve
Required
true

Suppress Parameter Validation: Java Configuration Options for Hive Metastore Server

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Java Configuration Options for Hive Metastore Server parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_metastore_java_opts
Required
true

Suppress Parameter Validation: Hive Metastore Server Port

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Metastore Server Port parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_metastore_port
Required
true

Suppress Parameter Validation: Metrics Sample File Location

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Metrics Sample File Location parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_metrics_sample_file_location
Required
true

Suppress Parameter Validation: Hive Metastore Server Advanced Configuration Snippet (Safety Valve) for core-site.xml

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Metastore Server Advanced Configuration Snippet (Safety Valve) for core-site.xml parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hms_core_site_safety_valve
Required
true

Suppress Parameter Validation: Hive Metastore Server Logging Advanced Configuration Snippet (Safety Valve)

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Metastore Server Logging Advanced Configuration Snippet (Safety Valve) parameter.
Related Name
Default Value
false
API Name
role_config_suppression_log4j_safety_valve
Required
true

Suppress Parameter Validation: Heap Dump Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Heap Dump Directory parameter.
Related Name
Default Value
false
API Name
role_config_suppression_oom_heap_dump_dir
Required
true

Suppress Parameter Validation: Custom Control Group Resources (overrides Cgroup settings)

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Custom Control Group Resources (overrides Cgroup settings) parameter.
Related Name
Default Value
false
API Name
role_config_suppression_rm_custom_resources
Required
true

Suppress Parameter Validation: Role Triggers

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Role Triggers parameter.
Related Name
Default Value
false
API Name
role_config_suppression_role_triggers
Required
true

Suppress Parameter Validation: Stacks Collection Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Stacks Collection Directory parameter.
Related Name
Default Value
false
API Name
role_config_suppression_stacks_collection_directory
Required
true

Suppress Health Test: Audit Pipeline Test

Description
Whether to suppress the results of the Audit Pipeline Test heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hivemetastore_audit_health
Required
true

Suppress Health Test: Hive Metastore Canary

Description
Whether to suppress the results of the Hive Metastore Canary heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hivemetastore_canary_health
Required
true

Suppress Health Test: File Descriptors

Description
Whether to suppress the results of the File Descriptors heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hivemetastore_file_descriptor
Required
true

Suppress Health Test: Heap Dump Directory Free Space

Description
Whether to suppress the results of the Heap Dump Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hivemetastore_heap_dump_directory_free_space
Required
true

Suppress Health Test: Host Health

Description
Whether to suppress the results of the Host Health heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hivemetastore_host_health
Required
true

Suppress Health Test: Log Directory Free Space

Description
Whether to suppress the results of the Log Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hivemetastore_log_directory_free_space
Required
true

Suppress Health Test: Pause Duration

Description
Whether to suppress the results of the Pause Duration heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hivemetastore_pause_duration
Required
true

Suppress Health Test: Process Status

Description
Whether to suppress the results of the Process Status heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hivemetastore_scm_health
Required
true

Suppress Health Test: Swap Memory Usage

Description
Whether to suppress the results of the Swap Memory Usage heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hivemetastore_swap_memory_usage
Required
true

Suppress Health Test: Unexpected Exits

Description
Whether to suppress the results of the Unexpected Exits heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hivemetastore_unexpected_exits
Required
true

HiveServer2

Advanced

HiveServer2 Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
For advanced use only. A string to be inserted into hive-site.xml for this role only.
Related Name
Default Value
API Name
hive_hs2_config_safety_valve
Required
false

HiveServer2 Environment Advanced Configuration Snippet (Safety Valve)

Description
For advanced use only, key-value pairs (one on each line) to be inserted into a role's environment. Applies to configurations of this role except client configuration.
Related Name
Default Value
API Name
hive_hs2_env_safety_valve
Required
false

Hive Metastore Connection Retries Count

Description
Number of retries while opening a connection to the Hive Metastore Server
Related Name
hive.metastore.connect.retries
Default Value
10
API Name
hive_metastore_connection_retries
Required
false

Enable Metrics Subsystem

Description
Controls whether the Hive metrics subsystem is enabled for the role.
Related Name
hive.server2.metrics.enabled
Default Value
true
API Name
hive_metrics_enabled
Required
false

Metrics Sample File Location

Description
The full path to a file with a sample of metrics exposed by the role. The sample is updated at the frequency configured by Metrics Sample File Logging Frequency. By default, the sample file is logged to a directory under the role log directory, e.g., /var/log/hive/metrics-hivemetastore/metrics.log. The setting only has an effect if "Enable Metrics Subsystem" is set to true.
Related Name
hive.service.metrics.file.location
Default Value
API Name
hive_metrics_sample_file_location
Required
false

Metrics Sample File Logging Frequency

Description
The frequency at which the metrics are logged to the sample file. The setting only has an effect if "Enable Metrics Subsystem" is set to true.
Related Name
hive.service.metrics.file.frequency
Default Value
30 second(s)
API Name
hive_metrics_sample_logging_frequency
Required
false

Hive Downloaded Resources Directory

Description
Local directory where Hive stores jars downloaded for remote file systems (HDFS). If not specified, Hive uses a default location.
Related Name
hive.downloaded.resources.dir
Default Value
API Name
hiveserver2_downloaded_resources_dir
Required
false

Enable Explain Logging

Description
When enabled, HiveServer2 logs EXPLAIN EXTENDED output for every query at INFO log4j level.
Related Name
hive.log.explain.output
Default Value
false
API Name
hiveserver2_enable_explain_output
Required
false

Hive Local Scratch Directory

Description
Local Directory where Hive stores jars and data when performing a MapJoin optimization. If not specified, Hive uses a default location.
Related Name
hive.exec.local.scratchdir
Default Value
API Name
hiveserver2_exec_local_scratchdir
Required
false

Hive HDFS Scratch Directory

Description
Directory in HDFS where Hive writes intermediate data between MapReduce jobs. If not specified, Hive uses a default location.
Related Name
hive.exec.scratchdir
Default Value
API Name
hiveserver2_exec_scratchdir
Required
false

Fair Scheduler XML Advanced Configuration Snippet (Safety Valve)

Description
An XML string that will be inserted verbatim into the Fair Scheduler allocations file. This configuration only has effect in CDH 5.8 or later.
Related Name
Default Value
API Name
hiveserver2_fair_scheduler_safety_valve
Required
false

Idle Operation Timeout

Description
Operation will be closed when not accessed for this duration of time, in milliseconds; disable by setting to zero. For a positive value, checked for operations in terminal state only (FINISHED, CANCELED, CLOSED, ERROR). For a negative value, checked for all of the operations regardless of state.
Related Name
hive.server2.idle.operation.timeout
Default Value
6 hour(s)
API Name
hiveserver2_idle_operation_timeout
Required
false

Idle Session Timeout

Description
Session will be closed when not accessed for this duration of time, in milliseconds; disable by setting to zero or a negative value.
Related Name
hive.server2.idle.session.timeout
Default Value
1 day(s)
API Name
hiveserver2_idle_session_timeout
Required
false

Exclude Live Operations From Session Idle Time

Description
Session will be considered to be idle only if there is no activity, and there is no pending operation. This setting takes effect only if session idle timeout (hive.server2.idle.session.timeout) and checking (hive.server2.session.check.interval) are enabled.
Related Name
hive.server2.idle.session.check.operation
Default Value
true
API Name
hiveserver2_idle_session_timeout_check_operation
Required
false

Java Configuration Options for HiveServer2

Description
These arguments will be passed as part of the Java command line. Commonly, garbage collection flags, PermGen, or extra debugging flags would be passed here. Note: When CM version is 6.3.0 or greater, {{JAVA_GC_ARGS}} will be replaced by JVM Garbage Collection arguments based on the runtime Java JVM version.
Related Name
Default Value
JAVA_GC_ARGS
API Name
hiveserver2_java_opts
Required
false

Maximum Query String Length for Show Locks

Description
The maximum length allowed for the query string when the SHOW LOCKS EXTENDED command is executed. Important: The query string is truncated at the length set for this property. Setting this property to a large value puts pressure on ZooKeeper and might cause out-of-memory issues.
Related Name
hive.lock.query.string.max.length
Default Value
10000
API Name
hiveserver2_lock_query_string_max_length
Required
false

Max HiveServer2 Threads

Description
Maximum number of worker threads in HiveServer2's thread pool
Related Name
hive.server2.thrift.max.worker.threads
Default Value
500
API Name
hiveserver2_max_threads
Required
true

Min HiveServer2 Threads

Description
Minimum number of worker threads in HiveServer2's thread pool
Related Name
hive.server2.thrift.min.worker.threads
Default Value
5
API Name
hiveserver2_min_threads
Required
true

Session Check Interval

Description
The check interval for session/operation timeout, in milliseconds, which can be disabled by setting to zero or a negative value.
Related Name
hive.server2.session.check.interval
Default Value
15 minute(s)
API Name
hiveserver2_session_check_interval
Required
false

HiveServer2 WebUI Max Threads

Description
The max threads for the HiveServer2 WebUI.
Related Name
hive.server2.webui.max.threads
Default Value
50
API Name
hiveserver2_webui_max_threads
Required
false

HiveServer2 Advanced Configuration Snippet (Safety Valve) for core-site.xml

Description
For advanced use only. A string to be inserted into core-site.xml for this role only.
Related Name
Default Value
API Name
hs2_core_site_safety_valve
Required
false

HiveServer2 Logging Advanced Configuration Snippet (Safety Valve)

Description
For advanced use only, a string to be inserted into log4j.properties for this role only.
Related Name
Default Value
API Name
log4j_safety_valve
Required
false

Heap Dump Directory

Description
Path to directory where heap dumps are generated when java.lang.OutOfMemoryError error is thrown. This directory is automatically created if it does not exist. If this directory already exists, role user must have write access to this directory. If this directory is shared among multiple roles, it should have 1777 permissions. The heap dump files are created with 600 permissions and are owned by the role user. The amount of free space in this directory should be greater than the maximum Java Process heap size configured for this role.
Related Name
oom_heap_dump_dir
Default Value
/tmp
API Name
oom_heap_dump_dir
Required
false

Dump Heap When Out of Memory

Description
When set, generates heap dump file when java.lang.OutOfMemoryError is thrown.
Related Name
Default Value
true
API Name
oom_heap_dump_enabled
Required
true

Kill When Out of Memory

Description
When set, a SIGKILL signal is sent to the role process when java.lang.OutOfMemoryError is thrown.
Related Name
Default Value
true
API Name
oom_sigkill_enabled
Required
true

Automatically Restart Process

Description
When set, this role's process is automatically (and transparently) restarted in the event of an unexpected failure. This configuration applies in the time after the Start Wait Timeout period.
Related Name
Default Value
false
API Name
process_auto_restart
Required
true

Enable Metric Collection

Description
Cloudera Manager agent monitors each service and each of its role by publishing metrics to the Cloudera Manager Service Monitor. Setting it to false will stop Cloudera Manager agent from publishing any metric for corresponding service/roles. This is usually helpful for services that generate large amount of metrics which Service Monitor is not able to process.
Related Name
Default Value
true
API Name
process_should_monitor
Required
true

Process Start Retry Attempts

Description
Number of times to try starting a role's process when the process exits before the Start Wait Timeout period. After a process is running beyond the Start Wait Timeout, the retry count is reset. Setting this configuration to zero will prevent restart of the process during the Start Wait Timeout period.
Related Name
Default Value
3
API Name
process_start_retries
Required
false

Process Start Wait Timeout

Description
The time in seconds to wait for a role's process to start successfully on a host. Processes which exit/crash before this time will be restarted until reaching the limit specified by the Start Retry Attempts count parameter. Setting this configuration to zero will turn off this feature.
Related Name
Default Value
20
API Name
process_start_secs
Required
false

Logs

HiveServer2 Log Directory

Description
Directory where HiveServer2 will place its log files.
Related Name
Default Value
/var/log/hive
API Name
hive_log_dir
Required
false

Enable HiveServer2 Operations Logging

Description
When enabled, HiveServer2 will temporarily save logs associated with ongoing operations. This enables clients like beeline and Hue to request and display logs for a particular ongoing operation. Logs are removed upon completion of operation.
Related Name
hive.server2.logging.operation.enabled
Default Value
true
API Name
hive_server2_logging_operation_enabled
Required
false

HiveServer2 Operations Log Directory

Description
Top level directory where operation logs are temporarily stored if Enable HiveServer2 Operations Logging is true. Logs are stored in session and operation level subdirectories under this location and are removed on completion of operation.
Related Name
hive.server2.logging.operation.log.location
Default Value
/var/log/hive/operation_logs
API Name
hive_server2_logging_operation_log_location
Required
false

HiveServer2 Logging Threshold

Description
The minimum log level for HiveServer2 logs
Related Name
Default Value
INFO
API Name
log_threshold
Required
false

HiveServer2 Maximum Log File Backups

Description
The maximum number of rolled log files to keep for HiveServer2 logs. Typically used by log4j or logback.
Related Name
Default Value
10
API Name
max_log_backup_index
Required
false

HiveServer2 Max Log Size

Description
The maximum size, in megabytes, per log file for HiveServer2 logs. Typically used by log4j or logback.
Related Name
Default Value
200 MiB
API Name
max_log_size
Required
false

Monitoring

Enable Health Alerts for this Role

Description
When set, Cloudera Manager will send alerts when the health of this role reaches the threshold specified by the EventServer setting eventserver_health_events_alert_threshold
Related Name
Default Value
true
API Name
enable_alerts
Required
false

Enable Configuration Change Alerts

Description
When set, Cloudera Manager will send alerts when this entity's configuration changes.
Related Name
Default Value
false
API Name
enable_config_alerts
Required
false

Heap Dump Directory Free Space Monitoring Absolute Thresholds

Description
The health test thresholds for monitoring of free space on the filesystem that contains this role's heap dump directory.
Related Name
Default Value
Warning: 10 GiB, Critical: 5 GiB
API Name
heap_dump_directory_free_space_absolute_thresholds
Required
false

Heap Dump Directory Free Space Monitoring Percentage Thresholds

Description
The health test thresholds for monitoring of free space on the filesystem that contains this role's heap dump directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Heap Dump Directory Free Space Monitoring Absolute Thresholds setting is configured.
Related Name
Default Value
Warning: Never, Critical: Never
API Name
heap_dump_directory_free_space_percentage_thresholds
Required
false

Hive Downloaded Resources Directory Free Space Monitoring Absolute Thresholds

Description
The health test thresholds for monitoring of free space on the filesystem that contains this role's Hive Downloaded Resources Directory.
Related Name
Default Value
Warning: 10 GiB, Critical: 5 GiB
API Name
hiveserver2_downloaded_resources_directory_free_space_absolute_thresholds
Required
false

Hive Downloaded Resources Directory Free Space Monitoring Percentage Thresholds

Description
The health test thresholds for monitoring of free space on the filesystem that contains this role's Hive Downloaded Resources Directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Hive Downloaded Resources Directory Free Space Monitoring Absolute Thresholds setting is configured.
Related Name
Default Value
Warning: Never, Critical: Never
API Name
hiveserver2_downloaded_resources_directory_free_space_percentage_thresholds
Required
false

Hive Local Scratch Directory Free Space Monitoring Absolute Thresholds

Description
The health test thresholds for monitoring of free space on the filesystem that contains this role's Hive Local Scratch Directory.
Related Name
Default Value
Warning: 10 GiB, Critical: 5 GiB
API Name
hiveserver2_exec_local_scratch_directory_free_space_absolute_thresholds
Required
false

Hive Local Scratch Directory Free Space Monitoring Percentage Thresholds

Description
The health test thresholds for monitoring of free space on the filesystem that contains this role's Hive Local Scratch Directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Hive Local Scratch Directory Free Space Monitoring Absolute Thresholds setting is configured.
Related Name
Default Value
Warning: Never, Critical: Never
API Name
hiveserver2_exec_local_scratch_directory_free_space_percentage_thresholds
Required
false

File Descriptor Monitoring Thresholds

Description
The health test thresholds of the number of file descriptors used. Specified as a percentage of file descriptor limit.
Related Name
Default Value
Warning: 50.0 %, Critical: 70.0 %
API Name
hiveserver2_fd_thresholds
Required
false

HiveServer2 Host Health Test

Description
When computing the overall HiveServer2 health, consider the host's health.
Related Name
Default Value
true
API Name
hiveserver2_host_health_enabled
Required
false

Pause Duration Thresholds

Description
The health test thresholds for the weighted average extra time the pause monitor spent paused. Specified as a percentage of elapsed wall clock time.
Related Name
Default Value
Warning: 30.0, Critical: 60.0
API Name
hiveserver2_pause_duration_thresholds
Required
false

Pause Duration Monitoring Period

Description
The period to review when computing the moving average of extra time the pause monitor spent paused.
Related Name
Default Value
5 minute(s)
API Name
hiveserver2_pause_duration_window
Required
false

HiveServer2 Process Health Test

Description
Enables the health test that the HiveServer2's process state is consistent with the role configuration
Related Name
Default Value
true
API Name
hiveserver2_scm_health_enabled
Required
false

Log Directory Free Space Monitoring Absolute Thresholds

Description
The health test thresholds for monitoring of free space on the filesystem that contains this role's log directory.
Related Name
Default Value
Warning: 10 GiB, Critical: 5 GiB
API Name
log_directory_free_space_absolute_thresholds
Required
false

Log Directory Free Space Monitoring Percentage Thresholds

Description
The health test thresholds for monitoring of free space on the filesystem that contains this role's log directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Log Directory Free Space Monitoring Absolute Thresholds setting is configured.
Related Name
Default Value
Warning: Never, Critical: Never
API Name
log_directory_free_space_percentage_thresholds
Required
false

Navigator Audit Failure Thresholds

Description
The health test thresholds for failures encountered when monitoring audits within a recent period specified by the mgmt_navigator_failure_window configuration for the role. The value that can be specified for this threshold is the number of bytes of audits data that is left to be sent to audit server.
Related Name
mgmt.navigator.failure.thresholds
Default Value
Warning: Never, Critical: Any
API Name
mgmt_navigator_failure_thresholds
Required
false

Monitoring Period For Audit Failures

Description
The period to review when checking if audits are blocked and not getting processed.
Related Name
mgmt.navigator.failure.window
Default Value
20 minute(s)
API Name
mgmt_navigator_failure_window
Required
false

Navigator Audit Pipeline Health Check

Description
Enable test of audit events processing pipeline. This will test if audit events are not getting processed by Audit Server for a role that generates audit.
Related Name
mgmt.navigator.status.check.enabled
Default Value
true
API Name
mgmt_navigator_status_check_enabled
Required
false

Metric Filter

Description
Defines a Metric Filter for this role. Cloudera Manager Agents will not send filtered metrics to the Service Monitor. Define the following fields:
  • Health Test Metric Set - Select this parameter to collect only metrics required for health tests.
  • Default Dashboard Metric Set - Select this parameter to collect only metrics required for the default dashboards. For user-defined charts, you must add the metrics you require for the chart using the Custom Metrics parameter.
  • Include/Exclude Custom Metrics - Select Include to specify metrics that should be collected. Select Exclude to specify metrics that should not be collected. Enter the metric names to be included or excluded using the Metric Name parameter.
  • Metric Name - The name of a metric that will be included or excluded during metric collection.
If you do not select Health Test Metric Set or Default Dashboard Metric Set, or specify metrics by name, metric filtering will be turned off (this is the default behavior).For example, the following configuration enables the collection of metrics required for Health Tests and the jvm_heap_used_mb metric:
  • Include only Health Test Metric Set: Selected.
  • Include/Exclude Custom Metrics: Set to Include.
  • Metric Name: jvm_heap_used_mb
You can also view the JSON representation for this parameter by clicking View as JSON. In this example, the JSON looks like this:{ "includeHealthTestMetricSet": true, "filterType": "whitelist", "metrics": ["jvm_heap_used_mb"] }
Related Name
Default Value
API Name
monitoring_metric_filter
Required
false

Process Swap Memory Thresholds

Description
The health test thresholds on the swap memory usage of the process. This takes precedence over the host level threshold.
Related Name
Default Value
Warning: 200 B, Critical: Never
API Name
process_swap_memory_thresholds
Required
false

Role Triggers

Description
The configured triggers for this role. This is a JSON-formatted list of triggers. These triggers are evaluated as part as the health system. Every trigger expression is parsed, and if the trigger condition is met, the list of actions provided in the trigger expression is executed. Each trigger has the following fields:
  • triggerName (mandatory) - The name of the trigger. This value must be unique for the specific role.
  • triggerExpression (mandatory) - A tsquery expression representing the trigger.
  • streamThreshold (optional) - The maximum number of streams that can satisfy a condition of a trigger before the condition fires. By default set to 0, and any stream returned causes the condition to fire.
  • enabled (optional) - By default set to 'true'. If set to 'false', the trigger is not evaluated.
  • expressionEditorConfig (optional) - Metadata for the trigger editor. If present, the trigger should only be edited from the Edit Trigger page; editing the trigger here can lead to inconsistencies.
For example, the following JSON formatted trigger configured for a DataNode fires if the DataNode has more than 1500 file descriptors opened:[{"triggerName": "sample-trigger", "triggerExpression": "IF (SELECT fd_open WHERE roleName=$ROLENAME and last(fd_open) > 1500) DO health:bad", "streamThreshold": 0, "enabled": "true"}]See the trigger rules documentation for more details on how to write triggers using tsquery.The JSON format is evolving and may change and, as a result, backward compatibility is not guaranteed between releases.
Related Name
Default Value
[]
API Name
role_triggers
Required
true

Unexpected Exits Thresholds

Description
The health test thresholds for unexpected exits encountered within a recent period specified by the unexpected_exits_window configuration for the role.
Related Name
Default Value
Warning: Never, Critical: Any
API Name
unexpected_exits_thresholds
Required
false

Unexpected Exits Monitoring Period

Description
The period to review when computing unexpected exits.
Related Name
Default Value
5 minute(s)
API Name
unexpected_exits_window
Required
false

Other

Restrict Cross Joins (Cartesian Products)

Description
Whether to allow queries with cross joins. If set to true, queries that contain this pattern throw a compile-time error.
Related Name
hive.strict.checks.cartesian.product
Default Value
false
API Name
hive_restrict_cross_joins
Required
false

Restrict LOAD Queries Against Bucketed Tables

Description
Whether to allow LOAD queries against bucketed tables. If set to true, queries that contain this pattern throw a compile-time error.
Related Name
hive.strict.checks.bucketing
Default Value
true
API Name
hive_restrict_load_bucketed_table
Required
false

Restrict Queries with ORDER BY but no LIMIT clause

Description
Whether to allow queries with an ORDER BY clause, but no LIMIT clause. If set to true, queries that contain this pattern throw a compile-time error.
Related Name
hive.strict.checks.orderby.no.limit
Default Value
false
API Name
hive_restrict_orderby_with_no_limit
Required
false

Restrict Partitioned Table Scans with no Partitioned Column Filter

Description
Whether to allow queries that scan a partitioned table but don't filter on the partition column. If set to true, queries that contain this pattern throw a compile-time error.
Related Name
hive.strict.checks.no.partition.filter
Default Value
false
API Name
hive_restrict_partitioned_scans_no_filter
Required
false

Restrict Unsafe Data Type Comparisons

Description
Whether to allow queries that compare bigints to strings or doubles. If set to true, queries that contain this pattern throw a compile-time error.
Related Name
hive.strict.checks.type.safety
Default Value
true
API Name
hive_restrict_unsafe_comparison
Required
false

HiveServer2 Enable Impersonation

Description
HiveServer2 will impersonate the beeline client user when talking to other services such as MapReduce and HDFS.
Related Name
hive.server2.enable.doAs
Default Value
true
API Name
hiveserver2_enable_impersonation
Required
false

HiveServer2 Load Balancer

Description
Address of the load balancer used for HiveServer2 roles, specified in host:port format. If port is not specified, the port used by HiveServer2 is used. Note: Changing this property regenerates Kerberos keytabs for all HiveServer2 roles.
Related Name
Default Value
API Name
hiveserver2_load_balancer
Required
false

Performance

Hive Auto Convert Join Noconditional Size

Description
If Hive auto convert join is on, and the sum of the size for n-1 of the tables/partitions for a n-way join is smaller than the specified size, the join is directly converted to a MapJoin (there is no conditional task).
Related Name
hive.auto.convert.join.noconditionaltask.size
Default Value
50 MiB
API Name
hiveserver2_auto_convert_join_noconditionaltask_size
Required
false

Store Intermediate Data on Blobstore

Description
When writing data to a table on a blobstore (such as S3), whether or not the blobstore should be used to store intermediate data during Hive query execution. Setting this to true can degrade performance for queries that spawn multiple MR / Spark jobs, but is useful for queries whose intermediate data cannot fit in the allocated HDFS cluster.
Related Name
hive.blobstore.use.blobstore.as.scratchdir
Default Value
false
API Name
hiveserver2_blobstore_use_blobstore_as_scratchdir
Required
false

Enable Stats Optimization

Description
Enable optimization that checks if a query can be answered using statistics. If so, answers the query using only statistics stored in metastore.
Related Name
hive.compute.query.using.stats
Default Value
true
API Name
hiveserver2_compute_query_using_stats
Required
false

Enable Cost-Based Optimizer for Hive

Description
Enabled the Calcite-based Cost-Based Optimizer for HiveServer2.
Related Name
hive.cbo.enable
Default Value
true
API Name
hiveserver2_enable_cbo
Required
false

Enable MapJoin Optimization

Description
Enable optimization that converts common join into MapJoin based on input file size.
Related Name
hive.auto.convert.join
Default Value
true
API Name
hiveserver2_enable_mapjoin
Required
false

Fetch Task Query Conversion

Description
Some select queries can be converted to a single FETCH task instead of a MapReduce task, minimizing latency. A value of none disables all conversion, minimal converts simple queries such as SELECT * and filter on partition columns, and more converts SELECT queries including FILTERS.
Related Name
hive.fetch.task.conversion
Default Value
more
API Name
hiveserver2_fetch_task_conversion
Required
false

Fetch Task Query Conversion Threshold

Description
Above this size, queries are converted to fetch tasks.
Related Name
hive.fetch.task.conversion.threshold
Default Value
1 GiB
API Name
hiveserver2_fetch_task_conversion_threshold
Required
false

Input Listing Max Threads

Description
Maximum number of threads that Hive uses to list input files. Increasing this value can improve performance when there are a lot of partitions being read, or when running on blobstores.
Related Name
hive.exec.input.listing.max.threads
Default Value
15
API Name
hiveserver2_input_listing_max_threads
Required
false

Maximum ReduceSink Top-K Memory Usage

Description
The maximum percentage of heap to be used for hash in ReduceSink operator for Top-K selection. 0 means the optimization is disabled. Accepted values are between 0 and 1.
Related Name
hive.limit.pushdown.memory.usage
Default Value
0.04
API Name
hiveserver2_limit_pushdown_memory_usage
Required
false

Load Dynamic Partitions Thread Count

Description
Number of threads used to load dynamically generated partitions. Loading requires renaming the file its final location, and updating some metadata about the new partition. Increasing this can improve performance when there are a lot of partitions dynamically generated.
Related Name
hive.load.dynamic.partitions.thread
Default Value
15
API Name
hiveserver2_load_dynamic_partitions_thread_count
Required
false

Enable Map-Side Aggregation

Description
Enable map-side partial aggregation, which cause the mapper to generate fewer rows. This reduces the data to be sorted and distributed to reducers.
Related Name
hive.map.aggr
Default Value
true
API Name
hiveserver2_map_aggr
Required
false

Ratio of Memory Usage for Map-Side Aggregation

Description
Portion of total memory used in map-side partial aggregation. When exceeded, the partially aggregated results will be flushed from the map task to the reducers.
Related Name
hive.map.aggr.hash.percentmemory
Default Value
0.5
API Name
hiveserver2_map_aggr_hash_memory_ratio
Required
false

Enable Merging Small Files - Map-Only Job

Description
Merge small files at the end of a map-only job. When enabled, a map-only job is created to merge the files in the destination table/partitions.
Related Name
hive.merge.mapfiles
Default Value
true
API Name
hiveserver2_merge_mapfiles
Required
false

Enable Merging Small Files - Map-Reduce Job

Description
Merge small files at the end of a map-reduce job. When enabled, a map-only job is created to merge the files in the destination table/partitions.
Related Name
hive.merge.mapredfiles
Default Value
false
API Name
hiveserver2_merge_mapredfiles
Required
false

Desired File Size After Merging

Description
The desired file size after merging. This should be larger than hive.merge.smallfiles.avgsize.
Related Name
hive.merge.size.per.task
Default Value
256 MiB
API Name
hiveserver2_merge_size_per_task
Required
false

Small File Average Size Merge Threshold

Description
When the average output file size of a job is less than the value of this property, Hive will start an additional map-only job to merge the output files into bigger files. This is only done for map-only jobs if hive.merge.mapfiles is true, for map-reduce jobs if hive.merge.mapredfiles is true, and for Spark jobs if hive.merge.sparkfiles is true.
Related Name
hive.merge.smallfiles.avgsize
Default Value
16 MiB
API Name
hiveserver2_merge_smallfiles_avgsize
Required
false

MSCK Repair Batch Size

Description
Batch size for the msck repair command (recover partitions command). If the value is greater than zero, new partition information will be sent from HiveServer2 to the Metastore in batches, which can potentially improve memory usage in the Metastore and avoid client read timeout exceptions. If this value is 0, all partition information will sent in a single Thrift call.
Related Name
hive.msck.repair.batch.size
Default Value
0
API Name
hiveserver2_msck_repair_batch_size
Required
false

Move Files Thread Count

Description
The number of threads used by HiveServer2 to move data from the staging directory to another location (typically to the final table location). A separate thread pool of workers of this size is used for each query, which means this configuration can be set on a per-query basis too.
Related Name
hive.mv.files.thread
Default Value
15
API Name
hiveserver2_mv_files_thread
Required
false

Hive Optimize Sorted Merge Bucket Join

Description
Whether to try sorted merge bucket (SMB) join.
Related Name
hive.optimize.bucketmapjoin.sortedmerge
Default Value
true
API Name
hiveserver2_optimize_bucketmapjoin_sortedmerge
Required
false

Enable Automatic Use of Indexes

Description
Whether to use the indexing optimization for all queries.
Related Name
hive.optimize.index.filter
Default Value
true
API Name
hiveserver2_optimize_index_filter
Required
false

Enable ReduceDeDuplication Optimization

Description
Remove extra map-reduce jobs if the data is already clustered by the same key, eliminating the need to repartition the dataset again.
Related Name
hive.optimize.reducededuplication
Default Value
true
API Name
hiveserver2_optimize_reducededuplication
Required
false

Mininum Reducers for ReduceDeDuplication Optimization

Description
When the number of ReduceSink operators after merging is less than this number, the ReduceDeDuplication optimization will be disabled.
Related Name
hive.optimize.reducededuplication.min.reducer
Default Value
4
API Name
hiveserver2_optimize_reducededuplication_min_reducer
Required
false

Enable Sorted Dynamic Partition Optimizer

Description
When dynamic partition is enabled, reducers keep only one record writer at all times, which lowers the memory pressure on reducers.
Related Name
hive.optimize.sort.dynamic.partition
Default Value
false
API Name
hiveserver2_optimize_sort_dynamic_partition
Required
false

Enable Parallel Compilation of Queries

Description
When activated, individual sessions can compile queries simultaneously. Within each session, queries compile one at a time.
Related Name
hive.driver.parallel.compilation
Default Value
true
API Name
hiveserver2_parallel_compilation_enabled
Required
false

Query Compilation Degree of Parallelism

Description
Determines the maximum number of queries that can compile in parallel on a HiveServer2 instance. Use negative values or zero to set unlimited parallelism. Use a positive value to set the number of queries that can compile simultaneously. This setting can be fine-tuned based on the current cluster load. Monitor cluster load using the 'waiting_compile_ops' metric and the 'Waiting Compile Operations' graph in the HiveServer2 graph library.
Related Name
hive.driver.parallel.compilation.global.limit
Default Value
3
API Name
hiveserver2_parallel_compilation_global_limit
Required
false

Hive SMB Join Cache Rows

Description
The number of rows with the same key value to be cached in memory per SMB-joined table.
Related Name
hive.smbjoin.cache.rows
Default Value
10000
API Name
hiveserver2_smbjoin_cache_rows
Required
false

Load Column Statistics

Description
Whether column stats for a table are fetched during explain.
Related Name
hive.stats.fetch.column.stats
Default Value
true
API Name
hiveserver2_stats_fetch_column_stats
Required
false

Vectorized Adapter Usage Mode

Description
Vectorized Adaptor Usage Mode specifies the extent to which the vectorization engine tries to vectorize UDFs that do not have native vectorized versions available. Selecting the "none" option specifies that only queries using native vectorized UDFs are vectorized. Selecting the "chosen" option specifies that Hive choses to vectorize a subset of the UDFs based on performance benefits using the Vectorized Adaptor. Selecting the "all" option specifies that the Vectorized Adaptor be used for all UDFs even when native vectorized versions are not available.
Related Name
hive.vectorized.adaptor.usage.mode
Default Value
chosen
API Name
hiveserver2_vectorized_adaptor_usage_mode
Required
false

Enable Vectorization Optimization

Description
Enable optimization that vectorizes query execution by streamlining operations by processing a block of 1024 rows at a time.
Related Name
hive.vectorized.execution.enabled
Default Value
true
API Name
hiveserver2_vectorized_enabled
Required
false

Vectorized GroupBy Check Interval

Description
In vectorized group-by, the number of row entries added to the hash table before re-checking average variable size for memory usage estimation.
Related Name
hive.vectorized.groupby.checkinterval
Default Value
4096
API Name
hiveserver2_vectorized_groupby_checkinterval
Required
false

Vectorized GroupBy Flush Ratio

Description
Ratio between 0.0 and 1.0 of entries in the vectorized group-by aggregation hash that is flushed when the memory threshold is exceeded.
Related Name
hive.vectorized.groupby.flush.percent
Default Value
0.1
API Name
hiveserver2_vectorized_groupby_flush_ratio
Required
false

Enable Vectorized Input Format

Description
If enabled, Hive uses the native vectorized input format for vectorized query execution when it is available.
Related Name
hive.vectorized.use.vectorized.input.format
Default Value
true
API Name
hiveserver2_vectorized_input_format_enabled
Required
false

Exclude Vectorized Input Formats

Description
Specifies a list of file input format classnames to exclude from vectorized query execution using the vectorized input format. Note that vectorized execution can still occur for an excluded input format based on whether row SerDes or vector SerDes are enabled.
Related Name
hive.vectorized.input.format.excludes
Default Value
API Name
hiveserver2_vectorized_input_format_excludes
Required
false

Enable Reduce-Side Vectorization

Description
Whether to vectorize the reduce side of query execution.
Related Name
hive.vectorized.execution.reduce.enabled
Default Value
true
API Name
hiveserver2_vectorized_reduce_enabled
Required
false

Enable Overflow-checked Vector Expressions

Description
To enhance performance, vectorized expressions operate using wide data types like long and double. When wide data types are used, numeric overflows can occur during expression evaluation in a different manner for vectorized expressions than they do for non-vectorized expressions. Consequently, different query results can be returned for vectorized expressions compared to results returned for non-vectorized expressions. When this configuration is enabled, Hive uses vectorized expressions that handle numeric overflows in the same way as non-vectorized expressions are handled.
Related Name
hive.vectorized.use.checked.expressions
Default Value
true
API Name
hiveserver2_vectorized_use_checked_expressions
Required
false

Vectorize Using Vector SerDes

Description
If enabled, Hive uses built-in vector SerDes to process text and sequencefile tables for vectorized query execution.
Related Name
hive.vectorized.use.vector.serde.deserialize
Default Value
false
API Name
hiveserver2_vectorized_use_vector_serde_deserialize
Required
false

Maximum Process File Descriptors

Description
If configured, overrides the process soft and hard rlimits (also called ulimits) for file descriptors to the configured value.
Related Name
Default Value
API Name
rlimit_fds
Required
false

Ports and Addresses

Bind HiveServer2 to Wildcard Address

Description
If enabled, the HiveServer2 binds to the wildcard address ("0.0.0.0") on all of its ports.
Related Name
hive.server2.webui.host
Default Value
true
API Name
hiveserver2_webui_bind_wildcard
Required
false

HiveServer2 WebUI Port

Description
The port the HiveServer2 WebUI will listen on. This can be set to 0 to disable the WebUI.
Related Name
hive.server2.webui.port
Default Value
10002
API Name
hiveserver2_webui_port
Required
false

HiveServer2 Port

Description
Port on which HiveServer2 will listen for connections.
Related Name
hive.server2.thrift.port
Default Value
10000
API Name
hs2_thrift_address_port
Required
false

Resource Management

Java Heap Size of HiveServer2 in Bytes

Description
Maximum size in bytes for the Java Process heap memory. Passed to Java -Xmx.
Related Name
Default Value
4 GiB
API Name
hiveserver2_java_heapsize
Required
false

Cgroup CPU Shares

Description
Number of CPU shares to assign to this role. The greater the number of shares, the larger the share of the host's CPUs that will be given to this role when the host experiences CPU contention. Must be between 2 and 262144. Defaults to 1024 for processes not managed by Cloudera Manager.
Related Name
cpu.shares
Default Value
1024
API Name
rm_cpu_shares
Required
true

Custom Control Group Resources (overrides Cgroup settings)

Description
Custom control group resources to assign to this role, which will be enforced by the Linux kernel. These resources should exist on the target hosts, otherwise an error will occur when the process starts. Use the same format as used for arguments to the cgexec command: resource1,resource2:path1 or resource3:path2 For example: 'cpu,memory:my/path blkio:my2/path2' ***These settings override other cgroup settings.***
Related Name
custom.cgroups
Default Value
API Name
rm_custom_resources
Required
false

Cgroup I/O Weight

Description
Weight for the read I/O requests issued by this role. The greater the weight, the higher the priority of the requests when the host experiences I/O contention. Must be between 100 and 1000. Defaults to 1000 for processes not managed by Cloudera Manager.
Related Name
blkio.weight
Default Value
500
API Name
rm_io_weight
Required
true

Cgroup Memory Hard Limit

Description
Hard memory limit to assign to this role, enforced by the Linux kernel. When the limit is reached, the kernel will reclaim pages charged to the process. If reclaiming fails, the kernel may kill the process. Both anonymous as well as page cache pages contribute to the limit. Use a value of -1 to specify no limit. By default processes not managed by Cloudera Manager will have no limit. If the value is -1, Cloudera Manager will not monitor Cgroup memory usage therefore some of the charts will show 'No Data'
Related Name
memory.limit_in_bytes
Default Value
-1 MiB
API Name
rm_memory_hard_limit
Required
true

Cgroup Memory Soft Limit

Description
Soft memory limit to assign to this role, enforced by the Linux kernel. When the limit is reached, the kernel will reclaim pages charged to the process if and only if the host is facing memory pressure. If reclaiming fails, the kernel may kill the process. Both anonymous as well as page cache pages contribute to the limit. Use a value of -1 to specify no limit. By default processes not managed by Cloudera Manager will have no limit. If the value is -1, Cloudera Manager will not monitor Cgroup memory usage therefore some of the charts will show 'No Data'
Related Name
memory.soft_limit_in_bytes
Default Value
-1 MiB
API Name
rm_memory_soft_limit
Required
true

Security

Enable TLS/SSL for HiveServer2 WebUI

Description
Encrypt communication between clients and HiveServer2 WebUI using Transport Layer Security (TLS) (formerly known as Secure Socket Layer (SSL)).
Related Name
hive.server2.webui.use.ssl
Default Value
false
API Name
ssl_enabled
Required
false

HiveServer2 WebUI TLS/SSL Server JKS Keystore File Location

Description
The path to the TLS/SSL keystore file containing the server certificate and private key used for TLS/SSL. Used when HiveServer2 WebUI is acting as a TLS/SSL server. The keystore must be in JKS format.
Related Name
hive.server2.webui.keystore.path
Default Value
API Name
ssl_server_keystore_location
Required
false

HiveServer2 WebUI TLS/SSL Server JKS Keystore File Password

Description
The password for the HiveServer2 WebUI JKS keystore file.
Related Name
hive.server2.webui.keystore.password
Default Value
API Name
ssl_server_keystore_password
Required
false

Stacks Collection

Stacks Collection Data Retention

Description
The amount of stacks data that is retained. After the retention limit is reached, the oldest data is deleted.
Related Name
stacks_collection_data_retention
Default Value
100 MiB
API Name
stacks_collection_data_retention
Required
false

Stacks Collection Directory

Description
The directory in which stacks logs are placed. If not set, stacks are logged into a stacks subdirectory of the role's log directory.
Related Name
stacks_collection_directory
Default Value
API Name
stacks_collection_directory
Required
false

Stacks Collection Enabled

Description
Whether or not periodic stacks collection is enabled.
Related Name
stacks_collection_enabled
Default Value
false
API Name
stacks_collection_enabled
Required
true

Stacks Collection Frequency

Description
The frequency with which stacks are collected.
Related Name
stacks_collection_frequency
Default Value
5.0 second(s)
API Name
stacks_collection_frequency
Required
false

Stacks Collection Method

Description
The method used to collect stacks. The jstack option involves periodically running the jstack command against the role's daemon process. The servlet method is available for those roles that have an HTTP server endpoint exposing the current stacks traces of all threads. When the servlet method is selected, that HTTP endpoint is periodically scraped.
Related Name
stacks_collection_method
Default Value
jstack
API Name
stacks_collection_method
Required
false

Suppressions

Suppress Configuration Validator: CDH Version Validator

Description
Whether to suppress configuration warnings produced by the CDH Version Validator configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_cdh_version_validator
Required
true

Suppress Parameter Validation: HiveServer2 Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 Advanced Configuration Snippet (Safety Valve) for hive-site.xml parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_hs2_config_safety_valve
Required
true

Suppress Parameter Validation: HiveServer2 Environment Advanced Configuration Snippet (Safety Valve)

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 Environment Advanced Configuration Snippet (Safety Valve) parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_hs2_env_safety_valve
Required
true

Suppress Parameter Validation: HiveServer2 Log Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 Log Directory parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_log_dir
Required
true

Suppress Parameter Validation: Metrics Sample File Location

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Metrics Sample File Location parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_metrics_sample_file_location
Required
true

Suppress Configuration Validator: Restrict Load Bucketed Table Validator

Description
Whether to suppress configuration warnings produced by the Restrict Load Bucketed Table Validator configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_restrict_load_bucketed_table_validator
Required
true

Suppress Configuration Validator: Restrict Unsafe Comparison Validator

Description
Whether to suppress configuration warnings produced by the Restrict Unsafe Comparison Validator configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_restrict_unsafe_comparison_validator
Required
true

Suppress Parameter Validation: HiveServer2 Operations Log Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 Operations Log Directory parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_server2_logging_operation_log_location
Required
true

Suppress Parameter Validation: Hive Downloaded Resources Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Downloaded Resources Directory parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_downloaded_resources_dir
Required
true

Suppress Parameter Validation: Hive Local Scratch Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Local Scratch Directory parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_exec_local_scratchdir
Required
true

Suppress Parameter Validation: Hive HDFS Scratch Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive HDFS Scratch Directory parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_exec_scratchdir
Required
true

Suppress Parameter Validation: Fair Scheduler XML Advanced Configuration Snippet (Safety Valve)

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Fair Scheduler XML Advanced Configuration Snippet (Safety Valve) parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_fair_scheduler_safety_valve
Required
true

Suppress Parameter Validation: Java Configuration Options for HiveServer2

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Java Configuration Options for HiveServer2 parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_java_opts
Required
true

Suppress Parameter Validation: HiveServer2 Load Balancer

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 Load Balancer parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_load_balancer
Required
true

Suppress Parameter Validation: Exclude Vectorized Input Formats

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Exclude Vectorized Input Formats parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_vectorized_input_format_excludes
Required
true

Suppress Parameter Validation: HiveServer2 WebUI Port

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 WebUI Port parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_webui_port
Required
true

Suppress Parameter Validation: HiveServer2 Advanced Configuration Snippet (Safety Valve) for core-site.xml

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 Advanced Configuration Snippet (Safety Valve) for core-site.xml parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hs2_core_site_safety_valve
Required
true

Suppress Parameter Validation: HiveServer2 Port

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 Port parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hs2_thrift_address_port
Required
true

Suppress Parameter Validation: HiveServer2 Logging Advanced Configuration Snippet (Safety Valve)

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 Logging Advanced Configuration Snippet (Safety Valve) parameter.
Related Name
Default Value
false
API Name
role_config_suppression_log4j_safety_valve
Required
true

Suppress Parameter Validation: Heap Dump Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Heap Dump Directory parameter.
Related Name
Default Value
false
API Name
role_config_suppression_oom_heap_dump_dir
Required
true

Suppress Parameter Validation: Custom Control Group Resources (overrides Cgroup settings)

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Custom Control Group Resources (overrides Cgroup settings) parameter.
Related Name
Default Value
false
API Name
role_config_suppression_rm_custom_resources
Required
true

Suppress Parameter Validation: Role Triggers

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Role Triggers parameter.
Related Name
Default Value
false
API Name
role_config_suppression_role_triggers
Required
true

Suppress Parameter Validation: HiveServer2 WebUI TLS/SSL Server JKS Keystore File Location

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 WebUI TLS/SSL Server JKS Keystore File Location parameter.
Related Name
Default Value
false
API Name
role_config_suppression_ssl_server_keystore_location
Required
true

Suppress Parameter Validation: HiveServer2 WebUI TLS/SSL Server JKS Keystore File Password

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 WebUI TLS/SSL Server JKS Keystore File Password parameter.
Related Name
Default Value
false
API Name
role_config_suppression_ssl_server_keystore_password
Required
true

Suppress Parameter Validation: Stacks Collection Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Stacks Collection Directory parameter.
Related Name
Default Value
false
API Name
role_config_suppression_stacks_collection_directory
Required
true

Suppress Health Test: Audit Pipeline Test

Description
Whether to suppress the results of the Audit Pipeline Test heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hiveserver2_audit_health
Required
true

Suppress Health Test: Hive Downloaded Resources Directory Free Space

Description
Whether to suppress the results of the Hive Downloaded Resources Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hiveserver2_downloaded_resources_directory_free_space
Required
true

Suppress Health Test: Hive Local Scratch Directory Free Space

Description
Whether to suppress the results of the Hive Local Scratch Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hiveserver2_exec_local_scratch_directory_free_space
Required
true

Suppress Health Test: File Descriptors

Description
Whether to suppress the results of the File Descriptors heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hiveserver2_file_descriptor
Required
true

Suppress Health Test: Heap Dump Directory Free Space

Description
Whether to suppress the results of the Heap Dump Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hiveserver2_heap_dump_directory_free_space
Required
true

Suppress Health Test: Host Health

Description
Whether to suppress the results of the Host Health heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hiveserver2_host_health
Required
true

Suppress Health Test: Log Directory Free Space

Description
Whether to suppress the results of the Log Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hiveserver2_log_directory_free_space
Required
true

Suppress Health Test: Pause Duration

Description
Whether to suppress the results of the Pause Duration heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hiveserver2_pause_duration
Required
true

Suppress Health Test: Process Status

Description
Whether to suppress the results of the Process Status heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hiveserver2_scm_health
Required
true

Suppress Health Test: Swap Memory Usage

Description
Whether to suppress the results of the Swap Memory Usage heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hiveserver2_swap_memory_usage
Required
true

Suppress Health Test: Unexpected Exits

Description
Whether to suppress the results of the Unexpected Exits heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_hiveserver2_unexpected_exits
Required
true

Service-Wide

Advanced

Hive Service Advanced Configuration Snippet (Safety Valve) for atlas-application.properties

Description
For advanced use only, a string to be inserted into atlas-application.properties. Applies to configurations of all roles in this service except client configuration.
Related Name
Default Value
API Name
application_properties_safety_valve
Required
false

Hive Auxiliary JARs Directory

Description
Directory containing auxiliary JARs used by Hive. This should be a directory location and not a classpath containing one or more JARs. This directory must be created and managed manually on hosts that run the Hive Metastore Server, HiveServer2, or the Hive CLI. The directory location is set in the environment as HIVE_AUX_JARS_PATH and will generally override the hive.aux.jars.path property set in XML files, even if hive.aux.jars.path is set in an advanced configuration snippet.
Related Name
Default Value
API Name
hive_aux_jars_path_dir
Required
false

Bypass Hive Metastore Server

Description
Instead of talking to Hive Metastore Server for Metastore information, Hive clients will talk directly to the Metastore database.
Related Name
Default Value
false
API Name
hive_bypass_metastore_server
Required
false

Hive Service Advanced Configuration Snippet (Safety Valve) for core-site.xml

Description
For advanced use only, a string to be inserted into core-site.xml. Applies to configurations of all roles in this service except client configuration.
Related Name
Default Value
API Name
hive_core_site_safety_valve
Required
false

Hive Copy Large File Size

Description
Smaller than this size, Hive uses a single-threaded copy; larger than this size, Hive uses DistCp.
Related Name
hive.exec.copyfile.maxsize
Default Value
32 MiB
API Name
hive_exec_copyfile_maxsize
Required
false

Hive Replication Environment Advanced Configuration Snippet (Safety Valve)

Description
For advanced use only, key-value pairs (one on each line) to be inserted into the environment of Hive replication jobs.
Related Name
Default Value
API Name
hive_replication_env_safety_valve
Required
false

Hive Service Advanced Configuration Snippet (Safety Valve) for sentry-site.xml

Description
For advanced use only, a string to be inserted into sentry-site.xml. Applies to configurations of all roles in this service except client configuration.
Related Name
Default Value
API Name
hive_server2_sentry_safety_valve
Required
false

Hive Service Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
For advanced use only, a string to be inserted into hive-site.xml. Applies to configurations of all roles in this service except client configuration.
Related Name
Default Value
API Name
hive_service_config_safety_valve
Required
false

Hive Service Environment Advanced Configuration Snippet (Safety Valve)

Description
For advanced use only, key-value pairs (one on each line) to be inserted into a role's environment. Applies to configurations of all roles in this service except client configuration.
Related Name
Default Value
API Name
hive_service_env_safety_valve
Required
false

Hive Replication Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
For advanced use only, a string to be inserted into hive-site.xml. Applies to all Hive Replication jobs.
Related Name
Default Value
API Name
hive_service_replication_config_safety_valve
Required
false

Hive Client Advanced Configuration Snippet (Safety Valve) for navigator.client.properties

Description
For advanced use only, a string to be inserted into the client configuration for navigator.client.properties.
Related Name
Default Value
API Name
navigator_client_config_safety_valve
Required
false

Hive Client Advanced Configuration Snippet (Safety Valve) for navigator.lineage.client.properties

Description
For advanced use only, a string to be inserted into the client configuration for navigator.lineage.client.properties.
Related Name
Default Value
API Name
navigator_lineage_client_config_safety_valve
Required
false

System Group

Description
The group that this service's processes should run as.
Related Name
Default Value
hive
API Name
process_groupname
Required
true

System User

Description
The user that this service's processes should run as.
Related Name
Default Value
hive
API Name
process_username
Required
true

Hive Service Advanced Configuration Snippet (Safety Valve) for ranger-hive-audit.xml

Description
For advanced use only, a string to be inserted into ranger-hive-audit.xml. Applies to configurations of all roles in this service except client configuration.
Related Name
Default Value
API Name
ranger_audit_safety_valve
Required
false

Hive Service Advanced Configuration Snippet (Safety Valve) for ranger-hive-policymgr-ssl.xml

Description
For advanced use only, a string to be inserted into ranger-hive-policymgr-ssl.xml. Applies to configurations of all roles in this service except client configuration.
Related Name
Default Value
API Name
ranger_policymgr_ssl_safety_valve
Required
false

Hive Service Advanced Configuration Snippet (Safety Valve) for ranger-hive-security.xml

Description
For advanced use only, a string to be inserted into ranger-hive-security.xml. Applies to configurations of all roles in this service except client configuration.
Related Name
Default Value
API Name
ranger_security_safety_valve
Required
false

Cloudera Navigator

Enable Audit Collection

Description
Enable collection of audit events from the service's roles.
Related Name
navigator.audit.enabled
Default Value
true
API Name
navigator_audit_enabled
Required
false

Audit Event Filter

Description
Event filters are defined in a JSON object like the following: { "defaultAction" : ("accept", "discard"), "rules" : [ { "action" : ("accept", "discard"), "fields" : [ { "name" : "fieldName", "match" : "regex" } ] } ] } A filter has a default action and a list of rules, in order of precedence. Each rule defines an action, and a list of fields to match against the audit event. A rule is "accepted" if all the listed field entries match the audit event. At that point, the action declared by the rule is taken. If no rules match the event, the default action is taken. Actions default to "accept" if not defined in the JSON object. The following is the list of fields that can be filtered for Hive events:
  • userName: the user performing the action.
  • ipAddress: the IP from where the request originated.
  • operation: the Hive operation being performed.
  • databaseName: the databaseName for the operation.
  • tableName: the tableName for the operation.
The default Hive audit event filter discards HDFS directory events generated by Hive jobs that reference the /tmp directory.
Related Name
navigator.event.filter
Default Value
comment: [ The default Hive audit event filter discards HDFS directory events , generated by Hive jobs that reference the /tmp directory. ], defaultAction: accept, rules: [ action: discard, fields: [ name: operation, match: QUERY , name: objectType, match: DFS_DIR , name: resourcePath, match: /tmp/hive-(?:.+)?/hive_(?:.+)?/-mr-.* ] ]
API Name
navigator_audit_event_filter
Required
false

Audit Queue Policy

Description
Action to take when the audit event queue is full. Drop the event or shutdown the affected process.
Related Name
navigator.batch.queue_policy
Default Value
DROP
API Name
navigator_audit_queue_policy
Required
false

Audit Event Tracker

Description
Configures the rules for event tracking and coalescing. This feature is used to define equivalency between different audit events. When events match, according to a set of configurable parameters, only one entry in the audit list is generated for all the matching events. Tracking works by keeping a reference to events when they first appear, and comparing other incoming events against the "tracked" events according to the rules defined here. Event trackers are defined in a JSON object like the following: { "timeToLive" : [integer], "fields" : [ { "type" : [string], "name" : [string] } ] } Where:
  • timeToLive: maximum amount of time an event will be tracked, in milliseconds. Must be provided. This defines how long, since it's first seen, an event will be tracked. A value of 0 disables tracking.
  • fields: list of fields to compare when matching events against tracked events.
Each field has an evaluator type associated with it. The evaluator defines how the field data is to be compared. The following evaluators are available:
  • value: uses the field value for comparison.
  • userName: treats the field value as a userNname, and ignores any host-specific data. This is useful for environment using Kerberos, so that only the principal name and realm are compared.
The following is the list of fields that can be used to compare Hive events:
  • operation: the Hive operation being performed.
  • username: the user performing the action.
  • ipAddress: the IP from where the request originated.
  • allowed: whether the operation was allowed or denied.
  • databaseName: the database affected by the operation.
  • tableName: the table or view affected by the operation.
  • objectType: the type of object affected by the operation.
  • resourcePath: the path of the resource affected by the operation.
Related Name
navigator_event_tracker
Default Value
API Name
navigator_event_tracker
Required
false

Enable Lineage Collection

Description
Enable collection of lineage from the service's roles.
Related Name
Default Value
true
API Name
navigator_lineage_enabled
Required
false

Database

Auto Create and Upgrade Hive Metastore Database Schema

Description
Automatically create or upgrade tables in the Hive Metastore database when needed. Consider setting this to false and managing the schema manually.
Related Name
datanucleus.schema.autoCreateAll
Default Value
false
API Name
hive_metastore_database_auto_create_schema
Required
false

Hive Metastore Database DataNucleus Metadata Validation

Description
Perform DataNucleus validation of metadata during startup. Note: when enabled, Hive will log DataNucleus warnings even though Hive will function normally.
Related Name
datanucleus.metadata.xml.validate
Default Value
false
API Name
hive_metastore_database_datanucleus_metadata_validation
Required
false

Enable Direct SQL

Description
Whether Hive Metastore should try to use direct SQL queries instead of DataNucleus for certain read paths. This can improve metastore performance by orders of magnitude when fetching many partitions. In case of failure, execution will fall back to DataNucleus.
Related Name
hive.metastore.try.direct.sql
Default Value
true
API Name
hive_metastore_database_datanucleus_try_direct_sql
Required
false

Hive Metastore Database Host

Description
Host name of Hive Metastore database
Related Name
Default Value
localhost
API Name
hive_metastore_database_host
Required
false

Hive Metastore Database Name

Description
Name of Hive Metastore database
Related Name
Default Value
metastore
API Name
hive_metastore_database_name
Required
false

Hive Metastore Database Password

Description
Password for Hive Metastore database
Related Name
javax.jdo.option.ConnectionPassword
Default Value
API Name
hive_metastore_database_password
Required
false

Hive Metastore Database Port

Description
Port number of Hive Metastore database
Related Name
Default Value
3306
API Name
hive_metastore_database_port
Required
false

Hive Metastore Database Type

Description
Type of Hive Metastore database. Note that Derby is not recommended and Apache Impala does not support Derby.
Related Name
Default Value
mysql
API Name
hive_metastore_database_type
Required
false

Hive Metastore Database User

Description
User for Hive Metastore database
Related Name
javax.jdo.option.ConnectionUserName
Default Value
hive
API Name
hive_metastore_database_user
Required
false

Hive Metastore Derby Path

Description
Directory name where Hive Metastore's database is stored (only for Derby)
Related Name
Default Value
/var/lib/hive/cloudera_manager/derby/metastore_db
API Name
hive_metastore_derby_path
Required
false

Strict Hive Metastore Schema Validation

Description
Prevent Metastore operations in the event of schema version incompatibility. Consider setting this to true to reduce probability of schema corruption during Metastore operations. Note that setting this property to true will also set datanucleus.autoCreateSchema property to false and datanucleus.fixedDatastore property to true. Any values set in Cloudera Manager for these properties will be overridden.
Related Name
hive.metastore.schema.verification
Default Value
true
API Name
hive_metastore_schema_verification
Required
false

Hive Metastore Database JDBC URL Override

Description
Custom JDBC URL to use when connecting to the Hive Metastore Database. This connection string will override all other values used to construct the JDBC URL, including Hive Metastore Database Host, Hive Metastore Database Name, and Hive Metastore Database Port.
Related Name
javax.jdo.option.ConnectionURL
Default Value
API Name
jdbc_url_override
Required
false

Hive Metastore TLS/SSL Client Trust Store File

Description
The location on disk of the trust store, in .jks format, used to confirm the authenticity of TLS/SSL servers that Hive Metastore might connect to. This is used when Hive Metastore is the client in a TLS/SSL connection. This trust store must contain the certificate(s) used to sign the service(s) connected to. If this parameter is not provided, the default list of well-known certificate authorities is used instead.
Related Name
hive.metastore.dbaccess.ssl.truststore.path
Default Value
API Name
ssl_client_truststore_location
Required
false

Hive Metastore TLS/SSL Client Trust Store Password

Description
The password for the Hive Metastore TLS/SSL Certificate Trust Store File. This password is not required to access the trust store; this field can be left blank. This password provides optional integrity checking of the file. The contents of trust stores are certificates, and certificates are public information.
Related Name
hive.metastore.dbaccess.ssl.truststore.password
Default Value
API Name
ssl_client_truststore_password
Required
false

Enable TLS/SSL to the Hive Metastore Database

Description
Encrypt communication between Hive Metastore and the database using Transport Layer Security (TLS) (formerly known as Secure Socket Layer (SSL)). If this is enabled, then the optionally provided Hive Metastore TLS/SSL Client Trust Store properties will be used.
Related Name
hive.metastore.dbaccess.ssl.use.SSL
Default Value
false
API Name
ssl_enabled_database
Required
false

Logs

Audit Log Directory

Description
Path to the directory where audit logs will be written. The directory will be created if it doesn't exist.
Related Name
audit_event_log_dir
Default Value
/var/log/hive/audit
API Name
audit_event_log_dir
Required
false

Hive Lineage Log Directory

Description
The directory in which Hive lineage log files are written.
Related Name
lineage_event_log_dir
Default Value
/var/log/hive/lineage
API Name
lineage_event_log_dir
Required
true

Hive Maximum Lineage Log File Size

Description
The maximum size, in megabytes, per log file for Hive lineage logs. Typically used by log4j or logback.
Related Name
max_lineage_log_file_size
Default Value
100 MiB
API Name
max_lineage_log_file_size
Required
false

Maximum Audit Log File Size

Description
Maximum size of audit log file in MB before it is rolled over.
Related Name
navigator.audit_log_max_file_size
Default Value
100 MiB
API Name
navigator_audit_log_max_file_size
Required
false

Number of Audit Logs to Retain

Description
Maximum number of rolled-over audit logs to retain. The logs are not deleted if they contain audit events that have not yet been propagated to the Audit Server.
Related Name
navigator.client.max_num_audit_log
Default Value
10
API Name
navigator_client_max_num_audit_log
Required
false

Monitoring

Enable Service Level Health Alerts

Description
When set, Cloudera Manager will send alerts when the health of this service reaches the threshold specified by the EventServer setting eventserver_health_events_alert_threshold
Related Name
Default Value
true
API Name
enable_alerts
Required
false

Enable Configuration Change Alerts

Description
When set, Cloudera Manager will send alerts when this entity's configuration changes.
Related Name
Default Value
false
API Name
enable_config_alerts
Required
false

Healthy Hive Metastore Server Monitoring Thresholds

Description
The health test thresholds of the overall Hive Metastore Server health. The check returns "Concerning" health if the percentage of "Healthy" Hive Metastore Servers falls below the warning threshold. The check is unhealthy if the total percentage of "Healthy" and "Concerning" Hive Metastore Servers falls below the critical threshold.
Related Name
Default Value
Warning: 99.0 %, Critical: 51.0 %
API Name
hive_hivemetastores_healthy_thresholds
Required
false

Healthy HiveServer2 Monitoring Thresholds

Description
The health test thresholds of the overall HiveServer2 health. The check returns "Concerning" health if the percentage of "Healthy" HiveServer2s falls below the warning threshold. The check is unhealthy if the total percentage of "Healthy" and "Concerning" HiveServer2s falls below the critical threshold.
Related Name
Default Value
Warning: 99.0 %, Critical: 51.0 %
API Name
hive_hiveserver2s_healthy_thresholds
Required
false

Healthy WebHCat Server Monitoring Thresholds

Description
The health test thresholds of the overall WebHCat Server health. The check returns "Concerning" health if the percentage of "Healthy" WebHCat Servers falls below the warning threshold. The check is unhealthy if the total percentage of "Healthy" and "Concerning" WebHCat Servers falls below the critical threshold.
Related Name
Default Value
Warning: 99.0 %, Critical: 51.0 %
API Name
hive_webhcats_healthy_thresholds
Required
false

Service Triggers

Description
The configured triggers for this service. This is a JSON-formatted list of triggers. These triggers are evaluated as part as the health system. Every trigger expression is parsed, and if the trigger condition is met, the list of actions provided in the trigger expression is executed. Each trigger has the following fields:
  • triggerName (mandatory) - The name of the trigger. This value must be unique for the specific service.
  • triggerExpression (mandatory) - A tsquery expression representing the trigger.
  • streamThreshold (optional) - The maximum number of streams that can satisfy a condition of a trigger before the condition fires. By default set to 0, and any stream returned causes the condition to fire.
  • enabled (optional) - By default set to 'true'. If set to 'false', the trigger is not evaluated.
  • expressionEditorConfig (optional) - Metadata for the trigger editor. If present, the trigger should only be edited from the Edit Trigger page; editing the trigger here can lead to inconsistencies.
For example, the following JSON formatted trigger fires if there are more than 10 DataNodes with more than 500 file descriptors opened:[{"triggerName": "sample-trigger", "triggerExpression": "IF (SELECT fd_open WHERE roleType = DataNode and last(fd_open) > 500) DO health:bad", "streamThreshold": 10, "enabled": "true"}]See the trigger rules documentation for more details on how to write triggers using tsquery.The JSON format is evolving and may change and, as a result, backward compatibility is not guaranteed between releases.
Related Name
Default Value
[]
API Name
service_triggers
Required
true

Service Monitor Client Config Overrides

Description
For advanced use only, a list of configuration properties that will be used by the Service Monitor instead of the current client configuration for the service.
Related Name
Default Value
<property> <name>hive.metastore.client.socket.timeout</name> <value>60</value> </property>
API Name
smon_client_config_overrides
Required
false

Service Monitor Derived Configs Advanced Configuration Snippet (Safety Valve)

Description
For advanced use only, a list of derived configuration properties that will be used by the Service Monitor instead of the default ones.
Related Name
Default Value
API Name
smon_derived_configs_safety_valve
Required
false

Other

Atlas Service

Description
Name of the Atlas service that this Hive service instance depends on
Related Name
Default Value
API Name
atlas_service
Required
false

Generate HADOOP_CREDSTORE_PASSWORD

Description
Flag to enable or disable the generation of HADOOP_CREDSTORE_PASSWORD.
Related Name
generate_jceks_password
Default Value
true
API Name
generate_jceks_password
Required
false

HBase Service

Description
Name of the HBase service that this Hive service instance depends on.
Related Name
Default Value
API Name
hbase_service
Required
false

HDFS Service

Description
Name of the HDFS service that this Hive service instance depends on
Related Name
Default Value
API Name
hdfs_service
Required
true

Hive Bytes Per Reducer

Description
Size per reducer. If the input size is 10GiB and this is set to 1GiB, Hive will use 10 reducers.
Related Name
hive.exec.reducers.bytes.per.reducer
Default Value
64 MiB
API Name
hive_bytes_per_reducer
Required
false

Enable Metastore Notifications for DML Operations

Description
When set to true, DML queries from Hive (and SparkSQL for limited use-cases) which insert data into tables will fire listener notifications in the metastore.
Related Name
hive.metastore.dml.events
Default Value
true
API Name
hive_fire_events_for_dml
Required
false

Hive Max Reducers

Description
Max number of reducers to use. If the configuration parameter Hive Reduce Tasks is negative, Hive will limit the number of reducers to the value of this parameter.
Related Name
hive.exec.reducers.max
Default Value
1009
API Name
hive_max_reducers
Required
false

Hive Reduce Tasks

Description
Default number of reduce tasks per job. Usually set to a prime number close to the number of available hosts. Ignored when mapred.job.tracker is "local". Hadoop sets this to 1 by default, while Hive uses -1 as the default. When set to -1, Hive will automatically determine an appropriate number of reducers for each job.
Related Name
mapred.reduce.tasks
Default Value
-1
API Name
hive_reduce_tasks
Required
false

Support Dynamic Service Discovery

Description
Whether HiveServer2 supports dynamic service discovery for its clients. To support this, each instance of HiveServer2 currently uses ZooKeeper to register itself, when it is brought up. JDBC/ODBC clients should use the ZooKeeper ensemble: hive.zookeeper.quorum in their connection string.
Related Name
hive.server2.support.dynamic.service.discovery
Default Value
true
API Name
hive_server2_support_dynamic_service_discovery
Required
false

Set User and Group Information

Description
In unsecure mode, setting this property to true will cause the Metastore Server to execute DFS operations using the client's reported user and group permissions. Cloudera Manager will set this for all clients and servers.
Related Name
hive.metastore.execute.setugi
Default Value
true
API Name
hive_set_ugi
Required
true

Hive Warehouse Directory

Description
Hive warehouse directory is the location in HDFS where Hive's tables are stored. Note that Hive's default value for its warehouse directory is '/user/hive/warehouse'.
Related Name
hive.metastore.warehouse.dir
Default Value
/warehouse/tablespace/managed/hive
API Name
hive_warehouse_directory
Required
false

Hive External Warehouse Directory

Description
Hive external warehouse directory is the location in HDFS where Hive's tables are stored. Note that Hive's default value for its warehouse directory is '/user/hive/warehouse'.
Related Name
hive.metastore.warehouse.external.dir
Default Value
/warehouse/tablespace/external/hive
API Name
hive_warehouse_external_directory
Required
false

MapReduce Service

Description
MapReduce jobs are run against this service.
Related Name
Default Value
API Name
mapreduce_yarn_service
Required
false

Ranger Plugin Trusted Proxy IP Address

Description
Accepts a list of IP addresses of proxy servers for trusting.
Related Name
ranger.plugin.hive.trusted.proxy.ipaddress
Default Value
API Name
ranger_plugin_trusted_proxy_ipaddress
Required
false

Ranger Plugin Use X-Forwarded for IP Address

Description
The parameter is used for identifying the originating IP address of a user connecting to a component through proxy for audit logs.
Related Name
ranger.plugin.hive.use.x-forwarded-for.ipaddress
Default Value
false
API Name
ranger_plugin_use_x_forwarded_for_ipaddress
Required
false

Ranger Service

Description
Name of the Ranger service that this Hive service instance depends on
Related Name
Default Value
API Name
ranger_service
Required
false

ZooKeeper Service

Description
Name of the ZooKeeper service that this Hive service instance depends on.
Related Name
Default Value
API Name
zookeeper_service
Required
false

Performance

Metastore Bulk Partitions Thread Count

Description
The number of threads the metastore uses when bulk adding partitions to the metastore.. Each thread performs some metadata operations for each partition added, such as collecting statistics for the partition or checking if the partition directory exists. This config is also used to control the size of the threadpool used when scanning the filesystem to look for directories that could correspond to partitions, each thread performs a list status on each possible partition directory.
Related Name
hive.metastore.fshandler.threads
Default Value
15
API Name
hive_metastore_fshandler_threads
Required
false

Policy File Based Sentry

Sentry User to Group Mapping Class

Description
The class to use in Sentry authorization for user to group mapping. Sentry authorization may be configured to use either Hadoop user to group mapping or local groups defined in the policy file. Hadoop user to group mapping may be configured in the Cloudera Manager HDFS service configuration page under the Security section.
Related Name
hive.sentry.provider
Default Value
org.apache.sentry.provider.file.HadoopGroupResourceAuthorizationProvider
API Name
hive_sentry_provider
Required
false

Sentry Global Policy File

Description
HDFS path to the global policy file for Sentry authorization. This should be a relative path (and not a full HDFS URL). The global policy file must be in Sentry policy file format.
Related Name
hive.sentry.provider.resource
Default Value
/user/hive/sentry/sentry-provider.ini
API Name
hive_sentry_provider_resource
Required
false

Allow URIs in Database Policy File

Description
Allows URIs when defining privileges in per-database policy files. Warning: Typically, this configuration should be disabled. Enabling it would allow database policy file owner (which is generally not Hive admin user) to grant load privileges to any directory with read access to Hive admin user, including databases controlled by other database policy files.
Related Name
sentry.allow.uri.db.policyfile
Default Value
false
API Name
sentry_allow_uri_db_policyfile
Required
false

Proxy

Hive Metastore Access Control and Proxy User Groups Override

Description
This configuration overrides the value set for Hive Proxy User Groups configuration in HDFS service for use by Hive Metastore Server. Specify a comma-delimited list of groups that you want to allow access to Hive Metastore metadata and allow the Hive user to impersonate. A value of '*' allows all groups. The default value of empty inherits the value set for Hive Proxy User Groups configuration in the HDFS service.
Related Name
hadoop.proxyuser.hive.groups
Default Value
API Name
hive_proxy_user_groups_list
Required
false

Replication

Replica functions root directory

Description
Root directory on the replica warehouse where the repl sub-system will store jars from the primary warehouse
Related Name
hive.repl.replica.functions.root.dir
Default Value
API Name
hive_repl_replica_functions_root_dir
Required
false

Security

Enable LDAP Authentication for Hive Metastore

Description
When checked, LDAP-based authentication for users is enabled.
Related Name
Default Value
false
API Name
hive_metastore_enable_ldap_auth
Required
false

LDAP BaseDN

Description
This parameter is useful when authenticating against a non-Active Directory server, such as OpenLDAP. When set, this parameter is used to convert the username into the LDAP Distinguished Name (DN), so that the resulting DN looks like uid=username,this parameter. For example, if this parameter is set to "ou=People,dc=cloudera,dc=com", and the username passed in is "mike", the resulting authentication passed to the LDAP server look like "uid=mike,ou=People,dc=cloudera,dc=com". This parameter is mutually exclusive with Active Directory Domain.
Related Name
hive.metastore.authentication.ldap.baseDN
Default Value
API Name
hive_metastore_ldap_basedn
Required
false

Active Directory Domain

Description
Use this field for Active Directory configurations only, when combined with a simple username value in the "LDAP Bind User Distinguished Name" field, it will result in a UPM of user@example.com used for search/bind operations for authenticated user lookups.
Related Name
hive.metastore.authentication.ldap.Domain
Default Value
API Name
hive_metastore_ldap_domain
Required
false

LDAP URL

Description
The URL of the LDAP Server. The URL must be prefixed with ldap:// or ldaps:// . The URL can optionally specify a custom port if necessary, but by default the ldap:// will connect to port 389, and the ldaps:// will connect to port 636. Note that passwords will be in the clear if ldap:// is used, and by fall 2020 Active directory servers will no longer allow non LDAPS connections to bind to AD hosts with LDAP signing enabled. See microsoft knowledge document 935834 for more information.
Related Name
hive.metastore.authentication.ldap.url
Default Value
API Name
hive_metastore_ldap_uri
Required
false

Enable LDAP Authentication for HiveServer2

Description
When checked, LDAP-based authentication for users is enabled.
Related Name
Default Value
false
API Name
hiveserver2_enable_ldap_auth
Required
false

Enable TLS/SSL for HiveServer2

Description
Encrypt communication between clients and HiveServer2 using Transport Layer Security (TLS) (formerly known as Secure Socket Layer (SSL)).
Related Name
hive.server2.use.SSL
Default Value
false
API Name
hiveserver2_enable_ssl
Required
false

HiveServer2 TLS/SSL Server JKS Keystore File Password

Description
The password for the HiveServer2 JKS keystore file.
Related Name
hive.server2.keystore.password
Default Value
API Name
hiveserver2_keystore_password
Required
false

HiveServer2 TLS/SSL Server JKS Keystore File Location

Description
The path to the TLS/SSL keystore file containing the server certificate and private key used for TLS/SSL. Used when HiveServer2 is acting as a TLS/SSL server. The keystore must be in JKS format.
Related Name
hive.server2.keystore.path
Default Value
API Name
hiveserver2_keystore_path
Required
false

LDAP BaseDN

Description
This parameter is useful when authenticating against a non-Active Directory server, such as OpenLDAP. When set, this parameter is used to convert the username into the LDAP Distinguished Name (DN), so that the resulting DN looks like uid=username,this parameter. For example, if this parameter is set to "ou=People,dc=cloudera,dc=com", and the username passed in is "mike", the resulting authentication passed to the LDAP server look like "uid=mike,ou=People,dc=cloudera,dc=com". This parameter is mutually exclusive with Active Directory Domain.
Related Name
hive.server2.authentication.ldap.baseDN
Default Value
API Name
hiveserver2_ldap_basedn
Required
false

Active Directory Domain

Description
Use this field for Active Directory configurations only, when combined with a simple username value in the "LDAP Bind User Distinguished Name" field, it will result in a UPM of user@example.com used for search/bind operations for authenticated user lookups.
Related Name
hive.server2.authentication.ldap.Domain
Default Value
API Name
hiveserver2_ldap_domain
Required
false

LDAP URL

Description
The URL of the LDAP Server. The URL must be prefixed with ldap:// or ldaps:// . The URL can optionally specify a custom port if necessary, but by default the ldap:// will connect to port 389, and the ldaps:// will connect to port 636. Note that passwords will be in the clear if ldap:// is used, and by fall 2020 Active directory servers will no longer allow non LDAPS connections to bind to AD hosts with LDAP signing enabled. See microsoft knowledge document 935834 for more information.
Related Name
hive.server2.authentication.ldap.url
Default Value
API Name
hiveserver2_ldap_uri
Required
false

HiveServer2 TLS/SSL Client Trust Store File

Description
The location on disk of the trust store, in .jks format, used to confirm the authenticity of TLS/SSL servers that HiveServer2 might connect to. This is used when HiveServer2 is the client in a TLS/SSL connection. This trust store must contain the certificate(s) used to sign the service(s) connected to. If this parameter is not provided, the default list of well-known certificate authorities is used instead.
Related Name
Default Value
API Name
hiveserver2_truststore_file
Required
false

HiveServer2 TLS/SSL Client Trust Store Password

Description
The password for the HiveServer2 TLS/SSL Certificate Trust Store File. This password is not required to access the trust store; this field can be left blank. This password provides optional integrity checking of the file. The contents of trust stores are certificates, and certificates are public information.
Related Name
Default Value
API Name
hiveserver2_truststore_password
Required
false

Kerberos Principal

Description
Kerberos principal short name used by all roles of this service.
Related Name
Default Value
hive
API Name
kerberos_princ_name
Required
true

Ranger DFS Audit Path

Description
The DFS path on which Ranger audits are written. The special placeholder '${ranger_base_audit_url}' should be used as the prefix, in order to use the centralized location defined in the Ranger service.
Related Name
xasecure.audit.destination.hdfs.dir
Default Value
$ranger_base_audit_url/hive
API Name
ranger_audit_hdfs_dir
Required
false

Ranger Audit DFS Spool Dir

Description
Spool directory for Ranger audits being written to DFS.
Related Name
xasecure.audit.destination.hdfs.batch.filespool.dir
Default Value
/var/log/hive/audit/hdfs/spool
API Name
ranger_audit_hdfs_spool_dir
Required
false

Ranger Audit Solr Spool Dir

Description
Spool directory for Ranger audits being written to Solr.
Related Name
xasecure.audit.destination.solr.batch.filespool.dir
Default Value
/var/log/hive/audit/solr/spool
API Name
ranger_audit_solr_spool_dir
Required
false

Ranger Policy Cache Directory

Description
The directory where Ranger security policies are cached locally.
Related Name
ranger.plugin.hive.policy.cache.dir
Default Value
/var/lib/ranger/hive/policy-cache
API Name
ranger_policy_cache_dir
Required
false

Bypass Sentry Authorization Users

Description
List of users that are allowed to bypass Sentry Authorization in the Hive metastore. These are usually service users that already ensure that all activity has been authorized, such as hive and impala. Only applies when Hive is using Sentry Service.
Related Name
sentry.metastore.service.users
Default Value
hive impala hue hdfs
API Name
sentry_metastore_service_users
Required
false

Sentry HDFS Sync Cache

Abort on Initialization Failure

Description
If set to true, the Hive metastore will treat a problem with cache initialization as a fatal error.
Related Name
sentry.hdfs.sync.metastore.cache.fail.on.partial.update
Default Value
true
API Name
sentry_hdfs_sync_metastore_cache_fail_on_partial_update
Required
false

Number of Threads on Initialization

Description
The number of threads used during Hive Metastore Sentry HDFS Sync Cache Initialization.
Related Name
sentry.hdfs.sync.metastore.cache.init.threads
Default Value
10
API Name
sentry_hdfs_sync_metastore_cache_init_threads
Required
false

Number of Partitions per RPC on Initialization

Description
The number of partitions per RPC retrieved during Hive Metastore Sentry HDFS Sync Cache Initialization.
Related Name
sentry.hdfs.sync.metastore.cache.max-partitions-per-rpc
Default Value
100
API Name
sentry_hdfs_sync_metastore_cache_partitions_per_rpc
Required
false

Max Number of Retries on Initialization

Description
The maximum number of retries allowed during Hive Metastore Sentry HDFS Sync cache initialization.
Related Name
sentry.hdfs.sync.metastore.cache.retry.max.num
Default Value
1
API Name
sentry_hdfs_sync_metastore_cache_retry_max_num
Required
false

Retry Wait Time on Initialization

Description
Wait duration in milliseconds for each retry during Hive Metastore Sentry HDFS Sync Cache Initialization.
Related Name
sentry.hdfs.sync.metastore.cache.retry.wait.duration.millis
Default Value
1 second(s)
API Name
sentry_hdfs_sync_metastore_cache_retry_wait_duration_millis
Required
false

Number of Tables per RPC on Initialization

Description
The number of tables per RPC retrieved during Hive Metastore Sentry HDFS Sync Cache Initialization.
Related Name
sentry.hdfs.sync.metastore.cache.max-tables-per-rpc
Default Value
100
API Name
sentry_hdfs_sync_metastore_cache_tables_per_rpc
Required
false

Suppressions

Suppress Configuration Validator: CDH Version Validator

Description
Whether to suppress configuration warnings produced by the CDH Version Validator configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_cdh_version_validator
Required
true

Suppress Configuration Validator: Deploy Directory

Description
Whether to suppress configuration warnings produced by the Deploy Directory configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_client_config_root_dir
Required
true

Suppress Configuration Validator: WebHCat Server Log Directory

Description
Whether to suppress configuration warnings produced by the WebHCat Server Log Directory configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hcatalog_log_dir
Required
true

Suppress Configuration Validator: Hive Client Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
Whether to suppress configuration warnings produced by the Hive Client Advanced Configuration Snippet (Safety Valve) for hive-site.xml configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_client_config_safety_valve
Required
true

Suppress Configuration Validator: Gateway Client Environment Advanced Configuration Snippet (Safety Valve) for hive-env.sh

Description
Whether to suppress configuration warnings produced by the Gateway Client Environment Advanced Configuration Snippet (Safety Valve) for hive-env.sh configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_client_env_safety_valve
Required
true

Suppress Configuration Validator: Client Java Configuration Options

Description
Whether to suppress configuration warnings produced by the Client Java Configuration Options configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_client_java_opts
Required
true

Suppress Configuration Validator: Hive Metastore Max Message Size Validator

Description
Whether to suppress configuration warnings produced by the Hive Metastore Max Message Size Validator configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_hms_max_message_size_validator
Required
true

Suppress Configuration Validator: HiveServer2 Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
Whether to suppress configuration warnings produced by the HiveServer2 Advanced Configuration Snippet (Safety Valve) for hive-site.xml configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_hs2_config_safety_valve
Required
true

Suppress Configuration Validator: HiveServer2 Environment Advanced Configuration Snippet (Safety Valve)

Description
Whether to suppress configuration warnings produced by the HiveServer2 Environment Advanced Configuration Snippet (Safety Valve) configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_hs2_env_safety_valve
Required
true

Suppress Configuration Validator: Hive Metastore Server Log Directory

Description
Whether to suppress configuration warnings produced by the Hive Metastore Server Log Directory configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_log_dir
Required
true

Suppress Configuration Validator: Hive Metastore Server Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
Whether to suppress configuration warnings produced by the Hive Metastore Server Advanced Configuration Snippet (Safety Valve) for hive-site.xml configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_metastore_config_safety_valve
Required
true

Suppress Configuration Validator: Hive Metastore Server Environment Advanced Configuration Snippet (Safety Valve)

Description
Whether to suppress configuration warnings produced by the Hive Metastore Server Environment Advanced Configuration Snippet (Safety Valve) configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_metastore_env_safety_valve
Required
true

Suppress Configuration Validator: Java Configuration Options for Hive Metastore Server

Description
Whether to suppress configuration warnings produced by the Java Configuration Options for Hive Metastore Server configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_metastore_java_opts
Required
true

Suppress Configuration Validator: Hive Metastore Server Port

Description
Whether to suppress configuration warnings produced by the Hive Metastore Server Port configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_metastore_port
Required
true

Suppress Configuration Validator: Metrics Sample File Location

Description
Whether to suppress configuration warnings produced by the Metrics Sample File Location configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_metrics_sample_file_location
Required
true

Suppress Configuration Validator: Restrict Load Bucketed Table Validator

Description
Whether to suppress configuration warnings produced by the Restrict Load Bucketed Table Validator configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_restrict_load_bucketed_table_validator
Required
true

Suppress Configuration Validator: Restrict Unsafe Comparison Validator

Description
Whether to suppress configuration warnings produced by the Restrict Unsafe Comparison Validator configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_restrict_unsafe_comparison_validator
Required
true

Suppress Configuration Validator: HiveServer2 Operations Log Directory

Description
Whether to suppress configuration warnings produced by the HiveServer2 Operations Log Directory configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_server2_logging_operation_log_location
Required
true

Suppress Configuration Validator: WebHCat Server Port

Description
Whether to suppress configuration warnings produced by the WebHCat Server Port configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_webhcat_address_port
Required
true

Suppress Configuration Validator: WebHCat Server Advanced Configuration Snippet (Safety Valve) for webhcat-site.xml

Description
Whether to suppress configuration warnings produced by the WebHCat Server Advanced Configuration Snippet (Safety Valve) for webhcat-site.xml configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_webhcat_config_safety_valve
Required
true

Suppress Configuration Validator: WebHCat Server Environment Advanced Configuration Snippet (Safety Valve)

Description
Whether to suppress configuration warnings produced by the WebHCat Server Environment Advanced Configuration Snippet (Safety Valve) configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_webhcat_env_safety_valve
Required
true

Suppress Configuration Validator: WebHCat Server Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
Whether to suppress configuration warnings produced by the WebHCat Server Advanced Configuration Snippet (Safety Valve) for hive-site.xml configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_webhcat_hive_config_safety_valve
Required
true

Suppress Configuration Validator: Java Configuration Options for WebHCat Server

Description
Whether to suppress configuration warnings produced by the Java Configuration Options for WebHCat Server configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hive_webhcat_java_opts
Required
true

Suppress Configuration Validator: Hive Downloaded Resources Directory

Description
Whether to suppress configuration warnings produced by the Hive Downloaded Resources Directory configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_downloaded_resources_dir
Required
true

Suppress Configuration Validator: Hive Local Scratch Directory

Description
Whether to suppress configuration warnings produced by the Hive Local Scratch Directory configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_exec_local_scratchdir
Required
true

Suppress Configuration Validator: Hive HDFS Scratch Directory

Description
Whether to suppress configuration warnings produced by the Hive HDFS Scratch Directory configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_exec_scratchdir
Required
true

Suppress Configuration Validator: Fair Scheduler XML Advanced Configuration Snippet (Safety Valve)

Description
Whether to suppress configuration warnings produced by the Fair Scheduler XML Advanced Configuration Snippet (Safety Valve) configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_fair_scheduler_safety_valve
Required
true

Suppress Configuration Validator: Java Configuration Options for HiveServer2

Description
Whether to suppress configuration warnings produced by the Java Configuration Options for HiveServer2 configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_java_opts
Required
true

Suppress Configuration Validator: HiveServer2 Load Balancer

Description
Whether to suppress configuration warnings produced by the HiveServer2 Load Balancer configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_load_balancer
Required
true

Suppress Configuration Validator: Exclude Vectorized Input Formats

Description
Whether to suppress configuration warnings produced by the Exclude Vectorized Input Formats configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_vectorized_input_format_excludes
Required
true

Suppress Configuration Validator: HiveServer2 WebUI Port

Description
Whether to suppress configuration warnings produced by the HiveServer2 WebUI Port configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hiveserver2_webui_port
Required
true

Suppress Configuration Validator: Hive Metastore Server Advanced Configuration Snippet (Safety Valve) for core-site.xml

Description
Whether to suppress configuration warnings produced by the Hive Metastore Server Advanced Configuration Snippet (Safety Valve) for core-site.xml configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hms_core_site_safety_valve
Required
true

Suppress Configuration Validator: HiveServer2 Advanced Configuration Snippet (Safety Valve) for core-site.xml

Description
Whether to suppress configuration warnings produced by the HiveServer2 Advanced Configuration Snippet (Safety Valve) for core-site.xml configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hs2_core_site_safety_valve
Required
true

Suppress Configuration Validator: HiveServer2 Port

Description
Whether to suppress configuration warnings produced by the HiveServer2 Port configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_hs2_thrift_address_port
Required
true

Suppress Configuration Validator: Gateway Logging Advanced Configuration Snippet (Safety Valve)

Description
Whether to suppress configuration warnings produced by the Gateway Logging Advanced Configuration Snippet (Safety Valve) configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_log4j_safety_valve
Required
true

Suppress Configuration Validator: Heap Dump Directory

Description
Whether to suppress configuration warnings produced by the Heap Dump Directory configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_oom_heap_dump_dir
Required
true

Suppress Configuration Validator: Custom Control Group Resources (overrides Cgroup settings)

Description
Whether to suppress configuration warnings produced by the Custom Control Group Resources (overrides Cgroup settings) configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_rm_custom_resources
Required
true

Suppress Configuration Validator: Role Triggers

Description
Whether to suppress configuration warnings produced by the Role Triggers configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_role_triggers
Required
true

Suppress Configuration Validator: HiveServer2 WebUI TLS/SSL Server JKS Keystore File Location

Description
Whether to suppress configuration warnings produced by the HiveServer2 WebUI TLS/SSL Server JKS Keystore File Location configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_ssl_server_keystore_location
Required
true

Suppress Configuration Validator: HiveServer2 WebUI TLS/SSL Server JKS Keystore File Password

Description
Whether to suppress configuration warnings produced by the HiveServer2 WebUI TLS/SSL Server JKS Keystore File Password configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_ssl_server_keystore_password
Required
true

Suppress Configuration Validator: Stacks Collection Directory

Description
Whether to suppress configuration warnings produced by the Stacks Collection Directory configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_stacks_collection_directory
Required
true

Suppress Configuration Validator: WebHCat Server Advanced Configuration Snippet (Safety Valve) for core-site.xml

Description
Whether to suppress configuration warnings produced by the WebHCat Server Advanced Configuration Snippet (Safety Valve) for core-site.xml configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_webhcat_core_site_safety_valve
Required
true

Suppress Parameter Validation: Hive Service Advanced Configuration Snippet (Safety Valve) for atlas-application.properties

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Service Advanced Configuration Snippet (Safety Valve) for atlas-application.properties parameter.
Related Name
Default Value
false
API Name
service_config_suppression_application_properties_safety_valve
Required
true

Suppress Parameter Validation: Audit Log Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Audit Log Directory parameter.
Related Name
Default Value
false
API Name
service_config_suppression_audit_event_log_dir
Required
true

Suppress Configuration Validator: Gateway Count Validator

Description
Whether to suppress configuration warnings produced by the Gateway Count Validator configuration validator.
Related Name
Default Value
false
API Name
service_config_suppression_gateway_count_validator
Required
true

Suppress Parameter Validation: Hive Auxiliary JARs Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Auxiliary JARs Directory parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_aux_jars_path_dir
Required
true

Suppress Configuration Validator: Hive Bypass Metastore Validator

Description
Whether to suppress configuration warnings produced by the Hive Bypass Metastore Validator configuration validator.
Related Name
Default Value
false
API Name
service_config_suppression_hive_bypass_metastore_validator
Required
true

Suppress Configuration Validator: Client TLS/SSL In Use With LDAP Authentication Validator

Description
Whether to suppress configuration warnings produced by the Client TLS/SSL In Use With LDAP Authentication Validator configuration validator.
Related Name
Default Value
false
API Name
service_config_suppression_hive_client_ssl_recommended_with_ldap_auth_validator
Required
true

Suppress Configuration Validator: Hive Concurrency Configuration Validator

Description
Whether to suppress configuration warnings produced by the Hive Concurrency Configuration Validator configuration validator.
Related Name
Default Value
false
API Name
service_config_suppression_hive_concurrency_validator
Required
true

Suppress Parameter Validation: Hive Service Advanced Configuration Snippet (Safety Valve) for core-site.xml

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Service Advanced Configuration Snippet (Safety Valve) for core-site.xml parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_core_site_safety_valve
Required
true

Suppress Configuration Validator: Hive Derby Validator

Description
Whether to suppress configuration warnings produced by the Hive Derby Validator configuration validator.
Related Name
Default Value
false
API Name
service_config_suppression_hive_derby_validator
Required
true

Suppress Parameter Validation: Hive Metastore Database Host

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Metastore Database Host parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_metastore_database_host
Required
true

Suppress Parameter Validation: Hive Metastore Database Name

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Metastore Database Name parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_metastore_database_name
Required
true

Suppress Parameter Validation: Hive Metastore Database Password

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Metastore Database Password parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_metastore_database_password
Required
true

Suppress Parameter Validation: Hive Metastore Database Port

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Metastore Database Port parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_metastore_database_port
Required
true

Suppress Configuration Validator: Database TLS with JDBC URL Override Validator

Description
Whether to suppress configuration warnings produced by the Database TLS with JDBC URL Override Validator configuration validator.
Related Name
Default Value
false
API Name
service_config_suppression_hive_metastore_database_tls_overridden_by_jdbc_url_validator
Required
true

Suppress Parameter Validation: Hive Metastore Database User

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Metastore Database User parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_metastore_database_user
Required
true

Suppress Parameter Validation: Hive Metastore Derby Path

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Metastore Derby Path parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_metastore_derby_path
Required
true

Suppress Parameter Validation: LDAP BaseDN

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the LDAP BaseDN parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_metastore_ldap_basedn
Required
true

Suppress Parameter Validation: Active Directory Domain

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Active Directory Domain parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_metastore_ldap_domain
Required
true

Suppress Parameter Validation: LDAP URL

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the LDAP URL parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_metastore_ldap_uri
Required
true

Suppress Configuration Validator: Hive Proxy Groups Validator

Description
Whether to suppress configuration warnings produced by the Hive Proxy Groups Validator configuration validator.
Related Name
Default Value
false
API Name
service_config_suppression_hive_proxy_groups_validator
Required
true

Suppress Parameter Validation: Hive Metastore Access Control and Proxy User Groups Override

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Metastore Access Control and Proxy User Groups Override parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_proxy_user_groups_list
Required
true

Suppress Configuration Validator: Hive Ranger Validator

Description
Whether to suppress configuration warnings produced by the Hive Ranger Validator configuration validator.
Related Name
Default Value
false
API Name
service_config_suppression_hive_ranger_validator
Required
true

Suppress Parameter Validation: Replica functions root directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Replica functions root directory parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_repl_replica_functions_root_dir
Required
true

Suppress Parameter Validation: Hive Replication Environment Advanced Configuration Snippet (Safety Valve)

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Replication Environment Advanced Configuration Snippet (Safety Valve) parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_replication_env_safety_valve
Required
true

Suppress Parameter Validation: Sentry Global Policy File

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Sentry Global Policy File parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_sentry_provider_resource
Required
true

Suppress Configuration Validator: Hive Sentry Validator

Description
Whether to suppress configuration warnings produced by the Hive Sentry Validator configuration validator.
Related Name
Default Value
false
API Name
service_config_suppression_hive_sentry_validator
Required
true

Suppress Parameter Validation: Hive Service Advanced Configuration Snippet (Safety Valve) for sentry-site.xml

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Service Advanced Configuration Snippet (Safety Valve) for sentry-site.xml parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_server2_sentry_safety_valve
Required
true

Suppress Parameter Validation: Hive Service Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Service Advanced Configuration Snippet (Safety Valve) for hive-site.xml parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_service_config_safety_valve
Required
true

Suppress Parameter Validation: Hive Service Environment Advanced Configuration Snippet (Safety Valve)

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Service Environment Advanced Configuration Snippet (Safety Valve) parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_service_env_safety_valve
Required
true

Suppress Parameter Validation: Hive Replication Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Replication Advanced Configuration Snippet (Safety Valve) for hive-site.xml parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_service_replication_config_safety_valve
Required
true

Suppress Parameter Validation: Hive Warehouse Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Warehouse Directory parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_warehouse_directory
Required
true

Suppress Parameter Validation: Hive External Warehouse Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive External Warehouse Directory parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hive_warehouse_external_directory
Required
true

Suppress Configuration Validator: Hive Metastore Server Count Validator

Description
Whether to suppress configuration warnings produced by the Hive Metastore Server Count Validator configuration validator.
Related Name
Default Value
false
API Name
service_config_suppression_hivemetastore_count_validator
Required
true

Suppress Configuration Validator: HiveServer2 Count Validator

Description
Whether to suppress configuration warnings produced by the HiveServer2 Count Validator configuration validator.
Related Name
Default Value
false
API Name
service_config_suppression_hiveserver2_count_validator
Required
true

Suppress Parameter Validation: HiveServer2 TLS/SSL Server JKS Keystore File Password

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 TLS/SSL Server JKS Keystore File Password parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hiveserver2_keystore_password
Required
true

Suppress Parameter Validation: HiveServer2 TLS/SSL Server JKS Keystore File Location

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 TLS/SSL Server JKS Keystore File Location parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hiveserver2_keystore_path
Required
true

Suppress Parameter Validation: LDAP BaseDN

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the LDAP BaseDN parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hiveserver2_ldap_basedn
Required
true

Suppress Parameter Validation: Active Directory Domain

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Active Directory Domain parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hiveserver2_ldap_domain
Required
true

Suppress Parameter Validation: LDAP URL

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the LDAP URL parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hiveserver2_ldap_uri
Required
true

Suppress Parameter Validation: HiveServer2 TLS/SSL Client Trust Store File

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 TLS/SSL Client Trust Store File parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hiveserver2_truststore_file
Required
true

Suppress Parameter Validation: HiveServer2 TLS/SSL Client Trust Store Password

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the HiveServer2 TLS/SSL Client Trust Store Password parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hiveserver2_truststore_password
Required
true

Suppress Parameter Validation: Hive Metastore Database JDBC URL Override

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Metastore Database JDBC URL Override parameter.
Related Name
Default Value
false
API Name
service_config_suppression_jdbc_url_override
Required
true

Suppress Parameter Validation: Kerberos Principal

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Kerberos Principal parameter.
Related Name
Default Value
false
API Name
service_config_suppression_kerberos_princ_name
Required
true

Suppress Parameter Validation: Hive Lineage Log Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Lineage Log Directory parameter.
Related Name
Default Value
false
API Name
service_config_suppression_lineage_event_log_dir
Required
true

Suppress Parameter Validation: Audit Event Filter

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Audit Event Filter parameter.
Related Name
Default Value
false
API Name
service_config_suppression_navigator_audit_event_filter
Required
true

Suppress Parameter Validation: Hive Client Advanced Configuration Snippet (Safety Valve) for navigator.client.properties

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Client Advanced Configuration Snippet (Safety Valve) for navigator.client.properties parameter.
Related Name
Default Value
false
API Name
service_config_suppression_navigator_client_config_safety_valve
Required
true

Suppress Parameter Validation: Audit Event Tracker

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Audit Event Tracker parameter.
Related Name
Default Value
false
API Name
service_config_suppression_navigator_event_tracker
Required
true

Suppress Parameter Validation: Hive Client Advanced Configuration Snippet (Safety Valve) for navigator.lineage.client.properties

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Client Advanced Configuration Snippet (Safety Valve) for navigator.lineage.client.properties parameter.
Related Name
Default Value
false
API Name
service_config_suppression_navigator_lineage_client_config_safety_valve
Required
true

Suppress Parameter Validation: System Group

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the System Group parameter.
Related Name
Default Value
false
API Name
service_config_suppression_process_groupname
Required
true

Suppress Parameter Validation: System User

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the System User parameter.
Related Name
Default Value
false
API Name
service_config_suppression_process_username
Required
true

Suppress Parameter Validation: Ranger DFS Audit Path

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Ranger DFS Audit Path parameter.
Related Name
Default Value
false
API Name
service_config_suppression_ranger_audit_hdfs_dir
Required
true

Suppress Parameter Validation: Ranger Audit DFS Spool Dir

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Ranger Audit DFS Spool Dir parameter.
Related Name
Default Value
false
API Name
service_config_suppression_ranger_audit_hdfs_spool_dir
Required
true

Suppress Parameter Validation: Hive Service Advanced Configuration Snippet (Safety Valve) for ranger-hive-audit.xml

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Service Advanced Configuration Snippet (Safety Valve) for ranger-hive-audit.xml parameter.
Related Name
Default Value
false
API Name
service_config_suppression_ranger_audit_safety_valve
Required
true

Suppress Parameter Validation: Ranger Audit Solr Spool Dir

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Ranger Audit Solr Spool Dir parameter.
Related Name
Default Value
false
API Name
service_config_suppression_ranger_audit_solr_spool_dir
Required
true

Suppress Parameter Validation: Ranger Plugin Trusted Proxy IP Address

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Ranger Plugin Trusted Proxy IP Address parameter.
Related Name
Default Value
false
API Name
service_config_suppression_ranger_plugin_trusted_proxy_ipaddress
Required
true

Suppress Parameter Validation: Ranger Policy Cache Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Ranger Policy Cache Directory parameter.
Related Name
Default Value
false
API Name
service_config_suppression_ranger_policy_cache_dir
Required
true

Suppress Parameter Validation: Hive Service Advanced Configuration Snippet (Safety Valve) for ranger-hive-policymgr-ssl.xml

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Service Advanced Configuration Snippet (Safety Valve) for ranger-hive-policymgr-ssl.xml parameter.
Related Name
Default Value
false
API Name
service_config_suppression_ranger_policymgr_ssl_safety_valve
Required
true

Suppress Parameter Validation: Hive Service Advanced Configuration Snippet (Safety Valve) for ranger-hive-security.xml

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Service Advanced Configuration Snippet (Safety Valve) for ranger-hive-security.xml parameter.
Related Name
Default Value
false
API Name
service_config_suppression_ranger_security_safety_valve
Required
true

Suppress Parameter Validation: Bypass Sentry Authorization Users

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Bypass Sentry Authorization Users parameter.
Related Name
Default Value
false
API Name
service_config_suppression_sentry_metastore_service_users
Required
true

Suppress Parameter Validation: Service Triggers

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Service Triggers parameter.
Related Name
Default Value
false
API Name
service_config_suppression_service_triggers
Required
true

Suppress Parameter Validation: Service Monitor Client Config Overrides

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Service Monitor Client Config Overrides parameter.
Related Name
Default Value
false
API Name
service_config_suppression_smon_client_config_overrides
Required
true

Suppress Parameter Validation: Service Monitor Derived Configs Advanced Configuration Snippet (Safety Valve)

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Service Monitor Derived Configs Advanced Configuration Snippet (Safety Valve) parameter.
Related Name
Default Value
false
API Name
service_config_suppression_smon_derived_configs_safety_valve
Required
true

Suppress Parameter Validation: Hive Metastore TLS/SSL Client Trust Store File

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Metastore TLS/SSL Client Trust Store File parameter.
Related Name
Default Value
false
API Name
service_config_suppression_ssl_client_truststore_location
Required
true

Suppress Parameter Validation: Hive Metastore TLS/SSL Client Trust Store Password

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Metastore TLS/SSL Client Trust Store Password parameter.
Related Name
Default Value
false
API Name
service_config_suppression_ssl_client_truststore_password
Required
true

Suppress Configuration Validator: WebHCat Server Count Validator

Description
Whether to suppress configuration warnings produced by the WebHCat Server Count Validator configuration validator.
Related Name
Default Value
false
API Name
service_config_suppression_webhcat_count_validator
Required
true

Suppress Health Test: Hive Metastore Server Health

Description
Whether to suppress the results of the Hive Metastore Server Health heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
service_health_suppression_hive_hivemetastores_healthy
Required
true

Suppress Health Test: HiveServer2 Health

Description
Whether to suppress the results of the HiveServer2 Health heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
service_health_suppression_hive_hiveserver2s_healthy
Required
true

Suppress Health Test: WebHCat Server Health

Description
Whether to suppress the results of the WebHCat Server Health heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
service_health_suppression_hive_webhcats_healthy
Required
true

WebHCat Server

Advanced

WebHCat Server Advanced Configuration Snippet (Safety Valve) for webhcat-site.xml

Description
For advanced use only. A string to be inserted into webhcat-site.xml for this role only.
Related Name
Default Value
API Name
hive_webhcat_config_safety_valve
Required
false

WebHCat Server Environment Advanced Configuration Snippet (Safety Valve)

Description
For advanced use only, key-value pairs (one on each line) to be inserted into a role's environment. Applies to configurations of this role except client configuration.
Related Name
Default Value
API Name
hive_webhcat_env_safety_valve
Required
false

WebHCat Server Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
For advanced use only. A string to be inserted into hive-site.xml for this role only.
Related Name
Default Value
API Name
hive_webhcat_hive_config_safety_valve
Required
false

Java Configuration Options for WebHCat Server

Description
These arguments will be passed as part of the Java command line. Commonly, garbage collection flags, PermGen, or extra debugging flags would be passed here. Note: When CM version is 6.3.0 or greater, {{JAVA_GC_ARGS}} will be replaced by JVM Garbage Collection arguments based on the runtime Java JVM version.
Related Name
Default Value
JAVA_GC_ARGS
API Name
hive_webhcat_java_opts
Required
false

WebHCat Server Logging Advanced Configuration Snippet (Safety Valve)

Description
For advanced use only, a string to be inserted into log4j.properties for this role only.
Related Name
Default Value
API Name
log4j_safety_valve
Required
false

Heap Dump Directory

Description
Path to directory where heap dumps are generated when java.lang.OutOfMemoryError error is thrown. This directory is automatically created if it does not exist. If this directory already exists, role user must have write access to this directory. If this directory is shared among multiple roles, it should have 1777 permissions. The heap dump files are created with 600 permissions and are owned by the role user. The amount of free space in this directory should be greater than the maximum Java Process heap size configured for this role.
Related Name
oom_heap_dump_dir
Default Value
/tmp
API Name
oom_heap_dump_dir
Required
false

Dump Heap When Out of Memory

Description
When set, generates heap dump file when java.lang.OutOfMemoryError is thrown.
Related Name
Default Value
true
API Name
oom_heap_dump_enabled
Required
true

Kill When Out of Memory

Description
When set, a SIGKILL signal is sent to the role process when java.lang.OutOfMemoryError is thrown.
Related Name
Default Value
true
API Name
oom_sigkill_enabled
Required
true

Automatically Restart Process

Description
When set, this role's process is automatically (and transparently) restarted in the event of an unexpected failure. This configuration applies in the time after the Start Wait Timeout period.
Related Name
Default Value
false
API Name
process_auto_restart
Required
true

Enable Metric Collection

Description
Cloudera Manager agent monitors each service and each of its role by publishing metrics to the Cloudera Manager Service Monitor. Setting it to false will stop Cloudera Manager agent from publishing any metric for corresponding service/roles. This is usually helpful for services that generate large amount of metrics which Service Monitor is not able to process.
Related Name
Default Value
true
API Name
process_should_monitor
Required
true

Process Start Retry Attempts

Description
Number of times to try starting a role's process when the process exits before the Start Wait Timeout period. After a process is running beyond the Start Wait Timeout, the retry count is reset. Setting this configuration to zero will prevent restart of the process during the Start Wait Timeout period.
Related Name
Default Value
3
API Name
process_start_retries
Required
false

Process Start Wait Timeout

Description
The time in seconds to wait for a role's process to start successfully on a host. Processes which exit/crash before this time will be restarted until reaching the limit specified by the Start Retry Attempts count parameter. Setting this configuration to zero will turn off this feature.
Related Name
Default Value
20
API Name
process_start_secs
Required
false

WebHCat Server Advanced Configuration Snippet (Safety Valve) for core-site.xml

Description
For advanced use only. A string to be inserted into core-site.xml for this role only.
Related Name
Default Value
API Name
webhcat_core_site_safety_valve
Required
false

Logs

WebHCat Server Log Directory

Description
Directory where WebHCat Server will place its log files.
Related Name
Default Value
/var/log/hcatalog
API Name
hcatalog_log_dir
Required
false

WebHCat Server Logging Threshold

Description
The minimum log level for WebHCat Server logs
Related Name
Default Value
INFO
API Name
log_threshold
Required
false

WebHCat Server Maximum Log File Backups

Description
The maximum number of rolled log files to keep for WebHCat Server logs. Typically used by log4j or logback.
Related Name
Default Value
10
API Name
max_log_backup_index
Required
false

WebHCat Server Max Log Size

Description
The maximum size, in megabytes, per log file for WebHCat Server logs. Typically used by log4j or logback.
Related Name
Default Value
200 MiB
API Name
max_log_size
Required
false

Monitoring

Enable Health Alerts for this Role

Description
When set, Cloudera Manager will send alerts when the health of this role reaches the threshold specified by the EventServer setting eventserver_health_events_alert_threshold
Related Name
Default Value
true
API Name
enable_alerts
Required
false

Enable Configuration Change Alerts

Description
When set, Cloudera Manager will send alerts when this entity's configuration changes.
Related Name
Default Value
false
API Name
enable_config_alerts
Required
false

Heap Dump Directory Free Space Monitoring Absolute Thresholds

Description
The health test thresholds for monitoring of free space on the filesystem that contains this role's heap dump directory.
Related Name
Default Value
Warning: 10 GiB, Critical: 5 GiB
API Name
heap_dump_directory_free_space_absolute_thresholds
Required
false

Heap Dump Directory Free Space Monitoring Percentage Thresholds

Description
The health test thresholds for monitoring of free space on the filesystem that contains this role's heap dump directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Heap Dump Directory Free Space Monitoring Absolute Thresholds setting is configured.
Related Name
Default Value
Warning: Never, Critical: Never
API Name
heap_dump_directory_free_space_percentage_thresholds
Required
false

Log Directory Free Space Monitoring Absolute Thresholds

Description
The health test thresholds for monitoring of free space on the filesystem that contains this role's log directory.
Related Name
Default Value
Warning: 10 GiB, Critical: 5 GiB
API Name
log_directory_free_space_absolute_thresholds
Required
false

Log Directory Free Space Monitoring Percentage Thresholds

Description
The health test thresholds for monitoring of free space on the filesystem that contains this role's log directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Log Directory Free Space Monitoring Absolute Thresholds setting is configured.
Related Name
Default Value
Warning: Never, Critical: Never
API Name
log_directory_free_space_percentage_thresholds
Required
false

Navigator Audit Failure Thresholds

Description
The health test thresholds for failures encountered when monitoring audits within a recent period specified by the mgmt_navigator_failure_window configuration for the role. The value that can be specified for this threshold is the number of bytes of audits data that is left to be sent to audit server.
Related Name
mgmt.navigator.failure.thresholds
Default Value
Warning: Never, Critical: Any
API Name
mgmt_navigator_failure_thresholds
Required
false

Monitoring Period For Audit Failures

Description
The period to review when checking if audits are blocked and not getting processed.
Related Name
mgmt.navigator.failure.window
Default Value
20 minute(s)
API Name
mgmt_navigator_failure_window
Required
false

Navigator Audit Pipeline Health Check

Description
Enable test of audit events processing pipeline. This will test if audit events are not getting processed by Audit Server for a role that generates audit.
Related Name
mgmt.navigator.status.check.enabled
Default Value
true
API Name
mgmt_navigator_status_check_enabled
Required
false

Metric Filter

Description
Defines a Metric Filter for this role. Cloudera Manager Agents will not send filtered metrics to the Service Monitor. Define the following fields:
  • Health Test Metric Set - Select this parameter to collect only metrics required for health tests.
  • Default Dashboard Metric Set - Select this parameter to collect only metrics required for the default dashboards. For user-defined charts, you must add the metrics you require for the chart using the Custom Metrics parameter.
  • Include/Exclude Custom Metrics - Select Include to specify metrics that should be collected. Select Exclude to specify metrics that should not be collected. Enter the metric names to be included or excluded using the Metric Name parameter.
  • Metric Name - The name of a metric that will be included or excluded during metric collection.
If you do not select Health Test Metric Set or Default Dashboard Metric Set, or specify metrics by name, metric filtering will be turned off (this is the default behavior).For example, the following configuration enables the collection of metrics required for Health Tests and the jvm_heap_used_mb metric:
  • Include only Health Test Metric Set: Selected.
  • Include/Exclude Custom Metrics: Set to Include.
  • Metric Name: jvm_heap_used_mb
You can also view the JSON representation for this parameter by clicking View as JSON. In this example, the JSON looks like this:{ "includeHealthTestMetricSet": true, "filterType": "whitelist", "metrics": ["jvm_heap_used_mb"] }
Related Name
Default Value
API Name
monitoring_metric_filter
Required
false

Process Swap Memory Thresholds

Description
The health test thresholds on the swap memory usage of the process. This takes precedence over the host level threshold.
Related Name
Default Value
Warning: 200 B, Critical: Never
API Name
process_swap_memory_thresholds
Required
false

Role Triggers

Description
The configured triggers for this role. This is a JSON-formatted list of triggers. These triggers are evaluated as part as the health system. Every trigger expression is parsed, and if the trigger condition is met, the list of actions provided in the trigger expression is executed. Each trigger has the following fields:
  • triggerName (mandatory) - The name of the trigger. This value must be unique for the specific role.
  • triggerExpression (mandatory) - A tsquery expression representing the trigger.
  • streamThreshold (optional) - The maximum number of streams that can satisfy a condition of a trigger before the condition fires. By default set to 0, and any stream returned causes the condition to fire.
  • enabled (optional) - By default set to 'true'. If set to 'false', the trigger is not evaluated.
  • expressionEditorConfig (optional) - Metadata for the trigger editor. If present, the trigger should only be edited from the Edit Trigger page; editing the trigger here can lead to inconsistencies.
For example, the following JSON formatted trigger configured for a DataNode fires if the DataNode has more than 1500 file descriptors opened:[{"triggerName": "sample-trigger", "triggerExpression": "IF (SELECT fd_open WHERE roleName=$ROLENAME and last(fd_open) > 1500) DO health:bad", "streamThreshold": 0, "enabled": "true"}]See the trigger rules documentation for more details on how to write triggers using tsquery.The JSON format is evolving and may change and, as a result, backward compatibility is not guaranteed between releases.
Related Name
Default Value
[]
API Name
role_triggers
Required
true

Unexpected Exits Thresholds

Description
The health test thresholds for unexpected exits encountered within a recent period specified by the unexpected_exits_window configuration for the role.
Related Name
Default Value
Warning: Never, Critical: Any
API Name
unexpected_exits_thresholds
Required
false

Unexpected Exits Monitoring Period

Description
The period to review when computing unexpected exits.
Related Name
Default Value
5 minute(s)
API Name
unexpected_exits_window
Required
false

File Descriptor Monitoring Thresholds

Description
The health test thresholds of the number of file descriptors used. Specified as a percentage of file descriptor limit.
Related Name
Default Value
Warning: 50.0 %, Critical: 70.0 %
API Name
webhcat_fd_thresholds
Required
false

WebHCat Server Host Health Test

Description
When computing the overall WebHCat Server health, consider the host's health.
Related Name
Default Value
true
API Name
webhcat_host_health_enabled
Required
false

WebHCat Server Process Health Test

Description
Enables the health test that the WebHCat Server's process state is consistent with the role configuration
Related Name
Default Value
true
API Name
webhcat_scm_health_enabled
Required
false

Performance

Maximum Process File Descriptors

Description
If configured, overrides the process soft and hard rlimits (also called ulimits) for file descriptors to the configured value.
Related Name
Default Value
API Name
rlimit_fds
Required
false

Ports and Addresses

WebHCat Server Port

Description
Port on which WebHCat Server will listen for connections.
Related Name
templeton.port
Default Value
50111
API Name
hive_webhcat_address_port
Required
false

Resource Management

Java Heap Size of WebHCat Server in Bytes

Description
Maximum size in bytes for the Java Process heap memory. Passed to Java -Xmx.
Related Name
Default Value
256 MiB
API Name
hive_webhcat_java_heapsize
Required
false

Cgroup CPU Shares

Description
Number of CPU shares to assign to this role. The greater the number of shares, the larger the share of the host's CPUs that will be given to this role when the host experiences CPU contention. Must be between 2 and 262144. Defaults to 1024 for processes not managed by Cloudera Manager.
Related Name
cpu.shares
Default Value
1024
API Name
rm_cpu_shares
Required
true

Custom Control Group Resources (overrides Cgroup settings)

Description
Custom control group resources to assign to this role, which will be enforced by the Linux kernel. These resources should exist on the target hosts, otherwise an error will occur when the process starts. Use the same format as used for arguments to the cgexec command: resource1,resource2:path1 or resource3:path2 For example: 'cpu,memory:my/path blkio:my2/path2' ***These settings override other cgroup settings.***
Related Name
custom.cgroups
Default Value
API Name
rm_custom_resources
Required
false

Cgroup I/O Weight

Description
Weight for the read I/O requests issued by this role. The greater the weight, the higher the priority of the requests when the host experiences I/O contention. Must be between 100 and 1000. Defaults to 1000 for processes not managed by Cloudera Manager.
Related Name
blkio.weight
Default Value
500
API Name
rm_io_weight
Required
true

Cgroup Memory Hard Limit

Description
Hard memory limit to assign to this role, enforced by the Linux kernel. When the limit is reached, the kernel will reclaim pages charged to the process. If reclaiming fails, the kernel may kill the process. Both anonymous as well as page cache pages contribute to the limit. Use a value of -1 to specify no limit. By default processes not managed by Cloudera Manager will have no limit. If the value is -1, Cloudera Manager will not monitor Cgroup memory usage therefore some of the charts will show 'No Data'
Related Name
memory.limit_in_bytes
Default Value
-1 MiB
API Name
rm_memory_hard_limit
Required
true

Cgroup Memory Soft Limit

Description
Soft memory limit to assign to this role, enforced by the Linux kernel. When the limit is reached, the kernel will reclaim pages charged to the process if and only if the host is facing memory pressure. If reclaiming fails, the kernel may kill the process. Both anonymous as well as page cache pages contribute to the limit. Use a value of -1 to specify no limit. By default processes not managed by Cloudera Manager will have no limit. If the value is -1, Cloudera Manager will not monitor Cgroup memory usage therefore some of the charts will show 'No Data'
Related Name
memory.soft_limit_in_bytes
Default Value
-1 MiB
API Name
rm_memory_soft_limit
Required
true

Stacks Collection

Stacks Collection Data Retention

Description
The amount of stacks data that is retained. After the retention limit is reached, the oldest data is deleted.
Related Name
stacks_collection_data_retention
Default Value
100 MiB
API Name
stacks_collection_data_retention
Required
false

Stacks Collection Directory

Description
The directory in which stacks logs are placed. If not set, stacks are logged into a stacks subdirectory of the role's log directory.
Related Name
stacks_collection_directory
Default Value
API Name
stacks_collection_directory
Required
false

Stacks Collection Enabled

Description
Whether or not periodic stacks collection is enabled.
Related Name
stacks_collection_enabled
Default Value
false
API Name
stacks_collection_enabled
Required
true

Stacks Collection Frequency

Description
The frequency with which stacks are collected.
Related Name
stacks_collection_frequency
Default Value
5.0 second(s)
API Name
stacks_collection_frequency
Required
false

Stacks Collection Method

Description
The method used to collect stacks. The jstack option involves periodically running the jstack command against the role's daemon process. The servlet method is available for those roles that have an HTTP server endpoint exposing the current stacks traces of all threads. When the servlet method is selected, that HTTP endpoint is periodically scraped.
Related Name
stacks_collection_method
Default Value
jstack
API Name
stacks_collection_method
Required
false

Suppressions

Suppress Configuration Validator: CDH Version Validator

Description
Whether to suppress configuration warnings produced by the CDH Version Validator configuration validator.
Related Name
Default Value
false
API Name
role_config_suppression_cdh_version_validator
Required
true

Suppress Parameter Validation: WebHCat Server Log Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the WebHCat Server Log Directory parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hcatalog_log_dir
Required
true

Suppress Parameter Validation: WebHCat Server Port

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the WebHCat Server Port parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_webhcat_address_port
Required
true

Suppress Parameter Validation: WebHCat Server Advanced Configuration Snippet (Safety Valve) for webhcat-site.xml

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the WebHCat Server Advanced Configuration Snippet (Safety Valve) for webhcat-site.xml parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_webhcat_config_safety_valve
Required
true

Suppress Parameter Validation: WebHCat Server Environment Advanced Configuration Snippet (Safety Valve)

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the WebHCat Server Environment Advanced Configuration Snippet (Safety Valve) parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_webhcat_env_safety_valve
Required
true

Suppress Parameter Validation: WebHCat Server Advanced Configuration Snippet (Safety Valve) for hive-site.xml

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the WebHCat Server Advanced Configuration Snippet (Safety Valve) for hive-site.xml parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_webhcat_hive_config_safety_valve
Required
true

Suppress Parameter Validation: Java Configuration Options for WebHCat Server

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Java Configuration Options for WebHCat Server parameter.
Related Name
Default Value
false
API Name
role_config_suppression_hive_webhcat_java_opts
Required
true

Suppress Parameter Validation: WebHCat Server Logging Advanced Configuration Snippet (Safety Valve)

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the WebHCat Server Logging Advanced Configuration Snippet (Safety Valve) parameter.
Related Name
Default Value
false
API Name
role_config_suppression_log4j_safety_valve
Required
true

Suppress Parameter Validation: Heap Dump Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Heap Dump Directory parameter.
Related Name
Default Value
false
API Name
role_config_suppression_oom_heap_dump_dir
Required
true

Suppress Parameter Validation: Custom Control Group Resources (overrides Cgroup settings)

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Custom Control Group Resources (overrides Cgroup settings) parameter.
Related Name
Default Value
false
API Name
role_config_suppression_rm_custom_resources
Required
true

Suppress Parameter Validation: Role Triggers

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Role Triggers parameter.
Related Name
Default Value
false
API Name
role_config_suppression_role_triggers
Required
true

Suppress Parameter Validation: Stacks Collection Directory

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Stacks Collection Directory parameter.
Related Name
Default Value
false
API Name
role_config_suppression_stacks_collection_directory
Required
true

Suppress Parameter Validation: WebHCat Server Advanced Configuration Snippet (Safety Valve) for core-site.xml

Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the WebHCat Server Advanced Configuration Snippet (Safety Valve) for core-site.xml parameter.
Related Name
Default Value
false
API Name
role_config_suppression_webhcat_core_site_safety_valve
Required
true

Suppress Health Test: Audit Pipeline Test

Description
Whether to suppress the results of the Audit Pipeline Test heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_webhcat_audit_health
Required
true

Suppress Health Test: File Descriptors

Description
Whether to suppress the results of the File Descriptors heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_webhcat_file_descriptor
Required
true

Suppress Health Test: Heap Dump Directory Free Space

Description
Whether to suppress the results of the Heap Dump Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_webhcat_heap_dump_directory_free_space
Required
true

Suppress Health Test: Host Health

Description
Whether to suppress the results of the Host Health heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_webhcat_host_health
Required
true

Suppress Health Test: Log Directory Free Space

Description
Whether to suppress the results of the Log Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_webhcat_log_directory_free_space
Required
true

Suppress Health Test: Process Status

Description
Whether to suppress the results of the Process Status heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_webhcat_scm_health
Required
true

Suppress Health Test: Swap Memory Usage

Description
Whether to suppress the results of the Swap Memory Usage heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_webhcat_swap_memory_usage
Required
true

Suppress Health Test: Unexpected Exits

Description
Whether to suppress the results of the Unexpected Exits heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts.
Related Name
Default Value
false
API Name
role_health_suppression_webhcat_unexpected_exits
Required
true