Navigator HSM KMS backed by Thales HSM Properties in CDH 5.16.0

Role groups:

Navigator Thales KMS Metastore

Categories:

Advanced

Display Name Description Related Name Default Value API Name Required
Navigator Thales KMS Metastore Environment Advanced Configuration Snippet (Safety Valve) For advanced use only, key-value pairs (one on each line) to be inserted into a role's environment. Applies to configurations of this role except client configuration. HSMKP_METASTORE_THALES_role_env_safety_valve false
Automatically Restart Process When set, this role's process is automatically (and transparently) restarted in the event of an unexpected failure. false process_auto_restart true
Enable Metric Collection Cloudera Manager agent monitors each service and each of its role by publishing metrics to the Cloudera Manager Service Monitor. Setting it to false will stop Cloudera Manager agent from publishing any metric for corresponding service/roles. This is usually helpful for services that generate large amount of metrics which Service Monitor is not able to process. true process_should_monitor true

Monitoring

Display Name Description Related Name Default Value API Name Required
Enable Health Alerts for this Role When set, Cloudera Manager will send alerts when the health of this role reaches the threshold specified by the EventServer setting eventserver_health_events_alert_threshold true enable_alerts false
Enable Configuration Change Alerts When set, Cloudera Manager will send alerts when this entity's configuration changes. false enable_config_alerts false
File Descriptor Monitoring Thresholds The health test thresholds of the number of file descriptors used. Specified as a percentage of file descriptor limit. Warning: 50.0 %, Critical: 70.0 % hsmkp_metastore_thales_fd_thresholds false
Navigator Thales KMS Metastore Host Health Test When computing the overall Navigator Thales KMS Metastore health, consider the host's health. true hsmkp_metastore_thales_host_health_enabled false
Navigator Thales KMS Metastore Process Health Test Enables the health test that the Navigator Thales KMS Metastore's process state is consistent with the role configuration true hsmkp_metastore_thales_scm_health_enabled false
Process Swap Memory Thresholds The health test thresholds on the swap memory usage of the process. Warning: Any, Critical: Never process_swap_memory_thresholds false
Role Triggers The configured triggers for this role. This is a JSON-formatted list of triggers. These triggers are evaluated as part as the health system. Every trigger expression is parsed, and if the trigger condition is met, the list of actions provided in the trigger expression is executed. Each trigger has the following fields:
  • triggerName (mandatory) - The name of the trigger. This value must be unique for the specific role.
  • triggerExpression (mandatory) - A tsquery expression representing the trigger.
  • streamThreshold (optional) - The maximum number of streams that can satisfy a condition of a trigger before the condition fires. By default set to 0, and any stream returned causes the condition to fire.
  • enabled (optional) - By default set to 'true'. If set to 'false', the trigger is not evaluated.
  • expressionEditorConfig (optional) - Metadata for the trigger editor. If present, the trigger should only be edited from the Edit Trigger page; editing the trigger here can lead to inconsistencies.
For example, the following JSON formatted trigger configured for a DataNode fires if the DataNode has more than 1500 file descriptors opened:[{"triggerName": "sample-trigger", "triggerExpression": "IF (SELECT fd_open WHERE roleName=$ROLENAME and last(fd_open) > 1500) DO health:bad", "streamThreshold": 0, "enabled": "true"}]See the trigger rules documentation for more details on how to write triggers using tsquery.The JSON format is evolving and may change and, as a result, backward compatibility is not guaranteed between releases.		 [] role_triggers true
Unexpected Exits Thresholds The health test thresholds for unexpected exits encountered within a recent period specified by the unexpected_exits_window configuration for the role. Warning: Never, Critical: Any unexpected_exits_thresholds false
Unexpected Exits Monitoring Period The period to review when computing unexpected exits. 5 minute(s) unexpected_exits_window false

Other

Display Name Description Related Name Default Value API Name Required
Navigator Thales KMS Metastore Directory Location of Navigator Thales KMS Metastore Directory. cloudera.hsmkp.metastore.directory /var/lib/hsmkp-meta cloudera_trustee_keyprovider_hsm_datadir true
Graceful Shutdown Timeout The timeout in milliseconds to wait for graceful shutdown to complete. 0 second(s) graceful_stop_timeout false

Performance

Display Name Description Related Name Default Value API Name Required
Maximum Process File Descriptors If configured, overrides the process soft and hard rlimits (also called ulimits) for file descriptors to the configured value. rlimit_fds false

Resource Management

Display Name Description Related Name Default Value API Name Required
Cgroup CPU Shares Number of CPU shares to assign to this role. The greater the number of shares, the larger the share of the host's CPUs that will be given to this role when the host experiences CPU contention. Must be between 2 and 262144. Defaults to 1024 for processes not managed by Cloudera Manager. cpu.shares 1024 rm_cpu_shares true
Cgroup I/O Weight Weight for the read I/O requests issued by this role. The greater the weight, the higher the priority of the requests when the host experiences I/O contention. Must be between 100 and 1000. Defaults to 1000 for processes not managed by Cloudera Manager. blkio.weight 500 rm_io_weight true
Cgroup Memory Hard Limit Hard memory limit to assign to this role, enforced by the Linux kernel. When the limit is reached, the kernel will reclaim pages charged to the process. If reclaiming fails, the kernel may kill the process. Both anonymous as well as page cache pages contribute to the limit. Use a value of -1 B to specify no limit. By default processes not managed by Cloudera Manager will have no limit. memory.limit_in_bytes -1 MiB rm_memory_hard_limit true
Cgroup Memory Soft Limit Soft memory limit to assign to this role, enforced by the Linux kernel. When the limit is reached, the kernel will reclaim pages charged to the process if and only if the host is facing memory pressure. If reclaiming fails, the kernel may kill the process. Both anonymous as well as page cache pages contribute to the limit. Use a value of -1 B to specify no limit. By default processes not managed by Cloudera Manager will have no limit. memory.soft_limit_in_bytes -1 MiB rm_memory_soft_limit true

Suppressions

Display Name Description Related Name Default Value API Name Required
Suppress Configuration Validator: CDH Version Validator Whether to suppress configuration warnings produced by the CDH Version Validator configuration validator. false role_config_suppression_cdh_version_validator true
Suppress Parameter Validation: Navigator Thales KMS Metastore Directory Whether to suppress configuration warnings produced by the built-in parameter validation for the Navigator Thales KMS Metastore Directory parameter. false role_config_suppression_cloudera_trustee_keyprovider_hsm_datadir true
Suppress Parameter Validation: Navigator Thales KMS Metastore Environment Advanced Configuration Snippet (Safety Valve) Whether to suppress configuration warnings produced by the built-in parameter validation for the Navigator Thales KMS Metastore Environment Advanced Configuration Snippet (Safety Valve) parameter. false role_config_suppression_hsmkp_metastore_thales_role_env_safety_valve true
Suppress Parameter Validation: Role Triggers Whether to suppress configuration warnings produced by the built-in parameter validation for the Role Triggers parameter. false role_config_suppression_role_triggers true
Suppress Health Test: Audit Pipeline Test Whether to suppress the results of the Audit Pipeline Test heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. false role_health_suppression_thales_kms_hsmkp_metastore_thales_audit_health true
Suppress Health Test: File Descriptors Whether to suppress the results of the File Descriptors heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. false role_health_suppression_thales_kms_hsmkp_metastore_thales_file_descriptor true
Suppress Health Test: Host Health Whether to suppress the results of the Host Health heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. false role_health_suppression_thales_kms_hsmkp_metastore_thales_host_health true
Suppress Health Test: Process Status Whether to suppress the results of the Process Status heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. false role_health_suppression_thales_kms_hsmkp_metastore_thales_scm_health true
Suppress Health Test: Swap Memory Usage Whether to suppress the results of the Swap Memory Usage heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. false role_health_suppression_thales_kms_hsmkp_metastore_thales_swap_memory_usage true
Suppress Health Test: Unexpected Exits Whether to suppress the results of the Unexpected Exits heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. false role_health_suppression_thales_kms_hsmkp_metastore_thales_unexpected_exits true

Navigator Thales KMS Proxy

Categories:

Advanced

Display Name Description Related Name Default Value API Name Required
Navigator Thales KMS Proxy Advanced Configuration Snippet (Safety Valve) for core-site.xml For advanced use only. A string to be inserted into core-site.xml for this role only. core-site.xml_role_safety_valve false
Navigator Thales KMS Proxy Environment Advanced Configuration Snippet (Safety Valve) For advanced use only, key-value pairs (one on each line) to be inserted into a role's environment. Applies to configurations of this role except client configuration. HSMKP_THALES_role_env_safety_valve false
Navigator Thales KMS Proxy Advanced Configuration Snippet (Safety Valve) for kms-acls.xml For advanced use only. A string to be inserted into kms-acls.xml for this role only. kms-acls.xml_role_safety_valve false
Navigator Thales KMS Proxy Advanced Configuration Snippet (Safety Valve) for kms-site.xml For advanced use only. A string to be inserted into kms-site.xml for this role only. kms-site.xml_role_safety_valve false
Navigator Thales KMS Proxy Logging Advanced Configuration Snippet (Safety Valve) For advanced use only, a string to be inserted into log4j.properties for this role only. log4j_safety_valve false
Automatically Restart Process When set, this role's process is automatically (and transparently) restarted in the event of an unexpected failure. false process_auto_restart true
Enable Metric Collection Cloudera Manager agent monitors each service and each of its role by publishing metrics to the Cloudera Manager Service Monitor. Setting it to false will stop Cloudera Manager agent from publishing any metric for corresponding service/roles. This is usually helpful for services that generate large amount of metrics which Service Monitor is not able to process. true process_should_monitor true

Logs

Display Name Description Related Name Default Value API Name Required
Navigator Thales KMS Proxy Log Directory The log directory for log files of the role Navigator Thales KMS Proxy. log.dir /var/log/hsmkp log_dir false
Navigator Thales KMS Proxy Logging Threshold The minimum log level for Navigator Thales KMS Proxy logs INFO log_threshold false
Navigator Thales KMS Proxy Maximum Log File Backups The maximum number of rolled log files to keep for Navigator Thales KMS Proxy logs. Typically used by log4j or logback. 10 max_log_backup_index false
Navigator Thales KMS Proxy Max Log Size The maximum size, in megabytes, per log file for Navigator Thales KMS Proxy logs. Typically used by log4j or logback. 200 MiB max_log_size false

Monitoring

Display Name Description Related Name Default Value API Name Required
Enable Health Alerts for this Role When set, Cloudera Manager will send alerts when the health of this role reaches the threshold specified by the EventServer setting eventserver_health_events_alert_threshold true enable_alerts false
Enable Configuration Change Alerts When set, Cloudera Manager will send alerts when this entity's configuration changes. false enable_config_alerts false
File Descriptor Monitoring Thresholds The health test thresholds of the number of file descriptors used. Specified as a percentage of file descriptor limit. Warning: 50.0 %, Critical: 70.0 % hsmkp_thales_fd_thresholds false
Navigator Thales KMS Proxy Host Health Test When computing the overall Navigator Thales KMS Proxy health, consider the host's health. true hsmkp_thales_host_health_enabled false
Navigator Thales KMS Proxy Process Health Test Enables the health test that the Navigator Thales KMS Proxy's process state is consistent with the role configuration true hsmkp_thales_scm_health_enabled false
Log Directory Free Space Monitoring Absolute Thresholds The health test thresholds for monitoring of free space on the filesystem that contains this role's log directory. Warning: 10 GiB, Critical: 5 GiB log_directory_free_space_absolute_thresholds false
Log Directory Free Space Monitoring Percentage Thresholds The health test thresholds for monitoring of free space on the filesystem that contains this role's log directory. Specified as a percentage of the capacity on that filesystem. This setting is not used if a Log Directory Free Space Monitoring Absolute Thresholds setting is configured. Warning: Never, Critical: Never log_directory_free_space_percentage_thresholds false
Process Swap Memory Thresholds The health test thresholds on the swap memory usage of the process. Warning: Any, Critical: Never process_swap_memory_thresholds false
Role Triggers The configured triggers for this role. This is a JSON-formatted list of triggers. These triggers are evaluated as part as the health system. Every trigger expression is parsed, and if the trigger condition is met, the list of actions provided in the trigger expression is executed. Each trigger has the following fields:
  • triggerName (mandatory) - The name of the trigger. This value must be unique for the specific role.
  • triggerExpression (mandatory) - A tsquery expression representing the trigger.
  • streamThreshold (optional) - The maximum number of streams that can satisfy a condition of a trigger before the condition fires. By default set to 0, and any stream returned causes the condition to fire.
  • enabled (optional) - By default set to 'true'. If set to 'false', the trigger is not evaluated.
  • expressionEditorConfig (optional) - Metadata for the trigger editor. If present, the trigger should only be edited from the Edit Trigger page; editing the trigger here can lead to inconsistencies.
For example, the following JSON formatted trigger configured for a DataNode fires if the DataNode has more than 1500 file descriptors opened:[{"triggerName": "sample-trigger", "triggerExpression": "IF (SELECT fd_open WHERE roleName=$ROLENAME and last(fd_open) > 1500) DO health:bad", "streamThreshold": 0, "enabled": "true"}]See the trigger rules documentation for more details on how to write triggers using tsquery.The JSON format is evolving and may change and, as a result, backward compatibility is not guaranteed between releases.		 [] role_triggers true
Unexpected Exits Thresholds The health test thresholds for unexpected exits encountered within a recent period specified by the unexpected_exits_window configuration for the role. Warning: Never, Critical: Any unexpected_exits_thresholds false
Unexpected Exits Monitoring Period The period to review when computing unexpected exits. 5 minute(s) unexpected_exits_window false

Other

Display Name Description Related Name Default Value API Name Required
Keystore Password Specify a unique password to protect the Navigator Thales KMS metadata. Important: Safely store this password for future use. In the event that the service is deleted, you must provide this password to re-add the service with the same metastore. cloudera.hsmkp.keystore.passwordcallback cloudera_trustee_keyprovider_hsm_keystore_passwd true
Thales HSM Password Obtain Thales HSM login password from HSM administrator. cloudera.hsmkp.hsm.passwordcallback cloudera_trustee_keyprovider_hsm_password true
Thales HSM Client Location Thales HSM Client Installation Location. cloudera.hsmkp.hsm.thales.client_dir /opt/nfast cloudera_trustee_keyprovider_hsm_thales_client_dir true
Thales Unix Group Thales Unix Group. cloudera.hsmkp.hsm.thales.unix_group nfast cloudera_trustee_keyprovider_hsm_thales_unix_group true
Flume Proxy User Groups Allows the flume superuser to impersonate any members of a comma-delimited list of groups. The default '*' allows all groups. To disable entirely, use a string that doesn't correspond to a group name, such as '_no_group_'. hadoop.kms.proxyuser.flume.groups * hadoop_kms_proxyuser_flume_groups false
Flume Proxy User Hosts Comma-delimited list of hosts where you want to allow the flume user to impersonate other users. The default '*' allows all hosts. To disable entirely, use a string that doesn't correspond to a host name, such as '_no_host'. hadoop.kms.proxyuser.flume.hosts * hadoop_kms_proxyuser_flume_hosts false
HDFS Proxy User Groups Allows the hdfs superuser to impersonate any members of a comma-delimited list of groups. The default '*' allows all groups. To disable entirely, use a string that doesn't correspond to a group name, such as '_no_group_'. hadoop.kms.proxyuser.hdfs.groups * hadoop_kms_proxyuser_hdfs_groups false
HDFS Proxy User Hosts Comma-delimited list of hosts where you want to allow the hdfs user to impersonate other users. The default '*' allows all hosts. To disable entirely, use a string that doesn't correspond to a host name, such as '_no_host'. hadoop.kms.proxyuser.hdfs.hosts * hadoop_kms_proxyuser_hdfs_hosts false
Hive Proxy User Groups Allows the hive superuser to impersonate any members of a comma-delimited list of groups. The default '*' allows all groups. To disable entirely, use a string that doesn't correspond to a group name, such as '_no_group_'. hadoop.kms.proxyuser.hive.groups * hadoop_kms_proxyuser_hive_groups false
Hive Proxy User Hosts Comma-delimited list of hosts where you want to allow the hive user to impersonate other users. The default '*' allows all hosts. To disable entirely, use a string that doesn't correspond to a host name, such as '_no_host'. hadoop.kms.proxyuser.hive.hosts * hadoop_kms_proxyuser_hive_hosts false
HTTP Proxy User Groups Allows the HTTP superuser to impersonate any members of a comma-delimited list of groups. The default '*' allows all groups. To disable entirely, use a string that doesn't correspond to a group name, such as '_no_group_'. hadoop.kms.proxyuser.HTTP.groups * hadoop_kms_proxyuser_HTTP_groups false
HTTP Proxy User Hosts Comma-delimited list of hosts where you want to allow the HTTP user to impersonate other users. The default '*' allows all hosts. To disable entirely, use a string that doesn't correspond to a host name, such as '_no_host'. hadoop.kms.proxyuser.HTTP.hosts * hadoop_kms_proxyuser_HTTP_hosts false
HttpFS Proxy User Groups Allows the httpfs superuser to impersonate any members of a comma-delimited list of groups. The default '*' allows all groups. To disable entirely, use a string that doesn't correspond to a group name, such as '_no_group_'. hadoop.kms.proxyuser.httpfs.groups * hadoop_kms_proxyuser_httpfs_groups false
HttpFS Proxy User Hosts Comma-delimited list of hosts where you want to allow the httpfs user to impersonate other users. The default '*' allows all hosts. To disable entirely, use a string that doesn't correspond to a host name, such as '_no_host'. hadoop.kms.proxyuser.httpfs.hosts * hadoop_kms_proxyuser_httpfs_hosts false
Hue Proxy User Groups Allows the hue superuser to impersonate any members of a comma-delimited list of groups. The default '*' allows all groups. To disable entirely, use a string that doesn't correspond to a group name, such as '_no_group_'. hadoop.kms.proxyuser.hue.groups * hadoop_kms_proxyuser_hue_groups false
Hue Proxy User Hosts Comma-delimited list of hosts where you want to allow the hue user to impersonate other users. The default '*' allows all hosts. To disable entirely, use a string that doesn't correspond to a host name, such as '_no_host'. hadoop.kms.proxyuser.hue.hosts * hadoop_kms_proxyuser_hue_hosts false
Mapred Proxy User Groups Allows the mapred superuser to impersonate any members of a comma-delimited list of groups. The default '*' allows all groups. To disable entirely, use a string that doesn't correspond to a group name, such as '_no_group_'. hadoop.kms.proxyuser.mapred.groups * hadoop_kms_proxyuser_mapred_groups false
Mapred Proxy User Hosts Comma-delimited list of hosts where you want to allow the mapred user to impersonate other users. The default '*' allows all hosts. To disable entirely, use a string that doesn't correspond to a host name, such as '_no_host'. hadoop.kms.proxyuser.mapred.hosts * hadoop_kms_proxyuser_mapred_hosts false
Oozie Proxy User Groups Allows the oozie superuser to impersonate any members of a comma-delimited list of groups. The default '*' allows all groups. To disable entirely, use a string that doesn't correspond to a group name, such as '_no_group_'. hadoop.kms.proxyuser.oozie.groups * hadoop_kms_proxyuser_oozie_groups false
Oozie Proxy User Hosts Comma-delimited list of hosts where you want to allow the oozie user to impersonate other users. The default '*' allows all hosts. To disable entirely, use a string that doesn't correspond to a host name, such as '_no_host'. hadoop.kms.proxyuser.oozie.hosts * hadoop_kms_proxyuser_oozie_hosts false
YARN Proxy User Groups Allows the yarn superuser to impersonate any members of a comma-delimited list of groups. The default '*' allows all groups. To disable entirely, use a string that doesn't correspond to a group name, such as '_no_group_'. hadoop.kms.proxyuser.yarn.groups * hadoop_kms_proxyuser_yarn_groups false
YARN Proxy User Hosts Comma-delimited list of hosts where you want to allow the yarn user to impersonate other users. The default '*' allows all hosts. To disable entirely, use a string that doesn't correspond to a host name, such as '_no_host'. hadoop.kms.proxyuser.yarn.hosts * hadoop_kms_proxyuser_yarn_hosts false
HSM KeyStoreProvider Directory Directory to the keystore file used by HSM KeyStoreProvider that backs the KMS. cloudera.hsmkp.data_dir /var/lib/hsmkp hadoop_security_key_provider_dir true
KMS Accept Count The maximum queue length for incoming connection requests when all possible request processing threads are in use. Any requests received when the queue is full will be refused.This configuration is only supported in CDH 5.11 and up. kms_accept_count 500 kms_accept_count false
KMS Acceptor Thread Count The number of threads to be used to accept connections. Increase this value on a multi CPU machine, although you would never really need more than 2. Also, with a lot of non keep alive connections, you might want to increase this value as well.This setting only works with Tomcat's NIO handler protocol.This configuration is only supported in CDH 5.11 and up. kms_acceptor_thread_count 1 kms_acceptor_thread_count false
Navigator Thales KMS Blacklist Users A comma-separated list of users (no spaces) for whom to disallow access to key material. These users can still fetch key metadata and create encrypted encryption keys, but are unable to do any other KMS operations. Typically, HDFS superusers will be specified here. kms_blacklist_users kms_blacklist_users false
Navigator Thales KMS Heap Size Maximum heap size of the Navigator Thales KMS. kms_heap_size 1 GiB kms_heap_size true
Additional Java Configuration Options for Navigator Thales KMS These arguments will be passed as part of the Java command line. Commonly, garbage collection flags, PermGen, or extra debugging flags would be passed here. kms_java_opts kms_java_opts false
Navigator Thales KMS Max Threads Maximum number of threads used to handle Navigator Thales KMS requests. kms_max_threads 250 kms_max_threads false
KMS Handler Protocol The Tomcat handler protocol. The default HTTP/1.1 handler is a thread-per-request model.This configuration is only supported in CDH 5.11 and up. kms_protocol HTTP/1.1 kms_protocol false
Navigator Thales KMS Staging Directory Directory where configuration and binaries are staged before starting Navigator Thales KMS. Does not normally need to be modified. kms_staging_dir /var/lib/hsmkp-staging kms_staging_dir true

Performance

Display Name Description Related Name Default Value API Name Required
Maximum Process File Descriptors If configured, overrides the process soft and hard rlimits (also called ulimits) for file descriptors to the configured value. rlimit_fds false

Ports and Addresses

Display Name Description Related Name Default Value API Name Required
Navigator Thales KMS Messaging Port Navigator Thales KMS Messaging Port cloudera.hsmkp.message.port 65111 cloudera_trustee_keyprovider_hsm_message_port false
Thales HSM Server Port Thales HSM Server Port. cloudera.hsmkp.hsm.thales.server_port 9000 cloudera_trustee_keyprovider_hsm_thales_server_port true
Navigator Thales KMS Admin Port Port used to access the Navigator Thales KMS' embedded Tomcat admin console. kms_admin_port 16001 kms_admin_port true
Navigator Thales KMS HTTP Port Port used by clients to interact with the Navigator Thales KMS. kms_http_port 16000 kms_http_port true

Resource Management

Display Name Description Related Name Default Value API Name Required
Cgroup CPU Shares Number of CPU shares to assign to this role. The greater the number of shares, the larger the share of the host's CPUs that will be given to this role when the host experiences CPU contention. Must be between 2 and 262144. Defaults to 1024 for processes not managed by Cloudera Manager. cpu.shares 1024 rm_cpu_shares true
Cgroup I/O Weight Weight for the read I/O requests issued by this role. The greater the weight, the higher the priority of the requests when the host experiences I/O contention. Must be between 100 and 1000. Defaults to 1000 for processes not managed by Cloudera Manager. blkio.weight 500 rm_io_weight true
Cgroup Memory Hard Limit Hard memory limit to assign to this role, enforced by the Linux kernel. When the limit is reached, the kernel will reclaim pages charged to the process. If reclaiming fails, the kernel may kill the process. Both anonymous as well as page cache pages contribute to the limit. Use a value of -1 B to specify no limit. By default processes not managed by Cloudera Manager will have no limit. memory.limit_in_bytes -1 MiB rm_memory_hard_limit true
Cgroup Memory Soft Limit Soft memory limit to assign to this role, enforced by the Linux kernel. When the limit is reached, the kernel will reclaim pages charged to the process if and only if the host is facing memory pressure. If reclaiming fails, the kernel may kill the process. Both anonymous as well as page cache pages contribute to the limit. Use a value of -1 B to specify no limit. By default processes not managed by Cloudera Manager will have no limit. memory.soft_limit_in_bytes -1 MiB rm_memory_soft_limit true

Security

Display Name Description Related Name Default Value API Name Required
Navigator Thales KMS Proxy TLS/SSL Client Trust Store File The location on disk of the trust store, in .jks format, used to confirm the authenticity of TLS/SSL servers that Navigator Thales KMS Proxy might connect to. This is used when Navigator Thales KMS Proxy is the client in a TLS/SSL connection. This trust store must contain the certificate(s) used to sign the service(s) connected to. If this parameter is not provided, the default list of well-known certificate authorities is used instead. ssl_client_truststore_location false
Navigator Thales KMS Proxy TLS/SSL Client Trust Store Password The password for the Navigator Thales KMS Proxy TLS/SSL Certificate Trust Store File. This password is not required to access the trust store; this field can be left blank. This password provides optional integrity checking of the file. The contents of trust stores are certificates, and certificates are public information. ssl_client_truststore_password false
Enable TLS/SSL for Navigator Thales KMS Proxy Encrypt communication between clients and Navigator Thales KMS Proxy using Transport Layer Security (TLS) (formerly known as Secure Socket Layer (SSL)). false ssl_enabled false
Navigator Thales KMS Proxy TLS/SSL Server JKS Keystore File Location The path to the TLS/SSL keystore file containing the server certificate and private key used for TLS/SSL. Used when Navigator Thales KMS Proxy is acting as a TLS/SSL server. The keystore must be in JKS format. ssl_server_keystore_location false
Navigator Thales KMS Proxy TLS/SSL Server JKS Keystore File Password The password for the Navigator Thales KMS Proxy JKS keystore file. ssl_server_keystore_password false

Suppressions

Display Name Description Related Name Default Value API Name Required
Suppress Configuration Validator: CDH Version Validator Whether to suppress configuration warnings produced by the CDH Version Validator configuration validator. false role_config_suppression_cdh_version_validator true
Suppress Parameter Validation: Keystore Password Whether to suppress configuration warnings produced by the built-in parameter validation for the Keystore Password parameter. false role_config_suppression_cloudera_trustee_keyprovider_hsm_keystore_passwd true
Suppress Parameter Validation: Thales HSM Password Whether to suppress configuration warnings produced by the built-in parameter validation for the Thales HSM Password parameter. false role_config_suppression_cloudera_trustee_keyprovider_hsm_password true
Suppress Parameter Validation: Thales HSM Client Location Whether to suppress configuration warnings produced by the built-in parameter validation for the Thales HSM Client Location parameter. false role_config_suppression_cloudera_trustee_keyprovider_hsm_thales_client_dir true
Suppress Parameter Validation: Thales Unix Group Whether to suppress configuration warnings produced by the built-in parameter validation for the Thales Unix Group parameter. false role_config_suppression_cloudera_trustee_keyprovider_hsm_thales_unix_group true
Suppress Parameter Validation: Navigator Thales KMS Proxy Advanced Configuration Snippet (Safety Valve) for core-site.xml Whether to suppress configuration warnings produced by the built-in parameter validation for the Navigator Thales KMS Proxy Advanced Configuration Snippet (Safety Valve) for core-site.xml parameter. false role_config_suppression_core-site.xml_role_safety_valve true
Suppress Parameter Validation: Flume Proxy User Groups Whether to suppress configuration warnings produced by the built-in parameter validation for the Flume Proxy User Groups parameter. false role_config_suppression_hadoop_kms_proxyuser_flume_groups true
Suppress Parameter Validation: Flume Proxy User Hosts Whether to suppress configuration warnings produced by the built-in parameter validation for the Flume Proxy User Hosts parameter. false role_config_suppression_hadoop_kms_proxyuser_flume_hosts true
Suppress Parameter Validation: HDFS Proxy User Groups Whether to suppress configuration warnings produced by the built-in parameter validation for the HDFS Proxy User Groups parameter. false role_config_suppression_hadoop_kms_proxyuser_hdfs_groups true
Suppress Parameter Validation: HDFS Proxy User Hosts Whether to suppress configuration warnings produced by the built-in parameter validation for the HDFS Proxy User Hosts parameter. false role_config_suppression_hadoop_kms_proxyuser_hdfs_hosts true
Suppress Parameter Validation: Hive Proxy User Groups Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Proxy User Groups parameter. false role_config_suppression_hadoop_kms_proxyuser_hive_groups true
Suppress Parameter Validation: Hive Proxy User Hosts Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Proxy User Hosts parameter. false role_config_suppression_hadoop_kms_proxyuser_hive_hosts true
Suppress Parameter Validation: HTTP Proxy User Groups Whether to suppress configuration warnings produced by the built-in parameter validation for the HTTP Proxy User Groups parameter. false role_config_suppression_hadoop_kms_proxyuser_http_groups true
Suppress Parameter Validation: HTTP Proxy User Hosts Whether to suppress configuration warnings produced by the built-in parameter validation for the HTTP Proxy User Hosts parameter. false role_config_suppression_hadoop_kms_proxyuser_http_hosts true
Suppress Parameter Validation: HttpFS Proxy User Groups Whether to suppress configuration warnings produced by the built-in parameter validation for the HttpFS Proxy User Groups parameter. false role_config_suppression_hadoop_kms_proxyuser_httpfs_groups true
Suppress Parameter Validation: HttpFS Proxy User Hosts Whether to suppress configuration warnings produced by the built-in parameter validation for the HttpFS Proxy User Hosts parameter. false role_config_suppression_hadoop_kms_proxyuser_httpfs_hosts true
Suppress Parameter Validation: Hue Proxy User Groups Whether to suppress configuration warnings produced by the built-in parameter validation for the Hue Proxy User Groups parameter. false role_config_suppression_hadoop_kms_proxyuser_hue_groups true
Suppress Parameter Validation: Hue Proxy User Hosts Whether to suppress configuration warnings produced by the built-in parameter validation for the Hue Proxy User Hosts parameter. false role_config_suppression_hadoop_kms_proxyuser_hue_hosts true
Suppress Parameter Validation: Mapred Proxy User Groups Whether to suppress configuration warnings produced by the built-in parameter validation for the Mapred Proxy User Groups parameter. false role_config_suppression_hadoop_kms_proxyuser_mapred_groups true
Suppress Parameter Validation: Mapred Proxy User Hosts Whether to suppress configuration warnings produced by the built-in parameter validation for the Mapred Proxy User Hosts parameter. false role_config_suppression_hadoop_kms_proxyuser_mapred_hosts true
Suppress Parameter Validation: Oozie Proxy User Groups Whether to suppress configuration warnings produced by the built-in parameter validation for the Oozie Proxy User Groups parameter. false role_config_suppression_hadoop_kms_proxyuser_oozie_groups true
Suppress Parameter Validation: Oozie Proxy User Hosts Whether to suppress configuration warnings produced by the built-in parameter validation for the Oozie Proxy User Hosts parameter. false role_config_suppression_hadoop_kms_proxyuser_oozie_hosts true
Suppress Parameter Validation: YARN Proxy User Groups Whether to suppress configuration warnings produced by the built-in parameter validation for the YARN Proxy User Groups parameter. false role_config_suppression_hadoop_kms_proxyuser_yarn_groups true
Suppress Parameter Validation: YARN Proxy User Hosts Whether to suppress configuration warnings produced by the built-in parameter validation for the YARN Proxy User Hosts parameter. false role_config_suppression_hadoop_kms_proxyuser_yarn_hosts true
Suppress Parameter Validation: HSM KeyStoreProvider Directory Whether to suppress configuration warnings produced by the built-in parameter validation for the HSM KeyStoreProvider Directory parameter. false role_config_suppression_hadoop_security_key_provider_dir true
Suppress Parameter Validation: Navigator Thales KMS Proxy Environment Advanced Configuration Snippet (Safety Valve) Whether to suppress configuration warnings produced by the built-in parameter validation for the Navigator Thales KMS Proxy Environment Advanced Configuration Snippet (Safety Valve) parameter. false role_config_suppression_hsmkp_thales_role_env_safety_valve true
Suppress Parameter Validation: Navigator Thales KMS Proxy Advanced Configuration Snippet (Safety Valve) for kms-acls.xml Whether to suppress configuration warnings produced by the built-in parameter validation for the Navigator Thales KMS Proxy Advanced Configuration Snippet (Safety Valve) for kms-acls.xml parameter. false role_config_suppression_kms-acls.xml_role_safety_valve true
Suppress Parameter Validation: Navigator Thales KMS Proxy Advanced Configuration Snippet (Safety Valve) for kms-site.xml Whether to suppress configuration warnings produced by the built-in parameter validation for the Navigator Thales KMS Proxy Advanced Configuration Snippet (Safety Valve) for kms-site.xml parameter. false role_config_suppression_kms-site.xml_role_safety_valve true
Suppress Parameter Validation: KMS Acceptor Thread Count Whether to suppress configuration warnings produced by the built-in parameter validation for the KMS Acceptor Thread Count parameter. false role_config_suppression_kms_acceptor_thread_count true
Suppress Parameter Validation: Navigator Thales KMS Blacklist Users Whether to suppress configuration warnings produced by the built-in parameter validation for the Navigator Thales KMS Blacklist Users parameter. false role_config_suppression_kms_blacklist_users true
Suppress Parameter Validation: Additional Java Configuration Options for Navigator Thales KMS Whether to suppress configuration warnings produced by the built-in parameter validation for the Additional Java Configuration Options for Navigator Thales KMS parameter. false role_config_suppression_kms_java_opts true
Suppress Parameter Validation: Navigator Thales KMS Staging Directory Whether to suppress configuration warnings produced by the built-in parameter validation for the Navigator Thales KMS Staging Directory parameter. false role_config_suppression_kms_staging_dir true
Suppress Parameter Validation: Navigator Thales KMS Proxy Logging Advanced Configuration Snippet (Safety Valve) Whether to suppress configuration warnings produced by the built-in parameter validation for the Navigator Thales KMS Proxy Logging Advanced Configuration Snippet (Safety Valve) parameter. false role_config_suppression_log4j_safety_valve true
Suppress Parameter Validation: Navigator Thales KMS Proxy Log Directory Whether to suppress configuration warnings produced by the built-in parameter validation for the Navigator Thales KMS Proxy Log Directory parameter. false role_config_suppression_log_dir true
Suppress Parameter Validation: Role Triggers Whether to suppress configuration warnings produced by the built-in parameter validation for the Role Triggers parameter. false role_config_suppression_role_triggers true
Suppress Parameter Validation: Navigator Thales KMS Proxy TLS/SSL Client Trust Store File Whether to suppress configuration warnings produced by the built-in parameter validation for the Navigator Thales KMS Proxy TLS/SSL Client Trust Store File parameter. false role_config_suppression_ssl_client_truststore_location true
Suppress Parameter Validation: Navigator Thales KMS Proxy TLS/SSL Client Trust Store Password Whether to suppress configuration warnings produced by the built-in parameter validation for the Navigator Thales KMS Proxy TLS/SSL Client Trust Store Password parameter. false role_config_suppression_ssl_client_truststore_password true
Suppress Parameter Validation: Navigator Thales KMS Proxy TLS/SSL Server JKS Keystore File Location Whether to suppress configuration warnings produced by the built-in parameter validation for the Navigator Thales KMS Proxy TLS/SSL Server JKS Keystore File Location parameter. false role_config_suppression_ssl_server_keystore_location true
Suppress Parameter Validation: Navigator Thales KMS Proxy TLS/SSL Server JKS Keystore File Password Whether to suppress configuration warnings produced by the built-in parameter validation for the Navigator Thales KMS Proxy TLS/SSL Server JKS Keystore File Password parameter. false role_config_suppression_ssl_server_keystore_password true
Suppress Health Test: Audit Pipeline Test Whether to suppress the results of the Audit Pipeline Test heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. false role_health_suppression_thales_kms_hsmkp_thales_audit_health true
Suppress Health Test: File Descriptors Whether to suppress the results of the File Descriptors heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. false role_health_suppression_thales_kms_hsmkp_thales_file_descriptor true
Suppress Health Test: Host Health Whether to suppress the results of the Host Health heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. false role_health_suppression_thales_kms_hsmkp_thales_host_health true
Suppress Health Test: Log Directory Free Space Whether to suppress the results of the Log Directory Free Space heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. false role_health_suppression_thales_kms_hsmkp_thales_log_directory_free_space true
Suppress Health Test: Process Status Whether to suppress the results of the Process Status heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. false role_health_suppression_thales_kms_hsmkp_thales_scm_health true
Suppress Health Test: Swap Memory Usage Whether to suppress the results of the Swap Memory Usage heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. false role_health_suppression_thales_kms_hsmkp_thales_swap_memory_usage true
Suppress Health Test: Unexpected Exits Whether to suppress the results of the Unexpected Exits heath test. The results of suppressed health tests are ignored when computing the overall health of the associated host, role or service, so suppressed health tests will not generate alerts. false role_health_suppression_thales_kms_hsmkp_thales_unexpected_exits true

Service-Wide

Categories:

Advanced

Display Name Description Related Name Default Value API Name Required
System Group The group that this service's processes should run as. kms process_groupname true
System User The user that this service's processes should run as. kms process_username true
Navigator HSM KMS backed by Thales HSM Service Environment Advanced Configuration Snippet (Safety Valve) For advanced use only, key-value pairs (one on each line) to be inserted into a role's environment. Applies to configurations of all roles in this service except client configuration. THALES_KMS_service_env_safety_valve false

Monitoring

Display Name Description Related Name Default Value API Name Required
Enable Service Level Health Alerts When set, Cloudera Manager will send alerts when the health of this service reaches the threshold specified by the EventServer setting eventserver_health_events_alert_threshold true enable_alerts false
Enable Configuration Change Alerts When set, Cloudera Manager will send alerts when this entity's configuration changes. false enable_config_alerts false
Service Triggers The configured triggers for this service. This is a JSON-formatted list of triggers. These triggers are evaluated as part as the health system. Every trigger expression is parsed, and if the trigger condition is met, the list of actions provided in the trigger expression is executed. Each trigger has the following fields:
  • triggerName (mandatory) - The name of the trigger. This value must be unique for the specific service.
  • triggerExpression (mandatory) - A tsquery expression representing the trigger.
  • streamThreshold (optional) - The maximum number of streams that can satisfy a condition of a trigger before the condition fires. By default set to 0, and any stream returned causes the condition to fire.
  • enabled (optional) - By default set to 'true'. If set to 'false', the trigger is not evaluated.
  • expressionEditorConfig (optional) - Metadata for the trigger editor. If present, the trigger should only be edited from the Edit Trigger page; editing the trigger here can lead to inconsistencies.
For example, the followig JSON formatted trigger fires if there are more than 10 DataNodes with more than 500 file descriptors opened:[{"triggerName": "sample-trigger", "triggerExpression": "IF (SELECT fd_open WHERE roleType = DataNode and last(fd_open) > 500) DO health:bad", "streamThreshold": 10, "enabled": "true"}]See the trigger rules documentation for more details on how to write triggers using tsquery.The JSON format is evolving and may change and, as a result, backward compatibility is not guaranteed between releases.		 [] service_triggers true
Service Monitor Derived Configs Advanced Configuration Snippet (Safety Valve) For advanced use only, a list of derived configuration properties that will be used by the Service Monitor instead of the default ones. smon_derived_configs_safety_valve false

Other

Display Name Description Related Name Default Value API Name Required
ZooKeeper Authentication Type for Secret Signer ZooKeeper Authentication for Secret Signer. Can be either "none" or "sasl" hadoop.kms.authentication.signer.secret.provider.zookeeper.auth.type none hadoop_kms_authentication_signer_secret_provider_zookeeper_auth_type true
Authentication Secret Signer ZooKeeper Path Is required to be set for Navigator Thales KMS High Availability deployments hadoop.kms.authentication.signer.secret.provider.zookeeper.path /kmsZKRoot hadoop_kms_authentication_signer_secret_provider_zookeeper_path true
Authentication Type Authentication type for the Navigator Thales KMS. Can either be "simple" or "kerberos". hadoop.kms.authentication.type simple hadoop_kms_authentication_type true
KMS Load Balancer Key Management Store Load Balancer, used with multiple Navigator Thales KMS roles (KMS high availability). Typically the ZooKeeper dependency is set and this property is left blank. The ZooKeeper-based high availability URL is automatically generated for clients. To use an external load balancer, specify the URL to that load balancer. When using the ZooKeeper-based load balancer, all KMS roles must listen on the same port. kms_load_balancer kms_load_balancer false
Graceful Shutdown Timeout The timeout in milliseconds to wait for graceful shutdown to complete. 0 stop_timeout false
ZooKeeper Service Name of the ZooKeeper service that this Navigator HSM KMS backed by Thales HSM service instance depends on zookeeper_service false

Ports and Addresses

Display Name Description Related Name Default Value API Name Required
Navigator Thales KMS Metastore Port Navigator Thales KMS Metastore Port. cloudera.hsmkp.metastore.port 27606 cloudera_trustee_keyprovider_hsm_database_port false

Suppressions

Display Name Description Related Name Default Value API Name Required
Suppress Parameter Validation: Authentication Secret Signer ZooKeeper Path Whether to suppress configuration warnings produced by the built-in parameter validation for the Authentication Secret Signer ZooKeeper Path parameter. false service_config_suppression_hadoop_kms_authentication_signer_secret_provider_zookeeper_path true
Suppress Configuration Validator: Navigator Thales KMS Metastore Count Validator Whether to suppress configuration warnings produced by the Navigator Thales KMS Metastore Count Validator configuration validator. false service_config_suppression_hsmkp_metastore_thales_count_validator true
Suppress Configuration Validator: Navigator Thales KMS Proxy Count Validator Whether to suppress configuration warnings produced by the Navigator Thales KMS Proxy Count Validator configuration validator. false service_config_suppression_hsmkp_thales_count_validator true
Suppress Parameter Validation: KMS Load Balancer Whether to suppress configuration warnings produced by the built-in parameter validation for the KMS Load Balancer parameter. false service_config_suppression_kms_load_balancer true
Suppress Parameter Validation: System Group Whether to suppress configuration warnings produced by the built-in parameter validation for the System Group parameter. false service_config_suppression_process_groupname true
Suppress Parameter Validation: System User Whether to suppress configuration warnings produced by the built-in parameter validation for the System User parameter. false service_config_suppression_process_username true
Suppress Parameter Validation: Service Triggers Whether to suppress configuration warnings produced by the built-in parameter validation for the Service Triggers parameter. false service_config_suppression_service_triggers true
Suppress Parameter Validation: Service Monitor Derived Configs Advanced Configuration Snippet (Safety Valve) Whether to suppress configuration warnings produced by the built-in parameter validation for the Service Monitor Derived Configs Advanced Configuration Snippet (Safety Valve) parameter. false service_config_suppression_smon_derived_configs_safety_valve true
Suppress Parameter Validation: Navigator HSM KMS backed by Thales HSM Service Environment Advanced Configuration Snippet (Safety Valve) Whether to suppress configuration warnings produced by the built-in parameter validation for the Navigator HSM KMS backed by Thales HSM Service Environment Advanced Configuration Snippet (Safety Valve) parameter. false service_config_suppression_thales_kms_service_env_safety_valve true