Isilon Properties in CDH 5.4.0
Role groups:
gateway
Advanced
Display Name | Description | Related Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Deploy Directory | The directory where the client configs will be deployed | /etc/hadoop | client_config_root_dir | true | |
Use Legacy Blockreader | Whether HDFS clients will use the legacy block reader. | dfs.client.use.legacy.blockreader | false | dfs_client_use_legacy_blockreader | false |
Client Java Configuration Options | These are Java command line arguments. Commonly, garbage collection flags, PermGen, or extra debugging flags would be passed here. | -Djava.net.preferIPv4Stack=true | hbase_client_java_opts | false | |
HDFS Client Advanced Configuration Snippet (Safety Valve) for hdfs-site.xml | For advanced use only, a string to be inserted into the client configuration for hdfs-site.xml. | hdfs_client_config_safety_valve | false | ||
HDFS Client Environment Advanced Configuration Snippet (Safety Valve) for hadoop-env.sh | For advanced use only, key-value pairs (one on each line) to be inserted into the client configuration for hadoop-env.sh | hdfs_client_env_safety_valve | false | ||
Gateway Logging Advanced Configuration Snippet (Safety Valve) | For advanced use only, a string to be inserted into log4j.properties for this role only. | log4j_safety_valve | false |
Logs
Display Name | Description | Related Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Gateway Logging Threshold | The minimum log level for Gateway logs | INFO | log_threshold | false |
Monitoring
Display Name | Description | Related Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Enable Configuration Change Alerts | When set, Cloudera Manager will send alerts when this entity's configuration changes. | false | enable_config_alerts | false |
Other
Display Name | Description | Related Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Alternatives Priority | The priority level that the client configuration will have in the Alternatives system on the hosts. Higher priority levels will cause Alternatives to prefer this configuration over any others. | 90 | client_config_priority | true | |
Use Trash | Move deleted files to the trash so that they can be recovered if necessary. This client side configuration takes effect only if the HDFS service-wide trash is disabled (NameNode Filesystem Trash Interval set to 0) and is ignored otherwise. The trash is not automatically emptied when enabled with this configuration. | false | dfs_client_use_trash | false |
Performance
Display Name | Description | Related Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Enable HDFS Short-Circuit Read | Enable HDFS short-circuit read. This allows a client colocated with the DataNode to read HDFS file blocks directly. This gives a performance boost to distributed clients that are aware of locality. | dfs.client.read.shortcircuit | false | dfs_client_read_shortcircuit | false |
Resource Management
Display Name | Description | Related Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Client Java Heap Size in Bytes | Maximum size in bytes for the Java process heap memory. Passed to Java -Xmx. | 256 MiB | hdfs_client_java_heapsize | false |
Suppressions
Display Name | Description | Related Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Suppress Configuration Validator: CDH Version Validator | Whether to suppress configuration warnings produced by the CDH Version Validator configuration validator. | false | role_config_suppression_cdh_version_validator | true | |
Suppress Parameter Validation: Deploy Directory | Whether to suppress configuration warnings produced by the built-in parameter validation for the Deploy Directory parameter. | false | role_config_suppression_client_config_root_dir | true | |
Suppress Parameter Validation: Client Java Configuration Options | Whether to suppress configuration warnings produced by the built-in parameter validation for the Client Java Configuration Options parameter. | false | role_config_suppression_hbase_client_java_opts | true | |
Suppress Parameter Validation: HDFS Client Advanced Configuration Snippet (Safety Valve) for hdfs-site.xml | Whether to suppress configuration warnings produced by the built-in parameter validation for the HDFS Client Advanced Configuration Snippet (Safety Valve) for hdfs-site.xml parameter. | false | role_config_suppression_hdfs_client_config_safety_valve | true | |
Suppress Parameter Validation: HDFS Client Environment Advanced Configuration Snippet (Safety Valve) for hadoop-env.sh | Whether to suppress configuration warnings produced by the built-in parameter validation for the HDFS Client Environment Advanced Configuration Snippet (Safety Valve) for hadoop-env.sh parameter. | false | role_config_suppression_hdfs_client_env_safety_valve | true | |
Suppress Configuration Validator: HDFS Trash Enabled Validator | Whether to suppress configuration warnings produced by the HDFS Trash Enabled Validator configuration validator. | false | role_config_suppression_hdfs_trash_disabled_validator | true | |
Suppress Parameter Validation: Gateway Logging Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Gateway Logging Advanced Configuration Snippet (Safety Valve) parameter. | false | role_config_suppression_log4j_safety_valve | true |
service_wide
Advanced
Display Name | Description | Related Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Cluster-wide Advanced Configuration Snippet (Safety Valve) for core-site.xml | For advanced use only, a string to be inserted into core-site.xml. Applies to all roles and client configurations in this HDFS service as well as all its dependent services. Any configs added here will be overridden by their default values in HDFS (which can be found in hdfs-default.xml). | core_site_safety_valve | false | ||
Enable HDFS Block Metadata API | Enables DataNode support for the experimental DistributedFileSystem.getFileVBlockStorageLocations API. Applicable to CDH 4.1 and onwards. | dfs.datanode.hdfs-blocks-metadata.enabled | true | dfs_datanode_hdfs_blocks_metadata_enabled | false |
HDFS Client Advanced Configuration Snippet (Safety Valve) for hdfs-site.xml | For advanced use only, a string to be inserted into the client configuration for hdfs-site.xml. | hdfs_client_config_safety_valve | false | ||
Isilon Service Environment Advanced Configuration Snippet (Safety Valve) | For advanced use only, key-value pairs (one on each line) to be inserted into a role's environment. Applies to configurations of all roles in this service except client configuration. | ISILON_service_env_safety_valve | false | ||
System Group | The group that this service's processes should run as. | hdfs | process_groupname | true | |
System User | The user that this service's processes should run as. | hdfs | process_username | true |
Monitoring
Display Name | Description | Related Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Enable Configuration Change Alerts | When set, Cloudera Manager will send alerts when this entity's configuration changes. | false | enable_config_alerts | false |
Other
Display Name | Description | Related Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Default File System URI | The full file system URI, to be emitted as 'fs.default.name' | default_fs_name | default_fs_name | true | |
HDFS Block Size | The default block size in bytes for new HDFS files. Note that this value is also used as the HBase Region Server HLog block size. | dfs.blocksize | 128 MiB | dfs_block_size | false |
Default Umask | Default umask for file and directory creation, specified in an octal value (with a leading 0) | fs.permissions.umask-mode | 022 | dfs_umaskmode | false |
Compression Codecs | Comma-separated list of compression codecs that can be used in job or map compression. | io.compression.codecs | org.apache.hadoop.io.compress.DefaultCodec, org.apache.hadoop.io.compress.GzipCodec, org.apache.hadoop.io.compress.BZip2Codec, org.apache.hadoop.io.compress.DeflateCodec, org.apache.hadoop.io.compress.SnappyCodec, org.apache.hadoop.io.compress.Lz4Codec | io_compression_codecs | false |
Kerberos Authentication | Whether Kerberos is enabled for authentication | kerberos_authentication | false | kerberos_authentication | true |
WebHDFS URL | Full URL for the Web Interface of Isilon service. | webhdfs_url | webhdfs_url | false |
Performance
Display Name | Description | Related Name | Default Value | API Name | Required |
---|---|---|---|---|---|
UNIX Domain Socket path | Path on the DataNode's local file system to a UNIX domain socket used for communication between the DataNode and local HDFS clients. This socket is used for Short Circuit Reads. Only the HDFS System User and "root" should have write access to the parent directory and all of its ancestors. This property is supported in CDH 4.2 or later deployments. | dfs.domain.socket.path | /var/run/hdfs-sockets/dn | dfs_domain_socket_path | false |
Proxy
Display Name | Description | Related Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Flume Proxy User Groups | Allows the flume user to impersonate any members of a comma-delimited list of groups. The default '*' allows all groups. To disable entirely, use a string that doesn't correspond to a group name, such as '_no_group_'. | hadoop.proxyuser.flume.groups | * | flume_proxy_user_groups_list | false |
Flume Proxy User Hosts | Comma-delimited list of hosts where you want to allow the flume user to impersonate other users. The default '*' allows all hosts. To disable entirely, use a string that doesn't correspond to a host name, such as '_no_host'. | hadoop.proxyuser.flume.hosts | * | flume_proxy_user_hosts_list | false |
HDFS Proxy User Groups | Comma-delimited list of groups to allow the HDFS user to impersonate. The default '*' allows all groups. To disable entirely, use a string that does not correspond to a group name, such as '_no_group_'. | hadoop.proxyuser.hdfs.groups | * | hdfs_proxy_user_groups_list | false |
HDFS Proxy User Hosts | Comma-delimited list of hosts where you want to allow the HDFS user to impersonate other users. The default '*' allows all hosts. To disable entirely, use a string that doesn't correspond to a host name, such as '_no_host'. | hadoop.proxyuser.hdfs.hosts | * | hdfs_proxy_user_hosts_list | false |
Hive Proxy User Groups | Comma-delimited list of groups that you want to allow the Hive user to impersonate. The default '*' allows all groups. To disable entirely, use a string that doesn't correspond to a group name, such as '_no_group_'. | hadoop.proxyuser.hive.groups | * | hive_proxy_user_groups_list | false |
Hive Proxy User Hosts | Comma-delimited list of hosts where you want to allow the Hive user to impersonate other users. The default '*' allows all hosts. To disable entirely, use a string that doesn't correspond to a host name, such as '_no_host'. | hadoop.proxyuser.hive.hosts | * | hive_proxy_user_hosts_list | false |
HTTP Proxy User Groups | Comma-delimited list of groups that you want to allow the HTTP user to impersonate. The default '*' allows all groups. To disable entirely, use a string that doesn't correspond to a group name, such as '_no_group_'. This is used by WebHCat. | hadoop.proxyuser.HTTP.groups | * | HTTP_proxy_user_groups_list | false |
HTTP Proxy User Hosts | Comma-delimited list of hosts where you want to allow the HTTP user to impersonate other users. The default '*' allows all hosts. To disable entirely, use a string that doesn't correspond to a host name, such as '_no_host'. This is used by WebHCat. | hadoop.proxyuser.HTTP.hosts | * | HTTP_proxy_user_hosts_list | false |
HttpFS Proxy User Groups | Comma-delimited list of groups to allow the HttpFS user to impersonate. The default '*' allows all groups. To disable entirely, use a string that does not correspond to a group name, such as '_no_group_'. | hadoop.proxyuser.httpfs.groups | * | httpfs_proxy_user_groups_list | false |
HttpFS Proxy User Hosts | Comma-delimited list of hosts where you allow the HttpFS user to impersonate other users. The default '*' allows all hosts. To disable entirely, use a string that doesn't correspond to a host name, such as '_no_host'. | hadoop.proxyuser.httpfs.hosts | * | httpfs_proxy_user_hosts_list | false |
Hue Proxy User Groups | Comma-delimited list of groups that you want to allow the Hue user to impersonate. The default '*' allows all groups. To disable entirely, use a string that doesn't correspond to a group name, such as '_no_group_'. | hadoop.proxyuser.hue.groups | * | hue_proxy_user_groups_list | false |
Hue Proxy User Hosts | Comma-delimited list of hosts where you want to allow the Hue user to impersonate other users. The default '*' allows all hosts. To disable entirely, use a string that doesn't correspond to a host name, such as '_no_host'. | hadoop.proxyuser.hue.hosts | * | hue_proxy_user_hosts_list | false |
Oozie Proxy User Groups | Allows the oozie superuser to impersonate any members of a comma-delimited list of groups. The default '*' allows all groups. To disable entirely, use a string that doesn't correspond to a group name, such as '_no_group_'. | hadoop.proxyuser.oozie.groups | * | oozie_proxy_user_groups_list | false |
Oozie Proxy User Hosts | Comma-delimited list of hosts where you want to allow the oozie user to impersonate other users. The default '*' allows all hosts. To disable entirely, use a string that doesn't correspond to a host name, such as '_no_host'. | hadoop.proxyuser.oozie.hosts | * | oozie_proxy_user_hosts_list | false |
Service Monitor Proxy User Groups | Allows the Cloudera Service Monitor user to impersonate any members of a comma-delimited list of groups. The default '*' allows all groups. This property is used only if Service Monitor is using a different Kerberos principal than the Hue service. To disable entirely, use a string that does not correspond to a group name, such as '_no_group_'. | hadoop.proxyuser.smon.groups | * | smon_proxy_user_groups_list | false |
Service Monitor Proxy User Hosts | Comma-delimited list of hosts where you want to allow the Cloudera Service Monitor user to impersonate other users. The default '*' allows all hosts. This property is used only if Service Monitor is using a different Kerberos principal than the Hue service. To disable entirely, use a string that does not correspond to a host name, such as '_no_host'. | hadoop.proxyuser.smon.hosts | * | smon_proxy_user_hosts_list | false |
Replication
Display Name | Description | Related Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Replication Factor | Default block replication. The number of replications to make when the file is created. The default value is used if a replication number is not specified. | dfs.replication | 3 | dfs_replication | false |
Security
Display Name | Description | Related Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Additional Rules to Map Kerberos Principals to Short Names | Additional mapping rules that will be inserted before rules generated from the list of trusted realms and before the default rule. After changing this value and restarting the service, any services depending on this one must be restarted as well. The hadoop.security.auth_to_local property is configured using this information. | extra_auth_to_local_rules | false | ||
Authorized Admin Groups | Comma-separated list of groups authorized to perform admin operations on Hadoop. This is emitted only if authorization is enabled. | hadoop_authorized_admin_groups | false | ||
Authorized Admin Users | Comma-separated list of users authorized to perform admin operations on Hadoop. This is emitted only if authorization is enabled. | * | hadoop_authorized_admin_users | false | |
Authorized Groups | Comma-separated list of groups authorized to used Hadoop. This is emitted only if authorization is enabled. | hadoop_authorized_groups | false | ||
Authorized Users | Comma-separated list of users authorized to used Hadoop. This is emitted only if authorization is enabled. | * | hadoop_authorized_users | false | |
Hadoop RPC Protection | Quality of protection for secured RPC connections between NameNode and HDFS clients. For effective RPC protection, enable Kerberos authentication. | hadoop.rpc.protection | authentication | hadoop_rpc_protection | false |
Hadoop Secure Authorization | Enable authorization | hadoop.security.authorization | false | hadoop_security_authorization | false |
Trusted Kerberos Realms | List of Kerberos realms that Hadoop services should trust. If empty, defaults to the default_realm property configured in the krb5.conf file. After changing this value and restarting the service, all services depending on this service must also be restarted. Adds mapping rules for each domain to the hadoop.security.auth_to_local property in core-site.xml. | trusted_realms | false |
Suppressions
Display Name | Description | Related Name | Default Value | API Name | Required |
---|---|---|---|---|---|
Suppress Parameter Validation: Cluster-wide Advanced Configuration Snippet (Safety Valve) for core-site.xml | Whether to suppress configuration warnings produced by the built-in parameter validation for the Cluster-wide Advanced Configuration Snippet (Safety Valve) for core-site.xml parameter. | false | service_config_suppression_core_site_safety_valve | true | |
Suppress Parameter Validation: Default File System URI | Whether to suppress configuration warnings produced by the built-in parameter validation for the Default File System URI parameter. | false | service_config_suppression_default_fs_name | true | |
Suppress Parameter Validation: UNIX Domain Socket path | Whether to suppress configuration warnings produced by the built-in parameter validation for the UNIX Domain Socket path parameter. | false | service_config_suppression_dfs_domain_socket_path | true | |
Suppress Parameter Validation: Replication Factor | Whether to suppress configuration warnings produced by the built-in parameter validation for the Replication Factor parameter. | false | service_config_suppression_dfs_replication | true | |
Suppress Parameter Validation: Additional Rules to Map Kerberos Principals to Short Names | Whether to suppress configuration warnings produced by the built-in parameter validation for the Additional Rules to Map Kerberos Principals to Short Names parameter. | false | service_config_suppression_extra_auth_to_local_rules | true | |
Suppress Parameter Validation: Flume Proxy User Groups | Whether to suppress configuration warnings produced by the built-in parameter validation for the Flume Proxy User Groups parameter. | false | service_config_suppression_flume_proxy_user_groups_list | true | |
Suppress Parameter Validation: Flume Proxy User Hosts | Whether to suppress configuration warnings produced by the built-in parameter validation for the Flume Proxy User Hosts parameter. | false | service_config_suppression_flume_proxy_user_hosts_list | true | |
Suppress Configuration Validator: Gateway Count Validator | Whether to suppress configuration warnings produced by the Gateway Count Validator configuration validator. | false | service_config_suppression_gateway_count_validator | true | |
Suppress Parameter Validation: Authorized Admin Groups | Whether to suppress configuration warnings produced by the built-in parameter validation for the Authorized Admin Groups parameter. | false | service_config_suppression_hadoop_authorized_admin_groups | true | |
Suppress Parameter Validation: Authorized Admin Users | Whether to suppress configuration warnings produced by the built-in parameter validation for the Authorized Admin Users parameter. | false | service_config_suppression_hadoop_authorized_admin_users | true | |
Suppress Parameter Validation: Authorized Groups | Whether to suppress configuration warnings produced by the built-in parameter validation for the Authorized Groups parameter. | false | service_config_suppression_hadoop_authorized_groups | true | |
Suppress Parameter Validation: Authorized Users | Whether to suppress configuration warnings produced by the built-in parameter validation for the Authorized Users parameter. | false | service_config_suppression_hadoop_authorized_users | true | |
Suppress Parameter Validation: HDFS Client Advanced Configuration Snippet (Safety Valve) for hdfs-site.xml | Whether to suppress configuration warnings produced by the built-in parameter validation for the HDFS Client Advanced Configuration Snippet (Safety Valve) for hdfs-site.xml parameter. | false | service_config_suppression_hdfs_client_config_safety_valve | true | |
Suppress Parameter Validation: HDFS Proxy User Groups | Whether to suppress configuration warnings produced by the built-in parameter validation for the HDFS Proxy User Groups parameter. | false | service_config_suppression_hdfs_proxy_user_groups_list | true | |
Suppress Parameter Validation: HDFS Proxy User Hosts | Whether to suppress configuration warnings produced by the built-in parameter validation for the HDFS Proxy User Hosts parameter. | false | service_config_suppression_hdfs_proxy_user_hosts_list | true | |
Suppress Parameter Validation: Hive Proxy User Groups | Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Proxy User Groups parameter. | false | service_config_suppression_hive_proxy_user_groups_list | true | |
Suppress Parameter Validation: Hive Proxy User Hosts | Whether to suppress configuration warnings produced by the built-in parameter validation for the Hive Proxy User Hosts parameter. | false | service_config_suppression_hive_proxy_user_hosts_list | true | |
Suppress Parameter Validation: HTTP Proxy User Groups | Whether to suppress configuration warnings produced by the built-in parameter validation for the HTTP Proxy User Groups parameter. | false | service_config_suppression_http_proxy_user_groups_list | true | |
Suppress Parameter Validation: HTTP Proxy User Hosts | Whether to suppress configuration warnings produced by the built-in parameter validation for the HTTP Proxy User Hosts parameter. | false | service_config_suppression_http_proxy_user_hosts_list | true | |
Suppress Parameter Validation: HttpFS Proxy User Groups | Whether to suppress configuration warnings produced by the built-in parameter validation for the HttpFS Proxy User Groups parameter. | false | service_config_suppression_httpfs_proxy_user_groups_list | true | |
Suppress Parameter Validation: HttpFS Proxy User Hosts | Whether to suppress configuration warnings produced by the built-in parameter validation for the HttpFS Proxy User Hosts parameter. | false | service_config_suppression_httpfs_proxy_user_hosts_list | true | |
Suppress Parameter Validation: Hue Proxy User Groups | Whether to suppress configuration warnings produced by the built-in parameter validation for the Hue Proxy User Groups parameter. | false | service_config_suppression_hue_proxy_user_groups_list | true | |
Suppress Parameter Validation: Hue Proxy User Hosts | Whether to suppress configuration warnings produced by the built-in parameter validation for the Hue Proxy User Hosts parameter. | false | service_config_suppression_hue_proxy_user_hosts_list | true | |
Suppress Parameter Validation: Compression Codecs | Whether to suppress configuration warnings produced by the built-in parameter validation for the Compression Codecs parameter. | false | service_config_suppression_io_compression_codecs | true | |
Suppress Parameter Validation: Isilon Service Environment Advanced Configuration Snippet (Safety Valve) | Whether to suppress configuration warnings produced by the built-in parameter validation for the Isilon Service Environment Advanced Configuration Snippet (Safety Valve) parameter. | false | service_config_suppression_isilon_service_env_safety_valve | true | |
Suppress Parameter Validation: Oozie Proxy User Groups | Whether to suppress configuration warnings produced by the built-in parameter validation for the Oozie Proxy User Groups parameter. | false | service_config_suppression_oozie_proxy_user_groups_list | true | |
Suppress Parameter Validation: Oozie Proxy User Hosts | Whether to suppress configuration warnings produced by the built-in parameter validation for the Oozie Proxy User Hosts parameter. | false | service_config_suppression_oozie_proxy_user_hosts_list | true | |
Suppress Parameter Validation: System Group | Whether to suppress configuration warnings produced by the built-in parameter validation for the System Group parameter. | false | service_config_suppression_process_groupname | true | |
Suppress Parameter Validation: System User | Whether to suppress configuration warnings produced by the built-in parameter validation for the System User parameter. | false | service_config_suppression_process_username | true | |
Suppress Parameter Validation: Service Monitor Proxy User Groups | Whether to suppress configuration warnings produced by the built-in parameter validation for the Service Monitor Proxy User Groups parameter. | false | service_config_suppression_smon_proxy_user_groups_list | true | |
Suppress Parameter Validation: Service Monitor Proxy User Hosts | Whether to suppress configuration warnings produced by the built-in parameter validation for the Service Monitor Proxy User Hosts parameter. | false | service_config_suppression_smon_proxy_user_hosts_list | true | |
Suppress Parameter Validation: Trusted Kerberos Realms | Whether to suppress configuration warnings produced by the built-in parameter validation for the Trusted Kerberos Realms parameter. | false | service_config_suppression_trusted_realms | true | |
Suppress Parameter Validation: WebHDFS URL | Whether to suppress configuration warnings produced by the built-in parameter validation for the WebHDFS URL parameter. | false | service_config_suppression_webhdfs_url | true |