Known Issues in HDFS
Learn about the known issues in HDFS, the impact or changes to the functionality, and the workaround.
- CDPSDX-5302: Avoiding long delay on the HBase master does not happen during upgrade.
-
- Log in to Cloudera Manager
- Select the HDFS service
- Select Configurations tab
- Search for hdfs-site.xml.
- Set ipc.client.connect.timeout = 5000
- Set ipc.client.connect.max.retries.on.timeouts = 5
- Click Save
- CDPD-65530: HDFS requests throw UnknownHostException during OS upgrade
- During the VM replacement as part of OS upgrade, every new
node gets a new IP Address, and if the old IP address is cached somewhere, HDFS
requests fail with
UnknownHostException
and it recovers after sometime (10 mins max).The issue is seen during COD and DL ZDU.
- CDPD-67230: Rolling restart can cause failed writes on small clusters
- In a rolling restart, if the cluster has less than 10 datanodes existing writers can fail with an error indicating a new block cannot be allocated and all nodes are excluded. This is because the client has attempted to use all the datanodes in the cluster, and failed to write to each of them as they were restarted. This will only happen on small clusters of less than 10 datanodes, as larger clusters have more spare node to allow the write to continue.
- OPSAPS-55788: WebHDFS is always enabled. The Enable WebHDFS checkbox does not take effect.
- None.
- Unsupported Features
-
The following HDFS features are currently not supported in Cloudera Data Platform:
- ACLs for the NFS gateway (HADOOP-11004)
- Aliyun Cloud Connector (HADOOP-12756)
- Allow HDFS block replicas to be provided by an external storage system (HDFS-9806)
- Consistent standby Serving reads (HDFS-12943)
- Cost-Based RPC FairCallQueue (HDFS-14403)
- HDFS Router Based Federation (HDFS-10467)
- More than two NameNodes (HDFS-6440)
- NameNode Federation (HDFS-1052)
- NameNode Port-based Selective Encryption (HDFS-13541)
- Non-Volatile Storage Class Memory (SCM) in HDFS Cache Directives (HDFS-13762)
- OpenStack Swift (HADOOP-8545)
- SFTP FileSystem (HADOOP-5732)
- Storage policy satisfier (HDFS-10285)