DocsHortonworks Data Platform

 

 3.1. Patch information for Hadoop

Hadoop is based on Apache Hadoop 1.2.0 and includes the following additional patches:

  • HADOOP-9509: Implemented ONCRPC and XDR.

  • HADOOP-9515: Added general interface for NFS and Mount.

  • HDFS-4762: Added HDFS based NFSv3 and Mountd implementation.

  • HDFS-5038: Added the following HDFS branch-2 APIs to HDFS branch-1:

    • FileSystem#newInstance(Configuration)

    • DFSClient#getNamenode()

    • FileStatus#isDirectory()

  • HDFS-4880: Added support to print image and edits file loaded by the NameNode, in the logs.

  • HDFS-4944: Fixed file path issue with WebHDFS. WebHDFS can now create a file path containing characters that must be URI-encoded (such as space).

  • HDFS Snapshot related changes:

    • HDFS-4842: Added ability to identify correct prior snapshot before deleting a snapshot under a renamed subtree.

    • HDFS-4857: Enhanced Snapshot.Root and AbstractINodeDiff#snapshotINode. (Snapshot.Root and AbstractINodeDiff#snapshotINode should not be put into INodeMap when loading FSImage.)

    • HDFS-4863: The root directory can now be added to the snapshottable directory list while loading fsimage.

    • HDFS-4846: Enhanced snapshot command line (CLI) commands output stacktrace for invalid arguments.

    • HDFS-4848: Fixed copyFromLocal and file rename operations. (While performing copyFromLocal operation and/or renaming a file to .snapshot, now displays an output message that that .snapshot is a reserved name.)

    • HDFS-4850: Fixed OfflineImageViewer to work on fsimages with empty files or snapshots.

    • HDFS-4876: Fixed JavaDoc for FileWithSnapshot.

    • HDFS-4877: Fixed the issues caused while renaming a directory under its prior descendant.

    • HDFS-4902: Fixed path issue for DFSClient.getSnapshotDiffReport. DFSClient.getSnapshotDiffReport now uses string path instead of using the o.a.h.fs.Path.

    • HDFS-4875: Added support for testing snapshot file length.

    • HDFS-5005: Moved SnapshotException and SnapshotAccessControlException to o.a.h.hdfs.protocol.

  • HDFS-2802: Added support for RW/RO snapshots in HDFS.

  • HDFS-4750: Added support for NFSv3 interface to HDFS.

  • MAPREDUCE-4661: Backport HTTPS to WebUIs to branch-1.

  • MAPREDUCE-5109: Added support to apply Job view-acl to job lists on JobTracker and also to the JobHistory listings.

  • MAPREDUCE-5217: Fixed issues for DistCP when launched by Oozie on a secure cluster.

  • MAPREDUCE-5256: Improved CombineInputFormat to make it thread safe. This issue was affecting HiveServer.

  • MAPREDUCE-5408: Backport MAPREDUCE-336 to branch-1.

  • HDFS-4334: Added support to enable adding a unique id to each INode.

  • HDFS-4635: Move BlockManager#computeCapacity to LightWeightGSet.

  • HDFS-4434: Added support for inode ID to inode map.

  • HDFS-4785: Fixed issue for Concat operation that affected removal of the concatenated files from InodeMap.

  • HDFS-4784: Fixed Null Pointer Exception (NPE) in FSDirectory.resolvePath().

  • HADOOP-8923: Fixed incorect rendering of the intermediate web user interface page caused when the authentication cookie (SPENGO/custom) expires.

  • HDFS-4108: Fixed dfsnodelist to work in secure mode.

  • HADOOP-9296: Added support to allow users from different realm to authenticate without a trust relationship.

  • NFS Updates:

    • BUG-5966: fix wrong XDR method names.

    • BUG-5750: Input/output error after restarting Namenode while uploading data.

    • BUG-5934: RuntimeException causes data loading failure.

    • Changed some trace level and add lock/unlock trace.

    • BUG-6111: use final clause to gauarntee OpenFileCtx lock is unlocked eventually.

    • Fixed readdir/readdirplus response to copy dirents to response

    • BUG-6609: Reduce lock granularity in OpenFileCtx

    • BUG-6352:Should resend response for some repeated write request

  • Other updates:

    • BUG-7668: Fix backwards-incompatible change for ClientProtocol#fsync.

    • BUG-10178: Fix negative value for JobInProgress.finishedMapTasks.

Legal notices
loading table of contents...