DocsHortonworks Data Platform

 

 3.1. Patch information for Hadoop

Hadoop is based on Apache Hadoop 1.2.0 and includes the following additional patches:

  • HDFS-7503: Namenode restart after large deletions can cause slow processReport (due to logging)

  • HDFS-6822: In branch-1, Namenode and datanode fails to replace "_HOST" to hostname for hadoop.http.authentication.kerberos.principal

  • HDFS-6277: WebHdfsFileSystem#toUrl does not perform character escaping for rename

  • HDFS-5306: Datanode https port is not available at the namenode

    HDFS-3794: WebHDFS: openFileWithOffset returns premature end of content-length delimited message body

  • HDFS-5306: Datanode https port is not available at the namenode

  • HDFS-6822 Namenode and datanode fails to replace "_HOST" to hostname for hadoop.http.authentication.kerberos.principal

  • HDFS-6141: WebHdfsFileSystem#toUrl does not perform character escaping.

  • HDFS-5982: Need to update snapshot manager when applying editlog for deleting a snapshottable directory

  • HDFS-2264: NamenodeProtocol has the wrong value for clientPrincipal in KerberosInfo annotation

  • HDFS-3404: Make putImage in GetImageServlet infer remote address to fetch from request

  • HADOOP-10627: Add documentation for http/https policy configuration/setup

    HADOOP-9509: Implemented ONCRPC and XDR.

  • HADOOP-9515: Added general interface for NFS and Mount.

  • HDFS-4762: Added HDFS based NFSv3 and Mountd implementation.

  • HDFS-5038: Added the following HDFS branch-2 APIs to HDFS branch-1:

    • FileSystem#newInstance(Configuration)

    • DFSClient#getNamenode()

    • FileStatus#isDirectory()

  • HDFS-4880: Added support to print image and edits file loaded by the NameNode, in the logs.

  • HDFS-4944: Fixed file path issue with WebHDFS. WebHDFS can now create a file path containing characters that must be URI-encoded (such as space).

  • HDFS Snapshot related changes:

    • HDFS-4842: Added ability to identify correct prior snapshot before deleting a snapshot under a renamed subtree.

    • HDFS-4857: Enhanced Snapshot.Root and AbstractINodeDiff#snapshotINode. (Snapshot.Root and AbstractINodeDiff#snapshotINode should not be put into INodeMap when loading FSImage.)

    • HDFS-4863: The root directory can now be added to the snapshottable directory list while loading fsimage.

    • HDFS-4846: Enhanced snapshot command line (CLI) commands output stacktrace for invalid arguments.

    • HDFS-4848: Fixed copyFromLocal and file rename operations. (While performing copyFromLocal operation and/or renaming a file to .snapshot, now displays an output message that that .snapshot is a reserved name.)

    • HDFS-4850: Fixed OfflineImageViewer to work on fsimages with empty files or snapshots.

    • HDFS-4876: Fixed JavaDoc for FileWithSnapshot.

    • HDFS-4877: Fixed the issues caused while renaming a directory under its prior descendant.

    • HDFS-4902: Fixed path issue for DFSClient.getSnapshotDiffReport. DFSClient.getSnapshotDiffReport now uses string path instead of using the o.a.h.fs.Path.

    • HDFS-4875: Added support for testing snapshot file length.

    • HDFS-5005: Moved SnapshotException and SnapshotAccessControlException to o.a.h.hdfs.protocol.

  • HDFS-2802: Added support for RW/RO snapshots in HDFS.

  • HDFS-4750: Added support for NFSv3 interface to HDFS.

  • MAPREDUCE-4366 Back port MAPREDUCE-4366 to Hadoop 1.2

  • MAPREDUCE-4661: Backport HTTPS to WebUIs to branch-1.

  • MAPREDUCE-5109: Added support to apply Job view-acl to job lists on JobTracker and also to the JobHistory listings.

  • MAPREDUCE-5217: Fixed issues for DistCP when launched by Oozie on a secure cluster.

  • MAPREDUCE-5256: Improved CombineInputFormat to make it thread safe. This issue was affecting HiveServer.

  • MAPREDUCE-5408: Backport MAPREDUCE-336 to branch-1.

  • HDFS-4334: Added support to enable adding a unique id to each INode.

  • HDFS-4635: Move BlockManager#computeCapacity to LightWeightGSet.

  • HDFS-4434: Added support for inode ID to inode map.

  • HDFS-4785: Fixed issue for Concat operation that affected removal of the concatenated files from InodeMap.

  • HDFS-4784: Fixed Null Pointer Exception (NPE) in FSDirectory.resolvePath().

  • HADOOP-8923: Fixed incorect rendering of the intermediate web user interface page caused when the authentication cookie (SPENGO/custom) expires.

  • HDFS-4108: Fixed dfsnodelist to work in secure mode.

  • HADOOP-9296: Added support to allow users from different realm to authenticate without a trust relationship.

Legal notices
loading table of contents...