HDP-2.2.9 Release Notes
Also available as:
PDF

Behavior Changes

Behavioral changes denote a marked change in behavior from the previously released version to this version of software. In HDP 2.2.9, behavioral changes affect the following Hadoop components.

Hortonworks Bug IDComponentSummaryDetails
BUG-40345HueHue now shows log messages for create and insert statements.Fixed data fetch mechanism to get logs from HiveServer2.
BUG-43069HueHue File browser does not respect dfs.umaskmode, fs.permissions.umask-mode when creating files or folders.Hue File browser previously used umask 022 when creating files and folders. In this release, the octal value of umask in hue.ini specifies the umask value to apply when creating files and folders through the Hue File Browser.
BUG-44184HDFSWhen HDFS metadata is replaced, namenode enters safe mode.

Scenario: A user loads an old Fsimage and starts Namenode. This Fsimage is missing the latest transactions that recently occurred on the cluster.

Previous Behavior: When a user starts the Namenode with this old image, the Namenode will come out of safemode as long as the amount of blocks reported reaches the set threshold (0.999 is default for dfs.namenode.safemode.threshold-pct). When the Namenode learns about a block without a filename, it instructs the Datanode to delete those blocks, resulting in lost data.

New Behavior: The new behavior is that when the Namenode detects such a scenario where there are blocks in the cluster which are tagged with future generation stamps, the Namenode will remain in the safemode state to prevent the blocks from being deleted. If the user manually executes hdfs dfsadmin –safemode leave, the Namenode will refuse to leave safemode. At this point, the user has an opportunity to shut down the Namenode and load the most current FSimage. If the user for some reason is not able to find the latest Fsimage, the last resort to get the cluster up and running with minimal data loss is to force the Namenode out of safemode by running the command hdfs dfsadmin –safemode forceExit after the Namenode has been started.

BUG-44387YARNDisable container stats publish to ATS by defaultChanged the value of yarn.timeline-service.generic-application-history.save-non-am-container-meta-info to false. This config defines if YARN will save container meta-info in the application history store.
BUG-44447HDFSThe feature introduces a new setting hadoop.caller.context.enabled. When set to additional fields are written into namenode audit log records to help identify the job or query that introduced each NameNode operation. This feature is enabled by default starting with this release of HDP.

This feature brings a new key-value pair at the end of each audit log record. The newly added key at is callerContext, value context:signature. The overall format would be callerContext=context:signature. If the signature is null or empty, the value will be context only, in the format of callerContext=context. If the hadoop.caller.context.enabled config key is false, the key-value pair will not be showing. The audit log format is not changed in this case. It is also possible to limit the maximum length of context and signature. Consider the hadoop.caller.context.max.size config key (default 128 bytes) and hadoop.caller.context.signature.max.size (default 40 bytes) config key respectively.

There is a chance that the new information in the audit log may break existing scripts/automation that was being used to analyze the audit log. In this case the scripts may need to be fixed. We do not recommend disabling this feature as it can be a useful troubleshooting aid.

BUG-44523HueHue now displays Hive tables in alphabetical orderIn Hue Beeswax/Hive UI tables were previously displayed in chronological order (the order in which tables were added). The change in this release is that tables are sorted by alphabetical order by default.