Hortonworks Data Platform for HDInsight
Also available as:
PDF

Behavioral Changes

Behavioral changes denote a marked change in behavior from the previously released version to this version of software. In HDP 2.6.5, behavioral changes affect the following Hadoop components.

Table 1. Behavioral Changes
Hortonworks Bug ID Apache Component Apache JIRA Summary Details
BUG-91290 Hive, Ranger N/A Additional ranger hive policies required for INSERT OVERWRITE

Scenario:Additional ranger hive policies required for INSERT OVERWRITE

Previous behavior: Hive INSERT OVERWRITE queries succeed as usual.

New behavior: Hive INSERT OVERWRITE queries are unexpectedly failing after upgrading to HDP-2.6.x with the error:

Error while compiling statement: FAILED: HiveAccessControlException Permission denied: user jdoe does not have WRITE privilege on /tmp/*(state=42000,code=40000)

As of HDP-2.6.0, Hive INSERT OVERWRITE queries require a Ranger URI policy to allow write operations, even if the user has write privilege granted through HDFS policy.

Workaround/Expected Customer Action:

  1. Create a new policy under the Hive repository.

  2. In the dropdown where you see Database, select URI.

  3. Update the path (Example: /tmp/*)

  4. Add the users and group and save.

  5. Retry the insert query.

BUG-94266 Spark HIVE-12505 Spark job completes successfully but there is an HDFS disk quota full error

Scenario: Running insert overwrite when a quota is set on the Trash folder of the user who runs the command.

Previous Behavior: The job succeeds even though it fails to move the data to the Trash. The result can wrongly contain some of the data previously present in the table.

New Behavior: When the move to the Trash folder fails, the files are permanently deleted.

BUG-94330 HDFS N/A HDFS should support for multiple KMS Uris

Previous Behavior: dfs.encryption.key.provider.uri property was used to configure the KMS provider path.

New Behavior: dfs.encryption.key.provider.uri is now deprecated in favor of hadoop.security.key.provider.path to configure the KMS provider path.

BUG-97244 Knox KNOX-1083 Sensible default timeout values

Previous Behavior: Previously, the default value for HttpClient was -1. In some cases, this caused Knox connections to hang (for example, using beeline).

New Behavior: The default value of HttpClient is now 20 seconds.

BUG-97459 Zeppelin ZEPPELIN-3271 Option for disabling scheduler

Component Affected: Zeppelin-Server

Previous Behavior: In previous releases of Zeppelin, there was no option for disabling scheduler.

New Behavior: By default, users will no longer see scheduler, as it is disabled by default.

Workaround/Expected Customer Action: If you want to enable scheduler, you will need to add a zeppelin.notebook.cron.enable with value of true under custom zeppelin site in Zeppelin settings from Ambari.