HDP-2.3.4 Release Notes
Also available as:
PDF

Known Issues

[Important]Important

Hortonworks strongly recommends that all users running HDP 2.3.4 upgrade to HDP 2.3.4.7.

Hortonworks Bug ID

Apache JIRA

Component

Summary

BUG-23260HIVE-11421Hive

Insert after alter table on Acid table causes ArrayIndexOutOfBoundsException

Issue: Schema evolution is not supported for Acid tables. Alter Table commands on Acid table may make the table unreadable. There is not w/a after that.

BUG-30022HIVE-7693HiveInvalid column ref error in order by when using column alias in select clause and using having
BUG-30556 HiveKilled job is not display correctly by ATS hook failure
BUG-31408HIVE-9642HiveHive metastore client retries don't happen consistently for all api calls
BUG-38390 Ranger

Ambari ranger-env settings for admin and usersync log dir don't seem to do anything.

Issue: The log directory specified for the ranger-admin and ranger-usersync component configurations are not being used in the current release.

BUG-38471HDFS-8512HDFSHDFS-8512 WebHDFS : GETFILESTATUS should return LocatedBlock with storage type info
BUG-38928HIVE-11599Hive

Alter table transactional=false on ACID table misleading user. create transactional table would be better

Issue: Once an ACID table is created (with transactional=true) and data is written to it, changing the property to transactional=false may cause wrong data to be returned by queries over this table.

BUG-38980HBASE-14223HBase

Meta WALs are not split or cleared

Issue: In case a meta region gets moved from one region server to another region server, the write ahead logs for the meta table might be left in the HDFS directory for the regionserver if that particular regionserver fails. This might leave the WAL files in that directory until they are removed manually, and also may result in the previous regionservers to be listed as "dead regionservers" in the master UI indefinitely. However, this is harmless and does not cause any data loss other operational issues in HBase.

BUG-39663 HiveHive compactor fails when 'hive' user does not have x permissions on the table directory
BUG-39988HIVE-11110HiveCBO : Default partition filter is from MetaStore query causing TPC-DS to regress by 3x
BUG-40720HIVE-11852Falcon, HivenumRows and rawDataSize table properties are not replicated by HiveDR job.
BUG-42084 HivePrevent misconfiguration when StorageBasedAuthorization is set on hive.security.authorization.manager
BUG-42151 HiveHS2/Metastore JVM settings
BUG-42569HIVE-10022Hive'create database [db_name] location /tmp/[db_name].db' via beeline throws [hrt_qa] does not have [WRITE] privilege although hive.server2.enable.doAs=false when Ranger or StdAuth is on.
BUG-42752HIVE-12366HiveHiveServer-Concurrency - Joins and select-joins tests failing with dag.RootInputInitializerManager: Failed InputInitializer for Input: v2 on vertex_*
BUG-43129 HiveACID update/delete query fails with ArrayIndexOutOfBoundsException when there is null struct
BUG-44646HIVE-11935HiveHS2LongRunningHTTP: Describe table intermittently throws NPE
BUG-44725 Sparkspark-shell failing to launch due to no response from timeline server in dual-homed setup
BUG-44951 Sparkpyspark doesn't recognize NN HA unless run from /usr/hdp/current/spark-client/bin/pyspark directly. If you try with just /usr/bin/pyspark, which is just a softlink to the above directory, it returns UnknownHostException
BUG-45459ATLAS-92Atlasimport-hive.sh failed to find HiveMetaStoreBridge
BUG-45525HIVE-11401HivePredicate push down does not work with Parquet when partitions are in the expression
BUG-45878 HiveHive Streaming does not honor orc.compress.* table properties
BUG-46092HIVE-7193HiveWe need to filter users who can connect on our HiveServer2 to those in a particular LDAP group (with nested groups)
BUG-46128 StormKafka spout showing errors in the log streaming workflow
BUG-46394 HiveHiveserver2 Error Seen After Upgrade
BUG-46771HIVE-11716HiveReading ACID table from non-acid session should raise an error
BUG-47148ATLAS-271AtlasType names starting with "hive_" are reserved for internal use by the Atlas system and as such should not be used to create custom types.
BUG-47626 HBase, Hive, PhoenixCreating Hive table on HBase fails in HDP 2.3.x with Phoenix Dependencies
BUG-47662 Ranger

UserSync - group sync is marked as INTERNAL even if the group is synced from LDAP

Issue: When the groups are synched from LDAP/AD, the ranger admin portal is showing the group as INTERNAL group instead of EXTERNAL group. It does not affect any functionality of Ranger.

BUG-47706HIVE-11603HiveMR: IndexOutOfBoundsException thrown when accessing a union all subquery and filtering on a column which does not exist in all underlying tables
BUG-47811 SparkApplication data missing from Spark History server
BUG-47834 HiveMR query on non-partition table NPE if hive.limit.query.max.table.partition is set other than -1
BUG-48078 StormNetty connection exceptions in the logs when a topology is deployed
BUG-48217 YARNAfter restarting Yarn services, applications stays in ACCEPTED state
BUG-48560PHOENIX-2496PhoenixPQS fails to respond to SIGTERM when HMaster is dead
BUG-48953HBASE-14886HBaseReplicationAdmin does not use full peer configuration
BUG-49181HBASE-14838HBaseSimpleRegionNormalizer does not merge empty (<1MB) regions
BUG-49181HBASE-14838HBaseClarify that SimpleRegionNormalizer does not merge empty (<1MB) regions
BUG-49182HBASE-14867SparkSimpleRegionNormalizer needs to have better heuristics to trigger merge operation
BUG-49182HBASE-14867HBaseSimpleRegionNormalizer needs to have better heuristics to trigger merge operation
BUG-49244 YARN, SparkSpark 1.5.2 integration with YARN ATS (Application Timeline Server) 1.5 is not yet ready for widespread production use, especially on large clusters that also have Hive workloads running on them.
BUG-49327HBASE-14928HBaseStart row should be set for query through HBase REST gateway involving globbing option
BUG-49424HBASE-10390HBaseTrack HBASE-10390 on HDP
BUG-49430 Phoenix

After local index changes, the explain plan could show scan over the physical data table name instead of the local index. The query plan contains index id, for example -32766, represents using local indexes.

After local index changes, the explain plan could show scan over the physical data table name instead of the local index. The query plan contains index id, for example -32766, represents using local indexes.

BUG-49433PHOENIX-1734Phoenix

Phoenix is returning wrong or empty results when querying split tables.

If region merges or splits are happening for tables with local indexes, the queries that are running during the split/merge might end up seeing invalid results.

BUG-49509PHOENIX-2500Phoenix

Phoenix-queryServer ha is failing with RejectedExecutionException

Issue: It is possible the clients using the Phoenix QueryServer might unexpectedly see application-level exceptions when the QueryServer is in the process of shutting down.

Workaround: Users should simply resubmit their query against an operation Phoenix QueryServer instance.

BUG-49531HIVE-11740HCatalog, HiveNPE in DynamicPartFileRecordWriterContainer on null part-keys
BUG-49563HADOOP-12622YARNEnhance trouble shooting for NM proxy retry policy
BUG-49704SPARK-5159SparkSpark Thriftserver does not work on non Hive hosts
BUG-49715KNOX-639Knox

Using empty master secret for Knox causes NullPointerException

Issue: If an empty string is used as the Knox master secret the Knox gateway server will fail to start and a NullPointerException will be found in the gateway.log file.

Error: The error found in the gateway.log file will appear as shown below. More information can be produced by modifying the gateway-log4j.properties file.

2015-12-10 17:03:30,389 INFO  hadoop.gateway (GatewayServer.java:startGateway(217)) - Starting gateway...
2015-12-10 17:03:30,579 FATAL hadoop.gateway (GatewayServer.java:startGateway(234)) - Failed to start gateway: java.lang.NullPointerException

Workaround: User can recover from this situation by replacing the empty string master secret with another value using the command below. This command should be executed as the 'Knox' user.

bin/knoxcli.sh create-master --force

If this does not solve the problem it may be necessary to delete the contents of the data/security directory before executing this command.

BUG-49724 Storm

Configuring KafkaSpout to Connect to HBase or Hive

Before connecting to HBase or Hive, we recommend that you add the following exclusions to your POM file, for the curator framework:

<exclusion>
  <groupId>org.apache.curator</groupId>
  <artifactId>curator-client</artifactId>
</exclusion>

<exclusion>
  <groupId>org.apache.curator</groupId>
  <artifactId>curator-recipes</artifactId>
</exclusion>

<exclusion>
  <groupId>org.apache.curator</groupId>
  <artifactId>apache-curator</artifactId>
</exclusion>
BUG-49806 Hue

Issue: Hue does not start on upgraded openssl libs on SUSE.

Error Message: Could not import desktop.auth.views. Error was: libssl.so.1.0.0: cannot open shared object file: No such file or directory

Workaround:

  1. Install openssl library version 1.0.0: zypper install openssl1 libopenssl1_0_0 libopenssl1-devel libopenssl1_0_0-32bit.

  2. Enable CherryPy web server in hue.ini configuration file: use_cherrypy_server=true.

BUG-49955PHOENIX-2531Phoenix

Issue: The Phoenix Thin Client Driver, org.apache.phoenix.queryserver.client.Driver, is not automatically registered in the JDBC DriverManager.

Workaround:

  1. Add the following to your Java application before trying to obtain the Driver:

    Properties props = new Properties();
    String URL = "jdbc:phoenix:thin:URL=http://localhost:8765";
    try {
      Class.forName("org.apache.phoenix.queryserver.client.Driver");
    } catch (Exception e) {
      throw new RuntimeException(e);
    }
    DriverManager.getConnection(URL, props);
  2. Manually register the driver.

BUG-50015TEZ-3037Tez

Tracking URL/history link not functional when ATS v1.5 is enabled

Issue:When YARN Timeline v1.5 is enabled, the Tracking URL link from the YARN ResourceManager UI to the Tez View may not function correctly.

Workaround: Directly go to the Tez View and search for the YARN Application.

BUG-50094SPARK-10500SparkSparkR can only be run with user "root", or the directory /usr/hdp/2.3.4.0-$BUILD/spark/R/lib/ must be given world write permissions.
BUG-50531 Kafka

Kafka file system support

Issue: Encrypted file systems such as SafenetFS are not supported for Kafka. Index file corruption can occur.

For more information, see: Install Kafka.

BUG-50663HIVE-12766TEZ-3017SparkEnabling YARN Timeline ( v1.5 ) can introduce a thread leak in HiveServer2.
BUG-55196HIVE-12937HiveDbNotificationListener unable to clean up old notification events
Technical Service BulletinApache JIRAApache ComponentSummary
TSB-405N/AN/A

Impact of LDAP Channel Binding and LDAP signing changes in Microsoft Active Directory

Microsoft has introduced changes in LDAP Signing and LDAP Channel Binding to increase the security for communications between LDAP clients and Active Directory domain controllers. These optional changes will have an impact on how 3rd party products integrate with Active Directory using the LDAP protocol.

Workaround

Disable LDAP Signing and LDAP Channel Binding features in Microsoft Active Directory if they are enabled

For more information on this issue, see the corresponding Knowledge article: TSB-2021 405: Impact of LDAP Channel Binding and LDAP signing changes in Microsoft Active Directory

TSB-406N/AHDFS

CVE-2020-9492 Hadoop filesystem bindings (ie: webhdfs) allows credential stealing

WebHDFS clients might send SPNEGO authorization header to remote URL without proper verification. A maliciously crafted request can trigger services to send server credentials to a webhdfs path (ie: webhdfs://…) for capturing the service principal

For more information on this issue, see the corresponding Knowledge article: TSB-2021 406: CVE-2020-9492 Hadoop filesystem bindings (ie: webhdfs) allows credential stealing

TSB-434HADOOP-17208, HADOOP-17304Hadoop

KMS Load Balancing Provider Fails to invalidate Cache on Key Delete

For more information on this issue, see the corresponding Knowledge article: TSB 2020-434: KMS Load Balancing Provider Fails to invalidate Cache on Key Delete

TSB-465N/AHBase

Corruption of HBase data stored with MOB feature

For more information on this issue, see the corresponding Knowledge article: TSB 2021-465: Corruption of HBase data stored with MOB feature on upgrade from CDH 5 and HDP 2

TSB-497N/ASolr

CVE-2021-27905: Apache Solr SSRF vulnerability with the Replication handler

The Apache Solr ReplicationHandler (normally registered at "/replication" under a Solr core) has a "masterUrl" (also "leaderUrl" alias) parameter. The “masterUrl” parameter is used to designate another ReplicationHandler on another Solr core to replicate index data into the local core. To help prevent the CVE-2021-27905 SSRF vulnerability, Solr should check these parameters against a similar configuration used for the "shards" parameter.

For more information on this issue, see the corresponding Knowledge article: TSB 2021-497: CVE-2021-27905: Apache Solr SSRF vulnerability with the Replication handler

TSB-512N/AHBase

HBase MOB data loss

HBase tables with the MOB feature enabled may encounter problems which result in data loss.

For more information on this issue, see the corresponding Knowledge article: TSB 2021-512: HBase MOB data loss