Known Issues
Important | |
---|---|
Hortonworks strongly recommends that all users running HDP 2.3.4 upgrade to HDP 2.3.4.7. |
Hortonworks Bug ID |
Apache JIRA |
Component |
Summary |
---|---|---|---|
BUG-23260 | HIVE-11421 | Hive |
Insert after alter table on Acid table causes ArrayIndexOutOfBoundsException Issue: Schema evolution is not supported for Acid tables. Alter Table commands on Acid table may make the table unreadable. There is not w/a after that. |
BUG-30022 | HIVE-7693 | Hive | Invalid column ref error in order by when using column alias in select clause and using having |
BUG-30556 | Hive | Killed job is not display correctly by ATS hook failure | |
BUG-31408 | HIVE-9642 | Hive | Hive metastore client retries don't happen consistently for all api calls |
BUG-38390 | Ranger |
Ambari ranger-env settings for admin and usersync log dir don't seem to do anything. Issue: The log directory specified for the ranger-admin and ranger-usersync component configurations are not being used in the current release. | |
BUG-38471 | HDFS-8512 | HDFS | HDFS-8512 WebHDFS : GETFILESTATUS should return LocatedBlock with storage type info |
BUG-38928 | HIVE-11599 | Hive |
Alter table transactional=false on ACID table misleading user. create transactional table would be better Issue: Once an ACID table is created (with transactional=true) and data is written to it, changing the property to transactional=false may cause wrong data to be returned by queries over this table. |
BUG-38980 | HBASE-14223 | HBase |
Meta WALs are not split or cleared Issue: In case a meta region gets moved from one region server to another region server, the write ahead logs for the meta table might be left in the HDFS directory for the regionserver if that particular regionserver fails. This might leave the WAL files in that directory until they are removed manually, and also may result in the previous regionservers to be listed as "dead regionservers" in the master UI indefinitely. However, this is harmless and does not cause any data loss other operational issues in HBase. |
BUG-39663 | Hive | Hive compactor fails when 'hive' user does not have x permissions on the table directory | |
BUG-39988 | HIVE-11110 | Hive | CBO : Default partition filter is from MetaStore query causing TPC-DS to regress by 3x |
BUG-40720 | HIVE-11852 | Falcon, Hive | numRows and rawDataSize table properties are not replicated by HiveDR job. |
BUG-42084 | Hive | Prevent misconfiguration when StorageBasedAuthorization is set on hive.security.authorization.manager | |
BUG-42151 | Hive | HS2/Metastore JVM settings | |
BUG-42569 | HIVE-10022 | Hive | 'create database [db_name] location /tmp/[db_name].db' via beeline throws [hrt_qa] does not have [WRITE] privilege although hive.server2.enable.doAs=false when Ranger or StdAuth is on. |
BUG-42752 | HIVE-12366 | Hive | HiveServer-Concurrency - Joins and select-joins tests failing with dag.RootInputInitializerManager: Failed InputInitializer for Input: v2 on vertex_* |
BUG-43129 | Hive | ACID update/delete query fails with ArrayIndexOutOfBoundsException when there is null struct | |
BUG-44646 | HIVE-11935 | Hive | HS2LongRunningHTTP: Describe table intermittently throws NPE |
BUG-44725 | Spark | spark-shell failing to launch due to no response from timeline server in dual-homed setup | |
BUG-44951 | Spark | pyspark doesn't recognize NN HA unless run from /usr/hdp/current/spark-client/bin/pyspark directly. If you try with just /usr/bin/pyspark, which is just a softlink to the above directory, it returns UnknownHostException | |
BUG-45459 | ATLAS-92 | Atlas | import-hive.sh failed to find HiveMetaStoreBridge |
BUG-45525 | HIVE-11401 | Hive | Predicate push down does not work with Parquet when partitions are in the expression |
BUG-45878 | Hive | Hive Streaming does not honor orc.compress.* table properties | |
BUG-46092 | HIVE-7193 | Hive | We need to filter users who can connect on our HiveServer2 to those in a particular LDAP group (with nested groups) |
BUG-46128 | Storm | Kafka spout showing errors in the log streaming workflow | |
BUG-46394 | Hive | Hiveserver2 Error Seen After Upgrade | |
BUG-46771 | HIVE-11716 | Hive | Reading ACID table from non-acid session should raise an error |
BUG-47148 | ATLAS-271 | Atlas | Type names starting with "hive_" are reserved for internal use by the Atlas system and as such should not be used to create custom types. |
BUG-47626 | HBase, Hive, Phoenix | Creating Hive table on HBase fails in HDP 2.3.x with Phoenix Dependencies | |
BUG-47662 | Ranger |
UserSync - group sync is marked as INTERNAL even if the group is synced from LDAP Issue: When the groups are synched from LDAP/AD, the ranger admin portal is showing the group as INTERNAL group instead of EXTERNAL group. It does not affect any functionality of Ranger. | |
BUG-47706 | HIVE-11603 | Hive | MR: IndexOutOfBoundsException thrown when accessing a union all subquery and filtering on a column which does not exist in all underlying tables |
BUG-47811 | Spark | Application data missing from Spark History server | |
BUG-47834 | Hive | MR query on non-partition table NPE if hive.limit.query.max.table.partition is set other than -1 | |
BUG-48078 | Storm | Netty connection exceptions in the logs when a topology is deployed | |
BUG-48217 | YARN | After restarting Yarn services, applications stays in ACCEPTED state | |
BUG-48560 | PHOENIX-2496 | Phoenix | PQS fails to respond to SIGTERM when HMaster is dead |
BUG-48953 | HBASE-14886 | HBase | ReplicationAdmin does not use full peer configuration |
BUG-49181 | HBASE-14838 | HBase | SimpleRegionNormalizer does not merge empty (<1MB) regions |
BUG-49181 | HBASE-14838 | HBase | Clarify that SimpleRegionNormalizer does not merge empty (<1MB) regions |
BUG-49182 | HBASE-14867 | Spark | SimpleRegionNormalizer needs to have better heuristics to trigger merge operation |
BUG-49182 | HBASE-14867 | HBase | SimpleRegionNormalizer needs to have better heuristics to trigger merge operation |
BUG-49244 | YARN, Spark | Spark 1.5.2 integration with YARN ATS (Application Timeline Server) 1.5 is not yet ready for widespread production use, especially on large clusters that also have Hive workloads running on them. | |
BUG-49327 | HBASE-14928 | HBase | Start row should be set for query through HBase REST gateway involving globbing option |
BUG-49424 | HBASE-10390 | HBase | Track HBASE-10390 on HDP |
BUG-49430 | Phoenix |
After local index changes, the explain plan could show scan over the physical data table name instead of the local index. The query plan contains index id, for example -32766, represents using local indexes. After local index changes, the explain plan could show scan over the physical data table name instead of the local index. The query plan contains index id, for example -32766, represents using local indexes. | |
BUG-49433 | PHOENIX-1734 | Phoenix |
Phoenix is returning wrong or empty results when querying split tables. If region merges or splits are happening for tables with local indexes, the queries that are running during the split/merge might end up seeing invalid results. |
BUG-49509 | PHOENIX-2500 | Phoenix |
Phoenix-queryServer ha is failing with RejectedExecutionException Issue: It is possible the clients using the Phoenix QueryServer might unexpectedly see application-level exceptions when the QueryServer is in the process of shutting down. Workaround: Users should simply resubmit their query against an operation Phoenix QueryServer instance. |
BUG-49531 | HIVE-11740 | HCatalog, Hive | NPE in DynamicPartFileRecordWriterContainer on null part-keys |
BUG-49563 | HADOOP-12622 | YARN | Enhance trouble shooting for NM proxy retry policy |
BUG-49704 | SPARK-5159 | Spark | Spark Thriftserver does not work on non Hive hosts |
BUG-49715 | KNOX-639 | Knox |
Using empty master secret for Knox causes NullPointerException Issue: If an empty string is used as the Knox master secret the Knox gateway server will fail to start and a NullPointerException will be found in the gateway.log file. Error: The error found in the gateway.log file will appear as shown below. More information can be produced by modifying the gateway-log4j.properties file. 2015-12-10 17:03:30,389 INFO hadoop.gateway (GatewayServer.java:startGateway(217)) - Starting gateway... 2015-12-10 17:03:30,579 FATAL hadoop.gateway (GatewayServer.java:startGateway(234)) - Failed to start gateway: java.lang.NullPointerException Workaround: User can recover from this situation by replacing the empty string master secret with another value using the command below. This command should be executed as the 'Knox' user. bin/knoxcli.sh create-master --force If this does not solve the problem it may be necessary to delete the contents of the data/security directory before executing this command. |
BUG-49724 | Storm |
Configuring KafkaSpout to Connect to HBase or Hive Before connecting to HBase or Hive, we recommend that you add the following exclusions to your POM file, for the curator framework: <exclusion> <groupId>org.apache.curator</groupId> <artifactId>curator-client</artifactId> </exclusion> <exclusion> <groupId>org.apache.curator</groupId> <artifactId>curator-recipes</artifactId> </exclusion> <exclusion> <groupId>org.apache.curator</groupId> <artifactId>apache-curator</artifactId> </exclusion> | |
BUG-49806 | Hue |
Issue: Hue does not start on upgraded openssl libs on SUSE. Error Message: Could not import desktop.auth.views. Error was: libssl.so.1.0.0: cannot open shared object file: No such file or directory Workaround:
| |
BUG-49955 | PHOENIX-2531 | Phoenix |
Issue: The Phoenix Thin Client Driver, org.apache.phoenix.queryserver.client.Driver, is not automatically registered in the JDBC DriverManager. Workaround:
|
BUG-50015 | TEZ-3037 | Tez |
Tracking URL/history link not functional when ATS v1.5 is enabled Issue:When YARN Timeline v1.5 is enabled, the Tracking URL link from the YARN ResourceManager UI to the Tez View may not function correctly. Workaround: Directly go to the Tez View and search for the YARN Application. |
BUG-50094 | SPARK-10500 | Spark | SparkR can only be run with user "root", or the directory
/usr/hdp/2.3.4.0-$BUILD/spark/R/lib/ must be given world write
permissions. |
BUG-50531 | Kafka |
Kafka file system support Issue: Encrypted file systems such as SafenetFS are not supported for Kafka. Index file corruption can occur. For more information, see: Install Kafka. | |
BUG-50663 | HIVE-12766TEZ-3017 | Spark | Enabling YARN Timeline ( v1.5 ) can introduce a thread leak in HiveServer2. |
BUG-55196 | HIVE-12937 | Hive | DbNotificationListener unable to clean up old notification events |
Technical Service Bulletin | Apache JIRA | Apache Component | Summary |
---|---|---|---|
TSB-405 | N/A | N/A |
Impact of LDAP Channel Binding and LDAP signing changes in Microsoft Active Directory Microsoft has introduced changes in LDAP Signing and LDAP Channel Binding to increase the security for communications between LDAP clients and Active Directory domain controllers. These optional changes will have an impact on how 3rd party products integrate with Active Directory using the LDAP protocol. Workaround Disable LDAP Signing and LDAP Channel Binding features in Microsoft Active Directory if they are enabled For more information on this issue, see the corresponding Knowledge article: TSB-2021 405: Impact of LDAP Channel Binding and LDAP signing changes in Microsoft Active Directory |
TSB-406 | N/A | HDFS |
CVE-2020-9492 Hadoop filesystem bindings (ie: webhdfs) allows credential stealing WebHDFS clients might send SPNEGO authorization header to remote URL without proper verification. A maliciously crafted request can trigger services to send server credentials to a webhdfs path (ie: webhdfs://…) for capturing the service principal For more information on this issue, see the corresponding Knowledge article: TSB-2021 406: CVE-2020-9492 Hadoop filesystem bindings (ie: webhdfs) allows credential stealing |
TSB-434 | HADOOP-17208, HADOOP-17304 | Hadoop |
KMS Load Balancing Provider Fails to invalidate Cache on Key Delete For more information on this issue, see the corresponding Knowledge article: TSB 2020-434: KMS Load Balancing Provider Fails to invalidate Cache on Key Delete |
TSB-465 | N/A | HBase |
Corruption of HBase data stored with MOB feature For more information on this issue, see the corresponding Knowledge article: TSB 2021-465: Corruption of HBase data stored with MOB feature on upgrade from CDH 5 and HDP 2 |
TSB-497 | N/A | Solr |
CVE-2021-27905: Apache Solr SSRF vulnerability with the Replication handler The Apache Solr ReplicationHandler (normally registered at "/replication" under a Solr core) has a "masterUrl" (also "leaderUrl" alias) parameter. The “masterUrl” parameter is used to designate another ReplicationHandler on another Solr core to replicate index data into the local core. To help prevent the CVE-2021-27905 SSRF vulnerability, Solr should check these parameters against a similar configuration used for the "shards" parameter. For more information on this issue, see the corresponding Knowledge article: TSB 2021-497: CVE-2021-27905: Apache Solr SSRF vulnerability with the Replication handler |
TSB-512 | N/A | HBase |
HBase MOB data loss HBase tables with the MOB feature enabled may encounter problems which result in data loss. For more information on this issue, see the corresponding Knowledge article: TSB 2021-512: HBase MOB data loss |