Fixed Issues in HDP 2.4.2
The following tables list and describe issues reported by customers through Hortonworks Support or Hortonworks Quality Engineering, and their resolutions in HDP 2.4.2.
Potential Data Loss
|
Hortonworks Bug ID |
Apache JIRA |
Apache Component |
Summary |
|---|---|---|---|
| BUG-52963 | HDFS-9289 | HDFS | Make DataStreamer#block thread safe and verify genStamp in commitBlock. |
Security
|
Hortonworks Bug ID |
Apache JIRA |
Apache Component |
Summary |
|---|---|---|---|
| BUG-48092 | RANGER-746 | Ranger | Ranger Admin: For validating plugins SSL certs - Add wildcard, multiple CN & SAN support. |
| BUG-51298 | HBASE-15145 | HBase | Default hbase-env.sh breaks add peer command that writes to /hbase-secure/replication znode for kerberized clusters. |
| BUG-52193 | RANGER-798 | Ranger | Ranger "Access > Audit" not showing anything with Source "Solr" due to Time filter Issue (GMT). |
| BUG-52636 | STORM-1521 | Storm | Kerberos login from keytab with multiple bolts/executors ticket is not renewed for HBase Bolt. |
| BUG-53108 | HIVE-13120 | Hive | Hiveserver2 doAs=true, local fetch task on orc table permission checks on wrong user. |
| BUG-53766 | STORM-1535 | Storm | Storm-HDFS - When using keytab, Kerberos ticket is not renewed with multiple bolts/executors. |
Incorrect Results
|
Hortonworks Bug ID |
Apache JIRA |
Apache Component |
Summary |
|---|---|---|---|
| BUG-49949 | Hive | Query with duplicate columns in GROUP BY clause fails. | |
| BUG-51192 | HIVE-12905 | Hive | Hive LEFT JOIN with empty data set produces empty data set. |
| BUG-52706 | HIVE-12742 | Hive | NULL table comparison within CASE does not work as previous hive versions. |
| BUG-53777 | PIG-4690 | Pig | Pig on TEZ creates wrong result with replicated join. |
| BUG-53918 | PHOENIX-2601 | Phoenix | Query result is incorrect when both index hint and limit are used. |
| BUG-53927 | HIVE-13330 | Hive | Vectorization returns NULL for empty values for varchar/string data type. |
| BUG-54958 | HIVE-13361, HIVE-13362 | Hive, Hive2 | Orc concatenation cannot enforce the compression buffer size. |
Stability
|
Hortonworks Bug ID |
Apache JIRA |
Apache Component |
Summary |
|---|---|---|---|
| BUG-51303 | HIVE-11470 | HCatalog, Hive | NPE in DynamicPartFileRecordWriterContainer on null part-keys. |
| BUG-51808 | HIVE-11097 | Hive | MR mode query fails if one table path string starts with another's. |
| BUG-51829 | YARN-4820 | YARN | ResourceManager JMX Redirects in HA Mode Drops the Query Parameters. |
| BUG-52479 | PHOENIX-1968, PHOENIX-2036, PHOENIX-2088, PHOENIX-2112, PHOENIX-2196, PHOENIX-2287, PHOENIX-2288, PHOENIX-2328, PHOENIX-2426, PHOENIX-2469, PHOENIX-2503, PHOENIX-2567, PHOENIX-2568, PHOENIX-2599, PHOENIX-2638 | Phoenix | Phoenix-Spark integration inoperative in HDP 2.3.4. |
| BUG-52732 | HIVE-12947 | Hive | SMB mapjoin query runtime error "FileSinkOperator cannot be cast to org.apache.hadoop.hive.ql.exec.DummyStoreOperator". |
| BUG-52957 | PHOENIX-2295 | Phoenix | NullPointerException when parsing a query with hints in UNION ALL. |
| BUG-53260 | HIVE-13092 | Hive | Vectorized java.lang.ClassCastException: org.apache.hadoop.hive.serde2.typeinfo.ListTypeInfo cannot be cast to org.apache.hadoop.hive.serde2.typeinfo.PrimitiveTypeInfo. |
| BUG-53482 | PIG-4814 | Pig | AvroStorage does not take namenode HA as part of schema file URL. |
| BUG-53499 | PIG-4790 | Pig | Cannot use values iterator on the previous K-V pair after moveToNext has been invoked to move to the next K-V. |
| BUG-53671 | HIVE-10308 | HDP / Stack, Hive | Vectorization execution throws java.lang.IllegalArgumentException: Unsupported complex type: MAP. |
| BUG-54106 | HIVE-13263 | Hive | Vectorization: Unable to vectorize regexp_extract " Udf: GenericUDFBridge, is not supported". |
| BUG-54199 | PHOENIX-2616 | Phoenix | Indexes over immutable tables not marked as immutable. |
| BUG-54214 | HIVE-13144 | Hive, Hive2 | HS2 can leak ZK ACL objects when curator retries to create the persistent ephemeral node. |
| BUG-54650 | KNOX-695 | Knox | Intermittent java.net.ConnectException: Connection timed out between Knox server and Hiveserver2. |
| BUG-54713 | STORM-1689 | Storm | Large request header causes 413 ERROR when accessing Storm Logviewer. |
| BUG-54822 | HIVE-13151 | Hive, Hive2 | Hive metastore memory leak of fs cache with ACID compaction on. |
Query Failure
|
Hortonworks Bug ID |
Apache JIRA |
Apache Component |
Summary |
|---|---|---|---|
| BUG-54388, BUG-51701, BUG-53494 | MAPREDUCE-6635 | MapReduce, Tez | java.lang.IndexOutOfBoundsException running select count(*) query on table with skip.header.line.count. |
Upgrade
|
Hortonworks Bug ID |
Apache JIRA |
Apache Component |
Summary |
|---|---|---|---|
| BUG-53878 | Kafka | Running bin/kafka-console-consumer.sh outputs "No brokers found in ZK". Script modified to address this issue. | |
| BUG-54155 | RANGER-882 | Ranger | Ranger policy engine initialization failure caused namenode startup to fail. |
Usability
|
Hortonworks Bug ID |
Apache JIRA |
Apache Component |
Summary |
|---|---|---|---|
| BUG-47662 | RANGER-218 | Ranger | UserSync - group sync is marked as INTERNAL even if the group is synced from LDAP. |
| BUG-48573 | OOZIE-2322 | Oozie | Oozie Web UI doesn't work with Kerberos in Internet Explorer 10 or 11 and curl. |
| BUG-52257 | FALCON-1315 | Falcon | Falcon UI Hive mirroring : Unable to provide security credentials. |
| BUG-52260 | SQOOP-2737 | Sqoop | Cannot import table from Oracle with column with spaces in name. |
| BUG-52702 | SQOOP-2779 | Sqoop | Sqoop metastore doesn't seem to recognize --schema option. |
| BUG-52951 | FALCON-1647 | Falcon | Unable to create feed : FilePermission error under cluster staging directory. |
| BUG-54681 | RANGER-889 | Ranger | Create new method for partners to use for integration. |
| BUG-55216 | FALCON-748 | Falcon | Falcon webUI return 413 error when SSL is enabled. |
Performance
|
Hortonworks Bug ID |
Apache JIRA |
Apache Component |
Summary |
|---|---|---|---|
| BUG-52708 | RANGER-809 | Ranger | Remove reference to getLocalHost() call from Audit code to avoid performance impact. |
| BUG-52729 | RANGER-821 | Ranger | NameNode shutdown hangs due to Ranger HDFS plugin. |
| BUG-53028 | RANGER-794, RANGER-836, RANGER-844 | Ranger | Policy download optimizations. |
Other
|
Hortonworks Bug ID |
Apache JIRA |
Apache Component |
Summary |
|---|---|---|---|
| BUG-51738 | HBASE-15147 | HBase | Backport HBASE-15147: Shell should use Admin.listTableNames() instead of Admin.listTables(). |
| BUG-53095 | HADOOP-12825 | Hadoop Common | Log slow name resolutions. |
| BUG-53871 | HBASE-15128 | HBase | Disable region splits and merges switch in master. |
| BUG-54764 | MAPREDUCE-6436 | MapReduce | JobHistoryServer cache issues. |