Fixed issues represents selected issues that were previously logged via Hortonworks Support, but are now addressed in the current release. These issues may have been reported in previous versions within the Known Issues section; meaning they were reported by customers or identified by Hortonworks Quality Engineering team.
Incorrect Results
| Hortonworks Bug ID | Apache JIRA | Component | Summary |
|---|---|---|---|
| BUG-36095 | HIVE-10607 | Hive | Combination of ReducesinkDedup + TopN optimization yields incorrect result if there are multiple GBY in reducer |
| BUG-36685 | Hive | (2.2) - Need fix for HDP 2.2.4.2-2 - select operator missing column, wrong results in multiple left outer join with sub queries | |
| BUG-38406 | PIG-4541 | Pig | (2.2) - Skewed full outer join does not return records if any relation is empty. Outer join does not return any record if left relation is empty |
| BUG-38852 | YARN-3764 | YARN | CapacityScheduler should forbid moving LeafQueue from one parent to another |
| BUG-39519 | Ranger | UserSync Process didn't sync the group when groups are added to the user at later time (2.2.4.2 backport) | |
| BUG-39832 | HIVE-11027 | Hive | [2.2] Hive Incorrect query results with Bucket Map joins vs Shuffle Joins. |
| BUG-40282 | HIVE-11104 | Hive | (2.2, patch) - Insert overwrite query does not return expected value |
| BUG-41821 | HIVE-10303HIVE-9471 | Hive | Bad seek in uncompressed ORC, at row-group boundary |
| BUG-42173 | Hive | query wrong results, filter dropped in multi-way joins that contain join on same table twice+ | |
| BUG-42695 | HBASE-12865 | HBase | Back Port HBASE-12865: WALs may be deleted before they are replicated to peers |
| BUG-42891 | HIVE-11493 | Hive | Backport HIVE-11493 (Predicate with integer column equals double evaluates to false) |
Other
| Hortonworks Bug ID | Apache JIRA | Component | Summary |
|---|---|---|---|
| BUG-37634 | RelEng | (2.2.4.10) - hdp-select script trips up on 'lost+found' directory | |
| BUG-39010 | RelEng | 2.2-maint apt-get install fails for Zookeeper, Knox, Hbase due to duplicate files in deb's | |
| BUG-39972 | RelEng | httpfs is broken in HDP 2.2.6.0 | |
| BUG-41480 | YARN-3832 | YARN | Resource Localization fails on a cluster due to existing cache directories |
| BUG-42123 | Storm | Nimbus Client Misconfiguration | |
| BUG-42616 | Kafka | kafka-run-class.sh should have client_jmx_port and broker_jmx_port |
Performance
| Hortonworks Bug ID | Apache JIRA | Component | Summary |
|---|---|---|---|
| BUG-37834 | HADOOP-10597 | HDFS | RPC Server signals backoff to clients when all request queues are full |
| BUG-38033 | HIVE-9984 | Hive | joinReorder getOutputSize exponential |
| BUG-38150 | HDFS-7398HDFS-7609 | HDFS | Improve NameNode EditLog load time by fixing retry cache collision |
| BUG-38893 | ACCUMULO-3890 | Accumulo, Slider | Use of CredentialProvider results in a lot of NameNode operations |
| BUG-39833 | HIVE-11035 | Hive | [2.2] PPD: Orc Split elimination fails because filterColumns=[-1] |
| BUG-41358 | Ranger | (2.2) - UserSync process performance issue due to user group cache inconsistency. | |
| BUG-42199 | HIVE-11429 | Hive | (2.2) - Increase default JDBC result set fetch size (# rows it fetches in one RPC call) to 1000 from 50 |
| BUG-42210 | Hive | Replace use of distcp with FileUtils.copy(), during Hive.renameFile() | |
| BUG-42284 | HDFS-8856 | HDFS | Improve HDFS Lease Manager performance |
| BUG-42364 | HIVE-6727 | Hive | table fast stats numFiles, totalSize set to 0 when table has non-default location |
| BUG-42810 | YARN-3641 | YARN | NodeManager: stopRecoveryStore() shouldn't be skipped when exceptions happen in stopping NM's sub-services. |
| BUG-43083 | TEZ-2628 | Tez | [ATS V1.5] Backport initial patches from TEZ-2628 (ATS v1.5 tez plugin ) into 2.2-maint |
Potential Data Loss
| Hortonworks Bug ID | Apache JIRA | Component | Summary |
|---|---|---|---|
| BUG-39580 | HIVE-10685 | Hive | [2.2] Backport HIVE-10685: Alter ORC table concatenate oparetor can cause duplicate/corrupt data |
| BUG-41424 | FLUME-2754 | Flume | Flume Hive Sink skipping first transaction in each TxnBatch |
| BUG-42323 | STORM-960 | Storm | While using a storm/hive/bolt to populate an ACID ORC table, it causes data loss and scan jobs fails with 'java.io.EOFException' error |
| BUG-42680 | HBASE-14054 | HBase | Back port HBASE-14054: Acknowledged writes may get lost if regionserver clock is set backwards |
Query Failure
| Hortonworks Bug ID | Apache JIRA | Component | Summary |
|---|---|---|---|
| BUG-36758 | HIVE-10273 | Hive | Union with partition tables which have no data fails with NPE |
| BUG-38986 | HIVE-11028 | Hive | table self join and join with another table fails with IndexOutOfBoundsException, constant propagation wrong plan |
| BUG-38996 | Hive | (2.2) - In Tez mode,dynamic partitioning query with union all fails at moveTask,Invalid partition key & values | |
| BUG-39431 | HIVE-9950 | Hive | (2.2) - Hive query using Cuckoo hashing causing NullPointerException |
| BUG-39432 | Hive | (2.2) - Hive Alter table, concatenate partition files, throws error | |
| BUG-40150 | HIVE-10538 | Hive | [2.2] Fix NPE in FileSinkOperator from hashcode mismatch (HIVE-10538 backport) |
| BUG-40704 | HIVE-11172 | Hive | Vectorization NPE error with aggregation with sub function on query with where clause |
| BUG-40858 | Hive | (2.2-maint) vectorization with ACID table, count(1) fails with ArrayIndexOutOfBoundsException | |
| BUG-41237 | HIVE-11285 | Hive | In MR mode, SMB join is failing with ClassCastException when a partition key of type CHAR / INT / BIGINT / DECIMAL is read. |
| BUG-41439 | Hive, Tez | Error thrown when Empty tables and SMB (OUTER) JOINs are used | |
| BUG-41663 | HIVE-11438 | Hive | hive cli starts in MR mode/CombineHiveInputFormat, query of ACID table join/union non-ACID fails with NPE map plan not found error. |
Security
| Hortonworks Bug ID | Apache JIRA | Component | Summary |
|---|---|---|---|
| BUG-36065 | Ranger | PRIVACY case issue in HBase Ranger plugin | |
| BUG-38608 | Hue | (2.2) - Hue does not respect Support dfs.umaskmode, fs.permissions.umask-mode when creating files or folders | |
| BUG-41603 | Ranger | (2.2) Data consistency across API and UI | |
| BUG-41975 | Ranger | (2.2) Ranger enable plugin script should handle file permission with umask 027 | |
| BUG-42587 | STORM-857 | Storm | Supervisor process fails to write log metadata to YAML file when "supervisor.run.worker.as.user" is enabled |
Stability
| Hortonworks Bug ID | Apache JIRA | Component | Summary |
|---|---|---|---|
| BUG-27650 | HBASE-12465 | HBase | HBase master start fails due to incorrect file creations |
| BUG-30184 | Hive | (2.2, Patch) - empty ORC file without schema produced by Hive | |
| BUG-31699 | HBASE-12070 | HBase | Back Port HBASE-12070: Add an option to hbck to fix ZK inconsistencies |
| BUG-36081 | HIVE-10595 | Hive | (2.2) - Deleted tables stalls all HiveMetastore compactions |
| BUG-36797 | YARN-3626 | YARN | On Windows localized resources are not moved to the front of the classpath when they should be merge to 2.2-maint |
| BUG-37096 | HADOOP-11328 | Hadoop Common | ZKFailoverController does not log Exception when doRun raises errors |
| BUG-37157 | HBASE-13331 | HBase | (2.2) - Exceptions from DFS client can cause CatalogJanitor to delete referenced files |
| BUG-37751 | STORM-329 STORM-404 | Storm | Worker on one machine crashes due to a failure of another worker on another machine |
| BUG-37760 | PHOENIX-2031 | Phoenix | Unable to process timestamp data loaded via Phoenix org.apache.phoenix.pig.PhoenixHBaseLoader |
| BUG-37915 | TEZ-2488 | Tez | (2.2) - [TEZ-2488] Tez AM crashes if a submitted DAG is configured to use invalid resource sizes. |
| BUG-39400 | Hive | hive tez dynamic partition pruning hang on to-be-pruned Map Vertex initialization, when tez reuse containers | |
| BUG-39565 | HDFS-7871 | HDFS | NameNode edit log roller error message printing can cause NameNode to freeze |
| BUG-39649 | TEZ-2189 | Tez | [TEZ-2189] Tez UI live AM tracking url only works for localhost addresses |
| BUG-39773 | HIVE-11023 | Hive | (2.2) - Disable direct sql if datanucleus.identifierFactory = datanucleus2 |
| BUG-39803 | YARN-2922 | YARN | ConcurrentModificationException in CapacityScheduler's LeafQueue |
| BUG-40133 | YARN-3055 | YARN | The token is not renewed properly if it's shared by jobs (oozie) in DelegationTokenRenewer |
| BUG-40195 | HIVE-11442 | Hive | commons-configuration-1.6.jar is backwards incompatible and regressive |
| BUG-41126 | Hue | Workaround HS2 memory Leak | |
| BUG-41137 | HDFS-8767 | HDFS | HDFS listStatus on unix pipe file fails with NPE |
| BUG-41148 | TEZ-2290 TEZ-2732 | Tez | DefaultSorter throws ArrayIndex exceptions on 2047 Mb size sort buffers |
| BUG-41179 | HBASE-12270 | HBase | A bug in the bucket cache, with cache blocks on write enabled |
| BUG-41385 | TEZ-2629 | Tez | [TEZ-2629] LimitExceededException in Tez client when DAG has exceeds the default max |
| BUG-41388 | HIVE-11303 | Hive | Getting Tez LimitExceededException after dag execution on large query |
| BUG-41401 | STORM-951 | Storm | Storm Hive Bolt leaking a transaction for every txnBatch |
| BUG-41461 | TEZ-2636 | Tez | [TEZ-2636] Tez needs to allow inputs that don't have data in MultiMRInput |
| BUG-41536 | SQOOP-2387 | Sqoop | (2.2) NPE during sqoop import when column contains a special character |
| BUG-41538 | YARN-3487 | YARN | CapacityScheduler scheduler lock obtained unnecessarily when calling getQueue |
| BUG-41656 | RelEng, Storm | Nimbus process dies in a 20 node cluster when there are multiple supervisors attempt to download a large jar. | |
| BUG-41920 | Falcon | (2.2) Feed replication test failed because of authentication issues | |
| BUG-42198 | HBASE-14196 | HBase | (2.2) - Thrift server connection idle timeout issue |
| BUG-42209 | YARN-2019 YARN-2136 YARN-2856 YARN-2946 YARN-2992 YARN-3094 YARN-3242 YARN-3369 YARN-3385 YARN-3469 YARN-3753 YARN-3878 | YARN | Stabilizing the RM-ZK integration |
| BUG-42217 | TEZ-2635 | Tez | Backport TEZ-2635 to 2.2 and 2.3 |
| BUG-42256 | HADOOP-12186 YARN-2605 YARN-2713 YARN-2865 YARN-3351 YARN-3526 YARN-3804 YARN-3999 | YARN | Fixes for RM HA stabilization on HDP-2.2.x |
| BUG-42662 | ACCUMULO-3957 | Accumulo | Accumulo monitor's getContentSummary calls may cause NN pauses |
| BUG-42682 | HBASE-12449 | HBase | Back port HBASE-12449: Use the max timestamp of current or old cell's timestamp in HRegion.append() |
| BUG-42690 | HBASE-13877 | HBase | Back Port HBASE-13877: Interrupt to flush from TableFlushProcedure causes dataloss in ITBLL |
| BUG-42692 | HBASE-13473 | HBase | Back Port HBASE-13473: deleted cells come back alive after the stripe compaction |
| BUG-42696 | HBASE-12686 | HBase | Back Port HBASE-12686: Failures in split before PONR not clearing the daughter regions from regions in transition during rollback |
| BUG-42718 | HBASE-12891 | HBase | Back Port HBASE-12891: Parallel execution for Hbck checkRegionConsistency |
| BUG-42733 | PHOENIX-1535 PHOENIX-1536 PHOENIX-1570 PHOENIX-1634 | Phoenix | Backport local index related issues to 2.2-maint version |
| BUG-42734 | PHOENIX-1448 PHOENIX-1456 PHOENIX-1600 PHOENIX-1610 PHOENIX-1650 | Phoenix | Backport resource leak related issues to Phoenix 2.2-maint |
| BUG-42765 | ACCUMULO-3445 | Accumulo | Backport ACCUMULO-3445 "Server failure to login using Kerberos doesn't exit the process" |
| BUG-42766 | ACCUMULO-3385 | Accumulo | Backport ACCUMULO-3385 "DateLexicoder fails to correctly order dates prior to 1970" |
| BUG-42767 | ACCUMULO-3745 | Accumulo | Backport ACCUMULO-3745 "deadlock in SourceSwitchingIterator" |
| BUG-42768 | ACCUMULO-2641 | Accumulo | Backport ACCUMULO-2641 "scan id not set in org.apache.accumulo.core.client.admin.ActiveScan" |
| BUG-42810 | YARN-3011 | YARN | NM dies because of the failure of resource localizatio |
| BUG-42810 | YARN-3222 | YARN | RMNodeImpl#ReconnectNodeTransition should send scheduler events in sequential order |
| BUG-42810 | YARN-3850 | YARN | NM fails to read files from full disks which can lead to container logs being lost and other issues |
| BUG-42810 | YARN-3238 | YARN | Connection timeouts to nodemanagers are retried at multiple levels |
| BUG-42810 | YARN-3055 | YARN | The token is not renewed properly if it's shared by jobs (oozie) in DelegationTokenRenewer |
| BUG-42876 | HBASE-14258 | HBase | [2.2-maint] Make region_mover.rb case insensitive in regards to hostname |
| BUG-42933 | HBASE-13995 | HBase | Backport HBASE-13995 to HDP-2.2 |
| BUG-42947 | TEZ-2687 | Tez | (2.2) - Tez should release/kill all held containers before stopping services during the shutdown phase |
| BUG-42973 | HBASE-13576 | HBase | Back Port HBASE-13576: HBCK enhancement: Failure in checking one region should not fail the entire HBCK operation. |
| BUG-43084 | YARN-3978 YARN-2301 | YARN | Backport YARN-3978 + YARN-2301 - Reduce ResourceManager memory footprint of Timeline events - Configurably turn off the saving of container info in Generic AHS |
| BUG-43107 | TEZ-1808 TEZ-2734z | Tez | [TEZ-1808] Job can fail since name of intermediate files can be too long in specific situation |
| BUG-43153 | HBASE-13413 | HBase | Cherry-pick IntegrationTestReplication (HBASE-13413) |
| BUG-43258 | TEZ-2552 | Tez | CLONE[2.2] - backport TEZ-2552 to 2.2 maint |
Upgrade
| Hortonworks Bug ID | Apache JIRA | Component | Summary |
|---|---|---|---|
| BUG-38009 | HDFS-7533 | HDFS | Datanode sometimes does not shutdown on receiving upgrade shutdown command |
Usability
| Hortonworks Bug ID | Apache JIRA | Component | Summary |
|---|---|---|---|
| BUG-32732 | Sqoop | Netezza skip control characters issue | |
| BUG-35352 | STORM-745 | Storm | Second Commandline Parameter passed to the main class is skipped when run in windows |
| BUG-35987 | Ranger | Disabling Hive Ranger does not restore original functionality | |
| BUG-36103 | Hue | (2.2) - Can't see Tez job details from Hue job browser while Tez job is running | |
| BUG-36829 | HIVE-10719 | Hive | alter table rename can not rename table in non-default database |
| BUG-37223 | TEZ-2546. | Tez | Tez UI: Backport tez-ui changes to display hive query text to 2.2 maint branch |
| BUG-37748 | Sqoop | (2.2) - Netezza skip control characters issue | |
| BUG-38045 | HIVE-9655 | Hive | Dynamic partition insert with distribute by clause |
| BUG-39419 | STORM-938 | Storm | Add an option to the storm hive-bolt to flush at a certain interval |
| BUG-40345 | Hue | (Hotfix on top of 2.2.4.2) - Hue - log empty for create and insert statements | |
| BUG-40423 | Hue | (2.2) - Hue UTF8 Filter Decoding | |
| BUG-41033 | HDFS-6673 | HDFS | Provide delimited format for the HDFS Offline Image Viewer |
| BUG-41349 | YARN-2513 | YARN | [YARN-2513] Host framework UIs in YARN for use with the ATS |
| BUG-41579 | HIVE-11112 | Hive | EY: Hive client is not displaying "non-ascii" characters when queried from CLI |
| BUG-41696 | YARN-2513 | YARN | Host framework UIs in YARN for use with the ATS |
| BUG-41849 | STORM-512 | Storm | KafkaBolt doesn't handle ticks properly |
| BUG-42145 | SPARK-6918 | Spark | Secure HBase with Kerberos does not work over YARN |
| BUG-42149 | MAPREDUCE-6238 | MapReduce | [MAPREDUCE-6238]MR2 can't run local jobs with -libjars command options which is a regression from MR1 |
| BUG-42717 | Ranger | Exceptions related to XA secure audit record | |
| BUG-42810 | YARN-3585 | YARN | NodeManager cannot exit on SHUTDOWN event triggered and NM recovery is enabled |
