Fixed Issues
Fixed issues represents selected issues that were previously logged via Hortonworks Support, but are now addressed in the current release. These issues may have been reported in previous versions within the Known Issues section; meaning they were reported by customers or identified by Hortonworks Quality Engineering team.
Incorrect Results
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-82251 | RANGER-1632 | Users are not sync'd when sAMAccountName is different than CN associated with groups |
| BUG-83596 | KNOX-984, RANGER-1726 | User are not getting deleted when Knox proxy is Enabled. |
| BUG-84475 | RANGER-1717 | Keyadmin login is not able to see "Admin audit" logs. |
| BUG-84820 | RANGER-1765 | Add unique key constraint in x_group and x_group_users table |
| BUG-84844 | RANGER-1765 | Support concurrent requests to create a group or create group-users mapping via Ranger REST API |
| BUG-85682 | FLUME-3083 | Backport FLUME-3083: Taildir source can miss events if file updated in same second as file close |
| BUG-86361 | AMBARI-21889 | MaxBackupIndex does not work with DailyRollingFileAppender in Ranger |
| BUG-88294 | RANGER-1801 | External users role is not getting changed |
| BUG-88654 | ATLAS-2092 | [Atlas] Concurrency bug while creating entity with referred entity |
| BUG-88867 | HDFS-11674 | reserveSpaceForReplicas is not released if append request failed due to mirror down and replica recovered |
| BUG-88869 | HADOOP-14543 | ZKFC should use getAversion() while setting the zkacl |
| BUG-89015 | HBASE-17290 | Port HBASE-17290 Potential loss of data for replication of bulk loaded hfiles |
| BUG-89111 | HBASE-14644 | Backport HBASE-14644 "Region in transition metric is broken" |
| BUG-89359 | RANGER-1715 | 'repl dump <database>.<table>' failed to authorize in Ranger |
| BUG-90145 | HIVE-17782 | (Fenton M20) - Decimal Cast returning NULL for String containing leading whitespaces |
Other
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-80809 | OOZIE-2781 | Backport OOZIE-2781: HCat partition available notification is not sent to coordinator actions if coordinator job is using a different hostname (cname, IP address, etc. ) for HCat URL. |
| BUG-83262 | HBASE-14850 | Backport c++ native client to HDP-2.6 |
| BUG-85808 | HIVE-16845 | Backport HIVE-16845: INSERT OVERWRITE a table with dynamic partitions on S3 fails with NPE |
| BUG-86767 | ATLAS-2078 | regression - updateTypes(typesDef) API fails if parameter includes a new type |
| BUG-86809 | KNOX-788, KNOX-789 | Atlas UI to support proxy through Knox |
| BUG-87135 | HIVE-17681 | Need to enable rename if HS2 crashes when bootstrap dump in progress. |
| BUG-87957 | HIVE-17394 | Backport HIVE-17394: AvroSerde is regenerating TypeInfo objects for each nullable Avro field for every row |
| BUG-88794 | N/A | Support livy.header in zeppelin |
| BUG-89033 | PHOENIX-4224 | Backport PHOENIX-4224 "Automatic resending cache for HashJoin when cache has expired on server side doesn't work" |
| BUG-89070 | PHOENIX-4225 | Backport PHOENIX-4225 "Using Google cache may lead to lock up on RS side. " |
| BUG-90095 | N/A | remove Remote Tea Runtime library dependency from HDP/HDF Storm binaries |
Performance
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-52028 | HBASE-13142, HBASE-15177, HBASE-15198, HBASE-15203, HBASE-15214 | Backport garbage collection related issues |
| BUG-78934 | HDFS-11641 | Reduce cost of audit logging by using FileStatus instead of HdfsFileStatus |
| BUG-82395 | N/A | Count distinct optimization |
| BUG-83166 | N/A | Backport: Avoid duplicate calls to metastore during compilation phase |
| BUG-83299 | PHOENIX-3964 | Backport PHOENIX-3964 |
| BUG-83852 | HDFS-12130 | getContentSummary does permission check for the whole subtree with Namesystem lock held. |
| BUG-84689 | N/A | Backport assorted mutable 2ndary index changes |
| BUG-84844 | RANGER-1765 | Support concurrent requests to create a group or create group-users mapping via Ranger REST API |
| BUG-85709 | HIVE-17265 | Backport HIVE-17265: Cache merged column stats from retrieved partitions |
| BUG-85870 | HIVE-17288 | Spark/LLAP: Increase netty event loop threads for LlapOutputFormatService |
| BUG-85959 | HIVE-17125 | Hive+ATLAS: Lineage optimizer is run early and unnecessarily for SELECT queries |
| BUG-86233 | HIVE-16133 | Footer cache in Tez AM can take too much memory |
| BUG-86549 | HBASE-18646 | Allow configuration on timeout for "rollog" procedure |
| BUG-86655 | PHOENIX-3986, PHOENIX-3997 | UngroupedAggregateRegionObserver.commitBatch() should set the index metadata as an attribute on every mutation |
| BUG-86658 | PHOENIX-3947, PHOENIX-3948, PHOENIX-4027, PHOENIX-4039 | Backport issues relating to timeouts and retries for secondary-index writes |
| BUG-86791 | HBASE-18665 | ReversedScannerCallable invokes getRegionLocations incorrectly |
| BUG-87105 | N/A | [Umbrella] TPCDS perf improvements for M20 |
| BUG-87115 | PHOENIX-3525, PHOENIX-4099 | Follow-on improvements to automatic index rebuilds |
| BUG-87490 | HBASE-18757 | Port HBASE-18757 Fix Improper bitwise & in BucketCache offset calculation |
| BUG-87495 | HDFS-6888 | Allow selectively audit logging ops |
| BUG-87688 | PHOENIX-3600, PHOENIX-3601 | Phoenix Spark MR classes doesn't provide location information |
| BUG-87818 | RANGER-1771 | Improve performance of merging lists of policyEvaluators returned by Trie |
| BUG-87874 | ZEPPELIN-2850 | changing the method of save-as.service.js from URI data scheme to createobjectURL + File API's blob feature |
| BUG-88036 | HBASE-17215 | Backport HBASE-17215 Separate small/large file delete threads in HFileCleaner to accelerate archived hfile cleanup speed |
| BUG-88274 | N/A | Spark/LLAP: Change temp table storage format to ORC |
| BUG-88334 | HBASE-17854 | Backport HBASE-17854 Use StealJobQueue in HFileCleaner |
| BUG-88799 | HIVE-17611 | spark-llap: Slow write performance with LazyBinarySerDe |
| BUG-88863 | HDFS-11592 | Closing a file has a wasteful preconditions in NameNode |
| BUG-88866 | HADOOP-14369 | NetworkTopology calls expensive toString() when logging |
| BUG-88870 | HDFS-10326 | Disable setting tcp socket send/receive buffers for write pipelines |
| BUG-88899 | HBASE-17127 | Port HBASE-17127 Locate region should fail fast if underlying Connection already closed |
| BUG-90260 | RANGER-1841 | Audit log record for 'use dbName' Hive command contains large number of tags |
| BUG-90385 | HIVE-13232 | CLONE - orc.stripe.size not respected by spark 2 |
| BUG-90419 | HIVE-13232 | CLONE - orc.stripe.size not respected by spark |
| BUG-90431 | RANGER-1843 | Performance fix in finding policies for the resource should be applied for finding tags as well |
Potential Data Loss
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-78460 | HDFS-11609 | Some blocks can be permanently lost if nodes are decommissioned while dead |
| BUG-85681 | FLUME-3085 | Backport FLUME-3085: HDFS Sink can skip flushing some BucketWriters, might lead to data loss |
| BUG-85684 | FLUME-3080 | Backport FLUME-3080: Close failure in HDFS Sink might cause data loss |
| BUG-85814 | HIVE-17280, HIVE-17403 | Data loss in CONCATENATE ORC created by Spark |
| BUG-87399 | HBASE-18743 | Integrate HBASE-18743 HFiles in use by a table which has the same name and namespace with a default table cloned from snapshot may be deleted when that snapshot and default table are deleted |
| BUG-88898 | HBASE-16886 | Port HBASE-16886: hbase-client: scanner with reversed=true and small=true gets no result |
| BUG-90290 | PHOENIX-3396 | Valid Multi-byte strings whose total byte size is greater than the max char limit cannot be inserted into VARCHAR fields in the PK |
Query Failure
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-84526 | ZEPPELIN-2833 | ResultSet closed exception after running Phoenix query on zeppelin |
| BUG-85854 | HIVE-17411 | TPCDS query failure in spark-hive run |
| BUG-87996 | N/A | Spark SQL query will failed on table partitioned by date type |
| BUG-88654 | ATLAS-2092 | [Atlas] Concurrency bug while creating entity with referred entity |
| BUG-88765 | SPARK-18355 | Spark SQL fails to read data from a ORC hive table that has a new column added to it |
Security
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-76314 | N/A | Document encrypted cluster JDBC connection property for Zeppelin impersonation |
| BUG-79764 | HIVE-17152 | Update random function use in HiveServer2 |
| BUG-79799 | RANGER-1505 | Backport RANGER-1505: Remove KeyProtector code in KMS |
| BUG-79828 | HIVE-17514 | use stronger hashing for cookie signer |
| BUG-81047 | HADOOP-14174 | Backport HADOOP-14174 as ADLS improvement |
| BUG-82283 | STORM-2562 | SCA : System Information Leak |
| BUG-82415 | N/A | feature that allows LDAP parameters for Zeppelin to Bind with a system username and password and authenticate in behalf of each user authenticating |
| BUG-82509 | STORM-2563 | SCA: Access Specifier Manipulation |
| BUG-82571 | N/A | SCA : Key Management: Hardcoded Encryption Key |
| BUG-83955 | RANGER-1756, RANGER-1783 | Handle role related restrictions for users having User role |
| BUG-84163 | N/A | Missing HTTP Headers and Cookie flags in Zeppelin |
| BUG-84296 | AMBARI-21675 | Add Secure Flag to Cookie / JSESSIONID |
| BUG-85566 | RANGER-1727 | Ranger allows user to change an external user's password with 'null' old password |
| BUG-85750 | HIVE-17289 | EXPORT and IMPORT shouldn't perform distcp with doAs privileged user. |
| BUG-86401 | AMBARI-21787 | By Default Zeppelin notes should be visible only to Owner (note creator) |
| BUG-86871 | AMBARI-21802 | Zeppelin's secure cookie should only be set when zeppelin is running in HTTPS mode |
| BUG-87249 | ATLAS-2144 | SCA : Denial of Service: StringBuilder |
| BUG-87267 | ATLAS-2174 | SCA : Server-Side Request Forgery |
| BUG-87300 | ATLAS-2079 | Fix issues flagged by static code scan |
| BUG-87373 | HIVE-17419 | Analyze table command show computed stats for masked tables |
| BUG-88478 | RANGER-1797 | [Fenton-M20] - Ranger - Upgrade Tomcat version |
| BUG-89085 | N/A | Port security related changes to 2.6 branch for ConsumerGroupCommand (support for PLAINTEXTSASL and SASL_PLAINTEXT) |
| BUG-89211 | N/A | [Fenton-M20] - Ranger - Upgrade Netty version |
| BUG-89301 | N/A | Upgrade Use of Netty-all to at least netty-all-4.0.37.Final. |
| BUG-89408 | N/A | SCA : Unreleased Resource: Database |
| BUG-90227 | HADOOP-14935 | Azure: POSIX permissions are taking effect in access() method even when authorization is enabled |
Stability
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-51421 | HBASE-9393 | Integrate HBASE-9393 Hbase does not closing a closed socket resulting in many CLOSE_WAIT |
| BUG-52028 | HBASE-13142, HBASE-15177, HBASE-15198, HBASE-15203, HBASE-15214 | Backport garbage collection related issues |
| BUG-59461 | HIVE-17455 | Lifecycle for temp tables created for complex queries using external LLAP client |
| BUG-69881 | HIVE-17480 | repl dump sub dir should use UUID |
| BUG-72747 | YARN-6509 | [YARN-6509] Add a size threshold beyond which yarn logs will require a force option |
| BUG-72905 | FLUME-2620 | File channel throws NullPointerException if a header value is null |
| BUG-75226 | N/A | Superset not able to discover schema from realtime segments |
| BUG-77413 | OOZIE-2828 | Query tag is not functional for Hive2 action node in oozie |
| BUG-77551 | N/A | Druid storage handler fails if the dimension is a VARCHAR instead of string |
| BUG-77706 | N/A | SSB: Support for numeric dimensions |
| BUG-77742 | AMBARI-21971 | Improvements to Rolling upgrades for Druid |
| BUG-78338 | HIVE-17420 | bootstrap - get replid before object dump |
| BUG-78547 | HIVE-16388 | log rotation for additional daemon files |
| BUG-78689 | HIVE-16990 | REPL LOAD should update last repl ID only after successful copy of data files. |
| BUG-79272 | HDFS-11511, HDFS-11630 | Support Timeout for Disk Checker |
| BUG-79372 | HIVE-17522 | cleanup old 'repl dump' dirs |
| BUG-79440 | HIVE-16886 | Investigate potential issues in dbnotification sequence |
| BUG-79714 | RANGER-1402 | Backport RANGER-1402: NPE if there is a problem with the HiveClient driverClassName |
| BUG-79715 | RANGER-1403 | Backport RANGER-1403: There is a problem in buildks class when delete invalid keystore file. |
| BUG-80119 | HIVE-16425 | Backport HIVE-16425: Vectorization: unload old hashtables before reloadHashTable |
| BUG-80195 | N/A | HDInsights: "Submit plan" interval is populated wrongly |
| BUG-80253 | HIVE-16582 | Backport HIVE-16582: HashTableLoader should log info about the input, rows, size etc. |
| BUG-80523 | N/A | Kafka Spout to support topic compaction |
| BUG-80603 | SLIDER-1243 | [SLIDER-1243] SCA : Missing XML Validation |
| BUG-80667 | SLIDER-1244 | [SLIDER-1244] SCA : Privacy Violation |
| BUG-80670 | SLIDER-1245 | [SLIDER-1245] SCA : Mass Assignment: Insecure Binder Configuration |
| BUG-80746 | HIVE-15758 | Backport: TPC-DS query 41 complains of non-equijoin predicate when none exists |
| BUG-80804 | OOZIE-2690 | Backport OOZIE-2690: OOZIE NPE while executing kill() |
| BUG-80808 | OOZIE-2777 | Backport OOZIE-2777: Config-default.xml longer than 64k results in java.io.UTFDataFormatException |
| BUG-80812 | HIVE-16689 | Backport: This query crashes Hive CLI |
| BUG-80868 | HIVE-14807 | Backport HIVE-14807: analyze table compute statistics fails due to presence of Infinity value in double column |
| BUG-80928 | N/A | testRerunFork UT fails |
| BUG-81042 | NA | NM fails to come when CGROUPS is enabled for SUSE 12 |
| BUG-81490 | N/A | [LLAP] -- VectorMapJoin Hash table loading exceeded memory limits Error - q16, q78 |
| BUG-81623 | N/A | Backport: wrong usage of count(column) by calcite/druid rules |
| BUG-81631 | N/A | Backport HIVE-16746: Reduce number of index lookups for same table in IndexWhereTaskDispatcher |
| BUG-81772 | HIVE-17587 | Dropping table with empty partition throws error |
| BUG-81903 | PHOENIX-3797 | Local Index - Compaction fails on table with local index due to non-increasing bloom keys |
| BUG-82154 | SLIDER-1236 | LLAP startup: Slider sleeps for 10 seconds(?) |
| BUG-82268 | N/A | Track and backport SPARK-20079 |
| BUG-82282 | SLIDER-1237 | [SLIDER-1237] SCA : System Information Leak |
| BUG-82306 | TEZ-3828 | make sure error handling relaxes locality even with -1 delay |
| BUG-82308 | PHOENIX-3832, PHOENIX-3858 | local-index related patches and fixes |
| BUG-82385 | N/A | nimbus autocreds plugin fails after submitting topology which has topology-specific cluster conf. |
| BUG-82394 | HIVE-15160 | Backport: Allow order by on unselected columns |
| BUG-82483 | N/A | Hive is not able to talk to druid when kerberos is enabled |
| BUG-82484 | HIVE-16864, HIVE-17172 | LLAP IO elevator stuck in infinite loop |
| BUG-82722 | HIVE-16113 | Backport HIVE-16113: PartitionPruner::removeNonPartCols needs to handle AND/OR cases |
| BUG-82744 | N/A | Backport HIVE-16903: LLAP: Fix config name in SHUFFLE_MANAGE_OS_CACHE |
| BUG-82812 | HIVE-17183 | Disable rename operations during bootstrap dump (Phase-1) |
| BUG-83171 | HIVE-16820 | Unable to stop query from Squirel/Alteryx |
| BUG-83313 | N/A | [LLAP] -- Hive queries are hung |
| BUG-83557 | YARN-3254 | RM UI doesn't show full disk status on the Nodes page |
| BUG-84303 | HIVE-17535 | Intersect and Except throw NPE when performing select with constant |
| BUG-84307 | HIVE-17428 | REPL LOAD of ALTER_PARTITION event doesn't create import tasks if the partition doesn't exist during analyze phase. |
| BUG-84526 | ZEPPELIN-2833 | ResultSet closed exception after running Phoenix query on zeppelin |
| BUG-84567 | HIVE-16943 | Backport HIVE-16943: MoveTask should separate src FileSystem from dest FileSystem |
| BUG-84574 | HIVE-16981 | Backport HIVE-16981: hive.optimize.bucketingsorting should compare the schema before removing RS |
| BUG-84575 | HIVE-16911 | Backport HIVE-16911: Upgrade groovy version to 2.4.11 |
| BUG-84923 | HIVE-16177, HIVE-17526 | Backport HIVE-16177: non Acid to acid conversion doesn't handle _copy_N files |
| BUG-85084 | HIVE-17196 | CM: ReplCopyTask should retain the original file names even if copied from CM path. |
| BUG-85408 | HIVE-16077 | Backport HIVE-16077: UPDATE/DELETE fails with numBuckets > numReducers |
| BUG-85685 | FLUME-3043 | Backport FLUME-3043: KafkaSink SinkCallback throws NullPointerException when Log4J level is debug |
| BUG-85686 | FLUME-2905 | Backport FLUME-2905: NetcatSource - Socket not closed when an exception is encountered during start() leading to file descriptor leaks |
| BUG-85720 | N/A | Multiple Failing test org.apache.hadoop.hive.ql.metadata.TestHive |
| BUG-85746 | HIVE-17494 | Bootstrap REPL DUMP throws exception if a partitioned table is dropped while reading partitions. |
| BUG-85803 | OOZIE-2819 | Make Oozie REST API accept multibyte characters for script Actions |
| BUG-85812 | HIVE-17222 | Backport HIVE-17222: Llap: Iotrace throws java.lang.UnsupportedOperationException with IncompleteCb |
| BUG-85946 | HIVE-17585 | Parallel loads failing for dynamic partitions |
| BUG-85950 | YARN-6811 | [hwxmonarch] [YARN-285] WASB ATS ACLS not evaluated | ATS History data to go in User Directory |
| BUG-86025 | HIVE-17327 | LLAP: FileID paths have problems with HDFS federation (or multiple NameNodes) |
| BUG-86073 | HIVE-17008 | Backport HIVE-17008: Fix boolean flag switchup in DropTableEvent |
| BUG-86078 | HIVE-17148 | Backport HIVE-17148: Incorrect result for Hive join query with COALESCE in WHERE condition |
| BUG-86135 | AMBARI-22125 | Druid process fails to start with OOME on small machines with default ambari configs |
| BUG-86241 | HADOOP-14573, HADOOP-14769 | WASB: delete recursive should not fail if a file is deleted |
| BUG-86326 | YARN-1453 | Hadoop fails to compile against jdk8 |
| BUG-86345 | HIVE-17272 | Backport HIVE-17272: when hive.vectorized.execution.enabled is true, query on empty partitioned table fails with NPE |
| BUG-86388 | HIVE-17375 | TPCDS query, mismatch in output for stddevsamp() |
| BUG-86420 | HIVE-17351 | backport HIVE-17351 |
| BUG-86454 | CALCITE-1683, CALCITE-1723, HIVE-15619, HIVE-17623 | Druid query result validation failure |
| BUG-86626 | ATLAS-2085 | not able to view atlas entities due to vertex_index is unknown |
| BUG-86676 | HIVE-17367 | IMPORT table doesn't load from data dump if a metadata-only dump was already imported. |
| BUG-86689 | N/A | Backport Router misc fixes |
| BUG-86739 | RANGER-1747 | [Fenton-M20]-LDAP paged results resets to 500 after fetching first page of results |
| BUG-86769 | N/A | Backport Hive-17352 |
| BUG-86793 | ATLAS-2082 | Regression: Search fails when filter contains a boolean attribute and a string attribute with special characters |
| BUG-86856 | N/A | tpcds query result mismatch, hive returning null when postgres return 0 |
| BUG-86876 | SLIDER-1248 | [SLIDER-1248] SCA : Insecure Randomness |
| BUG-87103 | https://issues.apache.org/jira/browse/STORM-2542 | STORM-2542 - Deprecate storm-kafka-client KafkaConsumer.subscribe API subscriptions on 1.x and remove them as options in 2.x |
| BUG-87104 | https://issues.apache.org/jira/browse/STORM-2541 | STORM-2541 - Manual partition assignment doesn't work |
| BUG-87106 | STORM-2640 | STORM-2640 - Deprecate KafkaConsumer.subscribe APIs on 1.x, and make KafkaConsumer.assign the default |
| BUG-87107 | N/A | Backport ndv bit vector related changes : HIVE-16997 and friends |
| BUG-87109 | HDFS-8429 | Avoid stuck threads if there is an error in DomainSocketWatcher that stops the thread |
| BUG-87111 | N/A | Backport HIVE-17276 to 2.6-maint hive2 |
| BUG-87113 | HIVE-17495 | Implement stats aggregation during cache pre-warm |
| BUG-87152 | HIVE-17360 | Backport HIVE-17360: Tez session reopen appears to use a wrong conf object |
| BUG-87157 | HIVE-17233 | Backport HIVE-17233: Set "mapred.input.dir.recursive" for HCatInputFormat-based jobs. |
| BUG-87206 | YARN-7163 | Resourcemanager crash due to OOM |
| BUG-87226 | N/A | Backport HIVE-17415 |
| BUG-87260 | N/A | Backport Superset timezone fix |
| BUG-87322 | HIVE-17527 | Table move from default to replicated database on source cluster fails to replicate in destination cluster |
| BUG-87390 | ZOOKEEPER-2146 | Port ZOOKEEPER-2146 BinaryInputArchive readString should check length before allocating memory |
| BUG-87475 | NA | [Umbrella] Support CGROUPS on Centos7 / SLES / Ubuntu / Debian |
| BUG-87477 | N/A | orc_llap stats changes |
| BUG-87494 | HIVE-17456 | Set current DB for LLAP external client |
| BUG-87499 | N/A | Backport HIVE-15476 / HIVE-16450 |
| BUG-87510 | N/A | kafka lag monitor in Storm UI fails with error "java.lang.NoSuchFieldError: PLAINTEXTSASL" even in non-secure cluster |
| BUG-87520 | YARN-7118 | AHS REST API can return NullPointerException |
| BUG-87531 | HDFS-10220 | A large number of expired leases can make namenode unresponsive and cause failover |
| BUG-87556 | HIVE-11827 | STORED AS AVRO fails SELECT COUNT(*) when empty |
| BUG-87631 | HIVE-17479 | Backport HIVE-17479: Staging directories do not get cleaned up for update/delete queries |
| BUG-87644 | HIVE-17523 | Druid insert into hangs Hive server2 |
| BUG-87746 | N/A | Change the defaults for certain settings |
| BUG-87748 | HIVE-17475 | Backport HIVE-17475: Mapjoin(none) hint |
| BUG-87823 | N/A | Backport case when vectorization : HIVE-16110 |
| BUG-87839 | ATLAS-1867 | ATLASClientV2 correct delete typedefs expected http code |
| BUG-87843 | HIVE-15367 | Temp table with CTAS tries to create staging directory in the actual database directory |
| BUG-87874 | ZEPPELIN-2850 | changing the method of save-as.service.js from URI data scheme to createobjectURL + File API's blob feature |
| BUG-87958 | HIVE-17275 | Backport HIVE-17275: Auto-merge fails on writes of UNION ALL output to ORC file with dynamic partitioning |
| BUG-87959 | HIVE-17410 | Backport HIVE-17410: repl load task during subsequent DAG generation does not start from the last partition processed |
| BUG-88117 | YARN-7157 | Tracking ticket for hwxmonarch YARN-276: YARN UI doesn't filter apps by users |
| BUG-88153 | YARN-6876, YARN-6877, YARN-7072, YARN-7144, YARN-7148, YARN-7194 | Backport new log format related patches into Fenton-M20/2.6-maint branch |
| BUG-88176 | N/A | Superset will lag to show the data on the UI till hand off occurs |
| BUG-88195 | N/A | SCA : Privacy Violation |
| BUG-88209 | N/A | SCA : Privacy Violation |
| BUG-88210 | N/A | SCA : Resource Injection |
| BUG-88257 | YARN-1993 | SCA : Cross-Site Scripting: Reflected (Input Validation and Representation, Data Flow) |
| BUG-88276 | HIVE-17608 | REPL LOAD should overwrite the data files if exists instead of duplicating it |
| BUG-88279 | N/A | Change in hive breaking atlas - 2.6-maint |
| BUG-88323 | HIVE-17422, HIVE-17504, HIVE-17558 | Skip non-native/temporary/ACID tables for major operations |
| BUG-88362 | HIVE-17013 | Backport to Fenton-M20 --> HIVE-17013 Delete request with a subquery based on select over a view |
| BUG-88416 | HADOOP-11846 | Backport HADOOP-11846: TestCertificateUtil.testCorruptPEM failing on Jenkins JDK8 |
| BUG-88419 | N/A | SCA : Unsafe Reflection |
| BUG-88424 | N/A | SCA : XML External Entity Injection |
| BUG-88476 | HIVE-17588 | LlapRowRecordReader doing name-based field lookup for every column of every row |
| BUG-88485 | hive-17529 | Backport HIVE-17529 |
| BUG-88510 | N/A | update config hive.repl.partitions.dump.parallelism=100 |
| BUG-88512 | OOZIE-2574 | Backport OOZIE-2574: Oozie to support replication-enabled mysql urls |
| BUG-88544 | N/A | Ambari 2.6.0.0 CI Is Blocked By a Hive SQL Problem |
| BUG-88577 | YARN-7249 | [YARN-7249] Fix CapacityScheduler NPE issue when a container preempted while the node is removing |
| BUG-88604 | N/A | Backport OOZIE-105? github commit, JPA fix |
| BUG-88639 | HIVE-17610 | TPCDS Query failing with unexpected RefCount in LLAP |
| BUG-88646 | HIVE-17562 | ETL strategy should treat empty compacted files as uncovered deltas |
| BUG-88746 | N/A | setting druid metadata properties at runtime is failing |
| BUG-88752 | N/A | ZooKeeper -- doc requirements for dev |
| BUG-88813 | HIVE-17554 | Backport HIVE-17554: Occurr java.lang.ArithmeticException: / by zero at hplsql component |
| BUG-88816 | HIVE-17529 | Backport HIVE-17529: Bucket Map Join : Sets incorrect edge type causing execution failure |
| BUG-88820 | HIVE-17452 | Backport HIVE-17452: HPL/SQL function variable block is not initialized |
| BUG-88821 | HIVE-17568 | Backport HIVE-17568: HiveJoinPushTransitivePredicatesRule may exchange predicates which are not valid on the other branch |
| BUG-88822 | HIVE-17594 | Backport HIVE-17594: Unit format error in Copy.java |
| BUG-88862 | HDFS-11377 | Balancer hung due to no available mover threads |
| BUG-88865 | HDFS-11131 | TestThrottledAsyncChecker#testCancellation is flaky |
| BUG-88923 | YARN-7257 | [YARN-7257] AggregatedLogsBlock reports a bad 'end' value as a bad 'start' value |
| BUG-88995 | YARN-7259 | [YARN-7259]add rolling policy to LogAggregationIndexedFileController |
| BUG-89089 | N/A | Kill api hive1 UT failures |
| BUG-89121 | PHOENIX-4010 | (addendum) Hash Join cache may not be send to all regionservers when we have stale HBase meta cache |
| BUG-89177 | HADOOP-14099 | [DOC] Update S3A documentation |
| BUG-89214 | HADOOP-14204 | S3A multipart commit failing, "UnsupportedOperationException" |
| BUG-89215 | HIVE-17665 | Upgrade Use of Netty-all to at least netty-all-4.0.37.Final. |
| BUG-89219 | HADOOP-14596 | AWS SDK 1.11+ aborts() on close() if > 0 bytes in stream; logs error. |
| BUG-89236 | HADOOP-14255, HADOOP-14428 | S3A to delete unnecessary fake directory objects in mkdirs() |
| BUG-89241 | HADOOP-14087, HADOOP-14305 | S3A SSE tests won't run in parallel |
| BUG-89262 | HADOOP-14845 | Azure wasb: getFileStatus not making any auth checks |
| BUG-89266 | HADOOP-14768 | Honoring sticky bit during Deletion when authorization is enabled in WASB |
| BUG-89277 | HADOOP-14910 | Hadoop Client: Upgrade Use of Netty-all to at least netty-all-4.0.37.Final. |
| BUG-89346 | N/A | Backport HIVE-17641: Visibility issue of Task.done cause Driver skip stages in parallel execution |
| BUG-89352 | YARN-6625 | [YARN-6625] yarn application -list returns a tracking URL for AM that doesn't work in secured and HA environment |
| BUG-89525 | N/A | druid tpc-ds query fails with ClassNotFoundException |
| BUG-89566 | AMBARI-22162 | HiveConf of name hive.druid.* does not exist warnings |
| BUG-89597 | CALCITE-1983 | druid tpcds query result validation failure |
| BUG-89648 | N/A | incorrect value for ss_quantity persisted in druid table |
| BUG-89711 | HADOOP-14899 | Restrict Access to setPermission operation when authorization is enabled in WASB |
| BUG-89725 | N/A | Backport review comments for NULL Handling |
| BUG-89755 | HIVE-11266 | Backport HIVE-11266: count(*) wrong result based on table statistics for external tables |
| BUG-89864 | CALCITE-1819, CALCITE-2006 | Backport CALCITE-2006: Push IS NULL and IS NOT NULL predicates to Druid |
| BUG-90197 | CALCITE-1749 | Backport CALCITE-1749: Push filter conditions partially into Druid |
| BUG-90308 | STORM-2779 | NPE on shutting down WindowedBoltExecutor |
| BUG-90329 | N/A | Backport critical fixes for Null handling support |
| BUG-90349 | HIVE-17804 | Backport HIVE-17804: Vectorized Like is like broken |
Supportability
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-66474 | ZOOKEEPER-1962 | Backport ZOOKEEPER-1962 ls -r support |
| BUG-78460 | HDFS-11609 | Some blocks can be permanently lost if nodes are decommissioned while dead |
| BUG-79272 | HDFS-11511, HDFS-11630 | Support Timeout for Disk Checker |
| BUG-79716 | RANGER-1408 | Backport RANGER-1408: When the error occurs, the system does not record the error message in RangerServiceService class |
| BUG-80306 | KNOX-994 | Need to append an extra '/' after zeppelin's knox URL |
| BUG-80811 | OOZIE-2807 | Backport OOZIE-2807: Oozie gets RM delegation token even for checking job status |
| BUG-81694 | N/A | Configuring the Ranger HBase Plugin for SSL |
| BUG-82251 | RANGER-1632 | Users are not sync'd when sAMAccountName is different than CN associated with groups |
| BUG-82925 | N/A | Generating jks for "Configuring the Ranger KMS Server" is misleading customers |
| BUG-83852 | HDFS-12130 | getContentSummary does permission check for the whole subtree with Namesystem lock held. |
| BUG-84545 | PHOENIX-4042 | Server-side secondary index metrics (fenton-m20) |
| BUG-85346 | N/A | Depend on Apache ORC for ORC in Apache Spark |
| BUG-85427 | AMBARI-21871, HBASE-15160, HBASE-18184 | HDFS metrics for better insights to performance issues |
| BUG-85495 | ATLAS-2018 | UI: Attribute filter will not preserving state |
| BUG-86655 | PHOENIX-3986, PHOENIX-3997 | UngroupedAggregateRegionObserver.commitBatch() should set the index metadata as an attribute on every mutation |
| BUG-86658 | PHOENIX-3947, PHOENIX-3948, PHOENIX-4027, PHOENIX-4039 | Backport issues relating to timeouts and retries for secondary-index writes |
| BUG-87495 | HDFS-6888 | Allow selectively audit logging ops |
| BUG-87874 | ZEPPELIN-2850 | changing the method of save-as.service.js from URI data scheme to createobjectURL + File API's blob feature |
| BUG-88868 | HDFS-11914 | Add more diagnosis info for fsimage transfer failure |
| BUG-88871 | HDFS-12293 | DataNode should log file name on disk error |
| BUG-89240 | HADOOP-14135 | Remove URI parameter in AWSCredentialProvider constructors |
| BUG-90420 | RANGER-1820 | Address Ranger DB consolidated SQL script inconsistency |
Upgrade
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-85632 | RANGER-1697 | Update NiFi service def + handle upgrade scenario for the same |
| BUG-87410 | N/A | Update Zeppelin with 0.7.3 |
Usability
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-46880 | HBASE-14663 | HStore::close does not honor config hbase.rs.evictblocksonclose |
| BUG-56700 | N/A | Ranger Log4jAuditProvider configuration documentation for Ranger Storm Plugin |
| BUG-74799 | N/A | Hive/Druid integration: null handling for metrics |
| BUG-75107 | N/A | Upgrade to Druid 0.10.0 |
| BUG-79717 | RANGER-1415 | Backport RANGER-1415: Ranger will fail after installing hdfs plugin if we set POLICY_MGR_URL ending as / |
| BUG-80306 | KNOX-994 | Need to append an extra '/' after zeppelin's knox URL |
| BUG-80800 | OOZIE-2658 | Backport OOZIE-2658: --driver-class-path can overwrite the classpath in SparkMain |
| BUG-82925 | N/A | Generating jks for "Configuring the Ranger KMS Server" is misleading customers |
| BUG-83293 | N/A | Oozie fails to submit job with validation error |
| BUG-83600 | RANGER-1724 | change image alt name in UI code |
| BUG-83605 | RANGER-1730 | Utility script that will list the users with a given role |
| BUG-83897 | RANGER-1682 | Clicking on export service after session timeout gets stuck indefinitely |
| BUG-84376 | YARN-7116 | RM UI is showing improper number under "Used AM Resource" |
| BUG-84632 | AMBARI-21125, AMBARI-21696 | Spark2: Spark Thrift Server Error occurred during processing of message |
| BUG-84985 | HBASE-16299 | Update REST API scanner with ability to do reverse scan |
| BUG-85394 | SPARK-19634 | Spark DataFrame/Dataset support multivariate statistic |
| BUG-85427 | AMBARI-21871, HBASE-15160, HBASE-18184 | HDFS metrics for better insights to performance issues |
| BUG-85732 | ATLAS-2025, ATLAS-2026 | Basic/DSL Query with invalid typeName/classification name throws 500 Internal server error |
| BUG-85738 | OOZIE-2656 | OozieShareLibCLI uses op system username instead of Kerberos to upload jars |
| BUG-85789 | ATLAS-1993 | UI : show list of Tables in detail page if entity type is hive_db |
| BUG-85790 | ATLAS-2027 | UI : Add type-name with attribute name in query-builder |
| BUG-85803 | OOZIE-2819 | Make Oozie REST API accept multibyte characters for script Actions |
| BUG-85886 | ATLAS-2039 | Unable to edit date value from UI when entity definition is POSTed without value for date attribute. |
| BUG-86155 | HIVE-17115 | MetaStoreUtils.getDeserializer doesn't catch the java.lang.ClassNotFoundException |
| BUG-86621 | ATLAS-2071 | UI : Minification of atlas code (js,css) |
| BUG-86626 | ATLAS-2085 | not able to view atlas entities due to vertex_index is unknown |
| BUG-86660 | ATLAS-2041 | Atlas not showing tag names that contain dot |
| BUG-86662 | ATLAS-2033 | Reduce size of Kafka notification contents by formatting JSON without pretty-print option |
| BUG-86663 | ATLAS-2017 | Import API: update to make the new parameter to be optional |
| BUG-86739 | RANGER-1747 | [Fenton-M20]-LDAP paged results resets to 500 after fetching first page of results |
| BUG-86750 | ATLAS-2080 | Search using entity and trait attributes - tag filters are also added in the "attributes" list of the POST request body |
| BUG-86782 | RANGER-1748 | User is unable to update existing policy while importing policy from file |
| BUG-86793 | ATLAS-2082 | Regression: Search fails when filter contains a boolean attribute and a string attribute with special characters |
| BUG-86808 | HBASE-18614 | Setting BUCKET_CACHE_COMBINED_KEY to false disables stats on RS UI |
| BUG-86844 | HADOOP-14839 | Distcp enhancement to include copied and skipped file information with Size |
| BUG-87099 | PHOENIX-2290, PHOENIX-2547 | Spark Phoenix cannot recognize Phoenix view fields and doesn't work well with columns that has space character. |
| BUG-87168 | HBASE-18568 | Port HBASE-18568 Correct metric of numRegions |
| BUG-87292 | PHOENIX-3406 | CSV bulkload may work incorrectly if ROW_TIMESTAMP is used. |
| BUG-87297 | ATLAS-2054 | Add flag to exclude attribute mapping in FullTextMapper |
| BUG-87298 | ATLAS-2062 | Add flag to disable v1 gremlin search API using atlas-application property |
| BUG-87317 | PHOENIX-3427, PHOENIX-3532 | Tenant-specific tables are not supported by Phoenix-Spark |
| BUG-87344 | RANGER-1786 | Need warning on external user role change. |
| BUG-87531 | HDFS-10220 | A large number of expired leases can make namenode unresponsive and cause failover |
| BUG-87550 | AMBARI-21910 | [Ranger smart config] Ranger Usersync config to support nested group evaluation for LDAP Sync source |
| BUG-87556 | HIVE-11827 | STORED AS AVRO fails SELECT COUNT(*) when empty |
| BUG-87686 | PHOENIX-3792 | Column name normalization in Phoenix Spark integration |
| BUG-87832 | ATLAS-1996, ATLAS-2003, ATLAS-2004, ATLAS-2015, ATLAS-2024, ATLAS-2038, ATLAS-2048, ATLAS-2060, ATLAS-2074, ATLAS-2083, ATLAS-2097, ATLAS-2101 | Misc improvements like documentation, refactoring, typo fixes |
| BUG-87833 | TEZ-3703 | Backport TEZ-3703: Use a sha comparison to compare vertex and dag resources, if there is a mismatch |
| BUG-87835 | ATLAS-1218 | Atlas says it is started but does not accept REST requests |
| BUG-87857 | RANGER-1787 | User has to fill up all the allow and deny conditions items to create a knox policy. |
| BUG-87874 | ZEPPELIN-2850 | changing the method of save-as.service.js from URI data scheme to createobjectURL + File API's blob feature |
| BUG-87943 | HDFS-8805 | getStoragePolicy should not need superuser privilege |
| BUG-88262 | HADOOP-14520 | WASB - Block Compaction: Backport HADOOP-14520 |
| BUG-88367 | HADOOP-14583 | WASB throws an exception if you try to create a file and there's no parent directory |
| BUG-88432 | OOZIE-2608 | Backport OOZIE-2608: Comma in oozie.service.JPAService.jdbc.password value results in authentication error |
| BUG-88520 | ATLAS-2151 | Search using entity and trait attributes - OR condition considers only the first criterion in the list. |
| BUG-88525 | ATLAS-2154 | UI save-search : No data message showing even after adding favorite search. |
| BUG-88539 | ATLAS-2156 | UI save-search : allow user to edit name |
| BUG-88576 | ATLAS-2157 | HiveHook error while processing temporary tables |
| BUG-88652 | N/A | Backport KNOX-1061 to fix KnoxSSO Redirects with QueryParams |
| BUG-88721 | AMBARI-22052 | Zeppelin's conf HDFS directory owner is wrong |
| BUG-88845 | KNOX-1068 | Knox returns HTTP 405 Method Not Allowed error with HTTP HEAD method |
| BUG-88862 | HDFS-11377 | Balancer hung due to no available mover threads |
| BUG-88939 | AMBARI-22069 | Zeppelin JDBC queries should be split by default |
| BUG-89366 | ATLAS-2186 | Atlas web UI is not loading with "SharedBlockingCallback$BlockerTimeoutException" |
| BUG-89401 | HIVE-17639 | Backport HIVE-17639: don't reuse planner context when re-parsing the query |
| BUG-89567 | KNOX-970 | Nifi Proxy Support Dispatch Fix |
| BUG-89775 | ATLAS-2189 | IE-9 Alignment Issues |
| BUG-89944 | ATLAS-2204 | UI - Safari Browser Alignment Issues |
| BUG-90255 | RANGER-1795 | Service should not be renamed if tagged service resources exist for it |
| BUG-90260 | RANGER-1841 | Audit log record for 'use dbName' Hive command contains large number of tags |
| BUG-90294 | OOZIE-2872 | Backport OOZIE-2872: Address backward compatibility issue introduced by OOZIE-2748 |
| BUG-90400 | OOZIE-2908 | Backport OOZIE-2908: Fix typo in oozie.actions.null.args.allowed property in oozie-default.xml |
| BUG-90431 | RANGER-1843 | Performance fix in finding policies for the resource should be applied for finding tags as well |