Fixed Issues
Fixed issues represents selected issues that were previously logged via Hortonworks Support, but are now addressed in the current release. These issues may have been reported in previous versions within the Known Issues section; meaning they were reported by customers or identified by Hortonworks Quality Engineering team.
Incorrect Results
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-100019 | YARN-8145 | yarn rmadmin -getGroups doesn't return updated groups for user |
| BUG-100058 | PHOENIX-2645 | Wildcard characters do not match newline characters |
| BUG-100266 | PHOENIX-3521, PHOENIX-4190 | Results wrong with local indexes |
| BUG-88774 | HIVE-17617, HIVE-18413, HIVE-18523 | query36 failing, row count mismatch |
| BUG-89765 | HIVE-17702 | incorrect isRepeating handling in decimal reader in ORC |
| BUG-92293 | HADOOP-15042 | Azure PageBlobInputStream.skip() can return negative value when numberOfPagesRemaining is 0 |
| BUG-92345 | ATLAS-2285 | UI : Renamed saved search with date attribute. |
| BUG-92563 | HIVE-17495, HIVE-18528 | Aggregate stats in ObjectStore get wrong result |
| BUG-92957 | HIVE-11266 | count(*) wrong result based on table statistics for external tables |
| BUG-93097 | RANGER-1944 | Action filter for Admin Audit is not working |
| BUG-93335 | HIVE-12315 | vectorization_short_regress.q has a wrong result issue for a double calculation |
| BUG-93415 | HIVE-18258, HIVE-18310 | Vectorization: Reduce-Side GROUP BY MERGEPARTIAL with duplicate columns is broken |
| BUG-93939 | ATLAS-2294 | Extra parameter "description" added when creating a type |
| BUG-94007 | PHOENIX-1751, PHOENIX-3112 | Phoenix Queries returns Null values due to HBase Partial rows |
| BUG-94266 | HIVE-12505 | Insert overwrite in same encrypted zone silently fails to remove some existing files |
| BUG-94414 | HIVE-15680 | Incorrect results when hive.optimize.index.filter=true and same ORC table is referenced twice in query |
| BUG-95048 | HIVE-18490 | Query with EXISTS and NOT EXISTS with non-equi predicate can produce wrong result |
| BUG-95053 | PHOENIX-3865 | IS NULL does not return correct results when first column family not filtered against |
| BUG-95476 | RANGER-1966 | Policy engine initialization does not create context enrichers in some cases |
| BUG-95566 | SPARK-23281 | Query produces results in incorrect order when a composite order by clause refers to both original columns and aliases |
| BUG-95907 | PHOENIX-3451, PHOENIX-3452, PHOENIX-3469, PHOENIX-4560 | Fixing issues with ORDER BY ASC when query has aggregation |
| BUG-96389 | PHOENIX-4586 | UPSERT SELECT doesn't take in account comparison operators for subqueries. |
| BUG-96602 | HIVE-18660 | PCR doesn't distinguish between partition and virtual columns |
| BUG-97686 | ATLAS-2468 | [Basic Search] Issue with OR cases when NEQ is used with numeric types |
| BUG-97708 | HIVE-18817 | ArrayIndexOutOfBounds exception during read of ACID table. |
| BUG-97864 | HIVE-18833 | Auto Merge fails when "insert into directory as orcfile" |
| BUG-97889 | RANGER-2008 | Policy evaluation is failing for multiline policy conditions. |
| BUG-98655 | RANGER-2066 | Hbase column family access is authorized by a tagged column in the column family |
| BUG-99883 | HIVE-19073, HIVE-19145 | StatsOptimizer may mangle constant columns |
Other
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-100267 | HBASE-17170 | HBase is also retrying DoNotRetryIOException because of class loader differences. |
| BUG-92367 | YARN-7558 | "yarn logs" command fails to get logs for running containers if UI authentication is enabled. |
| BUG-93159 | OOZIE-3139 | Oozie validates workflow incorrectly |
| BUG-93936 | ATLAS-2289 | Embedded kafka/zookeeper server start/stop code to be moved out of KafkaNotification implementation |
| BUG-93942 | ATLAS-2312 | Use ThreadLocal DateFormat objects to avoid simultaneous use from multiple threads |
| BUG-93946 | ATLAS-2319 | UI : Deleting a tag which at 25+ position in the tag list in both Flat and Tree structure needs a refresh to remove the tag from the list. |
| BUG-94618 | YARN-5037, YARN-7274 | Ability to disable elasticity at leaf queue level |
| BUG-94901 | HBASE-19285 | Add per-table latency histograms |
| BUG-95259 | HADOOP-15185, HADOOP-15186 | Update adls connector to use the current version of ADLS SDK |
| BUG-95619 | HIVE-18551 | Vectorization: VectorMapOperator tries to write too many vector columns for Hybrid Grace |
| BUG-97223 | SPARK-23434 | Spark should not warn `metadata directory` for a HDFS file path |
| BUG-98299 | RegionServer fails to shut down when abort triggered during RPC call |
Performance
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-83282 | HBASE-13376, HBASE-14473, HBASE-15210, HBASE-15515, HBASE-16570, HBASE-16810, HBASE-18164 | Fast locality computation in balancer |
| BUG-91300 | HBASE-17387 | Reduce the overhead of exception report in RegionActionResult for multi() |
| BUG-91804 | TEZ-1526 | LoadingCache for TezTaskID slow for large jobs |
| BUG-92760 | ACCUMULO-4578 | Cancel compaction FATE operation does not release namespace lock |
| BUG-93577 | RANGER-1938 | Solr for Audit setup doesn't use DocValues effectively |
| BUG-93910 | HIVE-18293 | Hive is failing to compact tables contained within a folder that is not owned by identity running HiveMetaStore |
| BUG-94345 | HIVE-18429 | Compaction should handle a case when it produces no output |
| BUG-94381 | HADOOP-13227, HDFS-13054 | Handling RequestHedgingProxyProvider RetryAction order: FAIL < RETRY < FAILOVER_AND_RETRY. |
| BUG-94432 | HIVE-18353 | CompactorMR should call jobclient.close() to trigger cleanup |
| BUG-94869 | PHOENIX-4290, PHOENIX-4373 | Requested row out of range for Get on HRegion for local indexed salted phoenix table. |
| BUG-94928 | HDFS-11078 | Fix NPE in LazyPersistFileScrubber |
| BUG-94964 | HIVE-18269, HIVE-18318, HIVE-18326 | Multiple LLAP fixes |
| BUG-95669 | HIVE-18577, HIVE-18643 | When run update/delete query on ACID partitioned table, HS2 read all each partitions. |
| BUG-96390 | HDFS-10453 | ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster. |
| BUG-96625 | HIVE-16110 | Revert of "Vectorization: Support 2 Value CASE WHEN instead of fall back to VectorUDFAdaptor" |
| BUG-97109 | HIVE-16757 | Use of deprecated getRows() instead of new estimateRowCount(RelMetadataQuery..) has serious performance impact |
| BUG-97110 | PHOENIX-3789 | Execute cross region index maintenance calls in postBatchMutateIndispensably |
| BUG-98833 | YARN-6797 | TimelineWriter does not fully consume the POST response |
| BUG-98931 | ATLAS-2491 | Update Hive hook to use Atlas v2 notifications |
Potential Data Loss
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-95613 | HBASE-18808 | Ineffective config check in BackupLogCleaner#getDeletableFiles() |
| BUG-97051 | HIVE-17403 | Fail concatenation for unmanaged and transactional tables |
| BUG-97787 | HIVE-18460 | Compactor doesn't pass Table properties to the Orc writer |
| BUG-97788 | HIVE-18613 | Extend JsonSerDe to support BINARY type |
Query Failure
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-100180 | CALCITE-2232 | Assertion error on AggregatePullUpConstantsRule while adjusting Aggregate indices |
| BUG-100422 | HIVE-19085 | FastHiveDecimal abs(0) sets sign to +ve |
| BUG-100834 | PHOENIX-4658 | IllegalStateException: requestSeek cannot be called on ReversedKeyValueHeap |
| BUG-102078 | HIVE-17978 | TPCDS queries 58 and 83 generate exceptions in vectorization. |
| BUG-92483 | HIVE-17900 | analyze stats on columns triggered by Compactor generates malformed SQL with > 1 partition column |
| BUG-93135 | HIVE-15874, HIVE-18189 | Hive query returning wrong results when set hive.groupby.orderby.position.alias to true |
| BUG-93136 | HIVE-18189 | Order by position does not work when cbo is disabled |
| BUG-93595 | HIVE-12378, HIVE-15883 | HBase mapped table in Hive insert fail for decimal and binary columns |
| BUG-94007 | PHOENIX-1751, PHOENIX-3112 | Phoenix Queries returns Null values due to HBase Partial rows |
| BUG-94144 | HIVE-17063 | insert overwrite partition onto a external table fail when drop partition first |
| BUG-94280 | HIVE-12785 | View with union type and UDF to `cast` the struct is broken |
| BUG-94505 | PHOENIX-4525 | Integer overflow in GroupBy execution |
| BUG-95618 | HIVE-18506 | LlapBaseInputFormat - negative array index |
| BUG-95644 | HIVE-9152 | CombineHiveInputFormat: Hive query is failing in Tez with java.lang.IllegalArgumentException exception |
| BUG-96762 | PHOENIX-4588 | Clone expression also if it's children have Determinism.PER_INVOCATION |
| BUG-97145 | HIVE-12245, HIVE-17829 | Support column comments for an HBase backed table |
| BUG-97741 | HIVE-18944 | Groupping sets position is set incorrectly during DPP |
| BUG-98082 | HIVE-18597 | LLAP: Always package the log4j2 API jar for org.apache.log4j |
| BUG-99849 | N/A | Create a new table from a file wizard tries to use default database |
Security
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-100436 | RANGER-2060 | Knox proxy with knox-sso is not working for ranger |
| BUG-101038 | SPARK-24062 | Zeppelin %Spark interpreter "Connection refused" error, "A secret key must be specified..." error in HiveThriftServer |
| BUG-101359 | ACCUMULO-4056 | Update version of commons-collection to 3.2.2 when released |
| BUG-54240 | HIVE-18879 | Disallow embedded element in UDFXPathUtil needs to work if xercesImpl.jar in classpath |
| BUG-79059 | OOZIE-3109 | Escape log-streaming's HTML-specific characters |
| BUG-90041 | OOZIE-2723 | JSON.org license is now CatX |
| BUG-93754 | RANGER-1943 | Ranger Solr authorization is skipped when collection is empty or null |
| BUG-93804 | HIVE-17419 | ANALYZE TABLE...COMPUTE STATISTICS FOR COLUMNS command shows computed stats for masked tables |
| BUG-94276 | ZEPPELIN-3129 | Zeppelin UI does not log out in IE |
| BUG-95349 | ZOOKEEPER-1256, ZOOKEEPER-1901 | Upgrade netty |
| BUG-95483 | N/A | Fix for CVE-2017-15713 |
| BUG-95646 | OOZIE-3167 | Upgrade tomcat version on Oozie 4.3 branch |
| BUG-95823 | N/A | Knox: Upgrade Beanutils |
| BUG-95908 | RANGER-1960 | HBase auth does not take table namespace into consideration for deleting snapshot |
| BUG-96191 | FALCON-2322, FALCON-2323 | Upgrade Jackson and Spring versions to avoid security vulnerabilities |
| BUG-96502 | RANGER-1990 | Add One-way SSL MySQL support in Ranger Admin |
| BUG-96712 | FLUME-3194 | upgrade derby to the latest (1.14.1.0) version |
| BUG-96713 | FLUME-2678 | Upgrade xalan to 2.7.2 to take care of CVE-2014-0107 vulnerability |
| BUG-96714 | FLUME-2050 | Upgrade to log4j2 (when GA) |
| BUG-96737 | N/A | Use java io filesystem methods to access local files |
| BUG-96925 | N/A | Upgrade Tomcat from 6.0.48 to 6.0.53 in Hadoop |
| BUG-96977 | FLUME-3132 | Upgrade tomcat jasper library dependencies |
| BUG-97022 | HADOOP-14799, HADOOP-14903, HADOOP-15265 | Upgrading Nimbus-JOSE-JWT library with version above 4.39 |
| BUG-97101 | RANGER-1988 | Fix insecure randomness |
| BUG-97178 | ATLAS-2467 | Dependency upgrade for Spring and nimbus-jose-jwt |
| BUG-97180 | N/A | Upgrade Nimbus-jose-jwt |
| BUG-98038 | HIVE-18788 | Clean up inputs in JDBC PreparedStatement |
| BUG-98353 | HADOOP-13707 | Revert of "If kerberos is enabled while HTTP SPNEGO is not configured, some links cannot be accessed" |
| BUG-98372 | HBASE-13848 | Access InfoServer SSL passwords through Credential Provder API |
| BUG-98385 | ATLAS-2500 | Add additional headers to Atlas response. |
| BUG-98564 | HADOOP-14651 | Update okhttp version to 2.7.5 |
| BUG-99440 | RANGER-2045 | Hive table columns with no explicit allow policy are listed with 'desc table' command |
| BUG-99803 | N/A | Oozie should disable HBase dynamic class loading |
Stability
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-100040 | ATLAS-2536 | NPE in Atlas Hive Hook |
| BUG-100057 | HIVE-19251 | ObjectStore.getNextNotification with LIMIT should use less memory |
| BUG-100072 | HIVE-19130 | NPE is thrown when REPL LOAD applied drop partition event. |
| BUG-100073 | N/A | too many close_wait connection from hiveserver to data node |
| BUG-100319 | HIVE-19248 | REPL LOAD doesn't throw error if file copy fails. |
| BUG-100352 | N/A | CLONE - RM purging logic scans /registry znode too frequently |
| BUG-100427 | HIVE-19249 | Replication: WITH clause is not passing the configuration to Task correctly in all cases |
| BUG-100430 | HIVE-14483 | java.lang.ArrayIndexOutOfBoundsException org.apache.orc.impl.TreeReaderFactory$BytesColumnVectorUtil.commonReadByteArrays |
| BUG-100432 | HIVE-19219 | Incremental REPL DUMP should throw error if requested events are cleaned-up. |
| BUG-100448 | SPARK-23637, SPARK-23802, SPARK-23809, SPARK-23816, SPARK-23822, SPARK-23823, SPARK-23838, SPARK-23881 | Update Spark2 to 2.3.0+ (4/11) |
| BUG-100740 | HIVE-16107 | JDBC: HttpClient should retry one more time on NoHttpResponseException |
| BUG-100810 | HIVE-19054 | Hive Functions replication fails |
| BUG-100937 | MAPREDUCE-6889 | Add Job#close API to shutdown MR client services. |
| BUG-101065 | ATLAS-2587 | Set read ACL for /apache_atlas/active_server_info znode in HA for Knox proxy to read. |
| BUG-101093 | STORM-2993 | Storm HDFS bolt throws ClosedChannelException when Time rotation policy is used |
| BUG-101181 | N/A | PhoenixStorageHandler doesn't handle AND in predicate correctly |
| BUG-101266 | PHOENIX-4635 | HBase Connection leak in org.apache.phoenix.hive.mapreduce.PhoenixInputFormat |
| BUG-101458 | HIVE-11464 | lineage info missing if there are multiple outputs |
| BUG-101485 | N/A | hive metastore thrift api is slow and causing client timeout |
| BUG-101628 | HIVE-19331 | Hive incremental replication to cloud failed. |
| BUG-102048 | HIVE-19381 | Hive Function Replication to cloud fails with FunctionTask |
| BUG-102064 | N/A | Hive Replication [ onprem to onprem ] tests failed in ReplCopyTask |
| BUG-102137 | HIVE-19423 | Hive Replication [ Onprem to Cloud ] tests failed in ReplCopyTask |
| BUG-102305 | HIVE-19430 | HS2 and hive metastore OOM dumps |
| BUG-102361 | N/A | multiple insert results in single insert replicated to target hive cluster ( onprem - s3 ) |
| BUG-87624 | N/A | Enabling storm event logging causes workers to continuously die |
| BUG-88929 | HBASE-15615 | Wrong sleep time when RegionServerCallable need retry |
| BUG-89628 | HIVE-17613 | remove object pools for short, same-thread allocations |
| BUG-89813 | N/A | SCA : Code Correctness: Non-Synchronized Method Overrides Synchronized Method |
| BUG-90437 | ZEPPELIN-3072 | Zeppelin UI becomes slow/unresponsive if there are too many notebooks |
| BUG-90640 | HBASE-19065 | HRegion#bulkLoadHFiles() should wait for concurrent Region#flush() to finish |
| BUG-91202 | HIVE-17013 | Delete request with a subquery based on select over a view |
| BUG-91350 | KNOX-1108 | NiFiHaDispatch not failing over |
| BUG-92054 | HIVE-13120 | propagate doAs when generating ORC splits |
| BUG-92373 | FALCON-2314 | Bump TestNG version to 6.13.1 to avoid BeanShell dependency |
| BUG-92381 | N/A | testContainerLogsWithNewAPI and testContainerLogsWithOldAPI UT fails |
| BUG-92389 | STORM-2841 | testNoAcksIfFlushFails UT fails with NullPointerException |
| BUG-92586 | SPARK-17920, SPARK-20694, SPARK-21642, SPARK-22162, SPARK-22289, SPARK-22373, SPARK-22495, SPARK-22574, SPARK-22591, SPARK-22595, SPARK-22601, SPARK-22603, SPARK-22607, SPARK-22635, SPARK-22637, SPARK-22653, SPARK-22654, SPARK-22686, SPARK-22688, SPARK-22817, SPARK-22862, SPARK-22889, SPARK-22972, SPARK-22975, SPARK-22982, SPARK-22983, SPARK-22984, SPARK-23001, SPARK-23038, SPARK-23095 | Update Spark2 up-to-date to 2.2.1 (Jan. 16) |
| BUG-92680 | ATLAS-2288 | NoClassDefFoundError Exception while running import-hive script when hbase table is created via Hive |
| BUG-92760 | ACCUMULO-4578 | Cancel compaction FATE operation does not release namespace lock |
| BUG-92797 | HDFS-10267, HDFS-8496 | Reducing the datanode lock contentions on certain use cases |
| BUG-92813 | FLUME-2973 | Deadlock in hdfs sink |
| BUG-92957 | HIVE-11266 | count(*) wrong result based on table statistics for external tables |
| BUG-93018 | ATLAS-2310 | In HA, the passive node redirects the request with wrong URL encoding |
| BUG-93116 | RANGER-1957 | Ranger Usersync is not syncing users or groups periodically when incremental sync is enabled. |
| BUG-93361 | HIVE-12360 | Bad seek in uncompressed ORC with predicate pushdown |
| BUG-93426 | CALCITE-2086 | HTTP/413 in certain circumstances due to large Authorization headers |
| BUG-93429 | PHOENIX-3240 | ClassCastException from Pig loader |
| BUG-93485 | N/A | Cannot get table mytestorg.apache.hadoop.hive.ql.metadata.InvalidTableException: Table not found when running analyze table on columns in LLAP |
| BUG-93512 | PHOENIX-4466 | java.lang.RuntimeException: response code 500 - Executing a spark job to connect to phoenix query server and load data |
| BUG-93550 | N/A | Zeppelin %spark.r does not work with spark1 due to scala version mismatch |
| BUG-93910 | HIVE-18293 | Hive is failing to compact tables contained within a folder that is not owned by identity running HiveMetaStore |
| BUG-93926 | ZEPPELIN-3114 | Notebooks and interpreters are not getting saved in zeppelin after >1d stress testing |
| BUG-93932 | ATLAS-2320 | classification "*" with query throws 500 Internal server exception. |
| BUG-93948 | YARN-7697 | NM goes down with OOM due to leak in log-aggregation (part#1) |
| BUG-93965 | ATLAS-2229 | DSL search : orderby non-string attribute throws exception |
| BUG-93986 | YARN-7697 | NM goes down with OOM due to leak in log-aggregation (part#2) |
| BUG-94030 | ATLAS-2332 | Creation of type with attributes having nested collection datatype fails |
| BUG-94080 | YARN-3742, YARN-6061 | Both RM are in standby in secure cluster |
| BUG-94081 | HIVE-18384 | ConcurrentModificationException in log4j2.x library |
| BUG-94168 | N/A | Yarn RM goes down with Service Registry is in wrong state ERROR |
| BUG-94330 | HADOOP-13190, HADOOP-14104, HADOOP-14814, HDFS-10489, HDFS-11689 | HDFS should support for multiple KMS Uris |
| BUG-94345 | HIVE-18429 | Compaction should handle a case when it produces no output |
| BUG-94372 | ATLAS-2229 | DSL query : hive_table name = ["t1","t2"] throws invalid DSL query exception |
| BUG-94381 | HADOOP-13227, HDFS-13054 | Handling RequestHedgingProxyProvider RetryAction order: FAIL < RETRY < FAILOVER_AND_RETRY. |
| BUG-94432 | HIVE-18353 | CompactorMR should call jobclient.close() to trigger cleanup |
| BUG-94575 | SPARK-22587 | Spark job fails if fs.defaultFS and application jar are different url |
| BUG-94791 | SPARK-22793 | Memory leak in Spark Thrift Server |
| BUG-94928 | HDFS-11078 | Fix NPE in LazyPersistFileScrubber |
| BUG-95013 | HIVE-18488 | LLAP ORC readers are missing some null checks |
| BUG-95077 | HIVE-14205 | Hive doesn't support union type with AVRO file format |
| BUG-95200 | HDFS-13061 | SaslDataTransferClient#checkTrustAndSend should not trust a partially trusted channel |
| BUG-95201 | HDFS-13060 | Adding a BlacklistBasedTrustedChannelResolver for TrustedChannelResolver |
| BUG-95284 | HBASE-19395 | [branch-1] TestEndToEndSplitTransaction.testMasterOpsWhileSplitting fails with NPE |
| BUG-95301 | HIVE-18517 | Vectorization: Fix VectorMapOperator to accept VRBs and check vectorized flag correctly to support LLAP Caching |
| BUG-95542 | HBASE-16135 | PeerClusterZnode under rs of removed peer may never be deleted |
| BUG-95595 | HIVE-15563 | Ignore Illegal Operation state transition exception in SQLOperation.runQuery to expose real exception. |
| BUG-95596 | YARN-4126, YARN-5750 | TestClientRMService fails |
| BUG-96019 | HIVE-18548 | Fix log4j import |
| BUG-96196 | HDFS-13120 | Snapshot diff could be corrupted after concat |
| BUG-96289 | HDFS-11701 | NPE from Unresolved Host causes permanent DFSInputStream failures |
| BUG-96291 | STORM-2652 | Exception thrown in JmsSpout open method |
| BUG-96363 | HIVE-18959 | Avoid creating extra pool of threads within LLAP |
| BUG-96390 | HDFS-10453 | ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster. |
| BUG-96454 | YARN-4593 | Deadlock in AbstractService.getConfig() |
| BUG-96704 | FALCON-2322 | ClassCastException while submitAndSchedule feed |
| BUG-96720 | SLIDER-1262 | Slider functests are failing in Kerberized environment |
| BUG-96931 | SPARK-23053, SPARK-23186, SPARK-23230, SPARK-23358, SPARK-23376, SPARK-23391 | Update Spark2 up-to-date (Feb. 19) |
| BUG-97067 | HIVE-10697 | ObjectInspectorConvertors#UnionConvertor does a faulty conversion |
| BUG-97244 | KNOX-1083 | HttpClient default timeout should be a sensible value |
| BUG-97459 | ZEPPELIN-3271 | Option for disabling scheduler |
| BUG-97511 | KNOX-1197 | AnonymousAuthFilter is not added when authentication=Anonymous in service |
| BUG-97601 | HIVE-17479 | Staging directories do not get cleaned up for update/delete queries |
| BUG-97605 | HIVE-18858 | System properties in job configuration not resolved when submitting MR job |
| BUG-97674 | OOZIE-3186 | Oozie is unable to use configuration linked using jceks://file/... |
| BUG-97743 | N/A | java.lang.NoClassDefFoundError exception while deploying storm topology |
| BUG-97756 | PHOENIX-4576 | Fix LocalIndexSplitMergeIT tests failing in master branch |
| BUG-97771 | HDFS-11711 | DN should not delete the block On "Too many open files" Exception |
| BUG-97869 | KNOX-1190 | Knox SSO support for Google OIDC is broken. |
| BUG-97879 | PHOENIX-4489 | HBase Connection leak in Phoenix MR Jobs |
| BUG-98392 | RANGER-2007 | ranger-tagsync's Kerberos ticket fails to renew |
| BUG-98484 | N/A | Hive Incremental Replication to Cloud not working |
| BUG-98533 | HBASE-19934, HBASE-20008 | Hbase snapshot restore is failing due to Null pointer exception |
| BUG-98555 | PHOENIX-4662 | NullPointerException in TableResultIterator.java on cache resend |
| BUG-98579 | HBASE-13716 | Stop using Hadoop's FSConstants |
| BUG-98705 | KNOX-1230 | Many Concurrent Requests to Knox causes URL Mangling |
| BUG-98983 | KNOX-1108 | NiFiHaDispatch not failing over |
| BUG-99107 | HIVE-19054 | Function replication shall use "hive.repl.replica.functions.root.dir" as root |
| BUG-99145 | RANGER-2035 | Errors accessing servicedefs with empty implClass with Oracle backend |
| BUG-99160 | SLIDER-1259 | Slider does not work in multi homed environments |
| BUG-99239 | ATLAS-2462 | Sqoop import for all tables throws NPE for no table provided in command |
| BUG-99301 | ATLAS-2530 | Newline at the beginning of the name attribute of a hive_process and hive_column_lineage |
| BUG-99453 | HIVE-19065 | Metastore client compatibility check should include syncMetaStoreClient |
| BUG-99521 | N/A | ServerCache for HashJoin is not re-created when iterators are re-instantiated |
| BUG-99590 | PHOENIX-3518 | Memory Leak in RenewLeaseTask |
| BUG-99618 | SPARK-23599, SPARK-23806 | Update Spark2 to 2.3.0+ (3/28) |
| BUG-99672 | ATLAS-2524 | Hive hook with V2 notifications - incorrect handling of 'alter view as' operation |
| BUG-99809 | HBASE-20375 | Remove use of getCurrentUserCredentials in hbase-spark module |
Supportability
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-87343 | HIVE-18031 | Support replication for Alter Database operation. |
| BUG-91293 | RANGER-2060 | Knox proxy with knox-sso is not working for ranger |
| BUG-93116 | RANGER-1957 | Ranger Usersync is not syncing users or groups periodically when incremental sync is enabled. |
| BUG-93577 | RANGER-1938 | Solr for Audit setup doesn't use DocValues effectively |
| BUG-96082 | RANGER-1982 | Error Improvement for Analytics Metric of Ranger Admin and Ranger Kms |
| BUG-96479 | HDFS-12781 | After Datanode down, In Namenode UI Datanode tab is throwing warning message. |
| BUG-97864 | HIVE-18833 | Auto Merge fails when "insert into directory as orcfile" |
| BUG-98814 | HDFS-13314 | NameNode should optionally exit if it detects FsImage corruption |
Upgrade
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-100134 | SPARK-22919 | Revert of "Bump Apache httpclient versions" |
| BUG-95823 | N/A | Knox: Upgrade Beanutils |
| BUG-96751 | KNOX-1076 | Update nimbus-jose-jwt to 4.41.2 |
| BUG-97864 | HIVE-18833 | Auto Merge fails when "insert into directory as orcfile" |
| BUG-99056 | HADOOP-13556 | Change Configuration.getPropsWithPrefix to use getProps instead of iterator |
| BUG-99378 | ATLAS-2461, ATLAS-2554 | Migration utility to export Atlas data in Titan graph DB |
Usability
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-100045 | HIVE-19056 | IllegalArgumentException in FixAcidKeyIndex when ORC file has 0 rows |
| BUG-100139 | KNOX-1243 | Normalize the required DNs that are Configured in KnoxToken Service |
| BUG-100570 | ATLAS-2557 | Fix to allow to lookup hadoop ldap groups when are groups from UGI are wrongly set or are not empty |
| BUG-100646 | ATLAS-2102 | Atlas UI Improvements: Search results page |
| BUG-100737 | HIVE-19049 | Add support for Alter table add columns for Druid |
| BUG-100750 | KNOX-1246 | Update service config in Knox to support latest configurations for Ranger. |
| BUG-100965 | ATLAS-2581 | Regression with V2 Hive hook notifications : Moving table to a different database |
| BUG-84413 | ATLAS-1964 | UI : Support to order columns in Search table |
| BUG-90570 | HDFS-11384, HDFS-12347 | Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike |
| BUG-90584 | HBASE-19052 | FixedFileTrailer should recognize CellComparatorImpl class in branch-1.x |
| BUG-90979 | KNOX-1224 | Knox Proxy HADispatcher to support Atlas in HA. |
| BUG-91293 | RANGER-2060 | Knox proxy with knox-sso is not working for ranger |
| BUG-92236 | ATLAS-2281 | Saving Tag/Type attribute filter queries with null/not null filters. |
| BUG-92238 | ATLAS-2282 | Saved favorite search appears only on refresh after creation when there are 25+ favorite searches . |
| BUG-92333 | ATLAS-2286 | Pre-built type 'kafka_topic' should not declare 'topic' attribute as unique |
| BUG-92678 | ATLAS-2276 | Path value for hdfs_path type entity is set to lower case from hive-bridge. |
| BUG-93097 | RANGER-1944 | Action filter for Admin Audit is not working |
| BUG-93135 | HIVE-15874, HIVE-18189 | Hive query returning wrong results when set hive.groupby.orderby.position.alias to true |
| BUG-93136 | HIVE-18189 | Order by position does not work when cbo is disabled |
| BUG-93387 | HIVE-17600 | Make OrcFile's "enforceBufferSize" user-settable. |
| BUG-93495 | RANGER-1937 | Ranger tagsync should process ENTITY_CREATE notification, to support Atlas import feature |
| BUG-93512 | PHOENIX-4466 | java.lang.RuntimeException: response code 500 - Executing a spark job to connect to phoenix query server and load data |
| BUG-93801 | HBASE-19393 | HTTP 413 FULL head while accessing HBase UI using SSL. |
| BUG-93804 | HIVE-17419 | ANALYZE TABLE...COMPUTE STATISTICS FOR COLUMNS command shows computed stats for masked tables |
| BUG-93932 | ATLAS-2320 | classification "*" with query throws 500 Internal server exception. |
| BUG-93933 | ATLAS-2286 | Pre-built type 'kafka_topic' should not declare 'topic' attribute as unique |
| BUG-93938 | ATLAS-2283, ATLAS-2295 | UI updates for classifications |
| BUG-93941 | ATLAS-2296, ATLAS-2307 | Basic search enhancement to optionally exclude sub-type entities and sub-classification-types |
| BUG-93944 | ATLAS-2318 | UI : Clicking on child tag twice , parent tag is selected |
| BUG-93946 | ATLAS-2319 | UI : Deleting a tag which at 25+ position in the tag list in both Flat and Tree structure needs a refresh to remove the tag from the list. |
| BUG-93977 | HIVE-16232 | Support stats computation for column in QuotedIdentifier |
| BUG-94030 | ATLAS-2332 | Creation of type with attributes having nested collection datatype fails |
| BUG-94099 | ATLAS-2352 | Atlas server should provide configuration to specify validity for Kerberos DelegationToken |
| BUG-94280 | HIVE-12785 | View with union type and UDF to `cast` the struct is broken |
| BUG-94332 | SQOOP-2930 | Sqoop job exec not overriding the saved job generic properties |
| BUG-94428 | N/A | Dataplane Profiler Agent REST API Knox support |
| BUG-94514 | ATLAS-2339 | UI : Modifications in "columns" in Basic search result view affects DSL also. |
| BUG-94515 | ATLAS-2169 | Delete request fails when hard delete is configured |
| BUG-94518 | ATLAS-2329 | Atlas UI Multiple Hovers appears if user click on another tag which is incorrect |
| BUG-94519 | ATLAS-2272 | Save the state of dragged columns using save search API. |
| BUG-94627 | HIVE-17731 | add a backward compat option for external users to HIVE-11985 |
| BUG-94786 | HIVE-6091 | Empty pipeout files are created for connection create/close |
| BUG-94793 | HIVE-14013 | Describe table doesn't show unicode properly |
| BUG-94900 | OOZIE-2606, OOZIE-2658, OOZIE-2787, OOZIE-2802 | Set spark.yarn.jars to fix Spark 2.0 with Oozie |
| BUG-94901 | HBASE-19285 | Add per-table latency histograms |
| BUG-94908 | ATLAS-1921 | UI : Search using entity and trait attributes : UI doesn't perform range check and allows providing out of bounds values for integral and float data types. |
| BUG-95086 | RANGER-1953 | improvement on user-group page listing |
| BUG-95193 | SLIDER-1252 | Slider agent fails with SSL validation errors with python 2.7.5-58 |
| BUG-95314 | YARN-7699 | queueUsagePercentage is coming as INF for getApp REST api call |
| BUG-95315 | HBASE-13947, HBASE-14517, HBASE-17931 | Assign system tables to servers with highest version |
| BUG-95392 | ATLAS-2421 | Notification updates to support V2 data structures |
| BUG-95476 | RANGER-1966 | Policy engine initialization does not create context enrichers in some cases |
| BUG-95512 | HIVE-18467 | support whole warehouse dump / load + create/drop database events |
| BUG-95593 | N/A | Extend Oozie DB utils to support Spark2 sharelib creation |
| BUG-95595 | HIVE-15563 | Ignore Illegal Operation state transition exception in SQLOperation.runQuery to expose real exception. |
| BUG-95685 | ATLAS-2422 | Export: Support type-based Export |
| BUG-95798 | PHOENIX-2714, PHOENIX-2724, PHOENIX-3023, PHOENIX-3040 | Don't use guideposts for executing queries serially |
| BUG-95969 | HIVE-16828, HIVE-17063, HIVE-18390 | Partitioned view fails with FAILED: IndexOutOfBoundsException Index: 1, Size: 1 |
| BUG-96019 | HIVE-18548 | Fix log4j import |
| BUG-96288 | HBASE-14123, HBASE-14135, HBASE-17850 | Backport Hbase Backup/Restore 2.0 |
| BUG-96313 | KNOX-1119 | Pac4J OAuth/OpenID Principal Needs to be Configurable |
| BUG-96365 | ATLAS-2442 | User with read-only permission on entity resource not able perform basic search |
| BUG-96479 | HDFS-12781 | After Datanode down, In Namenode UI Datanode tab is throwing warning message. |
| BUG-96502 | RANGER-1990 | Add One-way SSL MySQL support in Ranger Admin |
| BUG-96718 | ATLAS-2439 | Update Sqoop hook to use V2 notifications |
| BUG-96748 | HIVE-18587 | insert DML event may attempt to calculate a checksum on directories |
| BUG-96821 | HBASE-18212 | In Standalone mode with local filesystem HBase logs Warning message:Failed to invoke 'unbuffer' method in class class org.apache.hadoop.fs.FSDataInputStream |
| BUG-96847 | HIVE-18754 | REPL STATUS should support 'with' clause |
| BUG-96873 | ATLAS-2443 | Capture required entity attributes in outgoing DELETE messages |
| BUG-96880 | SPARK-23230 | When hive.default.fileformat is other kinds of file types, create textfile table cause a serde error |
| BUG-96911 | OOZIE-2571, OOZIE-2792, OOZIE-2799, OOZIE-2923 | Improve Spark options parsing |
| BUG-97100 | RANGER-1984 | Hbase audit log records may not show all tags associated with accessed column |
| BUG-97110 | PHOENIX-3789 | Execute cross region index maintenance calls in postBatchMutateIndispensably |
| BUG-97145 | HIVE-12245, HIVE-17829 | Support column comments for an HBase backed table |
| BUG-97409 | HADOOP-15255 | Upper/Lower case conversion support for group names in LdapGroupsMapping |
| BUG-97535 | HIVE-18710 | extend inheritPerms to ACID in Hive 2.X |
| BUG-97742 | OOZIE-1624 | Exclusion pattern for sharelib JARs |
| BUG-97744 | PHOENIX-3994 | Index RPC priority still depends on the controller factory property in hbase-site.xml |
| BUG-97787 | HIVE-18460 | Compactor doesn't pass Table properties to the Orc writer |
| BUG-97788 | HIVE-18613 | Extend JsonSerDe to support BINARY type |
| BUG-97899 | HIVE-18808 | Make compaction more robust when stats update fails |
| BUG-98038 | HIVE-18788 | Clean up inputs in JDBC PreparedStatement |
| BUG-98383 | HIVE-18907 | Create utility to fix acid key index issue from HIVE-18817 |
| BUG-98388 | RANGER-1828 | Good coding practice-add additional headers in ranger |
| BUG-98392 | RANGER-2007 | ranger-tagsync's Kerberos ticket fails to renew |
| BUG-98533 | HBASE-19934, HBASE-20008 | Hbase snapshot restore is failing due to Null pointer exception |
| BUG-98552 | HBASE-18083, HBASE-18084 | Make large/small file clean thread number configurable in HFileCleaner |
| BUG-98705 | KNOX-1230 | Many Concurrent Requests to Knox causes URL Mangling |
| BUG-98711 | N/A | NiFi dispatch can't use two-way SSL without service.xml modifications |
| BUG-98880 | OOZIE-3199 | Let system property restriction configurable |
| BUG-98931 | ATLAS-2491 | Update Hive hook to use Atlas v2 notifications |
| BUG-98983 | KNOX-1108 | NiFiHaDispatch not failing over |
| BUG-99088 | ATLAS-2511 | Provide options to selectively import database / tables from Hive into Atlas |
| BUG-99154 | OOZIE-2844, OOZIE-2845, OOZIE-2858, OOZIE-2885 | Spark query failed with "java.io.FileNotFoundException: hive-site.xml (Permission denied)" exception |
| BUG-99239 | ATLAS-2462 | Sqoop import for all tables throws NPE for no table provided in command |
| BUG-99636 | KNOX-1238 | Fix Custom Truststore Settings for Gateway |
| BUG-99650 | KNOX-1223 | Zeppelin's Knox proxy doesn't redirect /api/ticket as expected |
| BUG-99804 | OOZIE-2858 | HiveMain, ShellMain and SparkMain should not overwrite properties and config files locally |
| BUG-99805 | OOZIE-2885 | Running Spark actions should not need Hive on the classpath |
| BUG-99806 | OOZIE-2845 | Replace reflection-based code which sets variable in HiveConf |
| BUG-99807 | OOZIE-2844 | Increase stability of Oozie actions when log4j.properties is missing or not readable |
| RMP-9995 | AMBARI-22222 | Switch druid to use /var/druid directory instead of /apps/druid on local disk |