Hortonworks Data Platform for HDInsight
Also available as:
PDF

Fixed Issues

Fixed issues represents selected issues that were previously logged via Hortonworks Support, but are now addressed in the current release. These issues may have been reported in previous versions within the Known Issues section; meaning they were reported by customers or identified by Cloudera Quality Engineering team.

Incorrect Results

Hortonworks Bug ID Apache JIRA Summary
BUG-100019 YARN-8145 yarn rmadmin -getGroups doesn't return updated groups for user
BUG-100058 PHOENIX-2645 Wildcard characters do not match newline characters
BUG-100266 PHOENIX-3521, PHOENIX-4190 Results wrong with local indexes
BUG-88774 HIVE-17617, HIVE-18413, HIVE-18523 query36 failing, row count mismatch
BUG-89765 HIVE-17702 incorrect isRepeating handling in decimal reader in ORC
BUG-92293 HADOOP-15042 Azure PageBlobInputStream.skip() can return negative value when numberOfPagesRemaining is 0
BUG-92345 ATLAS-2285 UI : Renamed saved search with date attribute.
BUG-92563 HIVE-17495, HIVE-18528 Aggregate stats in ObjectStore get wrong result
BUG-92957 HIVE-11266 count(*) wrong result based on table statistics for external tables
BUG-93097 RANGER-1944 Action filter for Admin Audit is not working
BUG-93335 HIVE-12315 vectorization_short_regress.q has a wrong result issue for a double calculation
BUG-93415 HIVE-18258, HIVE-18310 Vectorization: Reduce-Side GROUP BY MERGEPARTIAL with duplicate columns is broken
BUG-93939 ATLAS-2294 Extra parameter "description" added when creating a type
BUG-94007 PHOENIX-1751, PHOENIX-3112 Phoenix Queries returns Null values due to HBase Partial rows
BUG-94266 HIVE-12505 Insert overwrite in same encrypted zone silently fails to remove some existing files
BUG-94414 HIVE-15680 Incorrect results when hive.optimize.index.filter=true and same ORC table is referenced twice in query
BUG-95048 HIVE-18490 Query with EXISTS and NOT EXISTS with non-equi predicate can produce wrong result
BUG-95053 PHOENIX-3865 IS NULL does not return correct results when first column family not filtered against
BUG-95476 RANGER-1966 Policy engine initialization does not create context enrichers in some cases
BUG-95566 SPARK-23281 Query produces results in incorrect order when a composite order by clause refers to both original columns and aliases
BUG-95907 PHOENIX-3451, PHOENIX-3452, PHOENIX-3469, PHOENIX-4560 Fixing issues with ORDER BY ASC when query has aggregation
BUG-96389 PHOENIX-4586 UPSERT SELECT doesn't take in account comparison operators for subqueries.
BUG-96602 HIVE-18660 PCR doesn't distinguish between partition and virtual columns
BUG-97686 ATLAS-2468 [Basic Search] Issue with OR cases when NEQ is used with numeric types
BUG-97708 HIVE-18817 ArrayIndexOutOfBounds exception during read of ACID table.
BUG-97864 HIVE-18833 Auto Merge fails when "insert into directory as orcfile"
BUG-97889 RANGER-2008 Policy evaluation is failing for multiline policy conditions.
BUG-98655 RANGER-2066 Hbase column family access is authorized by a tagged column in the column family
BUG-99883 HIVE-19073, HIVE-19145 StatsOptimizer may mangle constant columns

Other

Hortonworks Bug ID Apache JIRA Summary
BUG-100267 HBASE-17170 HBase is also retrying DoNotRetryIOException because of class loader differences.
BUG-92367 YARN-7558 "yarn logs" command fails to get logs for running containers if UI authentication is enabled.
BUG-93159 OOZIE-3139 Oozie validates workflow incorrectly
BUG-93936 ATLAS-2289 Embedded kafka/zookeeper server start/stop code to be moved out of KafkaNotification implementation
BUG-93942 ATLAS-2312 Use ThreadLocal DateFormat objects to avoid simultaneous use from multiple threads
BUG-93946 ATLAS-2319 UI : Deleting a tag which at 25+ position in the tag list in both Flat and Tree structure needs a refresh to remove the tag from the list.
BUG-94618 YARN-5037, YARN-7274 Ability to disable elasticity at leaf queue level
BUG-94901 HBASE-19285 Add per-table latency histograms
BUG-95259 HADOOP-15185, HADOOP-15186 Update adls connector to use the current version of ADLS SDK
BUG-95619 HIVE-18551 Vectorization: VectorMapOperator tries to write too many vector columns for Hybrid Grace
BUG-97223 SPARK-23434 Spark should not warn `metadata directory` for a HDFS file path

Performance

Hortonworks Bug ID Apache JIRA Summary
BUG-83282 HBASE-13376, HBASE-14473, HBASE-15210, HBASE-15515, HBASE-16570, HBASE-16810, HBASE-18164 Fast locality computation in balancer
BUG-91300 HBASE-17387 Reduce the overhead of exception report in RegionActionResult for multi()
BUG-91804 TEZ-1526 LoadingCache for TezTaskID slow for large jobs
BUG-92760 ACCUMULO-4578 Cancel compaction FATE operation does not release namespace lock
BUG-93577 RANGER-1938 Solr for Audit setup doesn't use DocValues effectively
BUG-93910 HIVE-18293 Hive is failing to compact tables contained within a folder that is not owned by identity running HiveMetaStore
BUG-94345 HIVE-18429 Compaction should handle a case when it produces no output
BUG-94381 HADOOP-13227, HDFS-13054 Handling RequestHedgingProxyProvider RetryAction order: FAIL < RETRY < FAILOVER_AND_RETRY.
BUG-94432 HIVE-18353 CompactorMR should call jobclient.close() to trigger cleanup
BUG-94869 PHOENIX-4290, PHOENIX-4373 Requested row out of range for Get on HRegion for local indexed salted phoenix table.
BUG-94928 HDFS-11078 Fix NPE in LazyPersistFileScrubber
BUG-94964 HIVE-18269, HIVE-18318, HIVE-18326 Multiple LLAP fixes
BUG-95669 HIVE-18577, HIVE-18643 When run update/delete query on ACID partitioned table, HS2 read all each partitions.
BUG-96390 HDFS-10453 ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.
BUG-96625 HIVE-16110 Revert of "Vectorization: Support 2 Value CASE WHEN instead of fall back to VectorUDFAdaptor"
BUG-97109 HIVE-16757 Use of deprecated getRows() instead of new estimateRowCount(RelMetadataQuery..) has serious performance impact
BUG-97110 PHOENIX-3789 Execute cross region index maintenance calls in postBatchMutateIndispensably
BUG-98833 YARN-6797 TimelineWriter does not fully consume the POST response
BUG-98931 ATLAS-2491 Update Hive hook to use Atlas v2 notifications

Potential Data Loss

Hortonworks Bug ID Apache JIRA Summary
BUG-95613 HBASE-18808 Ineffective config check in BackupLogCleaner#getDeletableFiles()
BUG-97051 HIVE-17403 Fail concatenation for unmanaged and transactional tables
BUG-97787 HIVE-18460 Compactor doesn't pass Table properties to the Orc writer
BUG-97788 HIVE-18613 Extend JsonSerDe to support BINARY typeQuery Failure
Hortonworks Bug ID Apache JIRA Summary
BUG-100180 CALCITE-2232 Assertion error on AggregatePullUpConstantsRule while adjusting Aggregate indices
BUG-100422 HIVE-19085 FastHiveDecimal abs(0) sets sign to +ve
BUG-100834 PHOENIX-4658 IllegalStateException: requestSeek cannot be called on ReversedKeyValueHeap
BUG-102078 HIVE-17978 TPCDS queries 58 and 83 generate exceptions in vectorization.
BUG-92483 HIVE-17900 analyze stats on columns triggered by Compactor generates malformed SQL with > 1 partition column
BUG-93135 HIVE-15874, HIVE-18189 Hive query returning wrong results when set hive.groupby.orderby.position.alias to true
BUG-93136 HIVE-18189 Order by position does not work when cbo is disabled
BUG-93595 HIVE-12378, HIVE-15883 HBase mapped table in Hive insert fail for decimal and binary columns
BUG-94007 PHOENIX-1751, PHOENIX-3112 Phoenix Queries returns Null values due to HBase Partial rows
BUG-94144 HIVE-17063 insert overwrite partition onto a external table fail when drop partition first
BUG-94280 HIVE-12785 View with union type and UDF to `cast` the struct is broken
BUG-94505 PHOENIX-4525 Integer overflow in GroupBy execution
BUG-95618 HIVE-18506 LlapBaseInputFormat - negative array index
BUG-95644 HIVE-9152 CombineHiveInputFormat: Hive query is failing in Tez with java.lang.IllegalArgumentException exception
BUG-96762 PHOENIX-4588 Clone expression also if it's children have Determinism.PER_INVOCATION
BUG-97145 HIVE-12245, HIVE-17829 Support column comments for an HBase backed table
BUG-97741 HIVE-18944 Groupping sets position is set incorrectly during DPP
BUG-98082 HIVE-18597 LLAP: Always package the log4j2 API jar for org.apache.log4j
BUG-99849 N/A Create a new table from a file wizard tries to use default database

Security

Hortonworks Bug ID Apache JIRA Summary
BUG-100436 RANGER-2060 Knox proxy with knox-sso is not working for ranger
BUG-101038 SPARK-24062 Zeppelin %Spark interpreter "Connection refused" error, "A secret key must be specified..." error in HiveThriftServer
BUG-101359 ACCUMULO-4056 Update version of commons-collection to 3.2.2 when released
BUG-54240 HIVE-18879 Disallow embedded element in UDFXPathUtil needs to work if xercesImpl.jar in classpath
BUG-79059 OOZIE-3109 Escape log-streaming's HTML-specific characters
BUG-90041 OOZIE-2723 JSON.org license is now CatX
BUG-93754 RANGER-1943 Ranger Solr authorization is skipped when collection is empty or null
BUG-93804 HIVE-17419 ANALYZE TABLE...COMPUTE STATISTICS FOR COLUMNS command shows computed stats for masked tables
BUG-94276 ZEPPELIN-3129 Zeppelin UI does not log out in IE
BUG-95349 ZOOKEEPER-1256, ZOOKEEPER-1901 Upgrade netty
BUG-95483 N/A Fix for CVE-2017-15713
BUG-95646 OOZIE-3167 Upgrade tomcat version on Oozie 4.3 branch
BUG-95823 N/A Knox: Upgrade Beanutils
BUG-95908 RANGER-1960 HBase auth does not take table namespace into consideration for deleting snapshot
BUG-96191 FALCON-2322, FALCON-2323 Upgrade Jackson and Spring versions to avoid security vulnerabilities
BUG-96502 RANGER-1990 Add One-way SSL MySQL support in Ranger Admin
BUG-96712 FLUME-3194 upgrade derby to the latest (1.14.1.0) version
BUG-96713 FLUME-2678 Upgrade xalan to 2.7.2 to take care of CVE-2014-0107 vulnerability
BUG-96714 FLUME-2050 Upgrade to log4j2 (when GA)
BUG-96737 N/A Use java io filesystem methods to access local files
BUG-96925 N/A Upgrade Tomcat from 6.0.48 to 6.0.53 in Hadoop
BUG-96977 FLUME-3132 Upgrade tomcat jasper library dependencies
BUG-97022 HADOOP-14799, HADOOP-14903, HADOOP-15265 Upgrading Nimbus-JOSE-JWT library with version above 4.39
BUG-97101 RANGER-1988 Fix insecure randomness
BUG-97178 ATLAS-2467 Dependency upgrade for Spring and nimbus-jose-jwt
BUG-97180 N/A Upgrade Nimbus-jose-jwt
BUG-98038 HIVE-18788 Clean up inputs in JDBC PreparedStatement
BUG-98353 HADOOP-13707 Revert of "If kerberos is enabled while HTTP SPNEGO is not configured, some links cannot be accessed"
BUG-98372 HBASE-13848 Access InfoServer SSL passwords through Credential Provder API
BUG-98385 ATLAS-2500 Add additional headers to Atlas response.
BUG-98564 HADOOP-14651 Update okhttp version to 2.7.5
BUG-99440 RANGER-2045 Hive table columns with no explicit allow policy are listed with 'desc table' command
BUG-99803 N/A Oozie should disable HBase dynamic class loading

Stability

Hortonworks Bug ID Apache JIRA Summary
BUG-100040 ATLAS-2536 NPE in Atlas Hive Hook
BUG-100057 HIVE-19251 ObjectStore.getNextNotification with LIMIT should use less memory
BUG-100072 HIVE-19130 NPE is thrown when REPL LOAD applied drop partition event.
BUG-100073 N/A too many close_wait connection from hiveserver to data node
BUG-100319 HIVE-19248 REPL LOAD doesn't throw error if file copy fails.
BUG-100352 N/A CLONE - RM purging logic scans /registry znode too frequently
BUG-100427 HIVE-19249 Replication: WITH clause is not passing the configuration to Task correctly in all cases
BUG-100430 HIVE-14483 java.lang.ArrayIndexOutOfBoundsException org.apache.orc.impl.TreeReaderFactory$BytesColumnVectorUtil.commonReadByteArrays
BUG-100432 HIVE-19219 Incremental REPL DUMP should throw error if requested events are cleaned-up.
BUG-100448 SPARK-23637, SPARK-23802, SPARK-23809, SPARK-23816, SPARK-23822, SPARK-23823, SPARK-23838, SPARK-23881 Update Spark2 to 2.3.0+ (4/11)
BUG-100740 HIVE-16107 JDBC: HttpClient should retry one more time on NoHttpResponseException
BUG-100810 HIVE-19054 Hive Functions replication fails
BUG-100937 MAPREDUCE-6889 Add Job#close API to shutdown MR client services.
BUG-101065 ATLAS-2587 Set read ACL for /apache_atlas/active_server_info znode in HA for Knox proxy to read.
BUG-101093 STORM-2993 Storm HDFS bolt throws ClosedChannelException when Time rotation policy is used
BUG-101181 N/A PhoenixStorageHandler doesn't handle AND in predicate correctly
BUG-101266 PHOENIX-4635 HBase Connection leak in org.apache.phoenix.hive.mapreduce.PhoenixInputFormat
BUG-101458 HIVE-11464 lineage info missing if there are multiple outputs
BUG-101485 N/A hive metastore thrift api is slow and causing client timeout
BUG-101628 HIVE-19331 Hive incremental replication to cloud failed.
BUG-102048 HIVE-19381 Hive Function Replication to cloud fails with FunctionTask
BUG-102064 N/A Hive Replication [ onprem to onprem ] tests failed in ReplCopyTask
BUG-102137 HIVE-19423 Hive Replication [ Onprem to Cloud ] tests failed in ReplCopyTask
BUG-102305 HIVE-19430 HS2 and hive metastore OOM dumps
BUG-102361 N/A multiple insert results in single insert replicated to target hive cluster ( onprem - s3 )
BUG-87624 N/A Enabling storm event logging causes workers to continuously die
BUG-88929 HBASE-15615 Wrong sleep time when RegionServerCallable need retry
BUG-89628 HIVE-17613 remove object pools for short, same-thread allocations
BUG-89813 N/A SCA : Code Correctness: Non-Synchronized Method Overrides Synchronized Method
BUG-90437 ZEPPELIN-3072 Zeppelin UI becomes slow/unresponsive if there are too many notebooks
BUG-90640 HBASE-19065 HRegion#bulkLoadHFiles() should wait for concurrent Region#flush() to finish
BUG-91202 HIVE-17013 Delete request with a subquery based on select over a view
BUG-91350 KNOX-1108 NiFiHaDispatch not failing over
BUG-92054 HIVE-13120 propagate doAs when generating ORC splits
BUG-92373 FALCON-2314 Bump TestNG version to 6.13.1 to avoid BeanShell dependency
BUG-92381 N/A testContainerLogsWithNewAPI and testContainerLogsWithOldAPI UT fails
BUG-92389 STORM-2841 testNoAcksIfFlushFails UT fails with NullPointerException
BUG-92586 SPARK-17920, SPARK-20694, SPARK-21642, SPARK-22162, SPARK-22289, SPARK-22373, SPARK-22495, SPARK-22574, SPARK-22591, SPARK-22595, SPARK-22601, SPARK-22603, SPARK-22607, SPARK-22635, SPARK-22637, SPARK-22653, SPARK-22654, SPARK-22686, SPARK-22688, SPARK-22817, SPARK-22862, SPARK-22889, SPARK-22972, SPARK-22975, SPARK-22982, SPARK-22983, SPARK-22984, SPARK-23001, SPARK-23038, SPARK-23095 Update Spark2 up-to-date to 2.2.1 (Jan. 16)
BUG-92680 ATLAS-2288 NoClassDefFoundError Exception while running import-hive script when hbase table is created via Hive
BUG-92760 ACCUMULO-4578 Cancel compaction FATE operation does not release namespace lock
BUG-92797 HDFS-10267, HDFS-8496 Reducing the datanode lock contentions on certain use cases
BUG-92813 FLUME-2973 Deadlock in hdfs sink
BUG-92957 HIVE-11266 count(*) wrong result based on table statistics for external tables
BUG-93018 ATLAS-2310 In HA, the passive node redirects the request with wrong URL encoding
BUG-93116 RANGER-1957 Ranger Usersync is not syncing users or groups periodically when incremental sync is enabled.
BUG-93361 HIVE-12360 Bad seek in uncompressed ORC with predicate pushdown
BUG-93426 CALCITE-2086 HTTP/413 in certain circumstances due to large Authorization headers
BUG-93429 PHOENIX-3240 ClassCastException from Pig loader
BUG-93485 N/A Cannot get table mytestorg.apache.hadoop.hive.ql.metadata.InvalidTableException: Table not found when running analyze table on columns in LLAP
BUG-93512 PHOENIX-4466 java.lang.RuntimeException: response code 500 - Executing a spark job to connect to phoenix query server and load data
BUG-93550 N/A Zeppelin %spark.r does not work with spark1 due to scala version mismatch
BUG-93910 HIVE-18293 Hive is failing to compact tables contained within a folder that is not owned by identity running HiveMetaStore
BUG-93926 ZEPPELIN-3114 Notebooks and interpreters are not getting saved in zeppelin after >1d stress testing
BUG-93932 ATLAS-2320 classification "*" with query throws 500 Internal server exception.
BUG-93948 YARN-7697 NM goes down with OOM due to leak in log-aggregation (part#1)
BUG-93965 ATLAS-2229 DSL search : orderby non-string attribute throws exception
BUG-93986 YARN-7697 NM goes down with OOM due to leak in log-aggregation (part#2)
BUG-94030 ATLAS-2332 Creation of type with attributes having nested collection datatype fails
BUG-94080 YARN-3742, YARN-6061 Both RM are in standby in secure cluster
BUG-94081 HIVE-18384 ConcurrentModificationException in log4j2.x library
BUG-94168 N/A Yarn RM goes down with Service Registry is in wrong state ERROR
BUG-94330 HADOOP-13190, HADOOP-14104, HADOOP-14814, HDFS-10489, HDFS-11689 HDFS should support for multiple KMS Uris
BUG-94345 HIVE-18429 Compaction should handle a case when it produces no output
BUG-94372 ATLAS-2229 DSL query : hive_table name = ["t1","t2"] throws invalid DSL query exception
BUG-94381 HADOOP-13227, HDFS-13054 Handling RequestHedgingProxyProvider RetryAction order: FAIL < RETRY < FAILOVER_AND_RETRY.
BUG-94432 HIVE-18353 CompactorMR should call jobclient.close() to trigger cleanup
BUG-94575 SPARK-22587 Spark job fails if fs.defaultFS and application jar are different url
BUG-94791 SPARK-22793 Memory leak in Spark Thrift Server
BUG-94928 HDFS-11078 Fix NPE in LazyPersistFileScrubber
BUG-95013 HIVE-18488 LLAP ORC readers are missing some null checks
BUG-95077 HIVE-14205 Hive doesn't support union type with AVRO file format
BUG-95200 HDFS-13061 SaslDataTransferClient#checkTrustAndSend should not trust a partially trusted channel
BUG-95201 HDFS-13060 Adding a BlacklistBasedTrustedChannelResolver for TrustedChannelResolver
BUG-95284 HBASE-19395 [branch-1] TestEndToEndSplitTransaction.testMasterOpsWhileSplitting fails with NPE
BUG-95301 HIVE-18517 Vectorization: Fix VectorMapOperator to accept VRBs and check vectorized flag correctly to support LLAP Caching
BUG-95542 HBASE-16135 PeerClusterZnode under rs of removed peer may never be deleted
BUG-95595 HIVE-15563 Ignore Illegal Operation state transition exception in SQLOperation.runQuery to expose real exception.
BUG-95596 YARN-4126, YARN-5750 TestClientRMService fails
BUG-96019 HIVE-18548 Fix log4j import
BUG-96196 HDFS-13120 Snapshot diff could be corrupted after concat
BUG-96289 HDFS-11701 NPE from Unresolved Host causes permanent DFSInputStream failures
BUG-96291 STORM-2652 Exception thrown in JmsSpout open method
BUG-96363 HIVE-18959 Avoid creating extra pool of threads within LLAP
BUG-96390 HDFS-10453 ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.
BUG-96454 YARN-4593 Deadlock in AbstractService.getConfig()
BUG-96704 FALCON-2322 ClassCastException while submitAndSchedule feed
BUG-96720 SLIDER-1262 Slider functests are failing in Kerberized environment
BUG-96931 SPARK-23053, SPARK-23186, SPARK-23230, SPARK-23358, SPARK-23376, SPARK-23391 Update Spark2 up-to-date (Feb. 19)
BUG-97067 HIVE-10697 ObjectInspectorConvertors#UnionConvertor does a faulty conversion
BUG-97244 KNOX-1083 HttpClient default timeout should be a sensible value
BUG-97459 ZEPPELIN-3271 Option for disabling scheduler
BUG-97511 KNOX-1197 AnonymousAuthFilter is not added when authentication=Anonymous in service
BUG-97601 HIVE-17479 Staging directories do not get cleaned up for update/delete queries
BUG-97605 HIVE-18858 System properties in job configuration not resolved when submitting MR job
BUG-97674 OOZIE-3186 Oozie is unable to use configuration linked using jceks://file/...
BUG-97743 N/A java.lang.NoClassDefFoundError exception while deploying storm topology
BUG-97756 PHOENIX-4576 Fix LocalIndexSplitMergeIT tests failing in master branch
BUG-97771 HDFS-11711 DN should not delete the block On "Too many open files" Exception
BUG-97869 KNOX-1190 Knox SSO support for Google OIDC is broken.
BUG-97879 PHOENIX-4489 HBase Connection leak in Phoenix MR Jobs
BUG-98392 RANGER-2007 ranger-tagsync's Kerberos ticket fails to renew
BUG-98484 N/A Hive Incremental Replication to Cloud not working
BUG-98533 HBASE-19934, HBASE-20008 Hbase snapshot restore is failing due to Null pointer exception
BUG-98555 PHOENIX-4662 NullPointerException in TableResultIterator.java on cache resend
BUG-98579 HBASE-13716 Stop using Hadoop's FSConstants
BUG-98705 KNOX-1230 Many Concurrent Requests to Knox causes URL Mangling
BUG-98983 KNOX-1108 NiFiHaDispatch not failing over
BUG-99107 HIVE-19054 Function replication shall use "hive.repl.replica.functions.root.dir" as root
BUG-99145 RANGER-2035 Errors accessing servicedefs with empty implClass with Oracle backend
BUG-99160 SLIDER-1259 Slider does not work in multi homed environments
BUG-99239 ATLAS-2462 Sqoop import for all tables throws NPE for no table provided in command
BUG-99301 ATLAS-2530 Newline at the beginning of the name attribute of a hive_process and hive_column_lineage
BUG-99453 HIVE-19065 Metastore client compatibility check should include syncMetaStoreClient
BUG-99521 N/A ServerCache for HashJoin is not re-created when iterators are re-instantiated
BUG-99590 PHOENIX-3518 Memory Leak in RenewLeaseTask
BUG-99618 SPARK-23599, SPARK-23806 Update Spark2 to 2.3.0+ (3/28)
BUG-99672 ATLAS-2524 Hive hook with V2 notifications - incorrect handling of 'alter view as' operation
BUG-99809 HBASE-20375 Remove use of getCurrentUserCredentials in hbase-spark module

Supportability

Hortonworks Bug ID Apache JIRA Summary
BUG-87343 HIVE-18031 Support replication for Alter Database operation.
BUG-91293 RANGER-2060 Knox proxy with knox-sso is not working for ranger
BUG-93116 RANGER-1957 Ranger Usersync is not syncing users or groups periodically when incremental sync is enabled.
BUG-93577 RANGER-1938 Solr for Audit setup doesn't use DocValues effectively
BUG-96082 RANGER-1982 Error Improvement for Analytics Metric of Ranger Admin and Ranger Kms
BUG-96479 HDFS-12781 After Datanode down, In Namenode UI Datanode tab is throwing warning message.
BUG-97864 HIVE-18833 Auto Merge fails when "insert into directory as orcfile"
BUG-98814 HDFS-13314 NameNode should optionally exit if it detects FsImage corruption

Upgrade

Hortonworks Bug ID Apache JIRA Summary
BUG-100134 SPARK-22919 Revert of "Bump Apache httpclient versions"
BUG-95823 N/A Knox: Upgrade Beanutils
BUG-96751 KNOX-1076 Update nimbus-jose-jwt to 4.41.2
BUG-97864 HIVE-18833 Auto Merge fails when "insert into directory as orcfile"
BUG-99056 HADOOP-13556 Change Configuration.getPropsWithPrefix to use getProps instead of iterator
BUG-99378 ATLAS-2461, ATLAS-2554 Migration utility to export Atlas data in Titan graph DB

Usability

Hortonworks Bug ID Apache JIRA Summary
BUG-100045 HIVE-19056 IllegalArgumentException in FixAcidKeyIndex when ORC file has 0 rows
BUG-100139 KNOX-1243 Normalize the required DNs that are Configured in KnoxToken Service
BUG-100570 ATLAS-2557 Fix to allow to lookup hadoop ldap groups when are groups from UGI are wrongly set or are not empty
BUG-100646 ATLAS-2102 Atlas UI Improvements: Search results page
BUG-100737 HIVE-19049 Add support for Alter table add columns for Druid
BUG-100750 KNOX-1246 Update service config in Knox to support latest configurations for Ranger.
BUG-100965 ATLAS-2581 Regression with V2 Hive hook notifications : Moving table to a different database
BUG-84413 ATLAS-1964 UI : Support to order columns in Search table
BUG-90570 HDFS-11384, HDFS-12347 Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike
BUG-90584 HBASE-19052 FixedFileTrailer should recognize CellComparatorImpl class in branch-1.x
BUG-90979 KNOX-1224 Knox Proxy HADispatcher to support Atlas in HA.
BUG-91293 RANGER-2060 Knox proxy with knox-sso is not working for ranger
BUG-92236 ATLAS-2281 Saving Tag/Type attribute filter queries with null/not null filters.
BUG-92238 ATLAS-2282 Saved favorite search appears only on refresh after creation when there are 25+ favorite searches .
BUG-92333 ATLAS-2286 Pre-built type 'kafka_topic' should not declare 'topic' attribute as unique
BUG-92678 ATLAS-2276 Path value for hdfs_path type entity is set to lower case from hive-bridge.
BUG-93097 RANGER-1944 Action filter for Admin Audit is not working
BUG-93135 HIVE-15874, HIVE-18189 Hive query returning wrong results when set hive.groupby.orderby.position.alias to true
BUG-93136 HIVE-18189 Order by position does not work when cbo is disabled
BUG-93387 HIVE-17600 Make OrcFile's "enforceBufferSize" user-settable.
BUG-93495 RANGER-1937 Ranger tagsync should process ENTITY_CREATE notification, to support Atlas import feature
BUG-93512 PHOENIX-4466 java.lang.RuntimeException: response code 500 - Executing a spark job to connect to phoenix query server and load data
BUG-93801 HBASE-19393 HTTP 413 FULL head while accessing HBase UI using SSL.
BUG-93804 HIVE-17419 ANALYZE TABLE...COMPUTE STATISTICS FOR COLUMNS command shows computed stats for masked tables
BUG-93932 ATLAS-2320 classification "*" with query throws 500 Internal server exception.
BUG-93933 ATLAS-2286 Pre-built type 'kafka_topic' should not declare 'topic' attribute as unique
BUG-93938 ATLAS-2283, ATLAS-2295 UI updates for classifications
BUG-93941 ATLAS-2296, ATLAS-2307 Basic search enhancement to optionally exclude sub-type entities and sub-classification-types
BUG-93944 ATLAS-2318 UI : Clicking on child tag twice , parent tag is selected
BUG-93946 ATLAS-2319 UI : Deleting a tag which at 25+ position in the tag list in both Flat and Tree structure needs a refresh to remove the tag from the list.
BUG-93977 HIVE-16232 Support stats computation for column in QuotedIdentifier
BUG-94030 ATLAS-2332 Creation of type with attributes having nested collection datatype fails
BUG-94099 ATLAS-2352 Atlas server should provide configuration to specify validity for Kerberos DelegationToken
BUG-94280 HIVE-12785 View with union type and UDF to `cast` the struct is broken
BUG-94332 SQOOP-2930 Sqoop job exec not overriding the saved job generic properties
BUG-94428 N/A Dataplane Profiler Agent REST API Knox support
BUG-94514 ATLAS-2339 UI : Modifications in "columns" in Basic search result view affects DSL also.
BUG-94515 ATLAS-2169 Delete request fails when hard delete is configured
BUG-94518 ATLAS-2329 Atlas UI Multiple Hovers appears if user click on another tag which is incorrect
BUG-94519 ATLAS-2272 Save the state of dragged columns using save search API.
BUG-94627 HIVE-17731 add a backward compat option for external users to HIVE-11985
BUG-94786 HIVE-6091 Empty pipeout files are created for connection create/close
BUG-94793 HIVE-14013 Describe table doesn't show unicode properly
BUG-94900 OOZIE-2606, OOZIE-2658, OOZIE-2787, OOZIE-2802 Set spark.yarn.jars to fix Spark 2.0 with Oozie
BUG-94901 HBASE-19285 Add per-table latency histograms
BUG-94908 ATLAS-1921 UI : Search using entity and trait attributes : UI doesn't perform range check and allows providing out of bounds values for integral and float data types.
BUG-95086 RANGER-1953 improvement on user-group page listing
BUG-95193 SLIDER-1252 Slider agent fails with SSL validation errors with python 2.7.5-58
BUG-95314 YARN-7699 queueUsagePercentage is coming as INF for getApp REST api call
BUG-95315 HBASE-13947, HBASE-14517, HBASE-17931 Assign system tables to servers with highest version
BUG-95392 ATLAS-2421 Notification updates to support V2 data structures
BUG-95476 RANGER-1966 Policy engine initialization does not create context enrichers in some cases
BUG-95512 HIVE-18467 support whole warehouse dump / load + create/drop database events
BUG-95593 N/A Extend Oozie DB utils to support Spark2 sharelib creation
BUG-95595 HIVE-15563 Ignore Illegal Operation state transition exception in SQLOperation.runQuery to expose real exception.
BUG-95685 ATLAS-2422 Export: Support type-based Export
BUG-95798 PHOENIX-2714, PHOENIX-2724, PHOENIX-3023, PHOENIX-3040 Don't use guideposts for executing queries serially
BUG-95969 HIVE-16828, HIVE-17063, HIVE-18390 Partitioned view fails with FAILED: IndexOutOfBoundsException Index: 1, Size: 1
BUG-96019 HIVE-18548 Fix log4j import
BUG-96288 HBASE-14123, HBASE-14135, HBASE-17850 Backport Hbase Backup/Restore 2.0
BUG-96313 KNOX-1119 Pac4J OAuth/OpenID Principal Needs to be Configurable
BUG-96365 ATLAS-2442 User with read-only permission on entity resource not able perform basic search
BUG-96479 HDFS-12781 After Datanode down, In Namenode UI Datanode tab is throwing warning message.
BUG-96502 RANGER-1990 Add One-way SSL MySQL support in Ranger Admin
BUG-96718 ATLAS-2439 Update Sqoop hook to use V2 notifications
BUG-96748 HIVE-18587 insert DML event may attempt to calculate a checksum on directories
BUG-96821 HBASE-18212 In Standalone mode with local filesystem HBase logs Warning message:Failed to invoke 'unbuffer' method in class class org.apache.hadoop.fs.FSDataInputStream
BUG-96847 HIVE-18754 REPL STATUS should support 'with' clause
BUG-96873 ATLAS-2443 Capture required entity attributes in outgoing DELETE messages
BUG-96880 SPARK-23230 When hive.default.fileformat is other kinds of file types, create textfile table cause a serde error
BUG-96911 OOZIE-2571, OOZIE-2792, OOZIE-2799, OOZIE-2923 Improve Spark options parsing
BUG-97100 RANGER-1984 Hbase audit log records may not show all tags associated with accessed column
BUG-97110 PHOENIX-3789 Execute cross region index maintenance calls in postBatchMutateIndispensably
BUG-97145 HIVE-12245, HIVE-17829 Support column comments for an HBase backed table
BUG-97409 HADOOP-15255 Upper/Lower case conversion support for group names in LdapGroupsMapping
BUG-97535 HIVE-18710 extend inheritPerms to ACID in Hive 2.X
BUG-97742 OOZIE-1624 Exclusion pattern for sharelib JARs
BUG-97744 PHOENIX-3994 Index RPC priority still depends on the controller factory property in hbase-site.xml
BUG-97787 HIVE-18460 Compactor doesn't pass Table properties to the Orc writer
BUG-97788 HIVE-18613 Extend JsonSerDe to support BINARY type
BUG-97899 HIVE-18808 Make compaction more robust when stats update fails
BUG-98038 HIVE-18788 Clean up inputs in JDBC PreparedStatement
BUG-98383 HIVE-18907 Create utility to fix acid key index issue from HIVE-18817
BUG-98388 RANGER-1828 Good coding practice-add additional headers in ranger
BUG-98392 RANGER-2007 ranger-tagsync's Kerberos ticket fails to renew
BUG-98533 HBASE-19934, HBASE-20008 Hbase snapshot restore is failing due to Null pointer exception
BUG-98552 HBASE-18083, HBASE-18084 Make large/small file clean thread number configurable in HFileCleaner
BUG-98705 KNOX-1230 Many Concurrent Requests to Knox causes URL Mangling
BUG-98711 N/A NiFi dispatch can't use two-way SSL without service.xml modifications
BUG-98880 OOZIE-3199 Let system property restriction configurable
BUG-98931 ATLAS-2491 Update Hive hook to use Atlas v2 notifications
BUG-98983 KNOX-1108 NiFiHaDispatch not failing over
BUG-99088 ATLAS-2511 Provide options to selectively import database / tables from Hive into Atlas
BUG-99154 OOZIE-2844, OOZIE-2845, OOZIE-2858, OOZIE-2885 Spark query failed with "java.io.FileNotFoundException: hive-site.xml (Permission denied)" exception
BUG-99239 ATLAS-2462 Sqoop import for all tables throws NPE for no table provided in command
BUG-99636 KNOX-1238 Fix Custom Truststore Settings for Gateway
BUG-99650 KNOX-1223 Zeppelin's Knox proxy doesn't redirect /api/ticket as expected
BUG-99804 OOZIE-2858 HiveMain, ShellMain and SparkMain should not overwrite properties and config files locally
BUG-99805 OOZIE-2885 Running Spark actions should not need Hive on the classpath
BUG-99806 OOZIE-2845 Replace reflection-based code which sets variable in HiveConf
BUG-99807 OOZIE-2844 Increase stability of Oozie actions when log4j.properties is missing or not readable
RMP-9995 AMBARI-22222 Switch druid to use /var/druid directory instead of /apps/druid on local disk