Fixed Issues
Fixed issues represents selected issues that were previously logged via Hortonworks Support, but are now addressed in the current release. These issues may have been reported in previous versions within the Known Issues section; meaning they were reported by customers or identified by Hortonworks Quality Engineering team.
Incorrect Results
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-65186 | HBASE-14694 | Scan copy constructor doesn't handle allowPartialResults |
| BUG-67594 | HIVE-14957 | HiveSortLimitPullUpConstantsRule misses branches when parent operator is Union |
| BUG-68223 | HIVE-13423 | Handle the overflow case for decimal datatype for sum() |
| BUG-68825 | HIVE-15588 | Incorrect behavior of COALESCE with CASE, LEFT JOIN and table STORED AS ORC |
| BUG-69199 | HIVE-13936 | Incorrect result when a query having left outer join with subquery and hive.optimize.ppd enabled |
| BUG-69556 | HIVE-15236 | timestamp and date comparison should happen in timestamp |
| BUG-71579 | HDFS-11018, HDFS-7284, HDFS-9350, HDFS-9947 | Incorrect check and message in FsDatasetImpl#invalidate |
| BUG-72122 | YARN-4403 | (AM/NM/Container)LivelinessMonitor should use monotonic time when calculating period |
| BUG-72544 | PIG-4918, PIG-4921, PIG-4951, PIG-4957, PIG-4961, PIG-4967, PIG-5032, PIG-5033, PIG-5040, PIG-5041, PIG-5048, PIG-5060, PIG-5064, PIG-5073, PIG-5088, PIG-5108, PIG-5119, PIG-5127 | Various patches for Pig 0.16 |
| BUG-72576 | HIVE-15327 | Outerjoin might produce wrong result depending on joinEmitInterval value |
| BUG-72756 | HIVE-15338 | Wrong result from vectorized DATEDIFF with scalar parameter of type DATE/TIMESTAMP |
| BUG-73583 | TEZ-3582 | Exception swallowed in PipelinedSorter causing incorrect results |
| BUG-75717 | SQOOP-3138 | Netezza Direct Mapper code duplicates 1st column in mapreduce.jdbc.output.field.names |
| BUG-76162 | HIVE-15291 | Timestamp datatype not working with comparison operator |
| BUG-76289 | HIVE-16050 | Union of null with non-null |
| BUG-76887 | HIVE-15848 | count or sum distinct incorrect when hive.optimize.reducededuplication set to true |
| BUG-77530 | PHOENIX-3608 | Phoenix query dropping/ignoring additional query conditions |
Other
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-65326 | RANGER-1355 | RangerAuthorizer for Hive MSCK command |
| BUG-70505 | HADOOP-12666, HADOOP-12738, HADOOP-12875, HADOOP-13037, HADOOP-13242, HADOOP-13257, HADOOP-13392, HADOOP-13393, HADOOP-13956, HADOOP-13962, HADOOP-14017, HADOOP-14049, HDFS-11240 | Support Microsoft Azure Data Lake - as a file system in Hadoop |
| BUG-76126 | PHOENIX-3652 | User requires all Create privilege on 'default' namespace to connect using sqlline.py |
| BUG-76646 | HADOOP-14048 | REDO operation of WASB#AtomicRename should create placeholder blob for destination folder |
| BUG-77800 | YARN-3589 | DOCTYPE html PUBLIC is displayed on Yarn UI |
Performance
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-65469 | HDFS-6763 | Initialize file system-wide quota once on transitioning to active |
| BUG-68141 | HIVE-14648 | LLAP: Avoid private pages in the SSD cache |
| BUG-68699 | HDFS-11047 | Remove deep copies of FinalizedReplica to alleviate heap consumption on DataNode |
| BUG-68959 | MAPREDUCE-6684, MAPREDUCE-6797 | High contention on scanning of user directory under immediate_done in Job History Server |
| BUG-69196 | HBASE-16773 | Integrate HBASE-16773 AccessController should access local region if possible |
| BUG-69356 | HIVE-15178 | ORC stripe merge may produce many MR jobs and no merge if split size is small |
| BUG-69510 | STORM-2197 | NimbusCLient connections leak due to leakage in ThriftCLient |
| BUG-70564 | HADOOP-13208 | HDC- S3A listStatus speedup |
| BUG-70717 | HADOOP-12185 | NetworkTopology is not efficient adding/getting/removing nodes |
| BUG-70727 | HIVE-13527 | Using deprecated APIs in HBase client causes zookeeper connection leaks. |
| BUG-71577 | HDFS-10987 | Make Decommission less expensive when lot of blocks present. |
| BUG-71580 | HDFS-11015 | Enforce timeout in balancer |
| BUG-71587 | HDFS-11087 | NamenodeFsck should check if the output writer is still writable. |
| BUG-71848 | MAPREDUCE-6724 | Single shuffle to memory must not exceed Integer#MAX_VALUE |
| BUG-72153 | YARN-4697 | NM aggregation thread pool is not bound by limits |
| BUG-72175 | HIVE-15803, HIVE-15879, HIVE-16014, HIVE-16086 | single threaded MSCK failing with NPE while multithread never completes due to Concurrency Issue |
| BUG-72364 | TEZ-3566 | HiveServer2 OOM - lots of DFSClient instances retained |
| BUG-72720 | MAPREDUCE-6485 | MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run |
| BUG-72752 | FLUME-2632 | High CPU on KafkaSink |
| BUG-73087 | HDFS-10627 | Volume Scanner marks a block as "suspect" even if the exception is network-related |
| BUG-73719 | HIVE-15693 | LLAP: cached threadpool in AMReporter creates too many threads leading to OOM |
| BUG-74060 | HDFS-4176 | EditLogTailer should call rollEdits with a timeout |
| BUG-74538 | HDFS-8674, HDFS-8792 | Improve postponed block scans |
| BUG-74593 | ATLAS-1542, ATLAS-1550 | Atlas server fails to start if duplicate types are found during Typesystem bootstrap |
| BUG-74606 | HDFS-11280 | Allow WebHDFS to reuse HTTP connections to NN |
| BUG-74622 | HADOOP-13466 | Add an AutoCloseableLock class |
| BUG-75409 | HDFS-10763 | Open files can leak permanently due to inconsistent lease update |
| BUG-75606 | CALCITE-1654 | Heap pressure in PQS due to unnecessary string generation in the logging path |
| BUG-75879 | N/A | Tech-preview backup and restore feature not disabled by default |
| BUG-75924 | HBASE-17682 | Region stuck in merging_new state indefinitely |
| BUG-75937 | HDFS-10301 | NameNode stuck in safe mode (block report progress is extremely slow) |
| BUG-76880 | HIVE-16090 | Addendum to HIVE-16014: HiveMetastoreChecker should use hive.metastore.fshandler.threads instead of hive.mv.files.thread for pool size |
| BUG-76954 | HBASE-14708 | Use copy on write Map for region location cache |
| BUG-77237 | ATLAS-1630 | Change ATLAS Search behavior to improve the search results for end-user |
Potential Data Loss
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-65824 | HBASE-16621 | HBCK should have -fixHFileLinks |
| BUG-65978 | YARN-3591 | Resource localization on a bad disk causes subsequent containers failure |
| BUG-67610 | HIVE-15002 | HiveSessionImpl#executeStatementInternal may leave locks in an inconsistent state |
| BUG-67974 | HIVE-9941 | sql std authorization on partitioned table: truncate and insert |
| BUG-72584 | HIVE-15355 | Concurrency issues during parallel moveFile due to HDFSUtils.setFullFileStatus |
| BUG-73011 | HBASE-15984 | Given failure to parse a given WAL that was closed cleanly, replay the WAL. |
| BUG-73090 | HDFS-10625, HDFS-11160 | VolumeScanner reports write-in-progress replicas as corrupt incorrectly |
| BUG-73796 | HBASE-16649 | Port HBASE-16649 - Truncate table with splits preserved can cause both data loss and truncated data appeared again |
| BUG-74601 | HDFS-10763 | Open files can leak permanently due to inconsistent lease update |
| BUG-75409 | HDFS-10763 | Open files can leak permanently due to inconsistent lease update |
| BUG-78703 | N/A | Hue :Hive query sometime utilize partition while browsing tables |
Query Failure
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-74154 | HIVE-12968 | genNotNullFilterForJoinSourcePlan: needs to merge predicates into the multi-AND |
| BUG-74311 | HIVE-13872 | Queries failing with java.lang.ClassCastException when vectorization is enabled |
Security
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-63624 | HBASE-16284 | Unauthorized client can shutdown the cluster |
| BUG-65326 | RANGER-1355 | RangerAuthorizer for Hive MSCK command |
| BUG-68689 | HIVE-15120 | Hive is not using SBA while dropping external tables. |
| BUG-71583 | HDFS-11069 | Tighten the authorization of datanode RPC |
| BUG-71585 | HDFS-10455 | Logging the username when deny the setOwner operation |
| BUG-71857 | RANGER-1095 | Invert authorization logic in RangerSolrAuthorizer |
| BUG-71858 | RANGER-1171 | Invert authorization logic in RangerKafkaAuthorizer |
| BUG-72036 | YARN-5549 | AMLauncher#createAMContainerLaunchContext() should not log the command to be launched indiscriminately |
| BUG-72083 | YARN-5353 | ResourceManager can leak delegation tokens when they are shared across apps |
| BUG-73327 | PIG-4811 | Upgrade groovy library |
| BUG-73468 | YARN-5206 | RegistrySecurity includes id:pass in exception text if considered invalid |
| BUG-73967 | YARN-1993 | Cross-site scripting vulnerability in TextView.java |
| BUG-74024 | RANGER-1338 | Ranger Plugin failed to download policy when JaasConfig alone is used to set the UGI instead of Principal/Keytab |
| BUG-74097 | ATLAS-1508 | Atlas AD authentication Active Directory Authentication should authenticate on sAMAccountName attribute |
| BUG-74129 | RANGER-1338 | Ranger Plugin failed to download policy when JaasConfig alone is used to set the UGI instead of Principal/Keytab |
| BUG-74205 | HIVE-15752 | HiveAuthorizer checkPrivileges didn't have the necessary inputHObjs for the command MSCK |
| BUG-74600 | HADOOP-13494 | ReconfigurableBase can log sensitive information |
| BUG-74620 | HADOOP-13299 | JMXJsonServlet is vulnerable to TRACE |
| BUG-74770 | HADOOP-14055 | SwiftRestClient includes pass length in exception if auth fails |
| BUG-75384 | HADOOP-14100 | Upgrade Jsch jar to latest version to fix vulnerability in old versions |
| BUG-76126 | PHOENIX-3652 | User requires all Create privilege on 'default' namespace to connect using sqlline.py |
| BUG-76496 | HBASE-14148 | Web UI Framable Page |
| BUG-77050 | KNOX-906 | Knox logging/auditing of attempted identity spoofing attacks |
| BUG-77717 | ZEPPELIN-2288 | CSRF protection in Zeppelin |
| BUG-78278 | HADOOP-13812 | Hadoop - Upgrade Tomcat version |
| BUG-78281 | N/A | Oozie - Upgrade Tomcat version |
| BUG-78284 | RANGER-1499 | Ranger - Upgrade Tomcat version |
Stability
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-58185 | HIVE-15208 | Drilldown link on HS2 UI for a running query results in an NPE |
| BUG-64503 | HBASE-14798 | Integrate HBASE-14798 NPE reporting server load causes regionserver abort; causes TestAcidGuarantee to fail |
| BUG-64732 | HBASE-16430 | Fix RegionServer Group's bug when moving multiple tables |
| BUG-64956 | HBASE-16270 | Handle duplicate clearing of snapshot in region replicas |
| BUG-64977 | YARN-5476 | Pig-HA stuck on nonexistent application id |
| BUG-65490 | HIVE-14375 | hcatalog-pig-adaptor pom.xml uses joda-time 2.2 instead of ${joda.version} that uses 2.8.1 |
| BUG-65978 | YARN-3591 | Resource localization on a bad disk causes subsequent containers failure |
| BUG-67148 | YARN-5659 | getPathFromYarnURL should use standard methods |
| BUG-67610 | HIVE-15002 | HiveSessionImpl#executeStatementInternal may leave locks in an inconsistent state |
| BUG-68046 | HADOOP-11780 | Prevent IPC reader thread death |
| BUG-68047 | HDFS-10609 | Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications |
| BUG-68947 | MAPREDUCE-6213 | NullPointerException caused by job history server addr not resolvable |
| BUG-69262 | HIVE-14924 | MSCK REPAIR table with single threaded is throwing null pointer exception |
| BUG-69392 | OOZIE-2826 | Falcon feed fails to aws s3 with hdp 2.5; Oozie joda time version does not meet required jar version 2.2 or later |
| BUG-69702 | KNOX-804 | Knox ehcache usage has intermittent CacheManger exception |
| BUG-70068 | SPARK-18160 | spark.files & spark.jars should not be passed to driver in yarn mode |
| BUG-70242 | OOZIE-2847 | Oozie job fails with NPE at LauncherMapper#setRecoveryId |
| BUG-70727 | HIVE-13527 | Using deprecated APIs in HBase client causes zookeeper connection leaks. |
| BUG-70957 | N/A | Spark Thrift Server failing after 24hrs due to delegation token renewal failure |
| BUG-71591 | HDFS-11180 | Intermittent deadlock in NameNode when failover happens. |
| BUG-71757 | HIVE-12664 | Bug in reduce deduplication optimization causing ArrayOutOfBoundException |
| BUG-71826 | HADOOP-12017 | Hadoop archives command should use configurable replication factor when closing |
| BUG-71848 | MAPREDUCE-6724 | Single shuffle to memory must not exceed Integer#MAX_VALUE |
| BUG-71863 | RANGER-1216 | Ranger Audit framework fails to audit to keberized + SSL enabled Solr |
| BUG-71871 | RANGER-1239 | hbase policy created as a result of hbase grant request does not allow dropping the namespace for the grantee user |
| BUG-72034 | YARN-5677 | RM should transition to standby when connection is lost for an extended period |
| BUG-72039 | YARN-5539 | TimelineClient failed to retry on "java.net.SocketTimeoutException: Read timed out" |
| BUG-72138 | YARN-857 | Localization failures should be available in container diagnostics |
| BUG-72141 | MAPREDUCE-6350, MAPREDUCE-6616, MAPREDUCE-6693 | ArrayIndexOutOfBoundsException occurs when the length of the job name is equal to mapreduce.jobhistory.jobname.limit |
| BUG-72150 | YARN-5873 | RM crashes with NPE if generic application history is enabled |
| BUG-72153 | YARN-4697 | NM aggregation thread pool is not bound by limits |
| BUG-72157 | MAPREDUCE-6789, YARN-4767 | Network issues can cause persistent RM UI outage |
| BUG-72175 | HIVE-15803, HIVE-15879, HIVE-16014, HIVE-16086 | single threaded MSCK failing with NPE while multithread never completes due to Concurrency Issue |
| BUG-72364 | TEZ-3566 | HiveServer2 OOM - lots of DFSClient instances retained |
| BUG-72507 | HADOOP-13823, HADOOP-14059 | s3a rename: fail if dest file exists |
| BUG-72544 | PIG-4918, PIG-4921, PIG-4951, PIG-4957, PIG-4961, PIG-4967, PIG-5032, PIG-5033, PIG-5040, PIG-5041, PIG-5048, PIG-5060, PIG-5064, PIG-5073, PIG-5088, PIG-5108, PIG-5119, PIG-5127 | Various patches for Pig 0.16 |
| BUG-72572 | HIVE-14928 | Analyze table no scan mess up schema |
| BUG-72720 | MAPREDUCE-6485 | MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run |
| BUG-72758 | HIVE-15542 | NPE in StatsUtils::getColStatistics when all values in DATE column are NULL |
| BUG-72766 | FLUME-2812 | Exception in thread "SinkRunner-PollingRunner-DefaultSinkProcessor" java.lang.Error: Maximum permit count exceeded |
| BUG-72831 | YARN-5121 | fix some container-executor portability issues |
| BUG-73010 | N/A | FullTableBackupProcedure#toStringClassDetails() should protect against empty table list |
| BUG-73085 | HDFS-10735 | Distcp using webhdfs on secure HA clusters fails with StandbyException |
| BUG-73096 | HDFS-11263 | ClassCastException when we use Bzipcodec for Fsimage compression |
| BUG-73481 | ZEPPELIN-2023 | User Impersonation fails on setting hive_conf_list in hive interpreter (JDBC) |
| BUG-73575 | STORM-2324 | Prevent topology from failing if its jar is missing resources directory |
| BUG-73728 | STORM-2360 | Storm hive bolt throws NoSuchMethodError and NullPointerException |
| BUG-73806 | FALCON-2280 | Unable to create mirror on WASB target due to "Cluster entity not found" |
| BUG-74062 | HDFS-8492 | DN should notify NN when client requests a missing block |
| BUG-74154 | HIVE-12968 | genNotNullFilterForJoinSourcePlan: needs to merge predicates into the multi-AND |
| BUG-74311 | HIVE-13872 | Queries failing with java.lang.ClassCastException when vectorization is enabled |
| BUG-74312 | HIVE-15542 | Getting NPE running a simple hive join in Tez engine after HDP upgrade |
| BUG-74593 | ATLAS-1542, ATLAS-1550 | Atlas server fails to start if duplicate types are found during Typesystem bootstrap |
| BUG-74601 | HDFS-10763 | Open files can leak permanently due to inconsistent lease update |
| BUG-74605 | HDFS-10512 | VolumeScanner may terminate due to NPE in DataNode.reportBadBlocks |
| BUG-74607 | HDFS-10684 | WebHDFS DataNode calls fail without parameter createparent |
| BUG-74612 | HDFS-11128 | CreateEditsLog throws NullPointerException |
| BUG-74618 | HADOOP-13461 | NPE in KeyProvider.rollNewVersion |
| BUG-74619 | HDFS-8224 | Schedule a block for scanning if its metadata file is corrupt |
| BUG-74629 | HADOOP-13202 | Avoid possible overflow in org.apache.hadoop.util.bloom.BloomFilter#getNBytes |
| BUG-74886 | STORM-2321 | Nimbus did not come up after restart |
| BUG-74891 | STORM-2360 | Storm-Hive: Thrift version mismatch with storm-core |
| BUG-74895 | STORM-2042, STORM-2266 | Nimbus client connections not closed properly causing connection leaks |
| BUG-74953 | RANGER-1379 | Seeing HTTP 404 in the logs for PolicyRefresher intermittently for different services |
| BUG-74959 | HADOOP-13433 | Region Server crashes with "Caused by: KrbException: The ticket isn't for us (35) - BAD TGS SERVER NAME " |
| BUG-75213 | HIVE-15803 | msck can hang when nested partitions are present |
| BUG-75220 | HIVE-15872 | The PERCENTILE_APPROX UDAF does not work with empty set |
| BUG-75224 | ATLAS-1351 | HiveHook fails with NPE for hive process registration |
| BUG-75924 | HBASE-17682 | Region stuck in merging_new state indefinitely |
| BUG-75976 | HIVE-11616 | DelegationTokenSecretManager reuses the same objectstore, which has concurrency issues |
| BUG-75977 | HIVE-11935 | Race condition in HiveMetaStoreClient: isCompatibleWith and close |
| BUG-76158 | PHOENIX-3078, PHOENIX-3346, PHOENIX-3386, PHOENIX-3387, PHOENIX-3408, PHOENIX-3416, PHOENIX-3422, PHOENIX-3486, PHOENIX-3490, PHOENIX-3503, PHOENIX-3512, PHOENIX-3662 | Various patches for Hive PhoenixStorageHandler |
| BUG-76215 | RANGER-1423 | Preparing Ranger Admin Step fails during RU |
| BUG-76618 | FALCON-2171 | Adding 'removeDeletedFiles' to hdfs-mirroring-workflow causes job failure |
| BUG-76953 | HIVE-13836 | DbNotifications giving an error = Invalid state. Transaction has already started |
| BUG-77152 | HIVE-16114 | NullPointerException in TezSessionPoolManager when getting the session |
| BUG-77323 | HDFS-11395 | Hive statement fails with RunTimeException with RequestHedgingProxyProvider |
| BUG-77353 | HIVE-16175 | Possible race condition in InstanceCache |
| BUG-77445 | HBASE-17020 | keylen in midkey() dont computed correctly |
| BUG-77480 | HADOOP-12404 | Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. |
| BUG-77632 | RANGER-1243 | Unable to create any services in ranger UI through ambari as well as manually |
| BUG-78017 | HDFS-9193 | Fix incorrect references the usages of the DN in dfshealth.js |
| BUG-78227 | HADOOP-14116 | FailoverOnNetworkExceptionRetry does not wait when failover on certain exception |
| BUG-78366 | HIVE-15181 | Metastore: TxnHandler locks into a seemingly infinite loop |
| BUG-78409 | HBASE-17287 | Port HBASE-17287 Master becomes a zombie if filesystem object closes |
| BUG-78491 | HIVE-14210 | Knox Connection to hive always hangs |
| BUG-78554 | HIVE-16225 | Memory leak in webhcat service (FileSystem CACHE entries) |
| BUG-78666 | N/A | Zeppelin-server: /api/notebook/job/$notebookId/$paragraphId throws NPE |
| BUG-78966 | HDFS-11608 | HDFS write crashed with block size greater than 2 GB |
Supportability
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-54085 | RANGER-1288 | Ranger upgrade fails if using SSL enabled DB environment. |
| BUG-64732 | HBASE-16430 | Fix RegionServer Group's bug when moving multiple tables |
| BUG-65728 | HIVE-14445 | upgrade maven surefire to 2.19.1 |
| BUG-65824 | HBASE-16621 | HBCK should have -fixHFileLinks |
| BUG-65899 | HIVE-14405 | Have tests log to the console along with hive.log |
| BUG-66650 | HDFS-6184 | Capture NN's thread dump when it fails over |
| BUG-69262 | HIVE-14924 | MSCK REPAIR table with single threaded is throwing null pointer exception |
| BUG-69385 | YARN-4109 | Excessive logging happening while scheduler UI page is visited |
| BUG-71564 | HIVE-15376 | Improve heartbeater scheduling for transactions |
| BUG-71584 | HDFS-9500 | datanodesSoftwareVersions map may counting wrong when rolling upgrade |
| BUG-71590 | HADOOP-13018, HDFS-9525 | Make Kdiag check whether hadoop.token.files points to existent and valid files |
| BUG-71954 | TEZ-2511 | Add exitCode to diagnostics when container fails |
| BUG-71955 | TEZ-2534 | Error handling summary event when shutting down AM |
| BUG-72036 | YARN-5549 | AMLauncher#createAMContainerLaunchContext() should not log the command to be launched indiscriminately |
| BUG-72134 | YARN-3387 | Previous AM's container complete message couldn't pass to current am if am restarted and rm changed |
| BUG-72138 | YARN-857 | Localization failures should be available in container diagnostics |
| BUG-72151 | YARN-5711 | Propogate exceptions back to client when using hedging RM failover provider |
| BUG-72544 | PIG-4918, PIG-4921, PIG-4951, PIG-4957, PIG-4961, PIG-4967, PIG-5032, PIG-5033, PIG-5040, PIG-5041, PIG-5048, PIG-5060, PIG-5064, PIG-5073, PIG-5088, PIG-5108, PIG-5119, PIG-5127 | Various patches for Pig 0.16 |
| BUG-72753 | HIVE-15312 | Orc generates a line saying "Writing additional X bytes, required 80" |
| BUG-72755 | FLUME-3031 | sequence source should reset its counter for event body on channel exception |
| BUG-72765 | FLUME-2991 | ExecSource command execution starts before starting the sourceCounter |
| BUG-72833 | YARN-5456 | container-executor support for FreeBSD, NetBSD, and others if conf path is absolute |
| BUG-73083 | HADOOP-13707 | If kerberos is enabled while HTTP SPNEGO is not configured, some links cannot be accessed |
| BUG-73084 | HDFS-11003 | Expose "XmitsInProgress" through DataNodeMXBean |
| BUG-73087 | HDFS-10627 | Volume Scanner marks a block as "suspect" even if the exception is network-related |
| BUG-73091 | HADOOP-12442, HADOOP-13824 | FsShell can suppress the real error if no error message is present |
| BUG-73092 | HDFS-11258 | File mtime change could not save to editlog |
| BUG-73093 | HDFS-11195 | Return error when appending files by webhdfs rest api fails |
| BUG-73744 | HADOOP-12054, YARN-4496, YARN-5711, YARN-6145, YARN-6206 | Connection refused exception call stack creating panic among end users |
| BUG-74475 | YARN-6145 | YARN-6145 Improve log message on fail over |
| BUG-74594 | YARN-4496, YARN-5711, YARN-6145 | Connection refused exception call stack creating panic among end users |
| BUG-74598 | HDFS-10822 | Log DataNodes in the write pipeline |
| BUG-74600 | HADOOP-13494 | ReconfigurableBase can log sensitive information |
| BUG-74602 | HDFS-7964 | Add support for async edit logging |
| BUG-74604 | HDFS-3918 | EditLogTailer shouldn't log WARN when other node is in standby mode |
| BUG-74614 | HDFS-10752 | Several log refactoring/improvement suggestion in HDFS |
| BUG-74615 | HADOOP-13710 | Supress CachingGetSpaceUsed from logging interrupted exception stacktrace |
| BUG-74624 | HADOOP-13458 | LoadBalancingKMSClientProvider#doOp should log IOException stacktrace |
| BUG-74894 | STORM-2338 | Subprocess exception handling is broken in storm.py on Windows environment |
| BUG-74953 | RANGER-1379 | Seeing HTTP 404 in the logs for PolicyRefresher intermittently for different services |
| BUG-75356 | HIVE-14612 | org.apache.hive.service.cli.operation.TestOperationLoggingLayout.testSwitchLogLayout failure |
| BUG-76350 | HADOOP-12735, HADOOP-13943 | TestCommonConfigurationFields.testCompareXmlAgainstConfigurationClass fails |
| BUG-76701 | RANGER-1434 | Enable Group Search First causes issues |
| BUG-77234 | ATLAS-1585 | Display Entity Type on ATLAS search results (list) |
| BUG-77235 | ATLAS-1596 | Show Properties in a Alphabetical order (sorting) |
| BUG-78226 | HADOOP-12386 | RetryPolicies.RETRY_FOREVER should be able to specify a retry interval |
Upgrade
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-71584 | HDFS-9500 | datanodesSoftwareVersions map may counting wrong when rolling upgrade |
| BUG-74616 | HDFS-10793 | Fix HdfsAuditLogger binary incompatibility introduced by HDFS-9184 |
Usability
| Hortonworks Bug ID | Apache JIRA | Summary |
|---|---|---|
| BUG-64005 | HADOOP-13552 | Hdfs prints WARN messages during file creation causing issues for Storm |
| BUG-64956 | HBASE-16270 | Handle duplicate clearing of snapshot in region replicas |
| BUG-64977 | YARN-5476 | Pig-HA stuck on nonexistent application id |
| BUG-65186 | HBASE-14694 | Scan copy constructor doesn't handle allowPartialResults |
| BUG-65469 | HDFS-6763 | Initialize file system-wide quota once on transitioning to active |
| BUG-65824 | HBASE-16621 | HBCK should have -fixHFileLinks |
| BUG-65919 | HIVE-14360 | Starting BeeLine after using !save, there is an error logged: "Error setting configuration: conf" |
| BUG-67099 | OOZIE-2705 | Oozie Spark action ignores spark.executor.extraJavaOptions and spark.driver.extraJavaOptions |
| BUG-67148 | YARN-5659 | getPathFromYarnURL should use standard methods |
| BUG-67445 | HIVE-14942 | HS2 UI: Canceled queries show up in "Open Queries" |
| BUG-67974 | HIVE-9941 | sql std authorization on partitioned table: truncate and insert |
| BUG-68005 | PHOENIX-3004 | Phoenix Query Server only accepts SPNEGO-authenticated clients from server's realm |
| BUG-68080 | HDFS-11054 | Suppress verbose log message in BlockPlacementPolicyDefault |
| BUG-68146 | SPARK-18160 | spark.files & spark.jars should not be passed to driver in yarn mode |
| BUG-68731 | HIVE-15123 | LLAP per node UI broken on hcube (when Cache is disabled) |
| BUG-68738 | YARN-5718 | TimelineClient and other YARN places shouldn't overwrite hdfs client retry setting which affect NN failed-over case. |
| BUG-68894 | PHOENIX-3241 | Convert_tz doesn't allow timestamp data type |
| BUG-68918 | KNOX-767 | Knox transforms XML files written to WebHDFS |
| BUG-68972 | N/A | Kafkaspout (old API) failing with secure kafka in HDP 2.5 |
| BUG-69385 | YARN-4109 | Excessive logging happening while scheduler UI page is visited |
| BUG-69392 | OOZIE-2826 | Falcon feed fails to aws s3 with hdp 2.5; Oozie joda time version does not meet required jar version 2.2 or later |
| BUG-69590 | N/A | Oozie allowing workflow names up to 40 characters |
| BUG-70061 | N/A | Pig job statuses remain 'Running' for succeeded jobs in query history |
| BUG-70717 | HADOOP-12185 | NetworkTopology is not efficient adding/getting/removing nodes |
| BUG-71583 | HDFS-11069 | Tighten the authorization of datanode RPC |
| BUG-71586 | HADOOP-13590, HADOOP-7930 | Retry until TGT expires even if the UGI renewal thread encountered exception |
| BUG-71587 | HDFS-11087 | NamenodeFsck should check if the output writer is still writable. |
| BUG-71589 | HDFS-10966 | Enhance Dispatcher logic on deciding when to give up a source DataNode |
| BUG-71826 | HADOOP-12017 | Hadoop archives command should use configurable replication factor when closing |
| BUG-71827 | YARN-5555 | Yarn RM UI % of Queue at application level is wrong |
| BUG-71860 | RANGER-1181 | HDFS Plugin does not allow removal of a non-empty directory if the directory is allowed to be removed by HDFS, but the file inside the directory is allowed to be removed by Ranger |
| BUG-71870 | RANGER-1229 | RangerResourceMatcher for Hdfs and Yarn resources does not correctly handle policy containing only one resource whose value is "*" |
| BUG-71872 | RANGER-1245 | Ranger UI group name limitation (32 characters in UI) |
| BUG-71955 | TEZ-2534 | Error handling summary event when shutting down AM |
| BUG-72034 | YARN-5677 | RM should transition to standby when connection is lost for an extended period |
| BUG-72039 | YARN-5539 | TimelineClient failed to retry on "java.net.SocketTimeoutException: Read timed out" |
| BUG-72059 | HIVE-12594 | X lock on partition should not conflict with S lock on DB |
| BUG-72083 | YARN-5353 | ResourceManager can leak delegation tokens when they are shared across apps |
| BUG-72122 | YARN-4403 | (AM/NM/Container)LivelinessMonitor should use monotonic time when calculating period |
| BUG-72124 | MAPREDUCE-6701 | application master log can not be available when clicking jobhistory's am logs link |
| BUG-72134 | YARN-3387 | Previous AM's container complete message couldn't pass to current am if am restarted and rm changed |
| BUG-72151 | YARN-5711 | Propogate exceptions back to client when using hedging RM failover provider |
| BUG-72305 | PHOENIX-2930 | Cannot resolve columns aliased to its own name |
| BUG-72373 | TEZ-3568 | Update SecurityUtils configuration to pick user provided configuration. |
| BUG-72507 | HADOOP-13823, HADOOP-14059 | s3a rename: fail if dest file exists |
| BUG-72548 | HADOOP-13988 | WebHDFS through Knox does not work with TDE |
| BUG-72575 | HIVE-13539 | HiveHFileOutputFormat searching the wrong directory for HFiles |
| BUG-72586 | HIVE-15437 | avro tables join fails when - tbl join tbl_postfix |
| BUG-72599 | HIVE-15590 | add separate spnego principal config for LLAP Web UI |
| BUG-72831 | YARN-5121 | fix some container-executor portability issues |
| BUG-72910 | N/A | Hue beeswax limits the listing of the tables to a limit of 5000 |
| BUG-73059 | RANGER-1310 | Ranger Audit framework enhancement to allow audit records to be spooled to local disk first |
| BUG-73083 | HADOOP-13707 | If kerberos is enabled while HTTP SPNEGO is not configured, some links cannot be accessed |
| BUG-73088 | HADOOP-13792 | Stackoverflow for schemeless defaultFS with trailing slash |
| BUG-73091 | HADOOP-12442, HADOOP-13824 | FsShell can suppress the real error if no error message is present |
| BUG-73093 | HDFS-11195 | Return error when appending files by webhdfs rest api fails |
| BUG-73124 | OOZIE-2649 | Can't override sub-workflow configuration property if defined in parent workflow XML |
| BUG-73302 | HIVE-15589 | Lengthen HIVE_TXN_TIMEOUT in TestDbTxnManager.setup to avoid unnecessary test failure |
| BUG-73327 | PIG-4811 | Upgrade groovy library |
| BUG-73417 | TEZ-3575 | RM have started forwarding origin. Use that in AMWebController for CORS support |
| BUG-73425 | TEZ-3494 | Support relative url for tez-ui.history-url.base config |
| BUG-73481 | ZEPPELIN-2023 | User Impersonation fails on setting hive_conf_list in hive interpreter (JDBC) |
| BUG-73806 | FALCON-2280 | Unable to create mirror on WASB target due to "Cluster entity not found" |
| BUG-73822 | RANGER-1314 | Ranger enhancement to support authorization of namespace operations |
| BUG-73964 | RANGER-1253 | UI error when a special character is entered for a username in the admin webapp |
| BUG-74024 | RANGER-1338 | Ranger Plugin failed to download policy when JaasConfig alone is used to set the UGI instead of Principal/Keytab |
| BUG-74056 | HIVE-11985, HIVE-15714 | CREATE EXTERNAL TABLE with Hive metastore in Oracle fails with ORA-01461 |
| BUG-74061 | HDFS-11112 | Journal Nodes should refuse to format non-empty directories |
| BUG-74088 | ZOOKEEPER-2227 | stmk four-letter word fails execution at server while reading trace mask argument. |
| BUG-74129 | RANGER-1338 | Ranger Plugin failed to download policy when JaasConfig alone is used to set the UGI instead of Principal/Keytab |
| BUG-74205 | HIVE-15752 | HiveAuthorizer checkPrivileges didn't have the necessary inputHObjs for the command MSCK |
| BUG-74296 | HIVE-15783 | small glitch in LlapServiceDriver on small VMs |
| BUG-74313 | MAPREDUCE-6338 | MR Ephemeral Port Range Issue - RPC port |
| BUG-74314 | HADOOP-12097, MAPREDUCE-6404 | MR Ephemeral Port Range Issue - WebApp port |
| BUG-74539 | HDFS-10423 | Increase default value of httpfs maxHttpHeaderSize |
| BUG-74585 | OOZIE-2243, OOZIE-2582, OOZIE-2678, OOZIE-2742 | Various patches for Oozie |
| BUG-74600 | HADOOP-13494 | ReconfigurableBase can log sensitive information |
| BUG-74602 | HDFS-7964 | Add support for async edit logging |
| BUG-74603 | HADOOP-12483 | Maintain wrapped SASL ordering for postponed IPC responses |
| BUG-74607 | HDFS-10684 | WebHDFS DataNode calls fail without parameter createparent |
| BUG-74608 | HADOOP-13847 | KMSWebApp should close KeyProviderCryptoExtension |
| BUG-74609 | HADOOP-13838 | KMSTokenRenewer should close providers |
| BUG-74610 | HADOOP-13742 | Expose "NumOpenConnectionsPerUser" as a metric |
| BUG-74611 | HADOOP-13822 | Use GlobalStorageStatistics.INSTANCE.reset() at FileSystem#clearStatistics() |
| BUG-74613 | HADOOP-12453 | Support decoding KMS Delegation Token with its own Identifier |
| BUG-74614 | HDFS-10752 | Several log refactoring/improvement suggestion in HDFS |
| BUG-74616 | HDFS-10793 | Fix HdfsAuditLogger binary incompatibility introduced by HDFS-9184 |
| BUG-74617 | HDFS-9696 | Garbage snapshot records lingering forever |
| BUG-74618 | HADOOP-13461 | NPE in KeyProvider.rollNewVersion |
| BUG-74622 | HADOOP-13466 | Add an AutoCloseableLock class |
| BUG-74623 | HADOOP-13443 | KMS should check the type of underlying keyprovider of KeyProviderExtension before falling back to default |
| BUG-74626 | HDFS-10710 | In BlockManager#rescanPostponedMisreplicatedBlocks(), postponed misreplicated block counts should be retrieved with NN lock protection |
| BUG-74627 | HDFS-10703 | HA NameNode Web UI should show last checkpoint time |
| BUG-74628 | HDFS-10225 | DataNode hot swap drives should disallow storage type changes. |
| BUG-74630 | HDFS-10544 | Balancer doesn't work with IPFailoverProxyProvider |
| BUG-74631 | HADOOP-14029 | Fix KMSClientProvider for non-secure proxyuser use case |
| BUG-74632 | HADOOP-13988 | KMSClientProvider does not work with WebHDFS and Apache Knox w/ProxyUser |
| BUG-74633 | HADOOP-13638 | KMS should set UGI's Configuration object properly |
| BUG-74634 | HADOOP-13749 | KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used |
| BUG-74635 | HADOOP-13558 | UserGroupInformation created from a Subject incorrectly tries to renew the Kerberos ticket |
| BUG-74657 | ATLAS-1546 | Hive hook should choose appropriate JAAS config if host uses kerberos ticket-cache |
| BUG-74683 | PHOENIX-1754 | Phoenix jdbc url can not support keytab PATH in window file system |
| BUG-74700 | HBASE-17460 | enable_table_replication can not perform cyclic replication of a table |
| BUG-74889 | STORM-2335 | Topology visualization breaks when ':transferred' in executor stats doesn't have any informations |
| BUG-74890 | STORM-2350 | Storm-HDFS's listFilesByModificationTime is broken |
| BUG-74895 | STORM-2042, STORM-2266 | Nimbus client connections not closed properly causing connection leaks |
| BUG-75000 | HDFS-11391 | Cannot write to WebHDFS with username starting with numbers |
| BUG-75116 | HBASE-17648 | Integrate HBASE-17648 HBase Table-level synchronization fails between two secured(kerberized) cluster |
| BUG-75248 | PHOENIX-2900 | Unable to find hash cache once a salted table 's first region has split |
| BUG-75249 | ATLAS-1567 | Regression: AtlasHook for falcon seems to be broken, it is not invoked when a falcon cluster entity is submitted |
| BUG-75561 | HIVE-15901 | LLAP: incorrect usage of gap cache |
| BUG-75586 | PHOENIX-3686 | De-couple PQS's use of Kerberos to talk to HBase and client authentication |
| BUG-75730 | HIVE-15124 | Fix OrcInputFormat to use reader's schema for include boolean array |
| BUG-75764 | SQOOP-2349 | Unable read from a locked DB2 AS400 table with "transaction.isolation=TRANSACTION_READ_UNCOMMITTED" |
| BUG-75879 | N/A | Tech-preview backup and restore feature not disabled by default |
| BUG-75952 | N/A | hive variables being set as conf variables from connection url |
| BUG-75978 | HIVE-15278 | PTF+MergeJoin = NPE |
| BUG-75979 | HIVE-15279 | map join dummy operators are not set up correctly in certain cases with merge join |
| BUG-75980 | HIVE-15323 | allow the user to turn off reduce-side SMB join |
| BUG-76126 | PHOENIX-3652 | User requires all Create privilege on 'default' namespace to connect using sqlline.py |
| BUG-76158 | PHOENIX-3078, PHOENIX-3346, PHOENIX-3386, PHOENIX-3387, PHOENIX-3408, PHOENIX-3416, PHOENIX-3422, PHOENIX-3486, PHOENIX-3490, PHOENIX-3503, PHOENIX-3512, PHOENIX-3662 | Various patches for Hive PhoenixStorageHandler |
| BUG-76162 | HIVE-15291 | Timestamp datatype not working with comparison operator |
| BUG-76215 | RANGER-1423 | Preparing Ranger Admin Step fails during RU |
| BUG-76536 | KNOX-890 | Make IdleTimeout Configurable in Knox Gateway Server |
| BUG-76674 | MAPREDUCE-6698 | Increase timeout on TestUnnecessaryBlockingOnHistoryFileInfo.testTwoThreadsQueryingDifferentJobOfSameUser. |
| BUG-76701 | RANGER-1434 | Enable Group Search First causes issues |
| BUG-76703 | RANGER-1435 | Allow different files to be specified for unix based usersync |
| BUG-76800 | HBASE-17717 | HBase superuser ZK ACL not properly set |
| BUG-76858 | ZEPPELIN-1320 | Support for ZEPPELIN_IMPERSONATE_CMD |
| BUG-76953 | HIVE-13836 | DbNotifications giving an error = Invalid state. Transaction has already started |
| BUG-77193 | SPARK-19970 | Spark hive context is not resolving principal to short name |
| BUG-77233 | ATLAS-1630 | Basic search implementation using fulltext |
| BUG-77237 | ATLAS-1630 | Change ATLAS Search behavior to improve the search results for end-user |
| BUG-77275 | ATLAS-1443 | Regression: Default values are not returned for optional attributes, these are actually ignored in the response. |
| BUG-77298 | ATLAS-1667 | Atlas UI Cleanup for lineage |
| BUG-77608 | HIVE-15792 | Need fix for HIVE-15792 on HDP 2.5.3 |
| BUG-77632 | RANGER-1243 | Unable to create any services in ranger UI through ambari as well as manually |
| BUG-77985 | N/A | Hue doesn't append single quotes around the date |
| BUG-78226 | HADOOP-12386 | RetryPolicies.RETRY_FOREVER should be able to specify a retry interval |
| BUG-78406 | YARN-4113 | RM should respect retry-interval when uses RetryPolicies.RETRY_FOREVER |
| BUG-78557 | HIVE-15947 | Enhance Templeton service job operations reliability |
| BUG-78561 | HIVE-12958 | Make embedded Jetty server more configurable |
| BUG-79014 | N/A | Query timeouts when browse table is clicked on a partitioned table |
| BUG-79173 | KAFKA-4073 | Kafka MirrorMaker should handle mirroring messages w/o timestamp better |
| BUG-79243 | HIVE-16473 | Receiving the error "Must Specify table name" on jobs after upgrade to HDP 2.5.3.0-37 from HDP 2.3.2 |