Fixed Issues in HDP 2.4.3
The following tables list and describe issues reported by customers through Hortonworks Support or Hortonworks Quality Engineering, and their resolutions in HDP 2.4.3.
Incorrect Results
|
Hortonworks Bug ID |
Apache JIRA |
Apache Component |
Summary |
|---|---|---|---|
| BUG-62579 | HADOOP-12291 | Hadoop Common, HDFS | Add support for nested groups in LdapGroupsMapping. |
| BUG-59399 | HBASE-15325 | HBase | ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests. |
| BUG-59881 | HIVE-13693, HIVE-13831 | Hive | Wrong results Multi-insert query drops filter before file output when there is a.val <> b.val filter. |
| BUG-57984 | HIVE-13299, HIVE-13618 | Hive | Column Names trimmed of leading and trailing spaces. |
| BUG-60335 | HIVE-14147 | Hive, Hive2 | Hive PPD might remove predicates when they are defined as a simple expression e.g. WHERE 'a'. |
| BUG-59881 | HIVE-13693, HIVE-13831 | Hive | Wrong results Multi-insert query drops filter before file output when there is a.val <> b.val filter. |
Security
|
Hortonworks Bug ID |
Apache JIRA |
Apache Component |
Summary |
|---|---|---|---|
| BUG-62567 | HADOOP-12901, HADOOP-13155, HADOOP-13251, HADOOP-12962 | HDFS | Apply Hadoop KMS patch. |
| BUG-57460 | HBASE-15837, PHOENIX-2883 | HBase, Phoenix | Invalid memstore state during close of region for Phoenix table. |
| BUG-55917 | STORM-1711 | Storm | HiveUtils.authenticate reuses current UGI, mixes up principles in use. |
| BUG-57857 | STORM-721 | Storm | Storm UI server should support SSL. |
Usability
|
Hortonworks Bug ID |
Apache JIRA |
Apache Component |
Summary |
|---|---|---|---|
| BUG-49428 | HBASE-13153 | HBase | Bulk Loaded HFile Replication. |
Query Failure
|
Hortonworks Bug ID |
Apache JIRA |
Apache Component |
Summary |
|---|---|---|---|
| BUG-52478 | N/A | Phoenix, Spark | Phoenix-Spark integration inoperative. |
Performance
|
Hortonworks Bug ID |
Apache JIRA |
Apache Component |
Summary |
|---|---|---|---|
| BUG-59466 | HBASE-14867 | HBase | Improved HBase Normalizer. |
| BUG-46240 | HBASE-14473 | HBase | Compute region locality in parallel. |
| BUG-63752 | HBASE-13829 | HBase | Hbase throttling Issue. |
| BUG-62675 | HADOOP-12916, HADOOP-12985, HADOOP-13159, HADOOP-13263, HDFS-10253, HDFS-10458, HDFS-7597, HDFS-8845, HDFS-9412 | HDFS | Performance improvements. |
| BUG-62673 | HDFS-8546, HDFS-8758, HDFS-9654, HDFS-9715, HDFS-9730 | HDFS | Upgrade improvements. |
| BUG-61590 | HDFS-9259, HDFS-9700 | HDFS | Backport HDFS-9259 (Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario) & HDFS-9700 (DFSClient and DFSOutputStream should set TCP_NODELAY on sockets for DataTransferProtocol). |
| BUG-59585 | HDFS-8828 | HDFS | Utilize Snapshot diff report to build diff copy list in distcp |
| BUG-61590 | HDFS-9259, HDFS-9700 | HDFS | Backport HDFS-9259 (Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario ) & HDFS-9700 (DFSClient and DFSOutputStream should set TCP_NODELAY on sockets for DataTransferProtocol). |
| BUG-55808 | YARN-3021, YARN-5048 | YARN | Backport YARN-3021 (YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp) and YARN-5048 (DelegationTokenRenewer#skipTokenRenewal may throw NPE). |
| BUG-56919 | YARN-2910 | YARN | FSLeafQueue can throw ConcurrentModificationException . |
Stability
|
Hortonworks Bug ID |
Apache JIRA |
Apache Component |
Summary |
|---|---|---|---|
| BUG-59387 | HADOOP-13105 | Hadoop Common | Support timeouts in LDAP queries in LdapGroupsMapping. |
| BUG-57732 | HBASE-14712, HBASE-15100 | HBase | Failover takes a long time due to MasterProcWALs never clean up. |
| BUG-57814 | HBASE-13318 | HBase | RpcServer.getListenerAddress should handle when the accept channel is closed. |
| BUG-60724 | HDFS-10271, HDFS-9530 | HDFS | ReservedSpace is not cleared for abandoned Blocks |
| BUG-63102 | HDFS-10688 | HDFS | BPServiceActor may run into a tight loop for sending block report when hitting IOException. |
| BUG-56423 | HDFS-10312 | HDFS | NameNode is stuck at SafeMode due to not all data blocks validated. |
| BUG-60419 | HIVE-14282 | Hive | Pig ToDate() exception with hive partition table ,partitioned by column of DATE datatype. |
| BUG-59118 | HIVE-12619 | Hive | Switching the field order within an array of structs causes the query to fail. |
| BUG-55812 | HIVE-13242 | Hive | DISTINCT keyword is dropped by the parser for windowing. |
| BUG-55551 | HIVE-13200 | Hive | Aggregation functions returning empty rows on partitioned columns. |
| BUG-63343 | HIVE-13191 | Hive | DummyTable map joins mix up columns between tables. |
| BUG-63342 | HIVE-14236 | Hive | CTAS with UNION ALL puts the wrong stats in Tez. |
| BUG-63341 | HIVE-14262 | Hive | Inherit writetype from partition WriteEntity for table WriteEntity. |
| BUG-60071 | HIVE-10631, HIVE-12213 | Hive | Create partitioned table takes longer time and then eventually fails |
| BUG-61883 | HIVE-14178 | Hive | Hive::needsToCopy should reuse FileUtils::equalsFileSystem. |
| BUG-60538 | HIVE-14045 | Hive | (Vectorization) Add missing case for BINARY in VectorizationContext.getNormalizedName method. |
| BUG-63523 | HIVE-13991 | Hive | Union All on view fail with no valid permission on underneath table. |
| BUG-59089 | HIVE-13592 | Hive | Metastore calls map is not thread safe. |
| BUG-58666 | HIVE-13729 | Hive | FileSystem$Cache leaks in FileUtils.checkFileAccessWithImpersonation. |
| BUG-56528 | HIVE-13596 | Hive | Need JAR fix for UDF reloading. |
| BUG-56083 | HIVE-13394 | Hive | Analyze table fails in tez on empty partitions/files/tables. |
| BUG-56528 | HIVE-13596 | Hive | Need JAR fix for UDF reloading. |
| BUG-58666 | HIVE-13729 | Hive | FileSystem$Cache leaks in FileUtils.checkFileAccessWithImpersonation. |
| BUG-58984 | HIVE-13602 | Hive | TPCH q16 return wrong result when CBO is on. |
| BUG-59089 | HIVE-13592 | Hive | Metastore calls map is not thread safe. |
| BUG-61775 | HIVE-14132 | Hive | Don't fail config validation for removed configs. |
| BUG-56776 | MAPREDUCE-6514, MAPREDUCE-6689 | MapReduce | MR job can infinitely increase number of reducer resource requests and job hangs as ask is not updated after ramping down of all reducers. |
| BUG-51701 | MAPREDUCE-6635 | MapReduce, Tez | java.lang.IndexOutOfBoundsException running select count(*) query on table with skip.header.line.count. |
| BUG-55158 | PHOENIX-1478 | Phoenix | Can't upsert value of 127 into column of type unsigned tinyint. |
| BUG-61855 | PIG-4587 | Pig | Applying isFirstReduceOfKey for Skewed left outer join skips records. |
| BUG-55869 | PIG-4714 | Pig | Pig launch throws ATS errors. |
| BUG-55895 | PIG-4873 | Pig | Pig job fails with Backend error : java.lang.NullPointerException. |
| BUG-60205 | SQOOP-2470 | Sqoop | Incremental Hive import with append not working after validation check for --hive-import and --import. |
| BUG-60024 | TEZ-2533 | Tez | AM deadlock when shutdown. |
| BUG-59515 | TEZ-3193 | Tez | Deadlock in AM during task commit request. |
| BUG-59368 | TEZ-3203 | Tez | DAG hangs when one of the upstream vertices has zero tasks. |
| BUG-62978 | HADOOP-13362 | YARN | OOM issue due to container metrics. |
| BUG-18218 | YARN-3846 | YARN | Scheduler queue filter failed to work because index of queue column changed. |
| BUG-48217 | YARN-4325 | YARN | After restarting Yarn services, applications stays in ACCEPTED state. |