Fixed Issues
Fixed issues represents selected issues that were previously logged via Hortonworks Support, but are now addressed in the current release. These issues may have been reported in previous versions within the Known Issues section; meaning they were reported by customers or identified by Hortonworks Quality Engineering team.
Potential Data Loss
Hortonworks Bug ID |
Apache Component |
Apache JIRA |
Summary |
---|---|---|---|
BUG-57918 | HDFS | HDFS-10178 | Permanent write failures can happen if pipeline recoveries occur for the first packet. |
BUG-58254 | HBase | HBASE-15811 | Batch Get after batch Put does not fetch all Cells |
Security
Hortonworks Bug ID |
Apache Component |
Apache JIRA |
Summary |
---|---|---|---|
BUG-39696 | Hive | HIVE-6026 | LDAP Authenticator should be more generic with BindDN. |
BUG-53072 | Kafka | KAFKA-2854 | The full Kerberos principal must be passed through for incoming requests to Kafka. |
BUG-55917 | Storm | STORM-1711 | HiveUtils.authenticate reuses current UGI, mixes up principles in use. |
BUG-56577 | Accumulo, HDFS | HADOOP-12559, HADOOP-12682, HADOOP-12716 | Port HOTFIX for HADOOP-12787 (KMS SPNEGO sequence does not work with WEBHDFS) and HADOOP-12559 (KMS connection failures should trigger TGT renewal). |
BUG-57460 | HBase, Phoenix | HBASE-15837, PHOENIX-2883 | Invalid memstore state during close of region for Phoenix table. |
BUG-58666 | Hive | HIVE-13729 | FileSystem$Cache leaks in FileUtils.checkFileAccessWithImpersonation. |
Incorrect Results
Hortonworks Bug ID |
Apache Component |
Apache JIRA |
Summary |
---|---|---|---|
BUG-35149 | YARN | YARN-4392 | ATS logs show start timestamp later than end timestamp. |
BUG-49254 | Ranger | RANGER-798 | Ranger "Access > Audit" not showing anything with Source "Solr" due to time filter issue (GMT). |
BUG-53364 | HBase | HBASE-15325 | ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests. |
BUG-55160 | Phoenix | PHOENIX-1478 | Can't upsert value of 127 into column of type unsigned tinyint. |
BUG-56961 | HBase | HBASE-15676 | FuzzyRowFilter fails and matches all the rows in the table if the mask consists of all 0s. |
BUG-57030 | Phoenix | PHOENIX-2876 | Phoenix ORDER BY clause does not work if the ORDER BY column is not present in the Select clause. |
BUG-58764 | HBase, Phoenix | PHOENIX-2915 | Dropping of Index can still leave some non-replayed writes in WAL. |
BUG-60197 | Knox, Ranger | RANGER-1039 | Knox permission details (User and Groups) are not listed from Ranger UI. |
BUG-62125 | Hive | HIVE-12768 | Tez various wrong results with map <- (map , reduce) join on decimal query. |
Stability
Hortonworks Bug ID |
Apache Component |
Apache JIRA |
Summary |
---|---|---|---|
BUG-17827 | Sqoop | SQOOP-2777 | Sqoop Fails to Create Tables with Reserved Keywords. |
BUG-18218 | YARN | YARN-3846 | Scheduler queue filter failed to work because index of queue column changed. |
BUG-27069 | Flume | FLUME-2118 | Occasional multi-hour pauses in file channel replay. |
BUG-41311 | HDFS | HDFS-9917 | Namenode quickly runs out of memory at start due to queued incremental block reports. |
BUG-43539 | HBase | HBASE-14229 | Flushing canceled by coprocessor still leads to memstoreSize set down. |
BUG-45878 | Hive, Hive2 | HIVE-13563 | Hive Streaming does not honor orc.compress.size and orc.stripe.size table properties. |
BUG-46789 | Hive, Hive2 | HIVE-13151 | Hive metastore memory leak of fs cache with ACID compaction on. |
BUG-48217 | YARN | YARN-4325 | After restarting YARN services, applications stays in ACCEPTED state. |
BUG-49898 | Hive | HIVE-12684 | Autoquerygen tests failing in secure runs |
BUG-51596 | Hive | HIVE-12439 | Hive Compactor cleaner thread fails to clean aborted txns due to ORA-01795 limit. |
BUG-51816 | Hive, Hive2 | HIVE-12976 | DirectSQL fails for large TPC-H runs. |
BUG-52300 | HBase | HBASE-15234 | ReplicationLogCleaner can abort due to transient ZK issues. |
BUG-53270 | Hive | Query with duplicate columns in GROUP BY clause fails. | |
BUG-53536 | Oozie | OOZIE-2185 | Make oozie cli source conf/oozie-env.sh. |
BUG-54166 | HBase | HBASE-15441 | Fix WAL splitting when region has moved multiple times. |
BUG-54308 | YARN | YARN-998 | Dynamic resource persistent from NM/RM restart. |
BUG-54498 | Hive | HIVE-12165 | Wrong result when hive.optimize.sampling.orderby=true with some aggregate functions. |
BUG-54500 | Hive | HIVE-12064 | Prevent transactional=false. |
BUG-54603 | Tez | TEZ-3114 | Shuffle OOM due to EventMetaData flood. |
BUG-54671 | Hive | HIVE-13233 | Use min and max values to estimate better stats for comparison operators. |
BUG-55447 | Hadoop Common | HADOOP-11687 | Ignore x-* and response headers when copying an Amazon S3 object. |
BUG-55494 | Hadoop Common | HADOOP-11901 | BytesWritable fails to support 2G chunks due to integer overflow |
BUG-55550 | Hive | HIVE-13200 | Aggregation functions returning empty rows on partitioned columns. |
BUG-55810 | Hive | HIVE-13242 | DISTINCT keyword is dropped by the parser for windowing. |
BUG-55816 | Hive | HIVE-10555 | Improve windowing spec of range based windowing to support additional range formats. |
BUG-56083 | Hive | HIVE-13394 | Analyze table fails in tez on empty partitions/files/tables. |
BUG-56420 | HDFS | HDFS-10319 | Balancer should not try to pair storages with different types. |
BUG-56423 | HDFS | HDFS-10312 | NameNode is stuck at SafeMode due to not all data blocks validated |
BUG-56528 | Hive | HIVE-13596 | Need JAR fix for UDF reloading. |
BUG-56772 | HDFS, Ranger | HADOOP-12423, HADOOP-12950, HADOOP-12993, RANGER-891 | ShutdownHookManager should have a timeout for each of the Registered shutdown hook. |
BUG-56869 | HDFS | HDFS-9902 | Support different values of dfs.datanode.du.reserved per storage-type. |
BUG-56932 | HDFS | HDFS-10335 | Mover$Processor#chooseTarget() always chooses the first matching target storage group. |
BUG-57007 | HDFS | HDFS-9917 | Namenode quickly runs out of memory at start due to queued incremental block reports. |
BUG-57016 | Hive, Hive2 | HIVE-14083 | ALTER INDEX via JDBC & HiveCLI causes NullPointerException. |
BUG-57556 | Hive, Hive2 | HIVE-14027 | NULL values produced by left outer join do not behave as null. |
BUG-57732 | HBase | HBASE-14712, HBASE-15100 | MasterProcWALs never clean up. |
BUG-57907 | HBase | PHOENIX-2892 | Scan for pre-warming the block cache for 2ndary index should be removed. |
BUG-58450 | Flume, Hive, Phoenix | PHOENIX-2568 | Flume dependency of Phoenix is bringing in an old version of Thrift (0.7.0). |
BUG-58850 | Sqoop | SQOOP-2596 | Sqoop import from sybase fails with varchars. |
BUG-59089 | Hive | HIVE-13592 | Metastore calls map is not thread safe. |
BUG-59268 | Hive | HIVE-13632 | Hive failing on insert empty array into parquet table. |
BUG-60071 | Hive | HIVE-10631, HIVE-12213 | Create partitioned table takes longer time and then eventually fails. |
BUG-60335 | Hive, Hive2 | HIVE-14147 | Hive PPD might remove predicates when they are defined as a simple expression e.g. WHERE 'a'. |
Upgrade
Hortonworks Bug ID |
Apache Component |
Apache JIRA |
Summary |
---|---|---|---|
BUG-54675 | Ambari, Kafka | AMBARI-16027 | RU does not handle Kafka .8.* topics well (Changes broker IDS). |
BUG-54742 | Ambari, Ranger | RANGER-910 | Error during EU while applying Ranger Java patches. |
BUG-61600 | Ambari, Ranger | AMBARI-16756 | [EU] Ranger restart is not happening after upgrade. |
Usability
Hortonworks Bug ID |
Apache Component |
Apache JIRA |
Summary |
---|---|---|---|
BUG-41362 | Sqoop | SQOOP-1361 | Sqoop import with --as-avrofile does not work when DB table column names have '$' character in them. |
BUG-42190 | Ambari, Storm | Ambari start Storm UI reports failure, although UI starts. | |
BUG-46316 | Sqoop | SQOOP-2471 | Support for Importing of arrays and struct datatypes in Sqoop Hcatalog. |
BUG-49832 | Falcon | FALCON-678 | Port doesn't change from 15000 to 15443 when change TLS to true. |
BUG-50767 | Falcon | FALCON-790 | Can't edit Falcon process specifications on Falcon Web UI once process is saved. |
BUG-52058 | Ambari, Spark | AMBARI-16757 | Spark History Server heap size is not exposed (History Server crashed with OOM). |
BUG-52622 | Falcon, Oozie, Spark | OOZIE-2170 | Fix Issues in current Oozie Spark Integration. |
BUG-56556 | Workflow Designer | OOZIE-1983 | Add spark action executor. |
BUG-57755 | HBase | HBASE-15808 | Reduce potential bulk load intermediate space usage and waste. |
BUG-60495 | Hive | HIVE-14022 | Left semi join should throw SemanticException if where clause contains columnname from right table. |
Performance
Hortonworks Bug ID |
Apache Component |
Apache JIRA |
Summary |
---|---|---|---|
BUG-50730 | Hive | HIVE-12893 | Hive optimize.sort.dynamic.partition not enabled in case of combination of bucketing and constant propagation if subset of partition column value set. |
BUG-51723 | Hadoop Common | HADOOP-12444 | Consider implementing lazy seek in S3AInputStream. |
BUG-52149 | HBase | HBASE-15213 | Fix increment performance regression. |
BUG-52844 | Ranger | RANGER-794, RANGER-836, RANGER-843, RANGER-844 | Policy download optimizations. |
BUG-53757 | Hive, Hive2 | HIVE-11424, HIVE-13233 | Stats are not properly accounted for when multiple COUNT(DISTINCT) are in the query. |
BUG-53830 | Hive2 | HIVE-13189, HIVE-13248 | Performance improvements for date_add/date_sub/to_date. |
BUG-55291 | HDFS | HDFS-10223 | peerFromSocketAndKey performs SASL exchange before setting connection timeouts. |
BUG-57513 | HDFS | HDFS-9198, HDFS-9958 | BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages. |
BUG-57906 | HBase | HBASE-14460 | Regression for CheckAndPut and Increment updates. |
Other
Hortonworks Bug ID |
Apache Component |
Apache JIRA |
Summary |
---|---|---|---|
BUG-56919 | YARN | YARN-2910 | FSLeafQueue can throw ConcurrentModificationException. |
BUG-60199 | Ranger | RANGER-1025 | Policy search REST API implemented in public api V1 is not returning results as expected. |