Fixed Issues
Fixed issues represents selected issues that were previously logged via Hortonworks Support, but are now addressed in the current release. These issues may have been reported in previous versions within the Known Issues section; meaning they were reported by customers or identified by Hortonworks Quality Engineering team.
Potential Data Loss
|
Component |
Hortonworks Bug ID |
Apache JIRA |
Summary |
|---|---|---|---|
| HBase | BUG-33249 | HBASE-13576 | HBCK failed to recover certain regions |
Security
|
Component |
Hortonworks Bug ID |
Apache JIRA |
Summary |
|---|---|---|---|
| Falcon | BUG-32768 | FALCON-954 | Secure Kerberos setup : Falcon should periodically revalidate security credentials. |
| Falcon Documentation | BUG-31545 | Add details of Falcon directory permissions to documentation | |
| HBase | BUG-30856 | HBASE-11869 | Support snapshot owner other than Global Admins in HBase |
| HBase | BUG-33278 | HBASE-13239 | HBASE grants at specific column level does not work for Groups |
| HBase | BUG-36565 | HBASE-13734 | deleteall behavior changes after applying org.apache.hadoop.hbase. security.visibility. VisibilityController to HBase |
| Hive | BUG-33338 | HIVE-10528 | Hiveserver2 in HTTP mode is not applying auth_to_local rules |
| Hive | BUG-35992 | HIVE-10875 | SELECT a.* FROM (SELECT * FROM source_view) a results in permission denied error. |
| Hue | BUG-28794 | Security scan -- The Hue web application is vulnerable to stored Cross-Site Scripting (XSS) | |
| Hue | BUG-30961 | Security scan -- The Hue web application is vulnerable to stored Cross-Site Scripting (XSS) | |
| Hue | BUG-32176 | Django Vulnerabilities in Hue | |
| Hue | BUG-32729 | Directory listing is enabled for HUE | |
| Hue | BUG-33163 | Clear Text Password Shows In Hue UI for Oozie jobs and job log files. | |
| Knox | BUG-33708 | KNOX-525 | persisted service registry is not updated to support HA after upgrade |
| Knox, Ranger | BUG-36431 | Found Jersey client API incompatibility that prevent HTTPS Knox from working | |
| Oozie | BUG-33621 | Clear Text Password Shows In Oozie workflow configuration | |
| Ranger | BUG-30108 | RANGER-375 | Ranger - when backend DB not reachable error thrown is "incorrect password/username" when trying to log into Ranger |
| Ranger | BUG-31425 | PolicyManager throws 404 error when creating HBase repo in Ranger | |
| Ranger | BUG-33819 | RANGER-483 | Provide an option to create password using alternate message digest algorithm |
| YARN, HADOOP | BUG-41100 | Yarn services Tomcat instance upgraded to 6.0.44 |
Incorrect Results
|
Component |
Hortonworks Bug ID |
Apache JIRA |
Summary |
|---|---|---|---|
| HCatalog | BUG-22370 | HIVE-5545 | HCatRecord getInteger method returns String when used on Partition columns of type INT |
| Hive | BUG-31914 | HIVE-9278 | arithmetic operators return incorrect results from certain operand types |
| Hive | BUG-33275 | HIVE-8746 | ORC timestamp columns are sensitive to daylight savings time |
| Hive | BUG-34210 | HIVE-9278 | multiple built-in date functions return incorrect results in same where clause |
| Hive | BUG-34971 | HIVE-10481 | ACID table update finishes but values not really updated if column names are not all lower case |
| Hive | BUG-36223 | wrong results for 2 left outer joins with overlapping join on keys, filter IS NULL pushed to left side table wrongly. | |
| Hive | BUG-40100 | HIVE-11104 | Insert overwrite query does not return expected value |
| Hue | BUG-33631 | Hue 2.6.1-2041 not displaying tables in alphabetical order | |
| Phoenix | BUG-34506 | PHOENIX-896 | Unable to load tab delimited data via Phoenix |
| Pig | BUG-34138 | Receiving exception 'No such file or directory' when using 'pig -useHCatalog' | |
| Pig | BUG-36853 | PIG-4541 | Skewed full outer join does not return records if any relation is empty. Outer join does not return any record if left relation is empty |
| Pig | BUG-37485 | PIG-4556 | Pig tests abort with Check of prerequites failed: <Failed running /usr/bin/pig -e fs -ls /> |
Stability
|
Component |
Hortonworks Bug ID |
Apache JIRA |
Summary |
|---|---|---|---|
| Falcon | BUG-34020 | FALCON-1165 | Falcon will fail to start, if a cluster entity that was defined is not reachable. |
| HBase | BUG-21924 | HBASE-13555 | HBase web gives a 500 error when you attempt to view table details and it's not the master |
| HBase | BUG-29350 | HBASE-12791 | HBase does not attempt to clean up an aborted SPLIT when the Regions Server is shutting down. |
| HBase | BUG-33349 | HBASE-13608 | 500 Error with Stargate through Knox, using AD, SPNEGO, and Pre-Auth |
| HDFS | BUG-34175 | HDFS-8072 | Non-HDFS disk space is not reclaimed until after Datanode restart |
| HDFS | BUG-5700 | NameNode should shut down if out of memory error occurs | |
| Hue | BUG-30224 | django.db.utils.DatabaseError: current transaction is aborted when setting up Hue on PostgreSQL database | |
| Hue | BUG-33284 | Hue - "/usr/lib/hue/build/env/bin/hue syncdb --noinput" in MySQL5.6 will result in an error | |
| Knox | BUG-33488 | KNOX-530 | Running Oozie jobs through Knox on a cluster with HDFS HA does not use proper namenode host name. |
| Oozie | BUG-26984 | OOZIE-1728 | Queue configuration is not working for distcp action |
| Storm | BUG-28119 | STORM-563 | Kafka Spout doesn't pick up from the beginning of the queue unless forceFromStart specified |
Query Failure
|
Component |
Hortonworks Bug ID |
Apache JIRA |
Summary |
|---|---|---|---|
| HCatalog | BUG-30038 | Sqoop Import on External Hcatalog Table | |
| Hive | BUG-27636 | HIVE-10500 | intermittent acid_concurrency test failures due to NoSuchLockException |
| Hive | BUG-29427 | HIVE-9235 | Turn off Parquet Vectorization until all data types work: DECIMAL, DATE, TIMESTAMP, CHAR, and VARCHAR |
| Hive | BUG-30901 | HIVE-10559 | with constant propagation off, left join and join, hive.tez.dynamic.partition. pruning throw compile error IndexOutOfBoundsException |
| Hive | BUG-33145 | HS2 HTTP Mode - Beeline Hanging after upgrading from HDP 2.1 to HDP 2.2 | |
| Hive | BUG-33857 | HIVE-10273 | Select * on Table View (with UNION ALL) throws NullPointerException if Tez execution engine is used |
| Hive | BUG-34809 | HIVE-10242 | ACID: insert overwrite prevents create table command |
| Hive | BUG-34872 | HIVE-10559 | Hive tez dynamic pruning throws IndexOutOfBounds exception on certain queries |
| Hive | BUG-34956 | Hive-10677 | Analyze table compute stats for columns, ColumnStatsTask fail when hive.exec.parallel=true (default false) |
| Hive | BUG-35048 | HIVE-10483 | insert overwrite table with self join gets into a deadlock state in ACID DBTxnManager |
| Hive | BUG-35795 | HIVE-10286 | orc ppd does not typecast of string to timestamp when evaluate predicate for timestamp column |
| Hive | BUG-36111 | HIVE-8470 | Orc writer cant handle column of type void |
| Hive | BUG-37304 | HIVE-9950 | Hive query using Cuckoo hashing causing NullPointerException |
| Hive | BUG-37429 | HIVE-9937 | vectorization with ACID table, count(1) fails with ArrayIndexOutOfBounds Exception |
| Hive | BUG-38292 | HIVE-10929 | In Tez mode,dynamic partitioning query with union all fails at moveTask,Invalid partition key & values |
| Hive | BUG-38817 | HIVE-11031 | Hive Alter table, concatenate partition files, throws error |
| Hive | BUG-39159 | HIVE-11027 | Hive Incorrect query results with Bucket Map joins vs Shuffle Joins. |
| Hive | BUG-39868 | HIVE-11051 | Tez Optimized MapJoin: Tables with Array<String> causes task failures |
| Hive | BUG-40036 | PIG-4624 | empty ORC file without schema produced by Hive |
Upgrade
|
Component |
Hortonworks Bug ID |
Apache JIRA |
Summary |
|---|---|---|---|
| HDFS | BUG-34508 | HDFS-8127 | NameNode Failover during HA upgrade can cause DataNode to finalize upgrade that will fail datanode -rollback |
| Hue | BUG-32999 | After upgrading to HDP 2.2 from HDP 2.1. HUE now throws an error when trying to delete users |
Usability
|
Component |
Hortonworks Bug ID |
Apache JIRA |
Summary |
|---|---|---|---|
| Falcon | BUG-34630 | AMBARI-11140 | Falcon UI does not allow login by any user other than ambari-qa |
| Falcon | BUG-35141 | Regression in the Falcon UI; Only 10 results shown for all entities. | |
| Flume | BUG-35598 | FLUME-2095 | JMS source setup fails with "org.apache.flume. FlumeException: Could not lookup ConnectionFactory" |
| HBase | BUG-35338 | HBASE-13555 | HBase web gives a 500 error when you attempt to view Thread Stacks |
| HCatalog | BUG-30186 | HIVE-9381 | Cannot load data into specific Hive table via pig HCatStorer |
| Hive | BUG-23032 | Jars added in Hive shell whilst in Tez mode are not recognized | |
| Hive | BUG-31113 | Hive "SLF4J: Class path contains multiple SLF4J bindings." error | |
| Hive | BUG-31899 | HIVE-10271 | remove hive.server2.thrift.http.min/max.worker.threads properties |
| Hive | BUG-32859 | HIVE-9977 | Hive metastore auto major compaction not happening if data is loaded through dynamic partitioning insert |
| Hive | BUG-33876 | HIVE-10226 | ANALYZE TABLE (compute_stats) UDAF doesn't have Date support |
| Hive | BUG-35285 | HIVE-3682, HIVE-5672 | cannot use separator of choice for Hive export in HDFS |
| Hive | BUG-35511 | hive.support.concurrency= false doesn't turn of Transactions | |
| Hive, Hue | BUG-29899 | HIVE-9223 | HS2/hue/tez: multiple concurrent queries not allowed in single tez session |
| Hue | BUG-32301 | Not able to change Hue users passwords via the Hue UI | |
| Hue | BUG-33632 | Hue 2.6.1-2041 does not allow you to copy data displayed when doing a query | |
| Hue | BUG-33693 | Hue - Enable Parameterization doesn't work | |
| Hue | BUG-35310 | Not able to access/edit the workflow from Oozie Job Designer when the workflow is not in Page 1 | |
| Hue | BUG-38607 | Hue does not respect Support dfs.umaskmode, fs.permissions.umask-mode when creating files or folders | |
| Pig | BUG-29616 | PIG-4381 | On PIG grunt shell DEFINE commands fails when it spans multiple lines. |
| Ranger | BUG-21763 | RANGER-451 | Policy Admin User/Group page doesn't show groups for users when the user belongs to large number of groups |
| Ranger | BUG-22120 | RANGER-244 | Option to disable/hide imported users/groups |
| Ranger | BUG-28060 | RANGER-281 | Support for PostgreSQL as DB server for XA Secure (Ranger, Argus) |
| Ranger | BUG-29900 | RANGER-318 | Not able to add user with only numbers |
| Ranger | BUG-31749 | RANGER-320 | Usersync NPE when object does not have userNameAttribute |
| Ranger | BUG-31782 | RANGER-337 | Ranger gives error when using hyphen or space in name field |
| Ranger | BUG-37467 | AMBARI-10924 | Ambari replaces ranger-admin install.properties with default after every start making it harder to debug |
| Spark | BUG-39567 | SPARK-8383 | Spark History Server shows Last Updated as 1969/12/31 when SparkPI application completed |
| WebHCat | BUG-7691 | Provide/extend API to support table views | |
| YARN | BUG-19508 | YARN-2246 | Job History Link in RM UI is redirecting to the URL which contains Job Id twice |
| YARN | BUG-27558 | YARN-3526 | ResourceManager probe on standby server in HA mode doesn't complete the redirect |
| YARN | BUG-9512 | YARN-2238 | Applications sometimes are not visible in RM web UI |
Performance
|
Component |
Hortonworks Bug ID |
Apache JIRA |
Summary |
|---|---|---|---|
| HDFS | BUG-38249 | HDFS-7435 | PB encoding of block reports is very inefficient |
| Hive | BUG-25165 | HIVE-9709 | Performance Issue Beeline > Knox > HS2 |
| Hive | BUG-33592 | HIVE-9644, HIVE-9645 | case/when query not optimized, partition pruning not happening |
| Hive | BUG-37846 | unix_timestamp non-deterministic causing less performance, current_timestamp not available in HDP 2.2.x | |
| Hive, Tez | BUG-39394 | HIVE-10746 | Mapred.TextInputFormat defaults to 1 byte FileSplits |
| Hue | BUG-33579 | Character Limit in Group Names unable to sync more than 30 characters. | |
| Pig | BUG-33853 | PIG-4488 | Pig on Tez only uses default queue |
| Ranger | BUG-21901 | RANGER-192 | XASecure loading groups for user hang if there are too many groups for the user |
| Ranger | BUG-34139 | Ranger is running out of database connection when looking up user/groups | |
| Tez | BUG-23856 | TEZ-14 | Support for speculative execution of slow tasks |
Other
|
Component |
Hortonworks Bug ID |
Apache JIRA |
Summary |
|---|---|---|---|
| HDFS | BUG-31287 | HDFS-8055 | NullPointerException when topology script is missing. |
| HDP / Stack | BUG-33764 | hdp-select needs to handle user created directories in /usr/hdp | |
| Hue | BUG-26357 | Display Hue server details | |
| Hue | BUG-29981 | Support HiveServer2 HTTP/S transport in hue | |
| Hue | BUG-30145 | Support LDAP authentication via Hue to Hiveserver2 | |
| Hue | BUG-31350 | Hue UTF8 Filter Decoding | |
| Hue | BUG-32315 | Users cannot use the job browser to investigate FAILED jobs. It works for other job types. | |
| Hue | BUG-33469 | Hue - log empty for create and insert statements | |
| Hue | BUG-34408 | hue-plugins.x86_64 has hadoop dependency | |
| Hue | BUG-35047 | Can't see Tez job details from Hue job browser while Tez job is running | |
| Hue | BUG-35847 | Select has a 1024 fd limit. If the FD number goes above 1024 for some reason (long running process), then all apps relying on thrift will fail. | |
| Hue | BUG-36121 | In HUE, clicking on useradmin -> groups gives "NoReverseMatch at /useradmin/groups" if group name with URL encoding crossing 80 characters | |
| Kafka | BUG-32049 | No Kafka Documentation Available at docs.hortonworks.com |