The following features and fixes were contributed back to Apache with the release of HDP 2.3.0.
Potential Data Loss
|
Hortonworks Bug ID |
Apache JIRA |
Component |
Summary |
|---|---|---|---|
| BUG-33249 | HBASE-13576 | HBase | HBCK failed to recover certain regions |
Security
|
Hortonworks Bug ID |
Apache JIRA |
Component |
Summary |
|---|---|---|---|
| BUG-30108 | RANGER-375 | Ranger | Ranger - when backend DB not reachable error thrown is "incorrect password/username" when trying to log into Ranger |
| BUG-30856 | HBASE-11869 | HBase | Support snapshot owner other than Global Admins in Hbase |
| BUG-31425 | Ranger | PolicyManager throws 404 error when creating HBase repo in Ranger | |
| BUG-31545 | Falcon Documentation | Add details of Falcon directory permissions to documentation | |
| BUG-32768 | FALCON-954 | Falcon | Secure Kerberos setup : Falcon should periodically revalidate security credentials. |
| BUG-33278 | HBASE-13239 | HBase | HBASE grants at specific column level does not work for Groups |
| BUG-33338 | HIVE-10528 | Hive | Hiveserver2 in HTTP mode is not applying auth_to_local rules |
| BUG-33621 | Oozie | Clear Text Password Shows In Oozie workflow configuration | |
| BUG-33708 | KNOX-525 | Knox | persisted service registry is not updated to support HA after upgrade |
| BUG-33819 | RANGER-483 | Ranger | Provide an option to create password using alternate message digest algorithm |
| BUG-35992 | HIVE-10875 | Hive | SELECT a.* FROM (SELECT * FROM source_view) a results in permission denied error. |
| BUG-36431 | Knox, Ranger | Found Jersey client API incompatibility that prevent HTTPS Knox from working | |
| BUG-36565 | HBASE-13734 | HBase | deleteall behavior changes after applying org.apache.hadoop.hbase. security.visibility. VisibilityController to HBase |
| BUG-41100 | YARN, HADOOP | Yarn services Tomcat instance upgraded to 6.0.44 |
Incorrect Results
|
Hortonworks Bug ID |
Apache JIRA |
Component |
Summary |
|---|---|---|---|
| BUG-22370 | HIVE-5545 | HCatalog | HCatRecord getInteger method returns String when used on Partition columns of type INT |
| BUG-31914 | HIVE-9278 | Hive | arithmetic operators return incorrect results from certain operand types |
| BUG-33275 | HIVE-8746 | Hive | ORC timestamp columns are sensitive to daylight savings time |
| BUG-34138 | Pig | Receiving exception 'No such file or directory' when using 'pig -useHCatalog' | |
| BUG-34210 | HIVE-9278 | Hive | multiple built-in date functions return incorrect results in same where clause |
| BUG-34506 | PHOENIX-896 | Phoenix | Unable to load tab delimited data via Phoenix |
| BUG-34971 | HIVE-10481 | Hive | ACID table update finishes but values not really updated if column names are not all lower case |
| BUG-36223 | Hive | wrong results for 2 left outer joins with overlapping join on keys, filter IS NULL pushed to left side table wrongly. | |
| BUG-36853 | PIG-4541 | Pig | Skewed full outer join does not return records if any relation is empty. Outer join does not return any record if left relation is empty |
| BUG-37485 | PIG-4556 | Pig | Pig tests abort with Check of prerequisites failed: <Failed running /usr/bin/pig -e fs -ls /> |
| BUG-40100 | HIVE-11104 | Hive | Insert overwrite query does not return expected value |
Stability
|
Hortonworks Bug ID |
Apache JIRA |
Component |
Summary |
|---|---|---|---|
| BUG-21924 | HBASE-13555 | HBase | HBase web gives a 500 error when you attempt to view table details and it's not the master |
| BUG-26984 | OOZIE-1728 | Oozie | Queue configuration is not working for distcp action |
| BUG-29350 | HBASE-12791 | HBase | HBase does not attempt to clean up an aborted SPLIT when the Regions Server is shutting down. |
| BUG-33349 | HBASE-13608 | HBase | 500 Error with Stargate through Knox, using AD, SPNEGO, and Pre-Auth |
| BUG-33488 | KNOX-530 | Knox | Running Oozie jobs through Knox on a cluster with HDFS HA does not use proper namenode host name. |
| BUG-34020 | FALCON-1165 | Falcon | Falcon will fail to start, if a cluster entity that was defined is not reachable. |
| BUG-34175 | HDFS-8072 | HDFS | Non-HDFS disk space is not reclaimed until after Datanode restart |
| BUG-5700 | HDFS | NameNode should shut down if out of memory error occurs |
Query Failure
|
Hortonworks Bug ID |
Apache JIRA |
Component |
Summary |
|---|---|---|---|
| BUG-27636 | HIVE-10500 | Hive | intermittent acid_concurrency test failures due to NoSuchLockException |
| BUG-29427 | HIVE-9235 | Hive | Turn off Parquet Vectorization until all data types work: DECIMAL, DATE, TIMESTAMP, CHAR, and VARCHAR |
| BUG-30038 | HCatalog | Sqoop Import on External Hcatalog Table | |
| BUG-30901 | HIVE-10559 | Hive | with constant propagation off, left join and join, hive.tez.dynamic.partition. pruning throw compile error IndexOutOfBoundsException |
| BUG-33145 | Hive | HS2 HTTP Mode - Beeline Hanging after upgrading from HDP 2.1 to HDP 2.2 | |
| BUG-33857 | HIVE-10273 | Hive | Select * on Table View (with UNION ALL) throws NullPointerException if Tez execution engine is used |
| BUG-34809 | HIVE-10242 | Hive | ACID: insert overwrite prevents create table command |
| BUG-34872 | HIVE-10559 | Hive | Hive tez dynamic pruning throws IndexOutOfBounds exception on certain queries |
| BUG-34956 | Hive-10677 | Hive | Analyze table compute stats for columns, ColumnStatsTask fail when hive.exec.parallel=true (default false) |
| BUG-35048 | HIVE-10483 | Hive | insert overwrite table with self join gets into a deadlock state in ACID DBTxnManager |
| BUG-35795 | HIVE-10286 | Hive | orc ppd does not typecast of string to timestamp when evaluate predicate for timestamp column |
| BUG-36111 | HIVE-8470 | Hive | Orc writer cant handle column of type void |
| BUG-37304 | HIVE-9950 | Hive | Hive query using Cuckoo hashing causing NullPointerException |
| BUG-37429 | HIVE-9937 | Hive | vectorization with ACID table, count(1) fails with ArrayIndexOutOfBounds Exception |
| BUG-38292 | HIVE-10929 | Hive | In Tez mode,dynamic partitioning query with union all fails at moveTask,Invalid partition key & values |
| BUG-38817 | HIVE-11031 | Hive | Hive Alter table, concatenate partition files, throws error |
| BUG-39159 | HIVE-11027 | Hive | Hive Incorrect query results with Bucket Map joins vs Shuffle Joins. |
| BUG-39868 | HIVE-11051 | Hive | Tez Optimized MapJoin: Tables with Array<String> causes task failures |
| BUG-40036 | PIG-4624 | Hive | empty ORC file without schema produced by Hive |
Upgrade
|
Hortonworks Bug ID |
Apache JIRA |
Component |
Summary |
|---|---|---|---|
| BUG-34508 | HDFS-8127 | HDFS | NameNode Failover during HA upgrade can cause DataNode to finalize upgrade that will fail datanode -rollback |
Usability
|
Hortonworks Bug ID |
Apache JIRA |
Component |
Summary |
|---|---|---|---|
| BUG-19508 | YARN-2246 | YARN | Job History Link in RM UI is redirecting to the URL which contains Job Id twice |
| BUG-21763 | RANGER-451 | Ranger | Policy Admin User/Group page doesn't show groups for users when the user belongs to large number of groups |
| BUG-22120 | RANGER-244 | Ranger | Option to disable/hide imported users/groups |
| BUG-23032 | Hive | Jars added in Hive shell whilst in Tez mode are not recognized | |
| BUG-27558 | YARN-3526 | YARN | ResourceManager probe on standby server in HA mode doesn't complete the redirect |
| BUG-28060 | RANGER-281 | Ranger | Support for PostgreSQL as DB server for XA Secure (Ranger, Argus) |
| BUG-29616 | PIG-4381 | Pig | On PIG grunt shell DEFINE commands fails when it spans multiple lines. |
| BUG-29899 | HIVE-9223 | Hive | HS2/tez: multiple concurrent queries not allowed in single tez session |
| BUG-29900 | RANGER-318 | Ranger | Not able to add user with only numbers |
| BUG-30186 | HIVE-9381 | HCatalog | Cannot load data into specific Hive table via pig HCatStorer |
| BUG-31113 | Hive | Hive "SLF4J: Class path contains multiple SLF4J bindings." error | |
| BUG-31749 | RANGER-320 | Ranger | Usersync NPE when object does not have userNameAttribute |
| BUG-31782 | RANGER-337 | Ranger | Ranger gives error when using hyphen or space in name field |
| BUG-31899 | HIVE-10271 | Hive | remove hive.server2.thrift.http.min/max.worker.threads properties |
| BUG-32859 | HIVE-9977 | Hive | Hive metastore auto major compaction not happening if data is loaded through dynamic partitioning insert |
| BUG-33876 | HIVE-10226 | Hive | ANALYZE TABLE (compute_stats) UDAF doesn't have Date support |
| BUG-35141 | Falcon | Regression in the Falcon UI; Only 10 results shown for all entities. | |
| BUG-35285 | HIVE-3682, HIVE-5672 | Hive | cannot use separator of choice for Hive export in HDFS |
| BUG-35338 | HBASE-13555 | HBase | HBase web gives a 500 error when you attempt to view Thread Stacks |
| BUG-35511 | Hive | hive.support.concurrency= false doesn't turn of Transactions | |
| BUG-35598 | FLUME-2095 | Flume | JMS source setup fails with "org.apache.flume. FlumeException: Could not lookup ConnectionFactory" |
| BUG-39567 | SPARK-8383 | Spark | Spark History Server shows Last Updated as 1969/12/31 when SparkPI application completed |
| BUG-7691 | WebHCat | Provide/extend API to support table views | |
| BUG-9512 | YARN-2238 | YARN | Applications sometimes are not visible in RM web UI |
Performance
|
Hortonworks Bug ID |
Apache JIRA |
Component |
Summary |
|---|---|---|---|
| BUG-21901 | RANGER-192 | Ranger | XASecure loading groups for user hang if there are too many groups for the user |
| BUG-23856 | TEZ-14 | Tez | Support for speculative execution of slow tasks |
| BUG-25165 | HIVE-9709 | Hive | Performance Issue Beeline > Knox > HS2 |
| BUG-33592 | HIVE-9644, HIVE-9645 | Hive | case/when query not optimized, partition pruning not happening |
| BUG-33853 | PIG-4488 | Pig | Pig on Tez only uses default queue |
| BUG-34139 | Ranger | Ranger is running out of database connection when looking up user/groups | |
| BUG-37846 | Hive | unix_timestamp non-deterministic causing less performance, current_timestamp not available in HDP 2.2.x | |
| BUG-38249 | HDFS-7435 | HDFS | PB encoding of block reports is very inefficient |
| BUG-39394 | HIVE-10746 | Hive, Tez | Mapred.TextInputFormat defaults to 1 byte FileSplits |
Other
|
Hortonworks Bug ID |
Apache JIRA |
Component |
Summary |
|---|---|---|---|
| BUG-31287 | HDFS-8055 | HDFS | NullPointerException when topology script is missing. |
| BUG-33764 | HDP / Stack | hdp-select needs to handle user created directories in /usr/hdp |
