Fixed Issues
Important | |
---|---|
Hortonworks strongly recommends that all users running HDP 2.3.4 upgrade to HDP 2.3.4.7. |
Fixed issues represents selected issues that were previously logged via Hortonworks Support, but are now addressed in the current release. These issues may have been reported in previous versions within the Known Issues section; meaning they were reported by customers or identified by Hortonworks Quality Engineering team.
Potential Data Loss
None.
Security
Hortonworks Bug ID |
Apache JIRA |
Component |
Summary |
---|---|---|---|
BUG-28778 | HIVE-9013 | Hive | Hive set command exposes metastore db password |
BUG-35952 | RANGER-680 | Ranger | Default policies for KMS repo |
BUG-44378 | RANGER-657 | Ranger | Ranger-Solr: Issue with Mapping Principals to user names "solr" |
BUG-45035 | RANGER-661 | Ranger | Plugin receives empty policy list though the service has policies |
BUG-45039 | RANGER-663 | Ranger | Race condition during policy update causes policy to get in an bad state |
BUG-45431 | HDFS-9175 | HDFS | Change scope of 'AccessTokenProvider.getAccessToken()' and 'CredentialBasedAccessTokenProvider.getCredential()' abstract methods to public |
BUG-45489 | HIVE-11995 | Hive | Remove repetitively setting permissions in insert/load overwrite partition |
BUG-45948 | Kafka | Command line script to recursively change zookeeper ACLs for Kafka zookeeper znodes | |
BUG-46149 | HIVE-10528 | Hive | Hiveserver2 in HTTP mode is not applying auth_to_local rules |
BUG-46207 | FALCON-1027 | Falcon | Added trusted proxy support to the Falcon REST API |
BUG-46556 | RANGER-714 | Ranger | Restrict group and role data for only ADMIN users |
BUG-47553 | RANGER-608 | Ranger | Denied access to HDFS file/directory is not audited in Ranger |
BUG-47606 | RANGER-749 | Ranger | Ranger KMS to support multiple KMS instances with keys across multiple clusters |
BUG-47791 | Hue | Django Vulnerabilities in Hue | |
BUG-47823 | HADOOP-12049 | Hadoop Common | Control http authentication cookie persistence via configuration. HADOOP-12049 introduces a new configuration setting to control the persistence of the HTTP cookie passed to the client during authentication with Hadoop HTTP consoles. |
BUG-49158 | HADOOP-12617 | Hadoop Common | SPNEGO authentication request to non-default realm gets default realm name inserted in target server principal |
Incorrect Results
Hortonworks Bug ID |
Apache JIRA |
Component |
Summary |
---|---|---|---|
BUG-41313 | HIVE-11432 | Hive | Hive macro give same result for different arguments |
BUG-44489 | HIVE-11892 | Hive | UDTF run in local fetch task does not return rows forwarded during GenericUDTF.close() |
BUG-44539 | SQOOP-2399 | Sqoop | Sqoop import into HBase - BigDecimalSplitter java.lang.ArrayIndexOutOfBoundsException |
BUG-45496 | HIVE-11517 | Hive | Vectorized auto_smb_mapjoin_14.q produces different results |
BUG-45582 | Hue | Cluster running Hue 2.6.1 Null values are being returned as 'None' and they are converted to blank value while exporting as CSV file | |
BUG-46167 | PHOENIX-2313 | Phoenix | org.apache.phoenix.schema.TypeMismatchException Error while querying a table that has an index with a Boolean |
BUG-46507 | HIVE-12230 | Hive | custom UDF configure() not called in Vectorization mode |
BUG-47209 | Ranger | check_db_connnection in Ambari setup_ranger.py does not properly escape before passing to shell |
Stability
Hortonworks Bug ID |
Apache JIRA |
Component |
Summary |
---|---|---|---|
BUG-26978 | HDFS-6481 | HDFS | DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs |
BUG-27659 | HIVE-12556 | Hive | Ctrl-C in beeline doesn't kill Tez query on HS2 |
BUG-30068 | HIVE-12444 | Hive | Global Limit optimization on ACID table without base directory may throw exception |
BUG-42203 | HIVE-11499 | Hive | Datanucleus leaks classloaders when used using embedded metastore with HiveServer2 with UDFs |
BUG-42415 | HIVE-11422 | Hive | Join a ACID table with non-ACID table fail with MR |
BUG-43592 | HIVE-12204 | Hive | Tez queries stopped running with ApplicationNotRunningException |
BUG-43603 | HIVE-12262 | Hive | Session log dir cannot be created in some cases |
BUG-44212 | HIVE-12084 | Hive | Hive queries with ORDER BY and large LIMIT fails with OutOfMemoryError Java heap space |
BUG-44549 | PHOENIX-2118 | Phoenix | Remove/modify usages of Guava StopWatch and deprecated ComparisonChain methods |
BUG-45090 | ZOOKEEPER-1952 | ZooKeeper | zookeeper.log.file property is not respected; log output goes only to the zookeeper.out |
BUG-45179 | PIG-4635 | Pig, Tez | Pig 0.15 on Tez 0.7 NPE |
BUG-45238 | HADOOP-12089 | Hadoop Common | StorageException complaining "no lease ID" when updating FolderLastModifiedTime in WASB |
BUG-45240 | HADOOP-12239 | Hadoop Common | StorageException complaining "no lease ID" when updating FolderLastModifiedTime in WASB |
BUG-45346 | Kafka | Sleep value for KILL command is set to 0.1 in install_kafka.sh | |
BUG-45361 | HBASE-14594 | HBase | Use new DNS API introduced in HADOOP-12437 |
BUG-45465 | HIVE-11977 | Hive | Hive should handle an external avro table with zero length files present |
BUG-45664 | Kafka | Memory leak in Kafka Broker caused by leak in instance of ConcurrentHashMap/socketContainer | |
BUG-45688 | KAFKA-2012 | Kafka | Kafka index file corruption |
BUG-45717 | STORM-1030 | Storm | Synchronization error between HiveBolt and heartbeat thread causing missed HiveWriter |
BUG-45943 | HBASE-14207 | HBase | Region was hijacked and remained in transition when RS failed to open a region and later regionplan changed to new RS on retry |
BUG-45952 | HBASE-14317 | HBase | Stuck FSHLog: bad disk (HDFS-8960) and can't roll WAL |
BUG-45955 | HBASE-14361 | HBase | ReplicationSink should create Connection instances lazily |
BUG-46328 | YARN-2910 | YARN | FSLeafQueue can throw ConcurrentModificationException |
BUG-46607 | HADOOP-12484 | Hadoop Common | Single File Rename Throws Incorrectly In Potential Race Condition Scenarios |
BUG-47136 | HADOOP-11685 | Hadoop Common | StorageException complaining "no lease ID" during HBase distributed log splitting |
BUG-47179 | HADOOP-12508 | Hadoop Common | Delete fails with exception when lease is held on blob |
BUG-47180 | HADOOP-12533 | Hadoop Common | Introduce FileNotFoundException in WASB for read and seek API |
BUG-47480 | FALCON-1595 | Falcon | Falcon server loses ability to communicate with HDFS over time |
BUG-47483 | HIVE-11698 | Hive | Add additional test for PointLookupOptimizer |
BUG-47563 | HIVE-12364 | Hive | Distcp job fails when run under Tez |
BUG-47757 | HIVE-12156 | Hive, Hive View | expanding view doesn't quote reserved keyword |
BUG-47910 | HIVE-12250 | Hive | ZooKeeper connection leaks in Hive's HBaseHandler. |
BUG-48437 | HIVE-12476 | Hive | Metastore NPE on Oracle with Direct SQL |
BUG-49159 | STORM-1030 | Storm | Storm HiveBolt sendHeartBeat flag is set to false after connectivity is lost with Hive database, causing heartbeats to stop until worker is restarted |
Query Failure
None.
Upgrade
Hortonworks Bug ID |
Apache JIRA |
Component |
Summary |
---|---|---|---|
BUG-44874 | RANGER-677 | Ranger | After upgrade, Ranger Admin fails to render policies referring to groups that contain "." in name |
BUG-44884 | RANGER-706 | Ranger | 2.2 to 2.3 upgrade timeout while migrating Ranger |
BUG-46275 | AMBARI-13578 | Ambari, Ranger | Hive Server Start times out due to ranger http calls |
BUG-46387 | Ambari, Ranger | Upgrade: Ranger needs ldap bind password after upgrade | |
BUG-46390 | Ambari, Ranger | Patched Ranger fails during RU | |
BUG-48155 | AMBARI-14153 | Ranger | Handle install failures/patch status during ranger upgrade and make detailed logs available |
Usability
Hortonworks Bug ID |
Apache JIRA |
Component |
Summary |
---|---|---|---|
BUG-38913 | AMBARI-11634 | Kafka | Kafka Service Check seems to complete successfully, however the stdout indicates an error creating a previously created topic |
BUG-43333 | YARN-4009, YARN-2513 | Tez, YARN | Functional standalone UI (hosted in ATS) for Tez |
BUG-43578 | HIVE-11919 | Hive | Hive Union Type Mismatch |
BUG-44481 | HDFS-9082 | HDFS | Change the log level in WebHdfsFileSystem.initialize() from INFO to DEBUG |
BUG-44568 | YARN-291, YARN-313 | YARN | Support NM resource dynamic reconfiguration with CLI. |
BUG-45264 | HADOOP-12437 | HDFS | HDFS and YARN configs for Kerberized Dual Homing |
BUG-45396 | ATLAS-198 | Atlas | Atlas Dashboard Requires Internet Connectivity |
BUG-45569 | HIVE-12235 | Hive | Improve beeline logging for dynamic service discovery |
BUG-45583 | HIVE-11960 | Hive | braces in join conditions are not supported |
BUG-45722 | HADOOP-12350 | Hadoop Common | WASB Logging: Improve WASB Logging around deletes, reads and writes |
BUG-47306 | RANGER-712 | Ranger | Add a samples project to Ranger to enable clients and VARs to write extensions to Ranger |
BUG-47475 | HIVE-10592 | Hive | ORC file dump in JSON format |
BUG-48014 | HDFS-8829 | HDFS | Make SO_RCVBUF and SO_SNDBUF size configurable for DataTransferProtocol sockets and allow configuring auto-tuning |
BUG-48022 | STORM-1203 | Storm | Worker metadata file creation doesn't use storm.log.dir config |
BUG-48187 | MAPREDUCE-6478 | MapReduce | Add an option to skip cleanupJob stage or ignore cleanup failure during commitJob(). |
BUG-49030 | Hue | No “permission denied” message is displayed in hue file browser when user with no permissions uploads a file. |
Performance
Hortonworks Bug ID |
Apache JIRA |
Component |
Summary |
---|---|---|---|
BUG-44879 | RANGER-681 | Ranger | Usersync interval between cycles is set to 1ms |
BUG-46319 | PIG-4703 | Pig | TezOperator.stores shall not ship to backend |
BUG-47415 | HIVE-12354 | Hive | MapJoin with double keys is slow on MR |
BUG-47481 | HIVE-11461 | Hive | Transform flat AND/OR into IN struct clause |
BUG-47485 | HIVE-11573 | Hive | PointLookupOptimizer can be pessimistic at a low nDV |
BUG-47904 | HIVE-12312 | Hive | Excessive logging in PPD code |
Other
Hortonworks Bug ID |
Apache JIRA |
Component |
Summary |
---|---|---|---|
BUG-44329 | HDFS-9063 | HDFS | HDFS - Correctly handle snapshot path for getContentSummary |
BUG-44544 | HADOOP-11098 | Hadoop Common | Max Non Heap Memory default changed between JDK7 and 8 |
BUG-45083 | HIVE-10752 | HCatalog, Pig | Pig scripts that involve more than 66 columns return null results when MapReduce is the execution engine. |
BUG-45687 | Kafka | kafka.out is not rotating causing it to grow very large in size | |
BUG-46243 | AMBARI-12678 | Ambari, Kafka | Installing additional Kafka broker on node with hostname that comes alphabetically before existing broker fails to start |
BUG-47431 | HADOOP-12334 | Hadoop Common | Change Mode Of Copy Operation of HBase WAL Archiving to bypass Azure Storage Throttling after retries |
BUG-47612 | HADOOP-12551 | Hadoop Common | Introduce FileNotFoundException for open and getFileStatus API's in WASB |
BUG-47731 | HDFS-8099 | HDFS | Change "DFSInputStream has been closed already" message to debug log level |
BUG-47820 | HBASE-14788 | HBase | Splitting a region does not support the hbase.rs.evictblocksonclose config when closing source region |
BUG-49167 | HDFS-9434 | HDFS | Recommission a datanode with 500k blocks may pause NN for 30 seconds |
BUG-49324 | HDFS-9397 | HDFS | Fix typo for readChecksum() LOG.warn in BlockSender.java |
BUG-49952 | YARN | Backport YARN-3604/YARN-3987 to 2.3-maint |