8.6. Hive Known Issues

  • BUG-28161, BUG-28234: Hive Server2 Long running test failed after 44 hours with OutOfMemory

    Problem: Hive Server 2 out of memory due to FileSystem.CACHE leak

    Workaround: To prevent memory leaks in unsecure mode, disable file system caches by setting the following parameters to true in hive configuration (hive-site.xml).

    fs.hdfs.impl.disable.cache – Disable HDFS filesystem cache, default false.

    fs.file.impl.disable.cache – Disable local filesystem cache, default false.

  • BUG-27913 Error while upgrading Hive Metastore schema for Oracle

    Problem: The pre-upgrade script causes an error when upgrading Hive Metastore using an Oracle DB. For example, after executing the command -upgradeSchema, the following error message occurs:

    root@ip-172-31-42-3 ~# /usr/hdp/2.2.0.0-2036/hive/bin/schematool -
    upgradeSchema -dbType oracle
    14/11/17 14:11:38 WARN conf.HiveConf: HiveConf of name 
    hive.optimize.mapjoin.mapreduce does not exist
    14/11/17 14:11:38 WARN conf.HiveConf: HiveConf of name hive.heapsize 
    does not exist
    14/11/17 14:11:38 WARN conf.HiveConf: HiveConf of name 
    hive.server2.enable.impersonation does not exist
    14/11/17 14:11:38 WARN conf.HiveConf: HiveConf of name 
    hive.semantic.analyzer.factory.impl does not exist
    14/11/17 14:11:38 WARN conf.HiveConf: HiveConf of name 
    hive.auto.convert.sortmerge.join.noconditionaltask does not exist
    Metastore connection URL:  jdbc:oracle:thin:@//ip-172-31-42-
    1.ec2.internal:1521/XE 
    Metastore Connection Driver :  oracle.jdbc.driver.OracleDriver 
    Metastore connection User:  hiveuser 
    Starting upgrade metastore schema from version 0.13.0 to 0.14.0
    Upgrade script upgrade-0.13.0-to-0.14.0.oracle.sql
    Error: ORA-00955: name is already used by an existing object 
    (state=42000,code=955)
    Warning in pre-upgrade script pre-0-upgrade-0.13.0-to-
    0.14.0.oracle.sql: Schema script failed, errorcode 2
    Completed upgrade-0.13.0-to-0.14.0.oracle.sql
    schemaTool completed

    Workaround: Ignore the error message. The schema tool has upgraded.

  • BUG-27637: Postgres Metastore has intermittent test failure due to "ERROR: could not serialize access due to read/write dependencies among transactions"

    Problem: Sometimes the acid_concurrency test on Postgres Metastore test fails with this error:

    ERROR: could not serialize access due to read/write dependencies among transactions
    Detail: Reason code: Canceled on identification as a pivot, during write. 
    Hint: The transaction might succeed if retried. 
    at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2198) 
    at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1927) 
    [...]
    ERROR: could not serialize access due to read/write dependencies among transactions
    Detail: Reason code: Canceled on identification as a pivot, during write. 
    Hint: The transaction might succeed if retried. 
    org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2198) 
    org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1927) 
    [...]
    ERROR [HiveServer2-Background-Pool: Thread-392]: SessionState (SessionState.java:printError(833)) - Execution has failed.
    2014-11-12 08:40:57,813 
    INFO  [HiveServer2-Background-Pool: Thread-392]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) 
    [...]
    ERROR [HiveServer2-Background-Pool: Thread-392]: ql.Driver (SessionState.java:printError(833)) - FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask
    2014-11-12 08:40:57,869 
    INFO  [HiveServer2-Background-Pool: Thread-392]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135))
    [...]
  • BUG-27636 Oracle Metastore: intemittent acid_concurrency test failures due to NoSuchLockException

    ERROR [HiveServer2-Background-Pool: Thread-1229]: 
    metastore.RetryingHMSHandler (RetryingHMSHandler.java:invoke(141)) - 
    NoSuchLockException(message:No such lock: 59) at org.apache.hadoop.hive.metastore.txn.
    TxnHandler.heartbeatLock(TxnHandler.java:1532) at org.apache.hadoop.hive.metastore.txn.
    TxnHandler.heartbeat(TxnHandler.java:608)
    [...]

  • BUG-27197: MatchPath not available in HDP 2.2.

    Intellectual property issues prevent Hortonworks from shipping MatchPath in Hive 0.14.x.

  • BUG-26418: SSLv3 not supported in Hive 0.14.x

    Problem: SSLv3 is vulnerable to the Poodle Attack and is therefore disabled in Hive 0.14.x. Do not enable SSLv3 in Hive.