Provides Database Connection Pooling Service for Apache Hive 3.x. Connections can be asked from pool and returned after usage.
hive, dbcp, jdbc, database, connection, pooling, store
In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.
| Display Name | API Name | Default Value | Allowable Values | Description |
|---|---|---|---|---|
| Database Connection URL | hive-db-connect-url | A database connection URL used to connect to a database. May contain database system name, host, port, database name and some parameters. The exact syntax of a database connection URL is specified by the Hive documentation. For example, the server principal is often included as a connection parameter when connecting to a secure Hive server. Supports Expression Language: true (will be evaluated using variable registry only) | ||
| Hive Configuration Resources | hive-config-resources | A file or comma separated list of files which contains the Hive configuration (hive-site.xml, e.g.). Without this, Hadoop will search the classpath for a 'hive-site.xml' file or will revert to a default configuration. Note that to enable authentication with Kerberos e.g., the appropriate properties must be set in the configuration files. Please see the Hive documentation for more details. This property expects a comma-separated list of file resources. Supports Expression Language: true (will be evaluated using variable registry only) | ||
| Database User | hive-db-user | Database user name Supports Expression Language: true (will be evaluated using variable registry only) | ||
| Password | hive-db-password | The password for the database user Sensitive Property: true Supports Expression Language: true (will be evaluated using variable registry only) | ||
| Max Wait Time | hive-max-wait-time | 500 millis | The maximum amount of time that the pool will wait (when there are no available connections) for a connection to be returned before failing, or -1 to wait indefinitely. Supports Expression Language: true (will be evaluated using variable registry only) | |
| Max Total Connections | hive-max-total-connections | 8 | The maximum number of active connections that can be allocated from this pool at the same time, or negative for no limit. Supports Expression Language: true (will be evaluated using variable registry only) | |
| Validation query | Validation-query | Validation query used to validate connections before returning them. When a borrowed connection is invalid, it gets dropped and a new valid connection will be returned. NOTE: Using validation may have a performance penalty. Supports Expression Language: true (will be evaluated using variable registry only) | ||
| Minimum Idle Connections | dbcp-min-idle-conns | 0 | The minimum number of connections that can remain idle in the pool, without extra ones being created, or zero to create none. Supports Expression Language: true (will be evaluated using variable registry only) | |
| Max Idle Connections | dbcp-max-idle-conns | 8 | The maximum number of connections that can remain idle in the pool, without extra ones being released, or negative for no limit. Supports Expression Language: true (will be evaluated using variable registry only) | |
| Max Connection Lifetime | dbcp-max-conn-lifetime | -1 | The maximum lifetime in milliseconds of a connection. After this time is exceeded the connection will fail the next activation, passivation or validation test. A value of zero or less means the connection has an infinite lifetime. Supports Expression Language: true (will be evaluated using variable registry only) | |
| Time Between Eviction Runs | dbcp-time-between-eviction-runs | -1 | The number of milliseconds to sleep between runs of the idle connection evictor thread. When non-positive, no idle connection evictor thread will be run. Supports Expression Language: true (will be evaluated using variable registry only) | |
| Minimum Evictable Idle Time | dbcp-min-evictable-idle-time | 30 mins | The minimum amount of time a connection may sit idle in the pool before it is eligible for eviction. Supports Expression Language: true (will be evaluated using variable registry only) | |
| Soft Minimum Evictable Idle Time | dbcp-soft-min-evictable-idle-time | -1 | The minimum amount of time a connection may sit idle in the pool before it is eligible for eviction by the idle connection evictor, with the extra condition that at least a minimum number of idle connections remain in the pool. When the not-soft version of this option is set to a positive value, it is examined first by the idle connection evictor: when idle connections are visited by the evictor, idle time is first compared against it (without considering the number of idle connections in the pool) and then against this soft option, including the minimum idle connections constraint. Supports Expression Language: true (will be evaluated using variable registry only) | |
| Kerberos Credentials Service | kerberos-credentials-service | Controller Service API: KerberosCredentialsService Implementation: KeytabCredentialsService | Specifies the Kerberos Credentials Controller Service that should be used for authenticating with Kerberos | |
| Kerberos Principal | Kerberos Principal | Kerberos principal to authenticate as. Requires nifi.kerberos.krb5.file to be set in your nifi.properties Supports Expression Language: true (will be evaluated using variable registry only) | ||
| Kerberos Keytab | Kerberos Keytab | Kerberos keytab associated with the principal. Requires nifi.kerberos.krb5.file to be set in your nifi.properties This property requires exactly one file to be provided.. Supports Expression Language: true (will be evaluated using variable registry only) | ||
| Kerberos Password | Kerberos Password | Kerberos password associated with the principal. Sensitive Property: true |