Service Dependencies in Cloudera Manager
The following tables list service dependencies that exist between various services in a Cloudera Manager deployment. As you configure services for Cloudera Manager, refer to the tables below for the appropriate version.
Service dependencies for Spark 2 on YARN and Cloudera Data Science Workbench are listed separately.
Version 6.2 Service Dependencies
| Service | Dependencies | Optional Dependencies |
|---|---|---|
| ADLS Connector | ||
| AWS S3 | ||
| Data Context Connector | ||
| Flume |
|
|
| HBase |
|
|
| HDFS |
|
|
| Hive | YARN |
|
| Hue |
|
|
| Impala |
|
|
| Kafka | ZooKeeper | Sentry |
| Key-Value Store Indexer |
|
Sentry |
| Oozie | YARN |
|
| Sentry | HDFS or Isilon | ZooKeeper |
| Solr |
|
Sentry |
| Spark on YARN | YARN | HBase |
| YARN | HDFS or Isilon | ZooKeeper |
| ZooKeeper |
Version 6.1 Service Dependencies
| Service | Dependencies | Optional Dependencies |
|---|---|---|
| ADLS Connector | ||
| AWS S3 | ||
| Data Context Connector | ||
| Flume |
|
|
| HBase |
|
|
| HDFS |
|
|
| Hive | YARN |
|
| Hue |
|
|
| Impala |
|
|
| Kafka | ZooKeeper | Sentry |
| Key-Value Store Indexer |
|
Sentry |
| Kudu | ||
| Oozie | YARN |
|
| Sentry | HDFS or Isilon | ZooKeeper |
| Solr |
|
Sentry |
| YARN | HDFS or Isilon | ZooKeeper |
| ZooKeeper |
Version 6.0 Service Dependencies
| Service | Dependencies | Optional Dependencies |
|---|---|---|
| Accumulo C6 |
|
|
| ADLS Connector | ||
| AWS S3 | ||
| Data Context Connector | ||
| Flume |
|
|
| HBase |
|
|
| HDFS |
|
|
| Hive | YARN |
|
| Hue |
|
|
| Impala |
|
|
| Kafka | ZooKeeper | Sentry |
| Key Trustee | ZooKeeper | |
| KMS | ||
| Key-Value Store Indexer |
|
Sentry |
| Kudu | ||
| Luna KMS | ZooKeeper | |
| Oozie | YARN |
|
| Sentry | HDFS or Isilon | ZooKeeper |
| Solr |
|
Sentry |
| Spark on YARN | YARN | HBase |
| Sqoop Client | ||
| Thales KMS | ZooKeeper | |
| YARN | HDFS or Isilon | ZooKeeper |
| ZooKeeper |
Version 5.16 Service Dependencies
| Service | Dependencies | Optional Dependencies |
|---|---|---|
| ADLS Connector | ||
| AWS S3 | ||
| Data Context Connector | ||
| Flume |
|
|
| HBase |
|
|
| HDFS |
|
|
| Hive | MapReduce or YARN |
|
| Hue |
|
|
| Impala |
|
|
| Key-Value Store Indexer |
|
Sentry |
| Kudu | ||
| MapReduce | HDFS or Isilon | ZooKeeper |
| Oozie | MapReduce or YARN |
|
| Sentry | HDFS or Isilon | ZooKeeper |
| Solr |
|
Sentry |
| Sqoop | MapReduce or YARN | |
| YARN | HDFS or Isilon | ZooKeeper |
| ZooKeeper |
Version 5.15 Service Dependencies
| Service | Dependencies | Optional Dependencies |
|---|---|---|
| ADLS Connector | ||
| AWS S3 | ||
| Data Context Connector | ||
| Flume |
|
|
| HBase |
|
|
| HDFS |
|
|
| Hive | MapReduce or YARN |
|
| Hue |
|
|
| Impala |
|
|
| Key-Value Store Indexer |
|
Sentry |
| MapReduce | HDFS or Isilon | ZooKeeper |
| Oozie | MapReduce or YARN |
|
| Sentry | HDFS or Isilon | ZooKeeper |
| Solr |
|
Sentry |
| Sqoop | MapReduce or YARN | |
| YARN | HDFS or Isilon | ZooKeeper |
| ZooKeeper |
Version 5.14 Service Dependencies
| Service | Dependencies | Optional Dependencies |
|---|---|---|
| ADLS Connector | ||
| AWS S3 | ||
| Data Context Connector | ||
| Flume |
|
|
| HBase |
|
|
| HDFS |
|
|
| Hive | MapReduce or YARN |
|
| Hue |
|
|
| Impala |
|
|
| Key-Value Store Indexer |
|
Sentry |
| MapReduce | HDFS or Isilon | ZooKeeper |
| Oozie | MapReduce or YARN |
|
| Sentry | HDFS or Isilon | ZooKeeper |
| Solr |
|
Sentry |
| Sqoop | MapReduce or YARN | |
| YARN | HDFS or Isilon | ZooKeeper |
| ZooKeeper |
Version 5.13 Service Dependencies
| Service | Dependencies | Optional Dependencies |
|---|---|---|
| AWS S3 | ||
| Data Context Connector | ||
| Flume |
|
|
| HBase |
|
|
| HDFS |
|
|
| Hive | MapReduce or YARN |
|
| Hue |
|
|
| Impala |
|
|
| Key-Value Store Indexer |
|
|
| MapReduce | HDFS or Isilon | ZooKeeper |
| Oozie | MapReduce or YARN |
|
| Sentry | HDFS or Isilon | ZooKeeper |
| Solr |
|
Sentry |
| Sqoop | MapReduce or YARN | |
| YARN | HDFS or Isilon | ZooKeeper |
| ZooKeeper |
Version 5.12 Service Dependencies
| Service | Dependencies | Optional Dependencies |
|---|---|---|
| AWS S3 | ||
| Flume |
|
|
| HBase |
|
|
| HDFS |
|
|
| Hive | MapReduce or YARN |
|
| Hue |
|
|
| Impala |
|
|
| Key-Value Store Indexer |
|
|
| MapReduce | HDFS or Isilon | ZooKeeper |
| Oozie | MapReduce or YARN |
|
| Sentry | HDFS or Isilon | ZooKeeper |
| Solr |
|
Sentry |
| Sqoop | MapReduce or YARN | |
| Thales KMS | ZooKeeper | |
| YARN | HDFS or Isilon | ZooKeeper |
| ZooKeeper |
Version 5.11.2 Service Dependencies
| Service | Dependencies | Optional Dependencies |
|---|---|---|
| AWS S3 | ||
| Flume |
|
|
| HBase |
|
|
| HDFS |
|
|
| Hive | MapReduce or YARN |
|
| Hue |
|
|
| Impala |
|
|
| Key-Value Store Indexer |
|
|
| MapReduce | HDFS or Isilon | ZooKeeper |
| Oozie | MapReduce or YARN |
|
| Sentry | HDFS or Isilon | ZooKeeper |
| Solr |
|
Sentry |
| Sqoop | MapReduce or YARN | |
| YARN | HDFS or Isilon | ZooKeeper |
| ZooKeeper |
Version 5.11.0 Service Dependencies
| Service | Dependencies | Optional Dependencies |
|---|---|---|
| AWS S3 | ||
| Flume |
|
|
| HBase |
|
|
| HDFS |
|
|
| Hive | MapReduce or YARN |
|
| Hue |
|
|
| Impala |
|
|
| Key-Value Store Indexer |
|
|
| Kudu | ||
| MapReduce | HDFS or Isilon | ZooKeeper |
| Oozie | MapReduce or YARN |
|
| Sentry | HDFS or Isilon | ZooKeeper |
| Solr |
|
Sentry |
| Spark on YARN | YARN | HBase |
| Sqoop | MapReduce or YARN | |
| YARN | HDFS or Isilon | ZooKeeper |
| ZooKeeper |
Version 5.10.3 Service Dependencies
| Service | Dependencies | Optional Dependencies |
|---|---|---|
| AWS S3 | ||
| Flume |
|
|
| HBase |
|
|
| HDFS |
|
|
| Hive | MapReduce or YARN |
|
| Hue |
|
|
| Impala |
|
|
| Key-Value Store Indexer |
|
|
| MapReduce | HDFS or Isilon | ZooKeeper |
| Oozie | MapReduce or YARN |
|
| Sentry | HDFS or Isilon | ZooKeeper |
| Solr |
|
Sentry |
| Sqoop | MapReduce or YARN | |
| YARN | HDFS or Isilon | ZooKeeper |
| ZooKeeper |
Version 5.10 Service Dependencies
| Service | Dependencies | Optional Dependencies |
|---|---|---|
| AWS S3 | ||
| Flume |
|
|
| HBase |
|
|
| HDFS |
|
|
| Hive | MapReduce or YARN |
|
| Hue |
|
|
| Impala |
|
|
| Key-Value Store Indexer |
|
|
| MapReduce | HDFS or Isilon | ZooKeeper |
| Oozie | MapReduce or YARN |
|
| Sentry | HDFS or Isilon | ZooKeeper |
| Solr |
|
Sentry |
| Sqoop | MapReduce or YARN | |
| YARN | HDFS or Isilon | ZooKeeper |
| ZooKeeper |
Version 5.9 Service Dependencies
| Service | Dependencies | Optional Dependencies |
|---|---|---|
| Flume |
|
|
| HBase |
|
|
| HDFS |
|
|
| Hive | MapReduce or YARN |
|
| Hue |
|
|
| Impala |
|
|
| Key-Value Store Indexer |
|
|
| MapReduce | HDFS or Isilon | ZooKeeper |
| Oozie | MapReduce or YARN |
|
| Sentry | HDFS or Isilon | ZooKeeper |
| Solr |
|
Sentry |
| Sqoop | MapReduce or YARN | |
| YARN | HDFS or Isilon | ZooKeeper |
| ZooKeeper |
Version 5.8 Service Dependencies
| Service | Dependencies | Optional Dependencies |
|---|---|---|
| Flume |
|
|
| HBase |
|
|
| HDFS |
|
|
| Hive | MapReduce or YARN |
|
| Hue |
|
|
| Impala |
|
|
| Key-Value Store Indexer |
|
|
| MapReduce | HDFS or Isilon | ZooKeeper |
| Oozie | MapReduce or YARN |
|
| Sentry | HDFS or Isilon | ZooKeeper |
| Solr |
|
Sentry |
| Sqoop | MapReduce or YARN | |
| YARN | HDFS or Isilon | ZooKeeper |
| ZooKeeper |
Version 5.7.1 Service Dependencies
| Service | Dependencies | Optional Dependencies |
|---|---|---|
| Flume |
|
|
| HBase |
|
|
| HDFS |
|
|
| Hive | MapReduce or YARN |
|
| Hue |
|
|
| Impala |
|
|
| Key-Value Store Indexer |
|
|
| MapReduce | HDFS or Isilon | ZooKeeper |
| Oozie | MapReduce or YARN |
|
| Sentry | HDFS or Isilon | ZooKeeper |
| Solr |
|
|
| Sqoop | MapReduce or YARN | |
| YARN | HDFS or Isilon | ZooKeeper |
| ZooKeeper |
Version 5.7.0 Service Dependencies
| Service | Dependencies | Optional Dependencies |
|---|---|---|
| Flume |
|
|
| HBase |
|
|
| HDFS |
|
|
| Hive | MapReduce or YARN |
|
| Hue |
|
|
| Impala |
|
|
| Key-Value Store Indexer |
|
|
| MapReduce | HDFS or Isilon | ZooKeeper |
| Oozie | MapReduce or YARN |
|
| Sentry | HDFS or Isilon | ZooKeeper |
| Solr |
|
|
| Sqoop | MapReduce or YARN | |
| YARN | HDFS or Isilon | ZooKeeper |
| ZooKeeper |
Version 5.6.0 Service Dependencies
| Service | Dependencies | Optional Dependencies |
|---|---|---|
| Flume |
|
|
| HBase |
|
|
| HDFS |
|
|
| Hive | MapReduce or YARN |
|
| Hue |
|
|
| Impala |
|
|
| Key-Value Store Indexer |
|
|
| MapReduce | HDFS or Isilon | ZooKeeper |
| Oozie | MapReduce or YARN |
|
| Sentry | HDFS or Isilon | ZooKeeper |
| Solr |
|
|
| Sqoop | MapReduce or YARN | |
| YARN | HDFS or Isilon | ZooKeeper |
| ZooKeeper |
Version 5.5.2 Service Dependencies
| Service | Dependencies | Optional Dependencies |
|---|---|---|
| Flume |
|
|
| HBase |
|
|
| HDFS |
|
|
| Hive | MapReduce or YARN |
|
| Hue |
|
|
| Impala |
|
|
| Key-Value Store Indexer |
|
|
| MapReduce | HDFS or Isilon | ZooKeeper |
| Oozie | MapReduce or YARN |
|
| Sentry | HDFS or Isilon | ZooKeeper |
| Solr |
|
|
| Sqoop | MapReduce or YARN | |
| YARN | HDFS or Isilon | ZooKeeper |
| ZooKeeper |
Version 5.5.0 Service Dependencies
| Service | Dependencies | Optional Dependencies |
|---|---|---|
| Flume |
|
|
| HBase |
|
|
| HDFS |
|
|
| Hive | MapReduce or YARN |
|
| Hue |
|
|
| Impala |
|
|
| Key-Value Store Indexer |
|
|
| MapReduce | HDFS or Isilon | ZooKeeper |
| Oozie | MapReduce or YARN |
|
| Sentry | HDFS or Isilon | ZooKeeper |
| Solr |
|
|
| Spark on YARN | YARN | HBase |
| Sqoop | MapReduce or YARN | |
| YARN | HDFS or Isilon | ZooKeeper |
| ZooKeeper |
Version 5.4.4 Service Dependencies
| Service | Dependencies | Optional Dependencies |
|---|---|---|
| Flume |
|
|
| HBase |
|
|
| HDFS |
|
|
| Hive | MapReduce or YARN |
|
| Hue |
|
|
| Impala |
|
|
| Key-Value Store Indexer |
|
|
| MapReduce | HDFS or Isilon | ZooKeeper |
| Oozie | MapReduce or YARN |
|
| Sentry | HDFS or Isilon | ZooKeeper |
| Solr |
|
|
| Sqoop | MapReduce or YARN | |
| YARN | HDFS or Isilon | ZooKeeper |
| ZooKeeper |
Version 5.4.1 Service Dependencies
| Service | Dependencies | Optional Dependencies |
|---|---|---|
| Flume |
|
|
| HBase |
|
|
| HDFS |
|
|
| Hive | MapReduce or YARN |
|
| Hue |
|
|
| Impala |
|
|
| Key-Value Store Indexer |
|
|
| MapReduce | HDFS or Isilon | ZooKeeper |
| Oozie | MapReduce or YARN |
|
| Sentry | HDFS or Isilon | ZooKeeper |
| Solr |
|
|
| Sqoop | MapReduce or YARN | |
| YARN | HDFS or Isilon | ZooKeeper |
| ZooKeeper |
Version 5.4.0 Service Dependencies
| Service | Dependencies | Optional Dependencies |
|---|---|---|
| Flume |
|
|
| HBase |
|
|
| HDFS |
|
|
| Hive | MapReduce or YARN |
|
| Hue |
|
|
| Impala |
|
|
| Key-Value Store Indexer |
|
|
| MapReduce | HDFS or Isilon | ZooKeeper |
| Oozie | MapReduce or YARN |
|
| Sentry | HDFS or Isilon | ZooKeeper |
| Solr |
|
|
| Spark on YARN | YARN | |
| Sqoop | MapReduce or YARN | |
| YARN | HDFS or Isilon | ZooKeeper |
| ZooKeeper |
Version 5.3.0 Service Dependencies
| Service | Dependencies | Optional Dependencies |
|---|---|---|
| Flume |
|
|
| HBase |
|
|
| HDFS |
|
|
| Hive | MapReduce or YARN |
|
| Hue |
|
|
| Impala |
|
|
| Key-Value Store Indexer |
|
|
| MapReduce | HDFS or Isilon | ZooKeeper |
| Oozie | MapReduce or YARN |
|
| Sentry | HDFS or Isilon | ZooKeeper |
| Solr |
|
|
| Sqoop | MapReduce or YARN | |
| YARN | HDFS or Isilon | ZooKeeper |
| ZooKeeper |
Version 5.2.0 Service Dependencies
| Service | Dependencies | Optional Dependencies |
|---|---|---|
| Flume |
|
|
| HBase |
|
|
| HDFS |
|
|
| Hive | MapReduce or YARN |
|
| Hue |
|
|
| Impala |
|
|
| Key Trustee | ZooKeeper | |
| KMS | ||
| Key-Value Store Indexer |
|
|
| MapReduce | HDFS or Isilon | ZooKeeper |
| Oozie | MapReduce or YARN |
|
| Sentry | HDFS or Isilon | ZooKeeper |
| Solr |
|
|
| Sqoop | MapReduce or YARN | |
| YARN | HDFS or Isilon | ZooKeeper |
| ZooKeeper |
Version 5.1.0 Service Dependencies
| Service | Dependencies | Optional Dependencies |
|---|---|---|
| Flume |
|
|
| HBase |
|
|
| HDFS |
|
|
| Hive | MapReduce or YARN |
|
| Hue |
|
|
| Impala |
|
|
| Key-Value Store Indexer |
|
|
| MapReduce | HDFS or Isilon | ZooKeeper |
| Oozie | MapReduce or YARN |
|
| Sentry | HDFS or Isilon | ZooKeeper |
| Solr |
|
|
| Sqoop | MapReduce or YARN | |
| YARN | HDFS or Isilon | ZooKeeper |
| ZooKeeper |
Version 5.0.0 Service Dependencies
| Service | Dependencies | Optional Dependencies |
|---|---|---|
| Accumulo 16 |
|
|
| Flume |
|
|
| HBase |
|
|
| HDFS |
|
|
| Hive | MapReduce or YARN |
|
| Hue |
|
|
| Impala |
|
|
| Isilon | ||
| Kafka | ZooKeeper | |
| Key Trustee Server | ||
| Key-Value Store Indexer |
|
|
| MapReduce | HDFS or Isilon | ZooKeeper |
| Oozie | MapReduce or YARN | ZooKeeper |
| Solr |
|
|
| Spark | HDFS or Isilon | |
| Spark on YARN | YARN | |
| Sqoop | MapReduce or YARN | |
| Sqoop Client | ||
| YARN | HDFS or Isilon | ZooKeeper |
| ZooKeeper |
Cloudera Data Science Workbench 1.5.0 Service Dependencies
| Service | Dependencies | Optional Dependencies |
|---|---|---|
| CDSW/CDH6 |
|
|
| CDSW/CDH5 |
Spark 2 on YARN Service Dependencies
| Spark 2 Version | Dependencies | Optional Dependencies |
|---|---|---|
| 2.3.4 | YARN |
|
| 2.2.4 | YARN | Hive |
| 2.1.4 | YARN | Hive |
| 2.0.2 | YARN | Hive |