Architecture Overview

important

The rest of this documentation assumes you are familiar with CDH and Cloudera Manager. If not, make sure you read the documentation for CDH and Cloudera Manager before you proceed.

Cloudera Manager
Cloudera Manager is an end-to-end application used for managing CDP clusters. When a CDP service (such as Impala, Spark, etc.) is added to the cluster, Cloudera Manager configures cluster hosts with one or more functions, called roles.
ML Runtimes
ML Runtimes are responsible for running data science workloads and intermediating access to the underlying cluster.
Cloudera Data Science Workbench Web Application
The Cloudera Data Science Workbench web application is typically hosted on the master host, at http://cdsw.<your_domain>.com.
CDS 2.x Powered by Apache Spark
Apache Spark is a general purpose framework for distributed computing that offers high performance for both batch and stream processing. It exposes APIs for Java, Python, R, and Scala, as well as an interactive shell for you to run jobs.