Manually Install Cloudera Software Packages

This topic shows how to manually install Cloudera software packages, namely Cloudera Manager and CDH. This is useful for environments where it is not possible to use Cloudera Manager to install the required packages, such as organizations where password-less sudo is not permitted.

Although you can install the software packages manually, Cloudera does not support clusters that are not deployed and managed by Cloudera Manager.

Install Cloudera Manager Packages

  1. On the Cloudera Manager Server host, type the following commands to install the Cloudera Manager packages.
    OS Command
    RHEL, CentOS, Oracle Linux 
    sudo yum install cloudera-manager-daemons cloudera-manager-agent cloudera-manager-server
    SLES 
    sudo zypper install cloudera-manager-daemons cloudera-manager-agent cloudera-manager-server
    Ubuntu 
    sudo apt-get install cloudera-manager-daemons cloudera-manager-agent cloudera-manager-server
  2. If you are using an Oracle database for Cloudera Manager Server, edit the /etc/default/cloudera-scm-server file on the Cloudera Manager server host. Locate the line that begins with export CMF_JAVA_OPTS and change the -Xmx2G option to -Xmx4G.

Manually Install Cloudera Manager Agent Packages

The Cloudera Manager Agent is responsible for starting and stopping processes, unpacking configurations, triggering installations, and monitoring all hosts in a cluster. You can install the Cloudera Manager agent manually on all hosts, or Cloudera Manager can install the Agents in a later step. To use Cloudera Manager to install the agents, skip this section.

To install the Cloudera Manager Agent packages manually, do the following on every cluster host (including those that will run one or more of the Cloudera Management Service roles: Service Monitor, Activity Monitor, Event Server, Alert Publisher, or Reports Manager):
  1. Use one of the following commands to install the Cloudera Manager Agent packages:
    OS Command
    RHEL, if you have a yum repo configured: 
    $ sudo yum install cloudera-manager-agent cloudera-manager-daemons
    RHEL, if you're manually transferring RPMs: 
    $ sudo yum --nogpgcheck localinstall cloudera-manager-agent-package.*.x86_64.rpm cloudera-manager-daemons
    SLES 
    $ sudo zypper install cloudera-manager-agent cloudera-manager-daemons
    Ubuntu or Debian 
    $ sudo apt-get install cloudera-manager-agent cloudera-manager-daemons
  2. On every cluster host, configure the Cloudera Manager Agent to point to the Cloudera Manager Server by setting the following properties in the /etc/cloudera-scm-agent/config.ini configuration file:
    Property Description
    server_host Name of the host where Cloudera Manager Server is running.
    server_port Port on the host where Cloudera Manager Server is running.
    For more information on Agent configuration options, see Agent Configuration File.
  3. Start the Agents by running the following command on all hosts:
    RHEL 7, SLES 12, Debian 8, Ubuntu 16.04 and higher
    sudo systemctl start cloudera-scm-agent
    If the agent starts without errors, no response displays.
    RHEL 5 or 6, SLES 11, Debian 6 or 7, Ubuntu 12.04 or 14.04
    sudo service cloudera-scm-agent start
    You should see the following: 
    Starting cloudera-scm-agent: [ OK ]

When the Agent starts, it contacts the Cloudera Manager Server. If communication fails between a Cloudera Manager Agent and Cloudera Manager Server, see Troubleshooting Installation Problems. When the Agent hosts reboot, cloudera-scm-agent starts automatically.

Manually Install CDH Packages

To install the CDH packages manually, do the following on every cluster host:

  1. Log in to each host in the cluster using ssh.
  2. Run the following command:
    RHEL / CentOS
    sudo yum install avro-tools bigtop-jsvc bigtop-utils flume-ng hadoop-hdfs-fuse hadoop-hdfs-nfs3 hadoop-httpfs hadoop-kms hbase hbase-solr hive-hbase hive-webhcat hue impala impala-shell kafka kite keytrustee-keyprovider kudu oozie parquet parquet-format pig search sentry sentry-hdfs-plugin solr solr-crunch solr-mapreduce spark-core spark-python sqoop zookeeper
    SLES
    sudo zypper install avro-tools bigtop-jsvc bigtop-utils flume-ng hadoop-hdfs-fuse hadoop-hdfs-nfs3 hadoop-httpfs hadoop-kms hbase hbase-solr hive-hbase hive-webhcat hue impala impala-shell kafka kite keytrustee-keyprovider kudu oozie parquet parquet-format pig search sentry sentry-hdfs-plugin solr solr-crunch solr-mapreduce spark-core spark-python sqoop zookeeper
    Debian / Ubuntu
    sudo apt-get install avro-tools bigtop-jsvc bigtop-utils flume-ng hadoop-hdfs-fuse hadoop-hdfs-nfs3 hadoop-httpfs hadoop-kms hbase hbase-solr hive-hbase hive-webhcat hue impala impala-shell kafka kite keytrustee-keyprovider kudu oozie parquet parquet-format pig search sentry sentry-hdfs-plugin solr solr-crunch solr-mapreduce spark-core spark-python sqoop zookeeper