Migrating from Parcels to Packages

Minimum Required Role: Cluster Administrator (also provided by Full Administrator)

To migrate from a parcel to the same version packages, perform the following steps. To upgrade to a different version, see Upgrading CDH and Managed Services Using Cloudera Manager.

  1. Install CDH and Managed Service Packages
  2. Deactivate Parcels
  3. Restart the Cluster
  4. Remove and Delete Parcels

Install CDH and Managed Service Packages

Choose a Repository Strategy

To install CDH and Managed Service Packages, choose one of the following repository strategies:

  • Standard Cloudera repositories. For this method, ensure you have added the required repository information to your systems.
  • Internally hosted repositories. You might use internal repositories for environments where hosts do not have access to the Internet. For information about preparing your environment, see Understanding Custom Installation Solutions. When using an internal repository, you must copy the repo or list file to the Cloudera Manager Server host and update the repository properties to point to internal repository URLs.

Install CDH 5 and Managed Service Packages

Install the packages on all cluster hosts using the following steps:

  • Red Hat
    1. Download and install the "1-click Install" package.
      1. Download the CDH 5 "1-click Install" package (or RPM).

        Click the appropriate RPM and Save File to a directory with write access (for example, your home directory).

        OS Version Link to CDH 5 RPM
        RHEL/CentOS/Oracle 5 RHEL/CentOS/Oracle 5 link
        RHEL/CentOS/Oracle 6 RHEL/CentOS/Oracle 6 link
        RHEL/CentOS/Oracle 7 RHEL/CentOS/Oracle 7 link
      2. Install the RPM for all RHEL versions:
        $ sudo yum --nogpgcheck localinstall cloudera-cdh-5-0.x86_64.rpm 
    2. (Optionally) add a repository key:
      • Red Hat/CentOS/Oracle 5
        $ sudo rpm --import https://archive.cloudera.com/cdh5/redhat/5/x86_64/cdh/RPM-GPG-KEY-cloudera
      • Red Hat/CentOS/Oracle 6
        $ sudo rpm --import https://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/RPM-GPG-KEY-cloudera
    3. Install the CDH packages:
      $ sudo yum clean all
      $ sudo yum install avro-tools crunch flume-ng hadoop-hdfs-fuse hadoop-hdfs-nfs3 hadoop-httpfs hadoop-kms hbase-solr hive-hbase hive-webhcat hue-beeswax hue-hbase hue-impala hue-pig hue-plugins hue-rdbms hue-search hue-spark hue-sqoop hue-zookeeper impala impala-shell kite llama mahout oozie pig pig-udf-datafu search sentry solr-mapreduce spark-core spark-master spark-worker spark-python sqoop sqoop2 whirr
  • SLES
    1. Download and install the "1-click Install" package.
      1. Download the CDH 5 "1-click Install" package.

        Download the rpm file, choose Save File, and save it to a directory to which you have write access (for example, your home directory).

      2. Install the RPM:
        $ sudo rpm -i cloudera-cdh-5-0.x86_64.rpm
      3. Update your system package index by running:
        $ sudo zypper refresh
    2. (Optionally) add a repository key:
      $ sudo rpm --import https://archive.cloudera.com/cdh5/sles/11/x86_64/cdh/RPM-GPG-KEY-cloudera
    3. Install the CDH packages:
      $ sudo zypper clean --all
      $ sudo zypper install avro-tools crunch flume-ng hadoop-hdfs-fuse hadoop-hdfs-nfs3 hadoop-httpfs hadoop-kms hbase-solr hive-hbase hive-webhcat hue-beeswax hue-hbase hue-impala hue-pig hue-plugins hue-rdbms hue-search hue-spark hue-sqoop hue-zookeeper impala impala-shell kite llama mahout oozie pig pig-udf-datafu search sentry solr-mapreduce spark-core spark-master spark-worker spark-python sqoop sqoop2 whirr
  • Ubuntu and Debian
    1. Download and install the "1-click Install" package
      1. Download the CDH 5 "1-click Install" package:
        OS Version Package Link
        Jessie Jessie package
        Wheezy Wheezy package
        Precise Precise package
        Trusty Trusty package
      2. Install the package by doing one of the following:
        • Choose Open with in the download window to use the package manager.
        • Choose Save File, save the package to a directory to which you have write access (for example, your home directory), and install it from the command line. For example:
          sudo dpkg -i cdh5-repository_1.0_all.deb
    2. Optionally add a repository key:
      • Debian Wheezy
        $ curl -s https://archive.cloudera.com/cdh5/debian/wheezy/amd64/cdh/archive.key | sudo apt-key add -
      • Ubuntu Precise
        $ curl -s https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh/archive.key | sudo apt-key add -
    3. Install the CDH packages:
      $ sudo apt-get update
      $ sudo apt-get install avro-tools crunch flume-ng hadoop-hdfs-fuse hadoop-hdfs-nfs3 hadoop-httpfs hadoop-kms hbase-solr hive-hbase hive-webhcat hue-beeswax hue-hbase hue-impala hue-pig hue-plugins hue-rdbms hue-search hue-spark hue-sqoop hue-zookeeper impala impala-shell kite llama mahout oozie pig pig-udf-datafu search sentry solr-mapreduce spark-core spark-master spark-worker spark-python sqoop sqoop2 whirr

Install CDH 4, Impala, and Solr Managed Service Packages

Install the packages on all cluster hosts using the following steps:

  • RHEL-compatible
    1. Click the entry in the table at CDH Download Information that matches your RHEL or CentOS system.
    2. Go to the repo file (cloudera-cdh4.repo) for your system and save it in the /etc/yum.repos.d/ directory.
    3. Optionally add a repository key:
      • RHEL/CentOS/Oracle 5
        $ sudo rpm --import https://archive.cloudera.com/cdh4/redhat/5/x86_64/cdh/RPM-GPG-KEY-cloudera
      • RHEL/CentOS 6
        $ sudo rpm --import https://archive.cloudera.com/cdh4/redhat/6/x86_64/cdh/RPM-GPG-KEY-cloudera
    4. Install packages on every host in your cluster:
      1. Install CDH 4 packages:
        $ sudo yum -y install bigtop-utils bigtop-jsvc bigtop-tomcat hadoop hadoop-hdfs hadoop-httpfs hadoop-mapreduce hadoop-yarn hadoop-client hadoop-0.20-mapreduce hue-plugins hbase hive oozie oozie-client pig zookeeper
      2. To install the hue-common package and all Hue applications on the Hue host, install the hue meta-package:
        $ sudo yum install hue 
    5. (Requires CDH 4.2 and higher) Install Impala
      1. In the table at Cloudera Impala Version and Download Information, click the entry that matches your RHEL or CentOS system.
      2. Go to the repo file for your system and save it in the /etc/yum.repos.d/ directory.
      3. Install Impala and the Impala Shell on Impala machines:
        $ sudo yum -y install impala impala-shell
    6. (Requires CDH 4.3 and higher) Install Search
      1. In the table at Cloudera Search Version and Download Information, click the entry that matches your RHEL or CentOS system.
      2. Go to the repo file for your system and save it in the /etc/yum.repos.d/ directory.
      3. Install the Solr Server on machines where you want Cloudera Search.
        $ sudo yum -y install solr-server
  • SLES
    1. Run the following command:
      $ sudo zypper addrepo -f https://archive.cloudera.com/cdh4/sles/11/x86_64/cdh/cloudera-cdh4.repo
    2. Update your system package index by running:
      $ sudo zypper refresh
    3. Optionally add a repository key:
      $ sudo rpm --import https://archive.cloudera.com/cdh4/sles/11/x86_64/cdh/RPM-GPG-KEY-cloudera  
    4. Install packages on every host in your cluster:
      1. Install CDH 4 packages:
        $ sudo zypper install bigtop-utils bigtop-jsvc bigtop-tomcat hadoop hadoop-hdfs hadoop-httpfs hadoop-mapreduce hadoop-yarn hadoop-client hadoop-0.20-mapreduce hue-plugins hbase hive oozie oozie-client pig zookeeper
      2. To install the hue-common package and all Hue applications on the Hue host, install the hue meta-package:
        $ sudo zypper install hue 
      3. (Requires CDH 4.2 and higher) Install Impala
        1. Run the following command:
          $ sudo zypper addrepo -f https://archive.cloudera.com/impala/sles/11/x86_64/impala/cloudera-impala.repo
        2. Install Impala and the Impala Shell on Impala machines:
          $ sudo zypper install impala impala-shell
      4. (Requires CDH 4.3 and higher) Install Search
        1. Run the following command:
          $ sudo zypper addrepo -f https://archive.cloudera.com/search/sles/11/x86_64/search/cloudera-search.repo
        2. Install the Solr Server on machines where you want Cloudera Search.
          $ sudo zypper install solr-server
  • Ubuntu or Debian
    1. In the table at CDH Version and Packaging Information, click the entry that matches your Ubuntu or Debian system.
    2. Go to the list file (cloudera.list) for your system and save it in the /etc/apt/sources.list.d/ directory. For example, to install CDH 4 for 64-bit Ubuntu Lucid, your cloudera.list file should look like:
      deb [arch=amd64] https://archive.cloudera.com/cdh4/ubuntu/lucid/amd64/cdh lucid-cdh4 contrib
      deb-src https://archive.cloudera.com/cdh4/ubuntu/lucid/amd64/cdh lucid-cdh4 contrib
    3. Optionally add a repository key:
      • Ubuntu Lucid
        $ curl -s https://archive.cloudera.com/cdh4/ubuntu/lucid/amd64/cdh/archive.key | sudo apt-key add -
      • Ubuntu Precise
        $ curl -s https://archive.cloudera.com/cdh4/ubuntu/precise/amd64/cdh/archive.key | sudo apt-key add -
      • Debian Squeeze
        $ curl -s https://archive.cloudera.com/cdh4/debian/squeeze/amd64/cdh/archive.key | sudo apt-key add -
    4. Install packages on every host in your cluster:
      1. Install CDH 4 packages:
        $ sudo apt-get install bigtop-utils bigtop-jsvc bigtop-tomcat hadoop hadoop-hdfs hadoop-httpfs hadoop-mapreduce hadoop-yarn hadoop-client hadoop-0.20-mapreduce hue-plugins hbase hive oozie oozie-client pig zookeeper
      2. To install the hue-common package and all Hue applications on the Hue host, install the hue meta-package:
        $ sudo apt-get install hue 
      3. (Requires CDH 4.2 and higher) Install Impala
        1. In the table at Cloudera Impala Version and Download Information, click the entry that matches your Ubuntu or Debian system.
        2. Go to the list file for your system and save it in the /etc/apt/sources.list.d/ directory.
        3. Install Impala and the Impala Shell on Impala machines:
          $ sudo apt-get install impala impala-shell
      4. (Requires CDH 4.3 and higher) Install Search
        1. In the table at Cloudera Search Version and Download Information, click the entry that matches your Ubuntu or Debian system.
        2. Install Solr Server on machines where you want Cloudera Search:
          $ sudo apt-get install solr-server

Deactivate Parcels

When you deactivate a parcel, Cloudera Manager points to the installed packages, ready to be run the next time a service is restarted. To deactivate parcels,
  1. Go to the Parcels page by doing one of the following:
    • Clicking the parcel indicator in the Admin Console navigation bar ()
    • Clicking the Hosts in the top navigation bar, then the Parcels tab.
  2. Click Actions on the activated CDH and managed service parcels and select Deactivate.

Restart the Cluster

  1. On the Home > Status tab, click to the right of the cluster name and select Restart.
  2. Click Restart that appears in the next screen to confirm. The Command Details window shows the progress of stopping services.

    When All services successfully started appears, the task is complete and you can close the Command Details window.

You can optionally perform a rolling restart.

Remove and Delete Parcels

Removing a Parcel

From the Parcels page, in the Location selector, choose ClusterName or All Clusters, click the to the right of an Activate button, and select Remove from Hosts.

Deleting a Parcel

From the Parcels page, in the Location selector, choose ClusterName or All Clusters, and click the to the right of a Distribute button, and select Delete.