This is the documentation for Cloudera Manager 5.0.x. Documentation for other versions is available at Cloudera Documentation.

Upgrading CDH 5 Using Parcels

If you want to upgrade your CDH 5 cluster to a newer version of CDH 5, you can do so using parcels from within the Cloudera Manager Admin Console. Your current CDH 5 cluster can have been installed with either parcels or packages. The new version will use parcels.

To upgrade CDH using parcels, the steps are as follows.

  1. Stop All Services
  2. Back up the HDFS Metadata on the NameNode
  3. Download, Distribute, and Activate the CDH 5 Parcel
  4. Upgrade Sqoop
  5. Upgrade the Oozie Database
  6. Start All Services
  7. Remove the Previous CDH Version Packages
  8. Deploy Client Configuration Files
  9. Update Symlinks for the Newly Installed Components

Stop All Services

  1. Stop each cluster.
    1. On the Home page, click to the right of the cluster name and select Stop.
    2. Click Stop in the confirmation screen. The Command Details window shows the progress of stopping services.

      When All services successfully stopped appears, the task is complete and you can close the Command Details window.

  2. Stop the Cloudera Management Service:
    1. Do one of the following:
        1. Select Clusters > Cloudera Management Service > mgmt.
        2. Select Actions > Stop.
        1. On the Home page, click to the right of mgmt and select Stop.
    2. Click Stop to confirm. The Command Details window shows the progress of stopping the roles.
    3. When Command completed with n/n successful subcommands appears, the task is complete. Click Close.

Back up the HDFS Metadata on the NameNode

  1. Stop the NameNode you want to back up.
  2. Go to the HDFS service.
  3. Select Configuration > View and Edit.
  4. In the Search field, search for "NameNode Data Directories". This locates the NameNode Data Directories property.
  5. From the command line on the NameNode host, back up the directory listed in the NameNode Data Directories property. If more than one is listed, then you only need to make a backup of one directory, since each directory is a complete copy. For example, if the data directory is /mnt/hadoop/hdfs/name, do the following as root:
    # cd /mnt/hadoop/hdfs/name
    # tar -cvf /root/nn_backup_data.tar .

    You should see output like this:

    ./
    ./current/
    ./current/fsimage
    ./current/fstime
    ./current/VERSION
    ./current/edits
    ./image/
    ./image/fsimage
      Warning: If you see a file containing the word lock, the NameNode is probably still running. Repeat the preceding steps, starting by shutting down the CDH services.

Download, Distribute, and Activate the CDH 5 Parcel

  1. In the Cloudera Manager Admin Console, click the Parcels indicator in the top navigation bar ( or ) to go to the Parcels page.
  2. In the parcels page, click Download for the version(s) you want to download. If the parcel you want is not shown here — for example, if you want to upgrade to a version of CDH that is not the most current version — you can make additional parcel repos available through the Parcel Configuration Settings page. You can find the locations of the previous CDH 5 parcels at http://archive.cloudera.com/cdh5/parcels/. If your Cloudera Manager server does not have Internet access, you can obtain the required parcel file(s) and put them into the local repository. See Creating and Using a Parcel Repository for more details.
  3. When the download has completed, click Distribute for the version you downloaded.
  4. When the parcel has been distributed and unpacked, the button will change to say Activate.
  5. Click Activate. A pop-up that offers to restart your services displays.

Upgrade Sqoop

  1. Go to the Sqoop service.
  2. Select Actions > Upgrade Sqoop and click Upgrade Sqoop to confirm.
  3. When the command completes, click Close.

Upgrade the Oozie Database

  1. Go to the Sqoop service.
  2. Select Actions > Upgrade Database and click Upgrade Database to confirm.
  3. When the command completes, click Close.

Start All Services

  1. Start each cluster.
  2. Start the Cloudera Management Service.

    When the command completes, click Close.

Remove the Previous CDH Version Packages

  Note:

Skip this step if you installed the previous version of CDH 5 using parcels.

If your previous installation of CDH 5 was done using packages, you must remove those packages on all hosts on which you installed the parcels and refresh the symlinks so that clients will run the new software versions.

  1. Uninstall the CDH packages on each host:
    • Not including Impala and Search
      Operating System Command
      RHEL
      $ sudo yum remove bigtop-utils bigtop-jsvc bigtop-tomcat hue-common sqoop2-client
      SLES
      $ sudo zypper remove bigtop-utils bigtop-jsvc bigtop-tomcat hue-common sqoop2-client
      Ubuntu or Debian
      $ sudo apt-get purge bigtop-utils bigtop-jsvc bigtop-tomcat hue-common sqoop2-client
    • Including Impala and Search
      Operating System Command
      RHEL
      $ sudo yum remove hue-common impala-shell solr-server 'bigtop-*'
      SLES
      $ sudo zypper remove hue-common impala-shell solr-server 'bigtop-*'
      Ubuntu or Debian
      $ sudo apt-get purge hue-common impala-shell solr-server 'bigtop-*'

Deploy Client Configuration Files

  1. On the Home page, click to the right of the cluster name and select Deploy Client Configuration.
  2. Click the Deploy Client Configuration button in the confirmation pop-up that appears.

Update Symlinks for the Newly Installed Components

Restart all the Cloudera Manager Agents to force an update of the symlinks to point to the newly installed components on each host:
$ sudo service cloudera-scm-agent restart
Page generated September 3, 2015.