Updating an existing CDH/Cloudera Manager deployment to access downloads with authentication

Access to Cloudera Manager binaries for production purposes requires authentication. To access the binaries at the locations below, you must first have an active subscription agreement and obtain a license key file along with the required authentication credentials (username and password).

If your deployment was not installed using authenticated downloads and if you need to add hosts to an existing cluster, add a new cluster, or add new services,you must follow the steps in this topic to configure your deployment to access the downloads.

Note that as of February 1, 2021, the download URLs on archive.cloudera.comhave changed. They are the same as the previous URLs, except that /p is added to the URL, after archive.cloudera.com. Depending on where you use the URL, you may also need to prepend your credentials to the URL. The instructions below contain that information. For example: 
https://username:password@archive.cloudera.com/p/...
For a complete list of download URLs, see:
Add hosts to an existing cluster
See Add hosts to an existing cluster managed by Cloudera Manager, below.
Add a service
If the parcel or package containing the service you want to add is already downloaded and available, no further action is required. If you need to download a parcel or package, see Add Services to an existing cluster managed by Cloudera Manager, below.
Add a new cluster
If you are adding a CDH cluster that is the same version of CDH as another cluster managed by the same instance of Cloudera Manager, no further action is required. To add a new cluster with a different supported version of CDH, see Adding a Cluster to an existing Cloudera Manager deployment using Parcels, below.
New Installations
You must use the new URLs and include your username and password to access downloads for a new installation. See Cloudera Installation Guide.
Upgrades
You must use the new URLs and include your username and password to access downloads for the upgrade. See the Cloudera Enterprise Upgrade Guide.

If your deployment was installed or upgraded using authenticated downloads, no further action is needed.

Obtain Credentials

The license key file and authentication credentials are provided in an email sent to customer accounts from Cloudera when a new license is issued. If you have an existing license with a CDP Private Cloud Base Edition entitlement, you might not have received an email. In this instance you can identify the authentication credentials from the license key file. If you do not have access to the license key, contact your account representative to receive a copy.

The license key file and authentication credentials are provided in an email sent to customer accounts from Cloudera when a new license is issued. If you have an existing license with a Cloudera Enterprise entitlement, you might not have received an email. In this instance you can identify the authentication credentials from the license key file. If you do not have access to the license key, contact your account representative to receive a copy.

To identify your authentication credentials using your license key file, complete the following steps:

  1. From cloudera.com, log into the cloudera.com account associated with the Cloudera Enterprise license and subscription agreement.
  2. On the Cloudera CDH Download page, select the version that you want to install and click Get It Now!.
  3. Scroll down to the Credentials Generator at the bottom of the page.
  4. In the Generate Credentials text box, copy and paste the text of the “PGP Signed Message” within your license key file and click Get Credentials. The credentials generator returns your username and password.

When you obtain your authentication credentials, use them to form the URLs below, where you can access the Cloudera repositories in the Cloudera Archive.

Prepare your deployment

There are three options for access to the downloads:
  • Use a local package and /or parcel repository. If your cluster does not have access to the internet, this is the only option.
    1. Download the contents of the repository for your version of the software from archive.cloudera.com using your username and password.
    2. Create a local package repository (for Cloudera Manager and CDH clusters installed using packages) or local parcel repository (for CDH clusters installed using Parcels).
  • Configure your operating system package manager (yum, zypper, or apt-get) to access the public Cloudera repositories at archive.cloudera.com. See Configure a Repository for Cloudera Manager.
  • Upgrade Cloudera Manager to one of the versions listed below. (If you are using Cloudera Manager 6.3.3 or higher, you do not need to upgrade.) Cloudera Manager is compatible with any version of CDH that is equal to lower than the Cloudera Manager version. The versions of Cloudera Manager have shown below have been updated to use authenticated downloads:
    Cloudera Manager Upgrades for authenticated downloads
    Current Cloudera Manager

    version

    		 Upgrade Cloudera Manager

    to this version
    6.1.x 6.1.1.4505
    6.2.x 6.2.1.4505
    6.3.0-6.3.2 6.3.3 or 6.3.4
    To upgrade Cloudera Manager:
    1. Go to the interactive Cloudera Enterprise Upgrade guide page for upgrading Cloudera Manager.
    2. In the form at the top of the page, select the current version of your Cloudera Manager deployment.
    3. Select the appropriate new version of Cloudera Manager from the table above.
    4. Select the operating system, database, and Navigator status.
    5. Follow the remaining steps on the page to upgrade the Cloudera Manager server and agents.

Add hosts to an existing cluster managed by Cloudera Manager

  1. Follow the steps to add hosts using the Add Host Wizard.
  2. When you get to the Select Repository page, select Custom Repository and enter one of the following:
    • If you have downloaded the repository and set up a local repository server, enter URL for the local repository.
    • If the cluster has access to the internet, enter the URL to the public Cloudera repository on archive.cloudera.com. See Cloudera Manager Version and Download Information to obtain the URL.
      For example: 
      https://username:password@archive.cloudera.com/p/cm6/6.3.4.4505/redhat7/yum/
  3. Continue with Add Hosts wizard to install the Cloudera Manager Agent, and, optionally the JDK.

Add Services to an existing cluster managed by Cloudera Manager

To add services, you must either set up a local package repository or local parcel repository from which to download the CDH parcels or packages or configure Cloudera Manager to access these directly from archive.cloudera.com.
  1. Log into the Cloudera Manager Admin Console.
  2. Click to open the Parcels page.
  3. If the status of the Parcel containing the service you want to add is downloaded, distributed and/or activated, no further action is required. Follow the instructions to add a service.
  4. If the parcel is not available, click Configuration.
  5. In the Remote Parcel Repository URLs section, click the + icon and add one of the following:
    • If you have downloaded the parcel repository and have set up a local repository server, enter the URL for the local repository.
    • If the cluster has access to the internet, enter the URL to the public Cloudera Parcel repository on archive.cloudera.com. See CDH Download Information to obtain the URL.
      For example: 
      https://username:password@archive.cloudera.com/p/cdh6/6.3.4/parcels/
  6. Click Save.

    The parcel status should now indicate that the parcel is Available Remotely.

  7. Continue with the instructions to add a service.

Adding a Cluster to an existing Cloudera Manager deployment using Parcels

Adding a Cluster to an existing Cloudera Manager deployment using Packages

  1. Follow the steps to add a cluster.
  2. When you get to the Select Repository page, In the Cloudera Manager Agent section, select Custom Repository.
  3. Enter the URL for the Cloudera Manager package repository. For example: 
    https://username:password@archive.cloudera.com/p/cm6/6.3.4.4505/redhat7/yum/
  4. In thew CDH and other software section, select Use Packages.

    The available versions of CDH display. Do not select any of these.

  5. Select Custom Repository.
  6. Enter the custom repository URL.
    • If you have downloaded the package repository and have set up a local repository server, enter URL for the local repository.
    • If the cluster has access to the internet, enter the URL to the public Cloudera package repository on archive.cloudera.com. See CDH Download Information to obtain the URL.
      For example: 
      https://username:password@archive.cloudera.com/p/cdh6/6.3.4/redhat7/yum/
  7. In the Select the specific release of the Cloudera Manager Agent you want to install on your hosts. section, click Custom Repository.
  8. Enter the URL for the Cloudera Manager package repository. For example: 
    https://username:password@archive.cloudera.com/p/cm6/6.3.4.4505/redhat7/yum/
  9. Continue with add cluster wizard to install the Cloudera Manager Agent, and, optionally the JDK.