Cloudera Docs

Major RHEL Operating System upgrade on ECS hosts

After installing CDP Private Cloud Data Services on a particular RHEL OS, you can now upgrade RHEL OS to a new major version. For example, you can upgrade from RHEL 7.x to RHEL 9.x major version.

You must perform this task on all Embedded Container Service (ECS) hosts when you are ready for an OS upgrade.
Collect the following information:
  • ECS hosts in the cluster. For example: host-1, host-2.

    Navigate to Cloudera Manager UI > ECS Cluster Name > HOSTS, to collect the host info.

  • Version of the ECS running on cluster. For example: 1.5.2

    Navigate to Cloudera Manager UI > DATA SERVICES > Cluster Name, the cluster displays the Version at the bottom of the UI .

  • Version of the Operating System (OS) running on those hosts. For example: RHEL 7.9
    • Login to all of the hosts in the ECS cluster by executing the following command: 
      cat /etc/redhat-release
  • Version of the upgraded OS. For example: RHEL 9.4

    Verify the ECS version supported on the upgraded OS version here: https://supportmatrix.cloudera.com/

Shutdown of the ECS Cluster

Perform the following steps:

  1. Log in to Cloudera Manager as an Administrator, then navigate to the ECS cluster.
  2. Go to the Home > Status tab.
  3. Click the Actions menu to the right of the Embedded Container Service (ECS) cluster name and select Stop.
  4. Click the Stop option in the confirmation screen.

    The Command Details window shows the progress of the services.

  5. SSH into a ECS cluster host as a root user.
  6. Verify the OS version by running the following command: 
    cat /etc/redhat-release
  7. Stop Cloudera Manager agent on all the ECS hosts, by executing the following command: 
    systemctl stop cloudera-scm-agent
  8. Uninstall Cloudera Manager agent packages on the ECS hosts by executing the following command: 
    yum remove cloudera-manager-agent

Major OS Upgrade

Follow the RHEL OS Upgrade documentation for major OS upgrade procedure.

Verify the upgraded OS version on all ECS hosts by executing the following command: 
cat /etc/redhat-release

Setup and install new Cloudera Manager agents

Perform the following steps on each host in your cluster:

  1. If you have not installed before, install python 3.8 and other dependencies on the ECS host.

    Example: yum install python3.8 -y

  2. Install the OS compatible Cloudera Manager agent packages.
    Example: RHEL 9 package instead of RHEL 7 through commands on the ECS hosts.
    • Change the baseurl= link in the cloudera-manager.repo to point to new RedHat version you upgraded to (from RedHat 7 to RedHat 9).

      Example: baseurl=https://archive.cloudera.com/p/cm7/7.11.3.0/redhat7/yum/

      vim /etc/yum.repos.d/cloudera-manager.repo

      Save the cloudera-manager.repo file.

    • To update repositories, execute: 
      yum clean all
    • To verify the version is available, Example: 7.11.3.26-58725444.el9, execute the following command:
      yum list available | grep -i cloudera-manager
    • To install the Cloudera Manager Agent, execute the following command:
      yum install cloudera-manager-agent
    • To verify the correct version of the OS compatible Cloudera Manager agent installed, execute the following command:
       yum list installed | grep -i cloudera-manager-agent
  3. Restore the Cloudera Manager agent config file, execute the following command: 
    cp /etc/cloudera-scm-agent/config.ini.rpmsave /etc/cloudera-scm-agent/config.ini)
  4. Login to all the ECS host and then start the Cloudera Manager agent by executing the following command:
    systemctl start cloudera-scm-agent
  5. To verify the status of the Cloudera Manager agents started, execute the following command:
    systemctl status cloudera-scm-agent
  6. Log in to Cloudera Manager UI as an Administrator.
  7. Verify that the Cloudera Manager displays all your hosts before starting ECS Cluster.

    Navigate to Cloudera Manager UI > ECS Cluster Name > HOSTS, to collect the host info.

Start the ECS Cluster

  1. To start the ECS cluster, go to the Home > Status tab.
  2. Click the Actions menu to the right of the Embedded Container Service cluster name and select Start.
  3. Click the Start option.

    The Command Details window shows the progress of the services.

    Wait for all the pods to start. The wait time depends on the number of nodes in the cluster.

  4. Navigate to ECS > WEB UI and try accessing: STORAGE UI, ECS WEB UI, and CONSOLE.

If you see a Vault sealed issue, after the start of the ECS service and if it does not unseal itself, then follow the step below to manually unseal it:

In the Cloudera Manager UI, Go to the ECS CLUSTER NAME > ECS SERVICE> ACTIONS > UNSEAL VAULT