Python Guidelines

Identify the correct Python version for your specific combination of Cloudera Manager and Cloudera Runtime on supported operating systems. Cloudera recommends using Python 3.11 or higher across all deployments. Learn how to migrate Python for different combinations of Cloudera Manager and Cloudera Runtime on the supported operating systems.

You must install Python on all hosts managed by Cloudera Manager. For detailed instructions, see Installing Python 3.

Migrating to Python 3.11

Minimum Version Requirements for Python 3.11 Migration

Cloudera recommends using the following versions when migrating to Python 3.11:


Cloudera Runtime	Cloudera Manager Version
7.3.2 or higher	7.13.2
7.3.1.500 SP3	7.13.1 CHF 5 (7.13.1.500)
7.1.9 SP1 CHF11	7.13.1 CHF 5 (7.13.1.500)

Installing Python 3.11 before upgrading Cloudera Manager

If you are migrating from Python 3.8 or 3.9 to Python 3.11 on supported operating systems, then follow this recommended workflow to upgrade Cloudera Manager to version 7.13.1 CHF5 (7.13.1.500) or higher, and version 7.13.2 or higher.

Install Python 3.11 from the standard repository. For information about installing Python 3.11 on on supported operating systems, see Installing Python 3.11 standard package on supported operating systems.
important
- Install Python 3.11 before upgrading Cloudera Manager to avoid performing a Cloudera Manager Agent restart later. If you install Python 3.11 after upgrading Cloudera Manager, then you must perform Cloudera Manager Agent restart after installing Python 3.11. For information about restarting Cloudera Manager Agents, see Starting, Stopping, and Restarting Cloudera Manager Agents.
- Similarly, if you perform the Python migration on a cluster already running Cloudera Runtime, then you must restart all Cloudera Runtime services respectively after installing Python 3.11 so that they will pick up the Python 3.11 version. To restart all Cloudera Runtime services, restart the cluster. For information about restarting a cluster, see Restarting a Cluster.
First, upgrade Cloudera Manager to the version that corresponds with your current Cloudera Runtime.
- If you are running Cloudera Runtime 7.3.2, then install Cloudera Manager 7.13.2.
- For those using Cloudera Runtime 7.3.1 or 7.1.9, you must upgrade to Cloudera Manager 7.13.1 CHF 5 (7.13.1.500).
For information about upgrading Cloudera Manager, see Upgrading Cloudera Manager 7.
After completing the Cloudera Manager upgrade, upgrade Cloudera Runtime to your desired target release. You can upgrade to any stable release of Cloudera Runtime 7.3.2, upgrade to Cloudera Runtime version 7.3.1.500, or upgrade to Cloudera Runtime version 7.1.9 SP1 CHF 11.

Verify all prerequisite hardware and OS requirements before you initiate the Runtime parcel distribution. This ensures your environment meets the necessary specifications for a successful deployment.

For information about upgrading Cloudera Runtime Cluster, see Upgrading a Cloudera Runtime Cluster.

Migrating to Python 3.9 on Legacy Cloudera Runtime Releases

(Recommended) Installing Python 3.9 before upgrading Cloudera Manager and Cloudera Runtime

If you are migrating from Python 3.8 to Python 3.9 on supported operating systems, then follow this recommended workflow to upgrade Cloudera Manager to version 7.13.1 through 7.13.1 CHF4 (7.13.1.400).

Install Python 3.9 from the standard repository. For information about installing Python 3.9 on supported operating systems, see Installing Python 3.9 standard package on RHEL 8.
important
- Install Python 3.9 before upgrading Cloudera Manager to avoid performing a Cloudera Manager Agent restart later. If you install Python 3.9 after upgrading Cloudera Manager, then you must perform Cloudera Manager Agent restart after installing Python 3.9.
- Similarly, if you perform the Python migration on a cluster already running Cloudera Runtime, then you must restart all Cloudera Runtime services respectively after installing Python 3.9 so that they will pick up the Python 3.9 version. To restart all Cloudera Runtime services, restart the cluster. For information about restarting a cluster, see Restarting a Cluster.
Upgrade Cloudera Manager to version 7.13.1 through 7.13.1 CHF4 (7.13.1.400). For information about upgrading Cloudera Manager, see Upgrading Cloudera Manager 7.
Upgrade Cloudera Runtime to version 7.3.1.400 SP2 or lower and 7.1.9 SP1 CHF10 or lower. For information about upgrading Cloudera Runtime Cluster, see Upgrading a Cloudera Runtime Cluster.
Optional: Uninstall Python 3.8. To uninstall Python 3.8 run the following command:
```
yum remove python38
```

(Not Recommended) Installing Python 3.9 after upgrading Cloudera Manager and Cloudera Runtime

Learn how to upgrade Cloudera Manager and Cloudera Runtime while delaying the upgrade of Python from 3.8 to 3.9 version on RHEL 8.8 or RHEL 8.10. This is not a recommended workflow due to Hue supports only Python 3.9 in Cloudera Runtime 7.3.1.

Upgrade Cloudera Manager to 7.13.1 version. For information about upgrading Cloudera Manager, see Upgrading Cloudera Manager 7.
Upgrade Cloudera Runtime to 7.3.1 version. For information about upgrading Cloudera Runtime Cluster, see Upgrading a Cloudera Runtime Cluster.
warning

Hue will fail to start. Continue the Cloudera Runtime Cluster upgrade process manually by following the manual upgrade instructions from Manual upgrade to Cloudera Base on premises.
Install Python 3.9 from standard repository. For information about installing Python 3.9 on RHEL 8, see Installing Python 3.9 standard package on RHEL 8.
important
If you install Python 3.9 after upgrading Cloudera Manager to 7.13.1 version and Cloudera Runtime to 7.3.1 version, then you must restart the Cloudera Manager Agent and all Cloudera Runtime services respectively after installing Python 3.9.
Restart Cloudera Manager Agents. For information about restarting Cloudera Manager Agents, see Starting, Stopping, and Restarting Cloudera Manager Agents.
After restarting Cloudera Manager Agents, Cloudera Manager Agent will pick up the highest Python version available between Python 3.8 and Python 3.9.
Restart all Cloudera Runtime services so that they will pick up the Python 3.9 version. To restart all Cloudera Runtime services, restart the cluster. For information about restarting a cluster, see Restarting a Cluster.
important
Hue starts now successfully.
Optional: Uninstall Python 3.8. To uninstall Python 3.8 run the following command:
```
yum remove python38
```

When Cloudera Manager is upgraded to 7.13.1 version and when Cloudera Runtime version is either 7.1.8, 7.1.7 SP3 or 7.1.9 for RHEL 8, all the Cloudera Runtime process will continue to use Python 3.8, whereas Cloudera Manager Agent will pick up the highest Python version available between Python 3.8 and Python 3.9.