Cloudera Manager 7.7.1 Cumulative hotfix 22

Know more about the Cloudera Manager 7.7.1 cumulative hotfixes 22 (version: 7.7.1-h31-55950782).

This cumulative hotfix was released on August 2, 2024.

New features and changed behavior for Cloudera Manager 7.7.1 CHF22 (version: 7.7.1-h31-55950782):

Custom properties atlas.jaas.KafkaClient.option.password was available in a clear text format in CDP cluster services when Kerberos authentication was not present.

To provide a secured access, two new fields are introduced for username / password and a radio field for loginModule for Kerberos or Plain selection.

atlas.jaas.KafkaClient.option.username=username

atlas.jaas.KafkaClient.option.password=<password is in clear text>

atlas.jaas.KafkaClient.option.loginModuleName=KERBEROS(default)

Platform Support Enhancements

New JDK Version: Azul Open JDK 8 and Azul Open JDK 11 are supported with Cloudera Manager 7.7.1 CHF22 and higher versions.

Following are the list of fixed issues that were shipped for Cloudera Manager 7.7.1 CHF22 (version: 7.7.1-h31-55950782):

OPSAPS-68752: Snapshot-diff delta is incorrectly renamed/deleted twice during on-premises to cloud replication

The snapshots created during replication are deleted twice instead of once, which results in incorrect snapshot information. This issue is fixed. For more information, see Cloudera Customer Advisory 2023-715: Replication Manager may delete its snapshot information when migrating from on-prem to cloud.

OPSAPS-60139: Staleness performance issue in clusters with a large number of roles

In large clusters, Cloudera Manager takes a long time to display the Configuration Staleness icon after a service configuration change. This issue is fixed now by improving the performance of the staleness-checking algorithm.

OPSAPS-60331: Active Directory creates invalid Service Principal Names(SPN) when generating Kerberos credentials

If Cloudera Manager is configured to use Active Directory as a Kerberos KDC, and is also configured to use /etc/cloudera-scm-server/cmf.keytab as the KDC admin credentials, you should no longer encounter errors when generating Kerberos credentials.

OPSAPS-67068: Updating interval value used by Ranger service for creating ranger_audits collection in Solr

Updated ranger.audit.solr.time.interval to 60000 ms.

OPSAPS-66924: HBase snapshot export deletes target folder in case of failure

HBase snapshot export no longer deletes the target folder if the snapshot export fails during HBase replication using Replication Manager.

OPSAPS-65913: Unstable config generation of Hue with multiple HS2 servers

Fixed an issue of unstable config generation of Hue when more than 1 HS2 servers are present without a configured load-balancer.

OPSAPS-66050: Hive performance issues when hive.auto.convert.join.noconditionaltask.size property was set to a low value

The hive.auto.convert.join.noconditionaltask.size property was set to a low value of 50 MB. This resulted in performance issues when the size of the container is 2 GB or more and if the sum of size of the tables/partitions is more than 50 MB.

This issue is now fixed and the default value for hive.auto.convert.join.noconditionaltask.size is set to 256 MB.

OPSAPS-70689: Enhanced performance of DistCp CRC check operation

When a MapReduce job for an HDFS replication policy job fails, or when there are target-side changes during a replication job, Replication Manager initiates the bootstrap replication process. During this process, a cyclic redundancy check (CRC) check is performed by default to determine whether a file can be skipped for replication.

By default, the CRC for each file is queried by the mapper (running on the target cluster) from the source cluster's NameNode. The round trip between the source and target cluster for each file consumes network resources and raises the cost of execution. To improve the performance, you can set the following variables to true, on the target cluster, to improve the performance of the CRC check for the Cloudera Manager > Clusters > HDFS service > Configuration > HDFS_REPLICATION_ENV_SAFETY_VALVE property:

ENABLE_FILESTATUS_EXTENSIONS
ENABLE_FILESTATUS_CRC_EXTENSIONS

By default, these are set to false.

After you set the key-value pairs, the CRC for each file is queried locally from the NameNode on the source cluster and copied over to the target cluster at the end of the replication process, which reduces the cost because round trip is between two nodes of the same cluster. The CRC checksums are written to the file listing files.

OPSAPS-70685: Post Copy Reconciliation (PCR) for HDFS replication policies between on-premises clusters

To add the Post Copy Reconciliation (PCR) script to run as a command step during the HDFS replication policy job run, you can enter the SCHEDULES_WITH_ADDITIONAL_DEBUG_STEPS = [***ENTER COMMA-SEPARATED LIST OF NUMERICAL IDS OF THE REPLICATION POLICIES***] key-value pair in the target Cloudera Manager > Clusters > HDFS service > hdfs_replication_env_safety_valve property.

To run the PCR script on the HDFS replication policy, use the /clusters/[***CLUSTER NAME***]>/services/[***SERVICE***]/replications/[***SCHEDULE ID***]/postCopyReconciliation API.

For more information about the PCR script, see How to use the post copy reconciliation script for HDFS replication policies.

The repositories for Cloudera Manager 7.7.1-CHF22 are listed in the following table:

Table 1. Cloudera Manager 7.7.1-CHF22
Repository Type	Repository Location
RHEL 8 Compatible	Repository: `https://username:password@archive.cloudera.com/p/cm7/7.7.1-h31-55950782/redhat8/yum` Repository File: `https://username:password@archive.cloudera.com/p/cm7/7.7.1-h31-55950782/redhat8/yum/cloudera-manager.repo`
RHEL 7 Compatible	Repository: `https://username:password@archive.cloudera.com/p/cm7/7.7.1-h31-55950782/redhat7/yum` Repository File: `https://username:password@archive.cloudera.com/p/cm7/7.7.1-h31-55950782/redhat7/yum/cloudera-manager.repo`
SLES 12	Repository: `https://username:password@archive.cloudera.com/p/cm7/7.7.1-h31-55950782/sles12/yum` Repository File: `https://username:password@archive.cloudera.com/p/cm7/7.7.1-h31-55950782/sles12/yum/cloudera-manager.repo`
Ubuntu 20	Repository: `https://username:password@archive.cloudera.com/p/cm7/7.7.1-h31-55950782/ubuntu2004/apt` Repository file: `https://username:password@archive.cloudera.com/p/cm7/7.7.1-h31-55950782/ubuntu2004/apt/cloudera-manager.list`
Ubuntu 18	Repository: `https://username:password@archive.cloudera.com/p/cm7/7.7.1-h31-55950782/ubuntu1804/apt` Repository file: `https://username:password@archive.cloudera.com/p/cm7/7.7.1-h31-55950782/ubuntu1804/apt/cloudera-manager.list`