Fixed issues in 7.1.9 SP1 CHF 3

Know more about the cumulative hotfix 3 for 7.1.9 SP1. This cumulative hotfix was released on 11 Nov, 2024.

Following are the list of fixes that were shipped for CDP Private Cloud Base version 7.1.9-1.cdh7.1.9.p1015.59425156.

CDPD-75272: Backport YARN-11709 to 7.1.9.1000: NodeManager is now shut down when it cannot run the /var/lib/yarn-ce/bin/container-executor program.
Apache Jira: YARN-11709
CDPD-75008: Performance fixes for Ozone plugin: Fixed the performance issues observed while evaluating policies for multi-level resources:

Improves policy evaluation for multi level resource hierarchies (RANGER-4893).

Reduces time to find tags associated with multi-level resources (RANGER-4922).
CDPD-75001: Export/Import APIs : Unable to import shell entities: Validation of mandatory attributes for shell entity has been removed
CDPD-74686: [AUTOSYNC] DirectoryDeletion task ignored through ratis: Previously, directory deletion task was ignored through Ratis, and there was deletion retry instaed of actually deleting it. This issue is now resolved.
CDPD-74685: [AUTOSYNC] Directory deletion get stuck having millions of directory: Directory deletion cleanup at background failed if there were huge number of empty directories (millions of empty directories), whose combined metadata size crossed the Ratis allowed request size for deletion. This issue is now resolved.
CDPD-74630: Backport HADOOP-18845 "Add ability to configure ConnectionTTL of http connections while creating S3 Client." to 7.1.9.1000
CDPD-74624: IMPALA-13262 Incorrect results due to predicate pushdown in join condition: Impala can incorrectly push predicates to scan nodes, causing wrong results in some join scenarios. For example, a query that should return 0 rows may return incorrect results when specific predicates are used.; Removing analytic predicates with self-referencing TupleIds during query execution prevents incorrect pushdown and resolves the issue.
CDPD-74309: IMPALA-13203 Boolean literals in OR conditions are not simplified as expected: Impala currently fails to simplify expressions like id = 0 OR false to id = 0. The root cause is that the CompoundPredicate generated by NormalizeExprsRule is not analyzed, preventing SimplifyConditionalsRule from applying the expected rewrite.; This fix addresses the issue by ensuring that the rewritten CompoundPredicate is analyzed properly, allowing boolean literals in AND/OR conditions to be simplified as expected.
CDPD-74842: IMPALA-13302 Conjunct registration issue during query rewrite in Impala: This issue, introduced in version 7.1.9, caused some queries with expressions that could be rewritten to false to fail with an IllegalStateException: Illegal reference to non-materialized slot; The issue was addressed by reverting an optimization that skipped registering certain conjuncts, ensuring proper registration and assignment during query analysis.
CDPD-74560: IMPALA-13378 Impalad crash due to inconsistent tuple IDs during query execution: Avoid impalad crash in RowDescriptor::InitTupleIdxMap() by verifying tuple ids in descriptor table received in executor side.
CDPD-72522: IMPALA-12582 Executor crash during runtime filter generation: Enabling the MIN_MAX runtime filter in nested loop Joins for certain queries caused out-of-bounds access, leading to executor crashes that prevented any queries from running, disrupting production.; The issue was resolved by ensuring ScalarExprEvaluator properly calls the Open() function, preventing out-of-bounds access and stabilizing query execution.
CDPD-74492: [7.1.9 SP1 CHF3] [UI] 'Exclude SubTypes' and 'Exclude Sub-classifications' filter should be removed from referred attributes tab of entity details page: 1)Added the validation for glossary, term and category name. The special characters will not be allow on the glossary, term and category name field. 2)The two unused filters 'Exclude SubTypes' and 'Exclude Sub-classifications from referred attributes tab of entity detail page were removed
CDPD-74472: When migration restarts it results into deletion of edges and vertices: fixed migration flow for : When migration is rerun after interruption it will avoid deleting edges and vertices from existing data and process data faster
CDPD-74441: [UI] 'Exclude SubTypes' and 'Exclude Sub-classifications' filter should be removed from referred attributes tab of entity details page: 1)Added the validation for glossary, term and category name. The special characters will not be allow on the glossary, term and category name field. 2)The two unused filters 'Exclude SubTypes' and 'Exclude Sub-classifications from referred attributes tab of entity detail page were removed
CDPD-74416: Backporting rel2j - CDPD - 74200 into 7.1.9 SP1 CHF3: When rel2j library was bumped up to higher version, Recon was failing to start. So this Recon start was fixed as part of this JIRA.
CDPD-74377: Replace solr.version with solr_lkgb_jar_version in the Ozone service.: This issue is now resolved. The build components file now replace pom solr.version with solr_lkgb_jar_version enabling the Ozone to use the downstream version of Solr
CDPD-74354: HIVE-28484 SharedWorkOptimizer sends DPP events to unknown operators: This issue is now fixed.
CDPD-74344: Ozone Recon Heatmap - Make SolrHttpClient to work wirh Solrj lib when kerberos is enabled.: When Recon Heatmap started using downstream version of solrJ lib, then kerberos client auth stopped working, This was fixed as part of this JIRA.
CDPD-74311: Support SASL bind for Ranger Usersync with AD/LDAP: Usersync of Ranger supports GSSAPI SASL Bind. For more information see, Support for SASL Bind in Ranger Usersync.
CDPD-73882: Alter Rename should not check for the CREATE permission on the database in which renamed table is created.: Alter rename command doesn't require CREATE permission on the database in which renamed table is created
CDPD-73264: Backport OMID-262: Remove commons-configuration: Upgraded Commons-configuration2 to 2.10.1.
CDPD-72032: Searching with the application ID and DAG ID not working in Hive Queries: This fix addresses the issue by ensuring that searching using the application ID and DAG ID in the Hive Queries tab of the Job Browser using the Hue Query Processor retrieves the results.
CDPD-72019: Remove the locks from SnapshotPurge and SnapshotSetProperty APIs: This issue is now resolved by fixing Ozone Manager crash issue when the follower is lagging and it executes purgeKeys or snapshotMoveDeletedKeys for the Snapshot in one transaction.
CDPD-71580: workaround needed for bootbox due to CVE-2023-46998: Bootbox.js library is outdated and vulnerable. so we remove it and use new library Bootprompt.
CDPD-69970: Support custom delimiter in SkippingTextInputFormat: Support custom delimiter in SkippingTextInputFormat
CDPD-68793: Hadoop - Upgrade Kafka Clients due to CVEs: Fixes CVE-2023-25194, CVE-2021-38153 and CVE-2018-17196
CDPD-68676: The getTopicContent does not always return messages when available: Fixed an issue when getTopicContent didn't return all messages up to the specified end offset when an individual poll request took too much time. The timeout for the whole getTopicContent request defined in responseTimeOutInMs still applies.
CDPD-67096: Upgrade commons-compress to 1.26.0 due to CVE-2024-25710 and CVE-2024-26308: This issue is now resolved by fixing CVE-2024-25710 and CVE-2024-26308.
CDPD-66299: Set role command is not audited by ranger: Audit Set role command in ranger
CDPD-65034: Receiving Error " TypeError: 'NoneType' object is not callable" in TCLIService.py when custom headers are being set: When XSRF (Cross-Site Request Forgery) or CSRF (Cross-Site Request Forgery) is enabled in Hive or Impala, you might encounter the error "Error " TypeError: 'NoneType' object is not callable” in TCLIService.py. You can resolve this issue by upgrading to 7.1.9 SP1 CHF3 version.
CDPD-64286: Hue - Metrics cannot restore database connections on failure: This fix resolves an issue where Hue could not establish a new database connection following a backend database restart, ensuring that all metrics are computed consistently after such events.
CDPD-62285: S3A StagingCommitter does not clean up staging-uploads directory: Fixed an issue that caused incomplete cleanup of staging committer limiting the number of jobs that could be committed.
For more information, see HADOOP-18793.
CDPD-60647: Snapshot purge should be an atomic operation.: This issue is resolved by fixing OM crash issue when the follower is lagging and it executes purgeKeys or snapshotMoveDeletedKeys for the Snapshot in one transaction.
CDPD-8041: Add HTTP Cache-Control Header: Added two Zeppelin configuration properties to control the HTTP response headers, allowing for improved cache management and server response behavior. See Configuring Zeppelin caching.

KUDU-3619: Disable KUDU-3367 behavior by default: This fix addresses an issue with major delta compaction caused by functionality introduced in KUDU-3367. The fix disables the functionality by adjusting the default value of the -all_delete_op_delta_file_cnt_for_compaction flag. While the original functionality was intended to optimize Kudu deployments of early versions, the functionality introduced by KUDU-3367 isn't relevant for data generated by Kudu servers in CDP 7.1.1 and newer versions. For more information, see KUDU-3619.

There are no Common Vulnerabilities and Exposures (CVE) fixed in this CHF.