Fixed issues in Ozone

Review the list of Ozone issues that are resolved in Cloudera Runtime 7.1.9 SP1.

CDPD-68972: When a leader Ozone Manager election gets stuck, the leader OM is not available. This causes the failure of the OM operation.

This issue is now resolved.

CDPD-61426: Improve Ozone metadata performance by avoiding duplicated internal lookups.

This issue is now resolved.

CDPD-57118: Improve Ozone metadata performance by optimizing internal locking implementation.

This issue is now resolved.

CDPD-69167: Upgrade Bouncy Castle to 1.78.

Upgraded Bouncy Castle Java release version to 1.78 to address issues identified in CVE-2023-33202, CVE-2023-33201, CVE-2024-29857, CVE-2024-30171, and CVE-2024-30172.

CDPD-68255: Upgrade Commons-configuration2 to 2.10.1.

Upgrade Commons-configuration2 version to 2.10.1 to address issues identified in CVE-2024-29133 and CVE-2024-29131.

CDPD-68159: File encryption information is not properly set when overwriting a file.

When a file is overwritten, the new version of the file uses encryption information of the old version file. This issue is now resolved.

CDPD-62273: Incorrect error message is displayed when deleting a file in a .snapshot path.

Correct error message is displayed now when deleting a file in the .snapshot path.

CDPD-62272: Return error response when creating a directory in the .snapshot path.

This issue has been fixed by displaying an error if the directories in the the reserved .snapshot path are deleted.

CDPD-61779: SnapshotDiff cannot accept continuation token greater than the length of the actual snapdiff.

This issue has been fixed by displaying an invalid token exception if the token is out of the range.

CDPD-67224: Upgrade Spring Framework to 6.1.6/6.0.19/5.3.34.

Upgrading spring framework to 5.3.34 to address issues identified in CVE-2024-22243, CVE-2024-22259, and CVE-2024-22262.

CDPD-67146: Add permission check for snapshot diff.

Only users with bucket read permission are allowed to get snapshot diff between two snapshots.

CDPD-64545: Recon Backport HDDS-9599 to CDP Private Cloud Base 7.1.9 SP1.

This issue is now resolved by highlighting the search icon in the OM DB Insights of Recon to navigate to containers.

CDPD-64540: Recon Backport HDDS-9161 to CDP Private Cloud Base 7.1.9 SP1.

This issue is now resolved.

CDPD-64500: Option to enable Ratis in SCM.

Starting CDP Private Cloud Base 7.1.9 SP1, you can enable Ratis in SCM on an existing Non-HA cluster by modifying ozone.scm.ratis.enable property. Enabling Ratis is prerequisite for making SCM Highly Available. This issue is now resolved.

CDPD-64285: Implement snapshot list pagination.

This issue is now resolved by adding the listOptions to list snapshot CLI to make the pagination work correctly.

CDPD-63165: The InvalidStateTransitionException exception is displayed after recommissioning SCM.

When a new SCM is bootstrapped with Container CLOSE transactions in Raft Log for the containers that are closed due to Pipeline failure, the newly bootstrapped SCM will fail to start as those containers are in OPEN state on the new SCM. To avoid this, the finalization of containers is now done only by the leader SCM and this operation goes through Ratis so that the followers also update the container state in the DB. This issue is now resolved.

CDPD-56768: ReplicationFactor may be one or three.

This issue occurs when distcp tries to create target replicas with a replication factor of 1 when the source replicas were Erasure Coded. This issue is now resolved.