Fixed Issues in Atlas

Review the list of Atlas issues that are resolved in Cloudera Runtime 7.1.9 SP1.

CDPD-69894: Atlas uses the upstream iceberg-hive-runtime package instead of the CDP build

The version of the iceberg-hive-runtime artifact is changed to a snapshot version, so downstream patches, bugfixes and CVE fixes will be pulled.

CDPD-69162: Upgrade jersey version to jersey 2

The Jersey version is upgraded to use Jersey 2 after Jackson Databind is updated to 2.15.

CDPD-66567: fetchType as "incremental" does full export instead of "CONNECTED"

An additional check is added for the Hive and Iceberg table export request to check if the fetch type is incremental or not.

CDPD-65509: Atlas Import/Export with iceberg_table type is copying Hive External Entity also

An additional check is added for the Hive and Iceberg table export request to check if the fetch type is incremental or not.

CDPD-59028, CDPD-62893: Cloudera Runtime 7.1.9 SPx Audit aging should be possible with only ttl or audit count instead of both

The issue was fixed by enabling the separate configuration of time-to-live and audit count limit parameters. For more information, see Using default audit aging

CDPD-62837: hive_storagedesc is incomplete in Atlas

The HDFS data pertaining to Hive tables that have undergone migration using the Navigator to Atlas transition process might be missing some information. The Nav2Atlas module was changed to set the relationType as "hive_table_storagedesc" of relationship attribute "table" for evey entity of "hive_storagedesc".

CDPD-62834: Status of deleted table is ACTIVE in Atlas after navigator2atlas migration

Deleted Hive tables migrated using the Navigator to Atlas transition may be shown as active in Atlas. The Nav2Atlas module was changed to set the relationType as "hive_table_storagedesc" of relationship attribute "table" for every entity of "hive_storagedesc".

CDPD-59033: Compression algorithm changed from Gzip to Snappy in Atlas HBase tables

The default compression algorithm was changed from Gzip' to 'Snappy' in Atlas HBase tables.

CDPD-57021: Relationship Search feature should be configurable

Relationship Search feature is made configurable to reduce time taken for iterating all the edges.

CDPD-55697: Clean Atlas application log in case of HA mode

The unwanted error logs are removed from the Atlas application log file.

CDPD-67977: Nullpointer exception during incremental Atlas Export

An incremental export with glossary and terms associated with exported entities was causing a null pointer exception, which is now resolved.

CDPD-67553: Parallel Atlas Import is failing with unexpected errors

Import operation of an entity is retried thrice when the transaction fails because of a PermanentLockingException. This issue is now resolved.

CDPD-59586: OperationType does not support Contains operation

Support for sub-string and wild character '*' is not present for attributeName=operationType in the Custom Audit Filters feature,.Hence, attributeValue can not be checked with the contains operator. This is fixed by adding support for substrings and the wildcard character "*" for the attribute operationType.

CDPD-65804: Atlas cannot search comments containing Chinese or Japanese characters

Entities whose comments contain Chinese or Japanese characters can be now searched by using the comment (string), containing filters.

CDPD-69654: Atlas parallel export fails with the formation of incomplete .zip files

An extra flag is added in Atlas. By enabling it (skipUpdateReplicationAttr":true), it will skip updating each entity for adding replicatedTo/replicatedFrom attribute, which will ultimately increase the performance of exporting and importing.

CDPD-69176: Entity search with "begins with" operator does not return correct results for some Japanese characters

Entities containing Japanese or Chinese can also be searched by using the “begins with” search filter.

CDPD-68655: Tag searches with multiple Japanese or multiple Chinese characters do not return the correct results

Tag searches work with multiple Japanese or Chinese characters included for hdfs_path entities.

CDPD-68643: Basic search query with '<Japanese search string>*' does not always return results

Searches including Japanese characters and the asterisk character can be reliably made.

CDPD-68328: Faceted hdfs_path entity type searches containing Japanese or Chinese characters do not return results only with query format searches.

Hdfs_path type entity queries can employ multiple filters (attribute, classification) concurrently.

CDPD-68189: Faceted searches do not give correct results for the "contains" operator applied to Chinese words with multiple characters.

Chinese words with multiple characters can be searched reliably.

CDPD-67022: Imports fail with 403 error by users with export, import permissions but without create, read, write, and update entity permissions

After the update, following a successful import, Atlas creates an entity of type _{}AtlasAuditEntry{} and no longer throws an _UNAUTHORIZED_ACCESS error with status code 403 because lacking create, read, write or update user permissions.

CDPD-67020: Imports fail by users with export or import permissions but no other permission for entities

After the update, during an export process, the following applies:

• The AtlasServerService creates a new AtlasServer entity if it does not exist already.
• The xportImportAuditService creates an entity with type __ExportImportAuditEntry if adequate read and write permissions are not present for the mentioned entities, exceptions are no longer thrown and the creation of the atlas-export-result.json is no longer skipped in the flow. The import with this export no longer throws a Null Pointer Exception due to the missing atlas-export-result.json.