Behavioral Changes in Atlas

Behavioral changes denote a marked change in behavior from the previously released version to this version of Apache Atlas.

Cloudera Runtime 7.3.1.400 SP2

Summary:

A new option to ignore spark_process.attributes, details and sparkPlanDescription is introduced.

Previous behavior:

The spark_process entity attributes details and sparkPlanDescription are populated with query plan details, which can contain a large amount of text, often in megabytes. This amount of data can incur unnecessary processing costs.

New behavior:

The attribute atlas.notification.consumer.preprocess.spark_process.attributesis set to false by default. Set it to true to avoid populating the details and sparkplandescription attributes. These attributes can be ignored using above configurations in Atlas server. Ignoring these attributes helps to eliminate the cost of having large amount of data processed in Atlas.

Summary:

A new option to avoid sending details and sparkPlanDescription in the Spark process entity is introduced.

Previous behavior:

The spark_process entity attributes details and sparkPlanDescription are populated with query plan details, which can contain a large amount of text, often in megabytes. This amount of data can incur unnecessary processing costs.

New behavior:

The atlas.spark.plan.enabled is set to true by default. Set it to false to send the details and sparkPlanDescription attributes in the Spark process entity. When these attributes are not sent, the cost of having large amount of data processed in Atlas is avoided.

Cloudera Runtime 7.3.1.300 SP1 CHF 1

There are no behavioral changes in this release.

Cloudera Runtime 7.3.1.200 SP1

There are no behavioral changes in this release.

Cloudera Runtime 7.3.1.100 CHF 1

There are no behavioral changes in this release.

Cloudera Runtime 7.3.1

Summary:
The Exclude SubTypes and Exclude Sub-classifications filters were removed from the Table tab of entity details.
Previous behavior:
Previously, the Exclude SubTypes and Exclude Sub-classifications filters were available from the Table tab in entity details. There were no properties being passed to these filters when you visited the entity details of the page.
New behavior:
The two unused filter checkboxes Exclude SubTypes and Exclude Sub-classifications from the Table tab of entity detail page were removed.
Summary:
Special character validation was added to glossary, term and category names in Apache Atlas.
Previous behavior:
The special characters ('@', '.', '<', '>') could be used in glossary, term and category name fields.
New behavior:
The special characters ('@', '.', '<', '>') are no longer accepted in glossary, term and category name fields by the validation introduced. Avoid using these characters when creating glossary names, glossary terms and category names.