Storage reduction for Atlas

Audit aging reduces the existing audit data in Apache Atlas based on the user-defined retention criteria. You can configure retention periods for DDL events pertaining to schema changes to meet organizational compliance requirements.

Atlas creates audit events for creation, update, and deletion (CUD) of entities in Cloudera, including TAG/Classification and DML events. Notification processing with less significant metadata, exponential growth of audit events with no constraints, and retaining of audit data for long periods of time causes overhead on the application processing and consumes additional storage space, thereby causing operational inefficiencies.

Atlas supports various audit reduction strategies, pertaining to the type of audit data the users can store and the period of time that they can retain the data in the Atlas systems.

Audit reduction strategies include the following options:

• DML Audit Filter — A hook-based filter that skips processing of DML events.
• Custom Audit Filters — User-defined filters that ignore or skip specified audit events.
• Audit Aging — A criteria-based filter that purges existing audit data.

Audit reduction strategies do not apply to Admin Audit data, which persists in the atlas_janus table.