Event notification cleanup interval

A new configuration is introduced to specify the Time-to-live (TTL) for event notifications based on whether replication is enabled. The TTL determines how long the events can remain in the Hive Metastore (HMS).

Before upgrade to CDP 7.1.5

The hive.metastore.event.db.listener.timetolive property was used to determine how long events are stored in the HMS after which the events are removed from the database listener queue. The default value for this property is set to 1 day. However, this does not take replication into context in order to have a longer duration.

After upgrade to CDP 7.1.5

A new property, hive.repl.event.db.listener.timetolive is introduced to determine how long events are stored in the HMS based on whether replication (hive.repl.cm.enabled) is enabled or not. The default value of this property is set to 10 days.

When hive.repl.cm.enabled is set to true, the TTL is determined by the value specified in hive.repl.event.db.listener.timetolive. Else, if the value is set to false, the TTL reverts to the earlier behavior and is determined by the value specified in hive.metastore.event.db.listener.timetolive.

For more information, see HIVE-24173.

Action required

If replication is enabled (hive.repl.cm.enabled=true), then ensure that the hive.repl.event.db.listener.timetolive property is set to the required time for which you want event notifications to be stored in the HMS.