Configuring the compaction check interval
You need to know when and how to control the compaction process checking, performed in the background, of the file system for changes that require compaction.
- Reduces the time it takes for compaction to be started for a table or partition that requires compaction.
Requires several calls to the file system for each table or partition that has undergone a transaction since the last major compaction, resulting in increases to the load on the filesystem.
To configure the compaction check interval, set the hive.compactor.check.interval. For example:
ALTER TABLE mydb.mytable SET TBLPROPERTIES ('hive.compactor.check.interval' = '300s');