Impala Lineage Properties

Minimum Required Role: Configurator (also provided by Cluster Administrator, Full Administrator)

The following property controls whether the Cloudera Manager Agent collects lineage entries:

Enable Impala Lineage Collection - Indicates whether Impala lineage logs should be collected.

The following properties apply to the Impala lineage log file:

Enable Impala Lineage Generation - Indicates whether Impala lineage logs should be generated.
Impala Daemon Lineage Log Directory - The directory in which lineage log files are written.
Note: If the value of this property is changed, and service is restarted, then the Cloudera Manager Agent will start monitoring the new log directory. In this case it is possible that not all events are published from the old directory. To avoid loss of lineage, when this property is changed, perform the following steps:
1. Stop the service.
2. Copy lineage log files and (for Impala only) the impalad_lineage_wal file from the old log directory to the new log directory. This needs to be done on all the hosts where Impala daemons are running.
3. Start the service.
Impala Daemon Maximum Lineage Log File Size - The maximum size in number of queries of the lineage log file before a new file is created.

Managing Impala Lineage

Impala lineage is enabled by default. To control whether the Impala Daemon role logs to the lineage log and whether the Cloudera Manager Agent collects the lineage entries:

Go to the Impala service.
Click the Configuration tab.
Select Scope > Impala Daemon.
Select Category > Logs.
Select the Enable Impala Lineage Generation checkbox.
Select Scope > All.
Select Category > Cloudera Navigator.
Select the Enable Lineage Collection checkbox.
Click Save Changes to commit the changes.
Restart the service.

If you deselect either checkbox, Impala lineage is disabled.

Configuring Impala Daemon Lineage Logs

Minimum Required Role: Configurator (also provided by Cluster Administrator, Full Administrator)

Go to the Impala service.
Click the Configuration tab.
Select Scope > Impala Daemon.
Type lineage in the Search box.
Edit the lineage log properties.
Click Save Changes to commit the changes.
Restart the service.

Cloudera Navigator Lineage Diagrams

Schema