Impala lineage

Atlas lineage graphs help you understand the source and impact of data and changes to data over time and across all your data.

Atlas collects metadata from Impala to represent the lineage among data assets. The Atlas lineage graph displays the input and output processes that the current entity participated in. Entities are included if they were inputs to processes that led to the current entity or if they are outputs of processes for which the current entity was an input. Impala processes follow this pattern.

In Cloudera Runtime 7.1.9 SP2, 7.3.2.10000, and higher versions, Impala lineage events include an explicit operationType field. Atlas uses that value when it builds Impala process and column lineage so the lineage graph reflects the operation without relying only on parsing the full queryText. In lower versions, Atlas infers the operation from the query text, which is less reliable for some statements.