Cloudera Docs

Integrating NiFi with Atlas when Auto-TLS is not enabled

If Auto-TLS enabled is not enabled on your Cloudera Flow Management or on the Cloudera Base on premises cluster, you must manually integrate NiFi with Atlas. To do this, create and configure the ReportLineageToAtlas reporting task in NiFi.

Perform this task if all of the following conditions are true:

  • Cloudera Flow Management does not have TLS enabled
  • The Cloudera Base on premises cluster does not have auto-TLS enabled
  • You do not plan to enable auto-TLS
  • You want to use Atlas with Cloudera Flow Management on a Cloudera Base on premises deployment.
  1. In NiFI, open the Global Menu in the upper-right corner, and select Controller Services.
  2. Click the Reporting Tasks tab.
  3. Click the Add (+) to open the Add Reporting Task dialog.
  4. Select ReportLineageToAtlas, then click Add.
  5. Click the Edit icon to open the Configure Reporting Task dialog.
  6. Configure the required properties described below.
    Atlas URLs
    Shows a comma-separated list of Atlas Server URLs.
    After the reporting task starts, you cannot modify this property to add new Atlas servers. To add an additional Atlas server, you must create a new reporting task.
    Atlas Configuration Directory
    Specifies the directory where the atlas-applications.properties file is created.
    The directory must:
    • Be accessible and writable by the user running the NiFi process
    • Be available on each NiFi node
    • Already exist (the reporting task does not create it)
    • Not be located in the /tmp directory.
    Create Atlas Configuration File
    Set this property to True.
    When enabled, the atlas-application-properties file is automatically created in the Atlas configuration directory when the reporting task starts.
    Lineage Strategy
    Specifies the level of granularity for your NiFi dataflow reporting to Atlas.
    After reporting starts, do not switch between simple and complete lineage strategies.
    Provenance Record Start Position
    Specifies where the reporting task starts reading from the provenance event stream.
    Provenance Record Batch Size
    Specifies the number of provenance records sent to Atlas in a single batch.
    NiFi URL for Atlas
    Specifies the NiFi cluster URL.
    Atlas Authentication Method
    Specifies how the reporting task authenticates with the Atlas server. Basic authentication is the default.
    Kafka Security Protocol
    Specifies the protocol used to communicate with Kafka brokers when sending Atlas hook notification messages. This value must match Kafka's security.protocol property value.