Enabling Spark on YARN for Atlas

Post-migration, Spark hook for Atlas is not enabled by default on AM2CM migrated clusters. you must manually enable Spark hook. This section is not applicable if you are upgrading to CDP Private Cloud Base 7.1.7.

  1. Log in to your Cloudera Manager instance
  2. Navigate to Clusters
  3. Select the Spark on YARN service
  4. Select Configurations tab
  5. Check the Enable Spark Lineage checkbox
  6. Select Atlas Dependency
  7. Click Save Changes