Enabling Spark on YARN for Atlas
Post-migration, Spark hook for Atlas is not enabled by default on AM2CM migrated clusters. you must manually enable Spark hook.
- Log into Cloudera Manager instance
- Navigate to Clusters
- Select the Spark on YARN service
- Select Configurations tab
- Check the Enable Spark Lineage checkbox
- Select Atlas Dependency
- Click Save Changes
