Using spark-submit drop-in migration tool for migrating Spark workloads to CDE
Cloudera Data Engineering (CDE) provides a command line tool cde-env
to help migrate your CDP Spark workloads running on CDP Private Cloud Base
(spark-on-YARN
) to CDE without having to completely rewrite your existing
spark-submit
command-lines.
Supported platforms
You can use the migration tool in the following platforms:
- Linux
- MacOS