Cloudera Docs

Using spark-submit drop-in migration tool for migrating Spark workloads to Cloudera Data Engineering

Cloudera Data Engineering provides a command line tool cde-env to help migrate your Cloudera Spark workloads running on Cloudera Base on premises (spark-on-YARN) and Cloudera Data Hub to Cloudera Data Engineering without having to completely rewrite your existing spark-submit command-lines.

Supported platforms

You can use the migration tool in the following platforms:

  • Linux
  • MacOS
  • Windows (Docker only)

You can use the migration tool either by installing it on a gateway host or running it as a docker container.