You can use the cde-env
tool to migrate your
spark-on-YARN
workloads to Cloudera Data Engineering:
-
In the Cloudera console,
click the Data Engineering tile. The Cloudera Data Engineering
Home page displays.
-
In the Home page, click the Migration
Tool link under Resources & Guides to download
the migration tool.
-
Select the Virtual Cluster.
-
Download the tool for either Linux or Mac.
-
Unzip the archive.
This is a temporary installation package and can be saved in any location. The folder contains
README.md, cde, cde-env.sh, spark-submit-cde
, and
spark3-submit-cde
files.