Prerequisites for setting up the cde-env tool
You must obtain the virtual cluster endpoint URL, Cloudera endpoint URL, and generate user keys for each user whose Spark jobs you are migrating over to Cloudera Data Engineering.
-
Virtual Cluster Endpoint URL: Determine the virtual
cluster endpoint URL.
- In the Cloudera console, click the Data Engineering tile. The Cloudera Data Engineering Home page displays.
- Click Administration in the left navigation menu, select the environment containing the virtual cluster you want to use.
- In the Virtual Clusters column on the right, click the Cluster Details icon for the virtual cluster you want to use to migrate your spark jobs to.
- Click JOBS API URL to copy the URL to your clipboard.
- Paste the URL into a text editor to identify the endpoint host. For example, the URL
is similar to the following:
https://dfdj6kgx.cde-2cdxw5x5.apps.ecs-demo.example.com/dex/api/v1
In the above example, the endpoint host isdfdj6kgx.cde-2cdxw5x5.apps.ecs-demo.example.com
-
Cloudera Endpoint URL: Copy the Cloudera console URL.
-
Access Key: Generate access key for each user
whose Spark jobs you are migrating over to Cloudera Data Engineering
:- Sign in to the Cloudera console as an Administrator.
- In the Cloudera Home page, click Cloudera Management Console.
- On the left navigation menu, click Users.
- On the Users page, click the name of the user or the machine user account for which you want to generate an access key.
- On the user account page, go to the Access Keys section and
click Generate Access Key.
Cloudera creates the key and displays the information on the screen.