Adding profile for each user and creating the Credentials file

You must create a profile for each user in the ~/.cde/config.yaml file and add the access key in the Credentials file.

Create the config.yaml and credentials files under ~/.cde folder. If the ~/.cde folder does not exist, create it where the cde-env tool is installed.

Edit the config.yaml file. You can create multiple profiles in the ~/.cde/config.yaml file and can be used while running commands.

Edit the ~/.cde/config.yaml file to add the allow-all-spark-submit-flags: true parameter and update the profiles.

# ~/.cde/config.yaml

allow-all-spark-submit-flags: true 
credentials-file: <credentials-location>
cdp-endpoint: <CDP-endpoint>
tls-insecure: true
  
profiles:
- name: <Profile Name1>
  vcluster-endpoint: <VC-endpoint>

- name: <Profile Name2>
  vcluster-endpoint: <VC-endpoint>

Example configuration file:

# ~/.cde/config.yaml
      
allow-all-spark-submit-flags: true 
credentials-file: /home/cdpuser1/.cde/credentials
cdp-endpoint: https://console-xhu-141.apps.shared-os-dev-01.kcloud.example.com
tls-insecure: true
      
profiles:
- name: vc-2
  vcluster-endpoint: https://5b27g4jm.cde-x6j2nh5j.apps.apps.shared-osdev-01.kcloud.example.com/dex/api/v1/

- name: spark3-1
  vcluster-endpoint: https://7j92n8q4.cde-smstx27m.apps.apps.shared-osdev-01.kcloud.example.com/dex/api/v1/

Add your access key information generated from the CDP management console in the credentials file.

Example credentails file:

[default]
cdp_access_key_id=a4e8f324-5940-454c-a172-5c748e56e4c2
cdp_private_key=qpG0CzVqodKTQYXakm89bjX0606c7fP3EnAcxuy+Rzs=