Associating a Python virtual environment with a Cloudera Data Engineering job

You can associate the Python virtual environment with a CDE job at the time of creation, or you can update an existing job.

  • Download and configure the CDE CLI.
  • Create a Python virtual environment CDE resource.
  • Create a CDE job.
Using the CDE CLI, run the cde job update command to associate a Python virtual environment with the job.
cde job update --name pyspark-example --python-env-resource-name cde-python-env-resource