Using Python virtual environments with Cloudera Data Engineering

Cloudera Data Engineering supports Python virtual environments to manage job dependencies by using the python-env resource type.

A resource in Cloudera Data Engineering is a named collection of files or other resources referenced by a job. The python-env resource type allows you to specify a requirements.txt file that defines a virtual environment that you can then associate with a Cloudera Data Engineering job. You can specify any Python package in the requirements.txt file, including those with C dependencies.