ML Runtimes Environment Variables List
The following table lists Cloudera AI environment variables that you can use to customize your project environments. These can be set either as a site administrator or within the scope of a project or a job.
Environment Variable | Description |
---|---|
MAX_TEXT_LENGTH
|
It is the maximum number of characters that can be displayed in a single text cell. By default, this value is set to 800,000 and any more characters will be truncated. Default value: 800,000 |
SESSION_MAXIMUM_MINUTES
|
It is the maximum number of minutes a session can run before it times out. Default value: 60*24*7 minutes (7 days) Maximum value: 35,000 minutes |
JOB_MAXIMUM_MINUTES
|
It is the maximum number of minutes a job can run before it times out. Default value: 60*24*7 minutes (7 days) Maximum value: 35,000 minutes |
IDLE_MAXIMUM_MINUTES
|
It is the maximum number of minutes a session can remain idle before it exits. In case of a Jupyterlab session, this is the maximum number of minutes a kernel can remain idle before it exits. Default value: 60 minutes Maximum value: 35,000 minutes Idle timeouts for sessions vary by workbench type (runtime).
|
JUPYTER_SERVER_TIMEOUT_SECONDS
|
It is the maximum number of seconds a Jupyterlab session can run without any activity before it exits. Having the Session open in an active browser tab and having running kernels within Jupyterlab count as activity. Default value: 300 seconds |
Per-Engine Environmental Variables: In addition to the previous table, there are some more built-in environmental variables that are set by the Cloudera AI application itself and do not need to be modified by users. These variables are set per-engine launched by Cloudera AI and only apply within the scope of each engine.
Environment Variable | Description |
---|---|
CDSW_PROJECT
|
The project to which this engine belongs. |
CDSW_ENGINE_ID
|
The ID of this engine. For sessions, this appears in your browser's URL bar. |
CDSW_MASTER_ID
|
If this engine is a worker, this is the
|
CDSW_MASTER_IP
|
If this engine is a worker, this is the IP address of its master. |
CDSW_PUBLIC_PORT |
A port on which you can expose HTTP services in the engine
to browsers. HTTP services that bind
A direct link to these web services will be available from the grid icon in the upper right corner of the Cloudera AI web application, as long as the job or session is still running. For more details, see Accessing Web User Interfaces from Cloudera AI. In Cloudera AI, setting
|
CDSW_APP_PORT |
A port on which you can expose HTTP services in the engine
to browsers. HTTP services that bind
A direct link to these web services will be available from the grid icon in the upper right corner of the Cloudera AI web application as long as the job or session runs. Even if the web UI does not have authentication, only Contributors and those with more access to the project can access it. For more details, see Accessing Web User Interfaces from Cloudera AI. Note that if the Site Administrator has enabled Allow only session creators to run commands on active sessions, then the UI is only available to the session creator. Other users will not be able to access it. Use |
CDSW_READONLY_PORT |
A port on which you can expose HTTP services in the engine
to browsers. HTTP services that bind
A direct link to these web services will be available to users with from the grid icon in the upper right corner of the Cloudera AI web application as long as the job or session runs. Even if the web UI does not have authentication, Viewers and those with more access to the project can access it. For more details, see Accessing Web User Interfaces from Cloudera AI. Use |
CDSW_DOMAIN
|
The domain on which Cloudera AI is being served. This can be useful for iframing services, as demonstrated in Accessing Web User Interfaces from Cloudera AI. |
CDSW_CPU_MILLICORES
|
The number of CPU cores allocated to this engine, expressed in thousandths of a core. |
CDSW_MEMORY_MB
|
The number of megabytes of memory allocated to this engine. |
CDSW_IP_ADDRESS
|
Other engines in the Cloudera AI cluster can contact this engine on this IP address. |