Cloudera Docs

Getting Cloudera Data Engineering job information using the API

You can get Cloudera Data Engineering (CDE) job information using the API by issuing a GET request to the /jobs/<job_name> endpoint.

Get an access token and save it as an environment variable as described in Getting a Cloudera Data Engineering API access token.
  1. Determine the API URL for the virtual cluster you want to access using the API:
    1. Navigate to the Cloudera Data Engineering Overview page.
    2. In the CDE Services column, select the environment containing the virtual cluster you want to interact with using the API.
    3. In the Virtual Clusters column on the right, click the Cluster Details icon for the virtual cluster you want to interact with.
    4. Copy the URL under JOBS API URL.
      For example: https://pmjkrgn5.cde-czlmkz4y.na-01.xvp2-7p8o.cloudera.site/dex/api/v1
  2. Issue a GET request to the /jobs/<jobname> endpoint:
    curl -H "Authorization: Bearer ${CDE_TOKEN}" -X GET "https://pmjkrgn5.cde-czlmkz4y.na-01.xvp2-7p8o.cloudera.site/dex/api/v1/jobs/SparkPi"