Pre-upgrade - Preparing for CDP Private Cloud Data Services update for CDE

To upgrade the CDE service, no jobs must be running or scheduled in any virtual cluster under that CDE service.

Pause all Airflow jobs and scheduled Spark jobs.
Kill all the the running jobs in the CDE virtual clusters under all CDE services or wait for them to complete.