Run sample spark-submit command inside the docker container

After you activate the docker image, you can run your spark-submit commands on CDE without completely rewriting your existing spark-on-yarn command lines inside the docker container.

  • Sample spark-submit commands you can run on the CDE workloads.
    $ spark-submit --name pt_rpt_streams5 --master=yarn --deploy-mode=cluster --driver-memory 4G --executor-memory 4G --executor-cores 3 --num-executors 4 --conf spark.yarn.queue=hr --conf "" --conf "" --conf "" --class org.apache.spark.examples.SparkPi 22