Compiling and running Spark workloads

After modifying the workloads, compile and run (or dry run) the refactored workloads on Spark 2.4.

You can write Spark applications using Java, Scala, Python, SparkR, and others. You build jars from these scripts using one of the following compilers.

• Java (with Maven/Java IDE),

• Scala (with sbt),

• Python (pip).

• SparkR (RStudio)