Compiling and running a Scala-based job

cat build.sbt
name := "Simple Project"
version := "1.0"
scalaVersion := "2.12.15"
libraryDependencies += "org.apache.spark" %% "spark-sql" % "2.4.0"             

You also need to create a compile the following example Spark program written in Scala:

/* SimpleApp.scala */
import org.apache.spark.sql.SparkSession
 
object SimpleApp {
  def main(args: Array[String]) {
	val logFile = "YOUR_SPARK_HOME/README.md" // Should be some file on your system
	val spark = SparkSession.builder.appName("Simple Application").getOrCreate()
	val logData = spark.read.textFile(logFile).cache()
	val numAs = logData.filter(line => line.contains("a")).count()
	val numBs = logData.filter(line => line.contains("b")).count()
    println(s"Lines with a: $numAs, Lines with b: $numBs")
	spark.stop()
  }