Validating the Spark Installation
To validate the Spark or Spark2 installation process, run the Spark Pi and WordCount jobs supplied with the Spark package. For more information, see Running Spark Applications.
- 1. Analyzing Data with Apache Spark
- 2. Installing Spark
- 3. Configuring Spark
- 4. Running Spark
- 5. Submitting Spark Applications Through Livy
- 6. Running PySpark in a Virtual Environment
- 7. Automating Spark Jobs with Oozie Spark Action
- 8. Developing Spark Applications
- Using the Spark DataFrame API
- Using Spark SQL
- Calling Hive User-Defined Functions
- Using Spark Streaming
- HBase Data on Spark with Connectors
- Accessing HDFS Files from Spark
- Accessing ORC Data in Hive Tables
- Using Custom Libraries with Spark
- 9. Using Spark from R: SparkR
- 10. Tuning Spark