Configure Phoenix-Spark connector using Cloudera Manager

  1. Go to the Spark service.
  2. Click the Configuration tab.
  3. Select Scope > Gateway.
  4. Select Category > Advanced.
  5. Locate the Spark Client Advanced Configuration Snippet (Safety Valve) for spark-conf/spark-defaults.conf property or search for it by typing its name in the Search box.
  6. Add the following properties to ensure that all required Phoenix and HBase platform dependencies are available on the classpath for the Spark executors and drivers:

    Phoenix client JARs:

    spark.executor.extraClassPath=phoenix-<version>-client.jar
    spark.driver.extraClassPath=phoenix-<version>-client.jar

    Phoenix-Spark JARs:

    spark.executor.extraClassPath=phoenix-spark-<version>.jar
    spark.driver.extraClassPath=phoenix-spark-<version>.jar
  7. Enter a Reason for change, and then click Save Changes to commit the changes.
  8. Restart the role and service when Cloudera Manager prompts you to restart.