Importing External Packages
If you want to use an external package within a Zeppelin note, you can follow one of these approaches:
Specify the dependency for the associated interpreter on the Interpreter page. For more information, see Dependency Management for Interpreter at
zeppelin.apache.org
.For Spark jobs, you can pass a jar, package, or list of files to
spark-submit
usingSPARK_SUBMIT_OPTIONS
; for example:SPARK_SUBMIT_OPTIONS in
conf/zeppelin-env.sh
export SPARKSUBMITOPTIONS="--packages com.databricks:spark-csv_2.10:1.2.0 --jars /path/mylib1.jar,/path/mylib2.jar --files /path/mylib1.py,/path/mylib2.zip,/path/mylib3.egg"
In
SPARK_HOME/conf/spark-defaults.conf
spark.jars /path/mylib1.jar,/path/mylib2.jar spark.jars.packages com.databricks:spark-csv_2.10:1.2.0 spark.files /path/mylib1.py,/path/mylib2.egg,/path/mylib3.zip
If you want to import a library for a note that uses the Livy interpreter, see Using the %livy
Interpreter to Access Spark.