HBase MCC Usage in Spark with Java
Example on writing to HBase bulk put and hbase-spark
Example
command:
spark-submit --class com.cloudeara.hbase.mcc.java.HBaseMCCBulkPutExample \ --jars "/tmp/hbase-mcc-0.2.0-SNAPSHOT.jar" \ --driver-class-path "hbase-mcc-0.2.0-SNAPSHOT.jar" \ --conf "spark.executor.extraClassPath=hbase-mcc-0.2.0-SNAPSHOT.jar" \ --conf "spark.hbase.connector.security.credentials.enabled=true" \ --conf "spark.yarn.principal=exampleuser/example.kdc.server.com@EXAMPLE.COM" \ --conf "spark.yarn.keytab=/tmp/configs/exampleuser.keytab" \ --conf "spark.security.credentials.hbase.enabled=false" \ --files /tmp/configs/hbase-site1.xml,/tmp/configs/core-site1.xml,/tmp/configs/hbase-site2.xml,/tmp/configs/core-site2.xml \ --principal exampleuser/example.kdc.server.com@EXAMPLE.COM \ --keytab /tmp/configs/exampleuser.keytab \ --master yarn --deploy-mode cluster /tmp/JavaMCCExamples-0.0.1-SNAPSHOT.jar hbase-site1.xml core-site1.xml hbase-site2.xml core-site2.xml
Example code: you can view the example code on this GitHub repository.
Example on writing to HBase bulk get and hbase-spark
Example
command:
spark-submit --class com.cloudeara.hbase.mcc.java.HBaseMCCBulkGetExample \ --jars "/tmp/hbase-mcc-0.2.0-SNAPSHOT.jar" \ --driver-class-path "hbase-mcc-0.2.0-SNAPSHOT.jar" \ --conf "spark.executor.extraClassPath=hbase-mcc-0.2.0-SNAPSHOT.jar" \ --conf "spark.hbase.connector.security.credentials.enabled=true" \ --conf "spark.yarn.principal=exampleuser/example.kdc.server.com@EXAMPLE.COM" \ --conf "spark.yarn.keytab=/tmp/configs/exampleuser.keytab" \ --conf "spark.security.credentials.hbase.enabled=false" \ --files /tmp/configs/hbase-site1.xml,/tmp/configs/core-site1.xml,/tmp/configs/hbase-site2.xml,/tmp/configs/core-site2.xml \ --principal exampleuser/example.kdc.server.com@EXAMPLE.COM \ --keytab /tmp/configs/exampleuser.keytab \ --master yarn --deploy-mode cluster /tmp/JavaMCCExamples-0.0.1-SNAPSHOT.jar hbase-site1.xml core-site1.xml hbase-site2.xml core-site2.xml
Example code: you can view the example code on this GitHub repository.
