Data Movement and Integration
Also available as:
PDF
loading table of contents...

Sqoop Import Jobs Using --as-avrodatafile

When running a Sqoop import job with --as-avrodatafile, you must set the parameter -Dmapreduce.job.user.classpath.first to true.

Sqoop command line example:

.bq sqoop -Dmapreduce.job.user.classpath.first=true <rest of sqoop arguments for an avro job>

When running a Sqoop import action in Oozie, since the job runs in the launcher, you must add the prefix oozie.launcher.

Oozie Sqoop action example:

<property>

<name>oozie.launcher.mapreduce.user.classpath.first</name>

<value>true</value>

</property>