Command Line Upgrade
Also available as:
PDF
loading table of contents...

Configure Apache Pig

  1. Replace your configuration after upgrading. Copy /etc/pig/conf from the template to the conf directory in pig hosts.

  2. To validate the Apache Pig upgrade, complete the following steps:

    1. On the host machine where Pig is installed, run the following commands:

      sudo su -c "hadoop fs -copyFromLocal /etc/passwd passwd" $HDFS_USER
    2. Create a Pig script file named /tmp/id.pig that contains the following Pig Latin commands:

      A = load 'passwd' using PigStorage(':');B = foreach A generate $0 as id; store B into '/tmp/id.out';
    3. Run the Pig script:

      su - $HDFS_USER
      pig -l /tmp/pig.log /tmp/id.pig