17. Configure and Start Apache Pig

  1. Replace your configuration after upgrading. Copy /etc/pig/conf from the template to the conf directory in pig hosts.

  2. To validate the Apache Pig upgrade, complete the following steps:

    1. On the host machine where Pig is installed, run the following commands:

      su - $HDFS_USER/usr/hdp/current/hadoop/bin/hadoop
      fs -copyFromLocal /etc/passwd passwd
    2. Create a Pig script file named /tmp/id.pig that contains the following Pig Latin commands:

      A = load 'passwd' using PigStorage(':');B = foreach A generate $0 as id; store B into '/tmp/id.out';
    3. Run the Pig script:

      su - $HDFS_USER
      pig -l /tmp/pig.log /tmp/id.pig

loading table of contents...