3. Install Compression Libraries

Make the following compression libraries available on all the cluster nodes.

 3.1. Install Snappy

  1. Install Snappy.

    • For RHEL and CentOS

      yum install snappy snappy-devel
    • For SLES

      zypper install snappy snappy-devel
  2. Make the Snappy libraries available to Hadoop:

    ln -sf /usr/lib64/libsnappy.so /usr/lib/hadoop/lib/native/Linux-amd64-64/.

 3.2. Install LZO

  • For RHEL and CentOS

    yum install hadoop-lzo lzo lzo-devel hadoop-lzo-native
  • For SLES

    zypper install lzo lzo-devel hadoop-lzo hadoop-lzo-native

loading table of contents...