3. Install Compression Libraries

Make the following compression libraries available on all the cluster nodes:

  1. Install Snappy.

    Complete the following instructions on all the nodes in your cluster:

    1. Install Snappy.

      • For RHEL and CentOS

        yum install snappy snappy-devel
        
      • For SLES

        zypper install snappy snappy-devel
        
    2. Make the Snappy libraries available to Hadoop:

      ln -sf /usr/lib64/libsnappy.so /usr/lib/hadoop/lib/native/Linux-amd64-64/.

  2. Install LZO.

    Execute the following command on all the nodes in your cluster. From a terminal window, type:

    • For RHEL and CentOS

      yum install hadoop-lzo lzo lzo-devel hadoop-lzo-native
      
    • For SLES

      zypper install lzo lzo-devel hadoop-lzo hadoop-lzo-native
      


loading table of contents...