3. Install Compression Libraries

Make the following compression libraries available on all the cluster nodes.

 3.1. Install Snappy

Complete the following instructions on all the nodes in your cluster:

  1. Install Snappy. From a terminal window, type:

    • For RHEL/CentOS/Oracle Linux:

      yum install snappy snappy-devel
    • For SLES:

      zypper install snappy snappy-devel
    • For Ubuntu:

      apt-get install libsnappy1 libsnappy-dev
  2. Make the Snappy libraries available to Hadoop:

    ln -sf /usr/lib64/libsnappy.so /usr/lib/hadoop/lib/native/.

 3.2. Install LZO

Execute the following command on all the nodes in your cluster. From a terminal window, type:

  • For RHEL/CentOS/Oracle Linux:

    yum install lzo lzo-devel hadoop-lzo hadoop-lzo-native  
    
  • For SLES:

    zypper install lzo lzo-devel hadoop-lzo hadoop-lzo-native  
    
  • For Ubuntu:

    apt-get install liblzo2-2 liblzo2-dev hadoop-lzo
    

loading table of contents...