Make the following compression libraries available on all the cluster nodes.
Complete the following instructions on all the nodes in your cluster:
Install Snappy. From a terminal window, type:
For RHEL/CentOS/Oracle Linux:
yum install snappy snappy-devel
For SLES:
zypper install snappy snappy-devel
For Ubuntu:
apt-get install libsnappy1 libsnappy-dev
Make the Snappy libraries available to Hadoop:
ln -sf /usr/lib64/libsnappy.so /usr/lib/hadoop/lib/native/.
Execute the following command on all the nodes in your cluster. From a terminal window, type:
For RHEL/CentOS/Oracle Linux:
yum install lzo lzo-devel hadoop-lzo hadoop-lzo-native
For SLES:
zypper install lzo lzo-devel hadoop-lzo hadoop-lzo-native
For Ubuntu:
apt-get install liblzo2-2 liblzo2-dev hadoop-lzo