Configuring a Local Parcel Repository

To host an internal repository, you must install or use an existing Web server on an internal host that is reachable by the Cloudera Manager host, and then download the repository files to the Web server host. The examples on this page use Apache HTTP Server as the Web server. If you already have a Web server in your organization, you can skip to Downloading and Publishing the Parcel Repository.

1. Install Apache HTTP Server:

   RHEL / CentOS

   sudo yum install httpd

   SLES

   sudo zypper install httpd

   Debian

   sudo apt-get install httpd

2. Edit the Apache HTTP Server configuration file (/etc/httpd/conf/httpd.conf by default) to add or edit the following line in the <IfModule mime_module> section:

       AddType application/x-gzip .gz .tgz .parcel

   If the <IfModule mime_module> section does not exist, you can add it in its entirety as follows:

   <IfModule mime_module>
       #
       # TypesConfig points to the file containing the list of mappings from
       # filename extension to MIME-type.
       #
       TypesConfig /etc/mime.types
   
       #
       # AddType allows you to add to or override the MIME configuration
       # file specified in TypesConfig for specific file types.
       #
       #AddType application/x-gzip .tgz
       #
       # AddEncoding allows you to have certain browsers uncompress
       # information on the fly. Note: Not all browsers support this.
       #
       #AddEncoding x-compress .Z
       #AddEncoding x-gzip .gz .tgz
       #
       # If the AddEncoding directives above are commented-out, then you
       # probably should define those extensions to indicate media types:
       #
       AddType application/x-compress .Z
       AddType application/x-gzip .gz .tgz .parcel
   
       #
       # AddHandler allows you to map certain file extensions to "handlers":
       # actions unrelated to filetype. These can be either built into the server
       # or added with the Action directive (see below)
       #
       # To use CGI scripts outside of ScriptAliased directories:
       # (You will also need to add "ExecCGI" to the "Options" directive.)
       #
       #AddHandler cgi-script .cgi
   
       # For type maps (negotiated resources):
       #AddHandler type-map var
   
       #
       # Filters allow you to process content before it is sent to the client.
       #
       # To parse .shtml files for server-side includes (SSI):
       # (You will also need to add "Includes" to the "Options" directive.)
       #
       AddType text/html .shtml
       AddOutputFilter INCLUDES .shtml
   </IfModule>

3. Start Apache HTTP Server:

   RHEL 7

   sudo systemctl start httpd

   RHEL 6 or lower

   sudo service httpd start

   SLES 12, Ubuntu 16 or later, Debian 8

   sudo systemctl start apache2

   SLES 11, Ubuntu 14.04, Debian 7 or lower

   sudo service apache2 start

1. Download manifest.json and the parcel files for the product you want to install:

   CDH 6.x

   Apache Impala, Apache Kudu, Apache Spark 2, and Cloudera Search are included in the CDH parcel. To download the files for the latest CDH 6.3 release, run the following commands on the Web server host. Substitute the correct version number:

   sudo mkdir -p /var/www/html/cloudera-repos
   sudo wget --recursive --no-parent --no-host-directories https://USERNAME:PASSWORD@archive.cloudera.com/p/cdh6/CDH version/parcels/ -P /var/www/html/cloudera-repos
   sudo wget --recursive --no-parent --no-host-directories https://USERNAME:PASSWORD@archive.cloudera.com/gplextras6/CDH version/parcels/ -P /var/www/html/cloudera-repos
   sudo chmod -R ugo+rX /var/www/html/cloudera-repos/cdh6
   sudo chmod -R ugo+rX /var/www/html/cloudera-repos/gplextras6

   If you want to create a repository for a different CDH 6 release, replace 6.3.3 with the CDH 6 version that you want. For more information, see CDH 6 Download Information.

   Apache Accumulo for CDH

   To download the files for an Accumulo release for CDH (Accumulo 1.9.2 in this example), run the following commands on the web server host:

   sudo mkdir -p /var/www/html/cloudera-repos
   sudo wget --recursive --no-parent --no-host-directories https://archive.cloudera.com/accumulo6/6.1.0/parcels/-P /var/www/html/cloudera-repos
   sudo chmod -R ugo+rX /var/www/html/cloudera-repos/accumulo6

   If you want to create a repository for Accumulo 1.6.0 instead, replace 1.7.2 with 1.6.0.

   CDS Powered By Apache Spark 2 for CDH

   To download the files for a CDS release for CDH (CDS 2.3.0.cloudera3 in this example), run the following commands on the Web server host:

   sudo mkdir -p /var/www/html/cloudera-repos
   sudo wget --recursive --no-parent --no-host-directories https://username:password@archive.cloudera.com/p/spark2/parcels/2.3.0.cloudera3/ -P /var/www/html/cloudera-repos
   sudo chmod -R ugo+rX /var/www/html/cloudera-repos/spark2

   If you want to create a repository for a different CDS release, replace 2.3.0.cloudera3 with the CDS version that you want. For more information, see CDS Powered By Apache Spark Version Information.

   Cloudera Navigator Key Trustee Server

   Go to the Key Trustee Server download page. Select Parcels from the CHOOSE DOWNLOAD TYPE drop-down menu, and click DOWNLOAD NOW. This downloads the Key Trustee Server parcels and manifest.json files in a .tar.gz file. Copy the file to your Web server, and extract the files with the tar xvfz filename.tar.gz command. This example uses Key Trustee Server 5.14.0:

   sudo mkdir -p /var/www/html/cloudera-repos/keytrustee-server
   sudo tar xvfz /path/to/keytrustee-server-5.14.0-parcels.tar.gz -C /var/www/html/cloudera-repos/keytrustee-server --strip-components=1

   sudo chmod -R ugo+rX /var/www/html/cloudera-repos/keytrustee-server

   Cloudera Navigator Key Trustee KMS and HSM KMS

   Go to the Key Trustee KMS download page. Select Parcels from the CHOOSE DOWNLOAD TYPE drop-down menu, and click DOWNLOAD NOW. This downloads the Key Trustee KMS parcels and manifest.json files in a .tar.gz file. Copy the file to your Web server, and extract the files with the tar xvfz filename.tar.gz command. This example uses Key Trustee KMS 5.14.0:

   sudo mkdir -p /var/www/html/cloudera-repos/keytrustee-kms
   sudo tar xvfz /path/to/keytrustee-kms-5.14.0-parcels.tar.gz -C /var/www/html/cloudera-repos/keytrustee-kms --strip-components=1

   sudo chmod -R ugo+rX /var/www/html/cloudera-repos/keytrustee-kms

   Sqoop Connectors

   To download the parcels for a Sqoop Connector release, run the following commands on the Web server host. This example uses the latest available Sqoop Connectors:

   sudo mkdir -p /var/www/html/cloudera-repos
   sudo wget --recursive --no-parent --no-host-directories https://username:password@archive.cloudera.com/p/sqoop-connectors/parcels/latest/ -P /var/www/html/cloudera-repos
   sudo chmod -R ugo+rX /var/www/html/cloudera-repos/sqoop-connectors

   If you want to create a repository for a different Sqoop Connector release, replace latest with the Sqoop Connector version that you want. You can see a list of versions in the parcels parent directory.

2. Visit the Repository URL http://<Web_server>/cloudera-repos/ in your browser and verify the files you downloaded are present. If you do not see anything, your Web server may have been configured to not show indexes.

1. Use one of the following methods to open the parcel settings page:
   • Navigation bar
     1. Click the parcel icon in the top navigation bar or click Hosts and click the Parcels tab.
     2. Click the Configuration button.
   • Menu
     1. Select Administration > Settings.
     2. Select Category > Parcels.
2. In the Remote Parcel Repository URLs list, click the addition symbol to open an additional row.
3. Enter the path to the parcel. For example: http://<web_server>/cloudera-parcels/cdh6/6.3.3/
4. Enter a Reason for change, and then click Save Changes to commit the changes.