Cloudera Docs

Setting up Cloudera Iceberg REST Catalog for data sharing

Learn how to perform the preparatory configurations in Cloudera to enable data sharing. These configurations are required for the creation of a data share in Cloudera and allow your clients to access data in Cloudera environments.

Installation and Upgrade Scenarios

Different versions of Cloudera Runtime and Data Lakes require different steps to enable data sharing.

Fresh 7.3.1.400 Data Lake Installation

Complete the following steps after a fresh installation of 7.3.1.400 Data Lake to enable data sharing.

  1. HMS Rest Catalog configuration

    Configure the Hive Metastore (HMS) service to serve as an Iceberg REST catalog. This allows clients to use REST Catalog APIs to access the required metadata files.

  2. Declaring Knox topologies

    Create the Knox topologies to define for Knox how to proxy requests from external users.

  3. Knox configuration

    Configure properties in Knox to set up administrator privileges that allow creation of tokens.

  4. IDBroker configuration

    Configure Knox IDBroker in Cloudera Manager.

  5. Creating a Data Share

    Create a Data Share in Cloudera

Upgrade from Cloudera Runtime 7.2.18.x with no Cloudera Iceberg REST Catalog configurations

Complete the following configurations to enable Cloudera Data Sharing when upgrading the Data Lake from 7.2.18.x with no REST Catalog or Cloudera Data Sharing configured in that version.

  1. Manual Installation of metering service

    Install and configure the metering server for Cloudera Data Sharing.

  2. HMS Rest Catalog configuration

    Configure the Hive Metastore service to serve as an Iceberg REST catalog. This allows your clients to use REST Catalog APIs to access the required metadata files.

  3. Declaring Knox topologies

    Create the Knox topologies to define for Knox how to proxy requests from external users.

  4. Knox configuration

    Configure properties in Knox to set up administrator privileges that allow creation of tokens.

  5. IDBroker configuration

    Configure Knox IDBroker in Cloudera Manager.

  6. Creating a Data Share

    Creating Data Share in Cloudera

Upgrade from Cloudera Runtime 7.2.18.x with Cloudera Iceberg REST Catalog / Cloudera Manager configuration

Complete the following configurations to enable Data Sharing when upgrading the Data Lake from 7.2.18.x with REST Catalog / Data Sharing configured in that version.

  1. Manual Installation of metering service

    Install and configure the metering server for Cloudera Data Sharing.

  2. HMS Rest Catalog configuration

    Configure the Hive Metastore service to serve as an Iceberg REST catalog. This allows your clients to use REST Catalog APIs to access the required metadata files.

  3. Declaring Knox topologies

    Create the Knox topologies to define for Knox how to proxy requests from external users.

  4. Knox configuration

    Configure properties in Knox to set up administrator privileges that allow creation of tokens.

  5. IDBroker configuration

    Configure Knox IDBroker in Cloudera Manager.

  6. Creating a Data Share

    Creating Data Share in Cloudera

Resizing Cloudera Data Lake from Light Duty Data Lake to Enterprise Data Lake

Complete the following configurations to enable Cloudera Data Sharing after resizing the Data Lake from Light Duty Data Lake to Enterprise Data Lake.

  1. HMS Rest Catalog configuration

    Configure the Hive Metastore service to serve as an Iceberg REST catalog. This allows your clients to use REST Catalog APIs to access the required metadata files.

  2. Declaring Knox topologies

    Create the Knox topologies to define for Knox how to proxy requests from external users.

  3. Knox configuration

    Configure properties in Knox to set up administrator privileges that allow creation of tokens.

  4. IDBroker configuration

    Configure Knox IDBroker in Cloudera Manager.