Cloudera Docs

Admin User - Octopai Client

With the Octopai Client, you are able to extract metadata from your tools and upload them to the Cloudera Data Lineage Cloud.

The Octopai Client application consists of the following sections:
  1. Metadata Sources
    The main panel contains the out-of-the-box connections in the purchased license.
  2. Upload Files to Cloudera Data Lineage
    Upload files to Cloudera Data Lineage. Only files in zip format are accepted. When the upload is completed, the files are displayed on your Portal.
  3. Contact Support

    If you need assistance, contact Cloudera Support.

  4. Send Logs to Cloudera
    Logs are helpful to solve issues. Click the icon to send the last logs to Cloudera to be analyzed by the Support team.
  5. Update License

    After opening the Octopai Client for the first time, or after a Version Upgrade, a window to install the license pops up.

    Click Click to select the license file to browse for the .lic file and click Open to install the license.
  6. Application Folders
    The Cloudera Data Lineage application folders play a crucial role in managing metadata extraction processes and ensuring the quality and integrity of metadata. By providing a structured storage environment, these folders enable users to verify metadata accuracy and address any potential issues. You can find the following folders in Octopai Client:
    • Target Files – The Target Files folder serves as a repository for the zip files uploaded to Cloudera Data Lineage.
    • Temp Files – During the metadata extraction process, Cloudera Data Lineage creates temporary files to facilitate data processing and transformation.
    • Log Files – Cloudera Data Lineage generates log files during the metadata extraction process to capture valuable information about the extraction activities.
    • Run Files – To automate the metadata extraction process, Cloudera Data Lineage provides Run (bat/sh) files that can be used in conjunction with Microsoft Task Scheduler. For instructions on using Microsoft Task Scheduler, see Automating Cloudera Data Lineage metadata extractions with Microsoft Task Scheduler.
    1. Click Run Files.
    2. Select the respective Batch or shell script file, depending on your operating system, to download to your computer for automation activity. Point your scheduler of choice.
  7. Information and Settings
    You can see the following tabs in the Information and Settings section:
    • The Settings tab defines if the extractions are automatically uploaded to the Cloudera Data Lineage Cloud or are done manually.

      Set the Auto Upload to ON to enable the extractions to be automatically transferred to the Cloudera Data Lineage Cloud.

      Set the Auto Upload to OFF to review the files before they are being transferred to the Cloudera Data Lineage Cloud.

    • The Information tab describes the Octopai Client version installed and the list of tools in the purchased license.
  8. List of Connectors
    If you create a new connector, it is shown on the Metadata Sources list or List of Connectors. The new source set gets a Connector Number, a common denomination between you and Cloudera Data Lineage Support.
  9. Tools List
    All the tools purchased to create connectors to extract metadata are displayed in the main pane.