Cloudera Docs

PostgreSQL

How to set up PostgreSQL metadata sources in Cloudera Octopai Data Lineage, including prerequisites, verification, and troubleshooting.

Tool Permissions Prerequisites

  • Postgres ODBC driver installed on the machine running the Cloudera Octopai Client
  • Open Server Port for each Postgre Database Connection
  • Existing/New Postgres user (OCTOPAI_USER) for each connection with grant select permission for the following dictionary tables:
    • information_schema.tables;
    • information_schema.views;
    • information_schema.columns;
    • pg_catalog.pg_proc;
    • pg_catalog.pg_namespace;
    • pg_catalog.pg_attribute;
    • pg_catalog.pg_constraint;
    • pg_catalog.pg_class;
    • pg_catalog.pg_database;

How to set up the permissions

psqlodbc - PostgreSQL ODBC driver

Setting up PostgreSQL Metadata Source

Metadata Sources are set on the Cloudera Octopai Client

Figure 1. New Metadata Source wizard

How to verify the extracted Metadata File

Access the Cloudera Octopai Target Folder (TGT)

  1. Go to the TGT Folder located on the Server where the Cloudera Octopai Client is installed. By default: C:\Program Files (x86)\Octopai\Service\TGT
  2. Open the zip file having the Connector Name. Example:
  3. Verify its content: Quantity & Quality of inner files

Troubleshoot

Error during the extraction:

  • Check the permissions
  • Send the log with the connector number and name to Cloudera Support - C:\Program Files (x86)\Octopai\Service\log