Amazon Redshift

Learn how to integrate Amazon Redshift with Cloudera Data Lineage (formerly Octopai).

Tool Permissions Prerequisites

Amazon Redshift ODBC driver installed on the machine running the Octopai Client https://docs.aws.amazon.com/redshift/latest/mgmt/configure-odbc-connection.html#install-odbc-driver-windows

Open Server Port for each Redshift Database Connection

Exiting/New Redshift user (OCTOPAI_USER) for each connection with grant select permission for the following dictionary tables:

  • pg_catalog.pg_database
  • pg_catalog.pg_proc
  • pg_catalog.pg_table_def
  • pg_catalog.pg_tables
  • pg_catalog.pg_views
  • pg_catalog.pg_namespace
  • pg_catalog.pg_attribute
  • pg_catalog.pg_class
  • pg_catalog.pg_constraint
  • pg_catalog.svv_table_info
  • pg_catalog.svv_all_tables
  • pg_catalog.svv_all_columns
  • pg_catalog.pg_user
  • pg_catalog.svv_external_schemas
  • pg_catalog.svv_external_tables
  • pg_catalog.svv_external_columns

Grant select on all tables in schema dbo to the group assigned to the Redshift user.

Grant usage on schema dbo to the group assigned to the Redshift user.

Setting up Redshift Metadata Source

Metadata Sources are set on the Octopai Client

Verify extraction results

After a successful run, confirm the metadata archive in the target folder. See Verify extracted metadata files.

Troubleshoot

If an error occurs during the extraction, see Troubleshoot connector extraction failures.