Amazon Redshift

Tool Permissions Prerequisites

Amazon Redshift ODBC driver installed on the machine running the Cloudera Octopai Client https://docs.aws.amazon.com/redshift/latest/mgmt/configure-odbc-connection.html#install-odbc-driver-windows

Open Server Port for each Redshift Database Connection

Exiting/New Redshift user (OCTOPAI_USER) for each connection with grant select permission for the following dictionary tables:

• pg_catalog.pg_database
• pg_catalog.pg_proc
• pg_catalog.pg_table_def
• pg_catalog.pg_tables
• pg_catalog.pg_views
• pg_catalog.pg_namespace
• pg_catalog.pg_attribute
• pg_catalog.pg_class
• pg_catalog.pg_constraint
• pg_catalog.svv_table_info
• pg_catalog.svv_all_tables
• pg_catalog.svv_all_columns
• pg_catalog.pg_user
• pg_catalog.svv_external_schemas
• pg_catalog.svv_external_tables
• pg_catalog.svv_external_columns

Grant select on all tables in schema dbo to the group assigned to the Redshift user.

Grant usage on schema dbo to the group assigned to the Redshift user.

Setting up Redshift Metadata Source

Metadata Sources are set on the Cloudera Octopai Client

How to verify the extracted Metadata File

Access the Cloudera Octopai Target Folder (TGT)

1. Go to the TGT Folder located on the Server where the Cloudera Octopai Client is installed. By default: C:\Program Files (x86)\Octopai\Service\TGT
2. Open the zip file having the Connector Name. Example:

   

3. Verify its content: Quantity & Quality of inner files

Troubleshoot

Error during the extraction:

• Check the permissions
• Send the log with the connector number and name to Cloudera Support - C:\Program Files (x86)\Octopai\Service\log