Cloudera Docs

Azure SQL DWH/DB & Azure Synapse Analytics

Learn how to configure and manage Azure SQL DWH/DB.

Tool Permissions Prerequisites

  • Open Server Port for each Oracle Database Connection
  • Existing/New user (SQL Server Authentication only) for each server/database with:
    • Grant 'CONNECT' to MASTER DB
    • Grant 'SELECT' for the following dictionary tables:
      • sys.objects
      • sys.schemas
      • sys.sql_modules
      • sys.columns
      • sys.identity_columns
      • sys.computed_columns
      • sys.check_constraints
      • sys.synonyms
      • sys.indexes
      • sys.index_columns
      • sys.tables
      • sys.foreign_keys
      • sys.foreign_key_columns
  • Only if previous grants are not enough:
    • USE MASTER:
    • grant connect any database to "DOMAIN_NAME\OCTOPAI_USER";
    • grant view server state to "DOMAIN_NAME\OCTOPAI_USER";
    • grant view any definition to "DOMAIN_NAME\OCTOPAI_USER";

Setting up SQL Azure DWH/DB Metadata Source

Metadata Sources are set on the Cloudera Octopai Client:

Figure 1. Azure SQL DWH/DB
Figure 2. Azure SQL Synapse

How to verify the extracted Metadata File

Access the Cloudera Octopai Target Folder (TGT)

  1. Go to the TGT Folder located on the Server where the Cloudera Octopai Client is installed. By default: C:\Program Files (x86)\Octopai\Service\TGT
  2. Open the zip file having the Connector Name. Example:
  3. Verify its content: Quantity & Quality of inner files

Troubleshoot

Error during the extraction:

  • Check the permissions
  • Send the log with the connector number and name to Cloudera Support - C:\Program Files (x86)\Octopai\Service\log