Microsoft Fabric SQL Database [Technical Preview]

Overview

Before you set up the Microsoft Fabric SQL Database connector, ensure that you have the following:

• Microsoft Entra application credentials: a registered service principal with a tenant ID, application (client) ID, and client secret. See Application registration (service principal).

• Microsoft ODBC Driver 18 for SQL Server: installed on the Windows machine that hosts the Cloudera Octopai platform for SQL endpoint connectivity. See SQL access (ODBC).

• Fabric admin tenant settings: settings that allow the service principal to call Fabric public APIs and access Fabric items. See Tenant settings (Fabric admin portal).

• Fabric workspace permissions: the Contributor role assigned to the service principal on the target workspace. See Workspace permissions.

• Microsoft Fabric API permissions: application API permissions assigned to the service principal, including SQLDatabase.Read.All and related scopes. See Required application permissions.

Application registration (service principal)

1. In the Azure portal, open Microsoft Entra ID > App registrations, and select New registration.
2. Give the application a name, and select Accounts in this organizational directory only.
3. Select Register.
4. From the application overview, record the Directory (tenant) ID and Application (client) ID.
5. Create a Client secret under Manage > Certificates and secrets.

The Cloudera Octopai Microsoft Fabric SQL Database connector authenticates using a Microsoft Entra service principal. The service principal is used for:

• Microsoft Fabric REST API access
• SQL endpoint access through ODBC using Microsoft Entra authentication

You must record the following values for configuration in Cloudera Octopai:

• Tenant ID
• Application (client) ID
• Client Secret Value

SQL access (ODBC)

Microsoft Fabric SQL Database metadata extraction requires SQL connectivity through the SQL endpoint. Install Microsoft ODBC Driver 18 for SQL Server on the Windows machine that hosts the Cloudera Octopai platform.

For Windows, see Download ODBC Driver for SQL Server.

Tenant settings (Fabric admin portal)

Use the Fabric admin portal to enable the settings required by the connector:

1. Open Microsoft Fabric.
2. Select Settings, and then select Admin portal.
3. Open Tenant settings.
4. Find and enable Service principals can call Fabric public APIs.
5. Find and enable Allow apps to access Fabric items.

Workspace permissions

Assign the service principal to the target workspace with the Contributor role. Contributor access is required for complete metadata extraction coverage, including:

• Stored procedures
• Views
• Functions
• Tables
• Columns
• Schemas

The Viewer role is not sufficient for full metadata extraction because it may not expose stored procedures, views, and functions.

Required application permissions

The application requires the following Microsoft Fabric API permissions:

• SQLDatabase.Read.All
• SQLEndpoint.Read.All
• Workspace.Read.All
• Item.Read.All

Metadata access requirements

Ensure that the service principal can access the following SQL metadata sources:

• INFORMATION_SCHEMA: returns metadata only for objects visible to the current user. Limited permissions can result in missing objects.

• System views (sys.*): requires SELECT permission or equivalent metadata visibility. Used for extracting views, stored procedures, and functions, including:

  • sys.objects
  • sys.sql_modules
  • sys.schemas

Network requirements

The extraction environment must allow outbound HTTPS access over port 443 to the following endpoints for authentication and Microsoft Fabric API interaction:

• api.fabric.microsoft.com
• *.fabric.microsoft.com
• login.microsoftonline.com

Setting up SQL Database (Microsoft Fabric) metadata source

Configure the metadata source on the Cloudera Octopai Client. In the New Metadata Source wizard, on Metadata Source Type, select SQL Database (Microsoft Fabric).

On Metadata Source Details, select Service Principal, and enter the following:

• Connection Name: Enter a meaningful name. The name is displayed to Cloudera Octopai platform users.
• Application (client) ID
• Tenant ID
• Client Secret Value
• Workspace ID

• Parse, Analyze, and Tag the Views and Stored Procedures as ETLs: optional. Select this option when you want Cloudera Octopai to treat views and stored procedures as ETL objects during analysis.