Universal Connector for Database Objects
Use the Universal Connector Objects CSV template to register databases, schemas, objects, and columns so that Cloudera Octopai can enrich the catalog and lineage for systems without a native connector.
The Universal Connector Objects template integrates metadata from databases and catalog objects in systems that are not covered by native connectors. You can build a more complete view of your data ecosystem, with data lineage, discovery, and catalog content aligned and connected with the rest of your environment.
This guide explains the Universal Connector Objects CSV template structure. It complements ETL process and task metadata. When you also need transformations and column-level data flows defined inside the ETL graph, see Universal Connector for ETLs.
How to use the Database Objects template file
- Download the template file: Universal Connector Objects
- Fill in the required fields using the table below.
| Column Name | Description | Required |
|---|---|---|
| Provider Name | The type of database that the object connects to (for example, Oracle or SQL Server). See Supported script parsing providers. | No |
| Server Name | Server name of the object. | No |
| Database Name | Database name of the object. | Yes |
| Schema Name | Schema name of the object. | Yes |
| Object Name | Name of the source object. | Yes |
| Object Description | Documentation about the object. | No (default = empty string) |
| Column Name | Column name in the source object. | Yes |
| Column Description | Short column description. | No (default = empty string) |
| Data Type | Data type of the column. | No |
| Is Nullable | Indicates whether the column accepts null values. | No |
| Precision | Precision of the column. | No |
| Scale | Scale of the column. | No |
| Object Type | Type of object – table, view, file, and so on. | Yes |
| Definition | The definition text for the object (for example DDL or SQL). | No |
Supported script parsing providers
Supported parsing providers for scripts:
DB2HIVEIMPALAMSSQLSYNAPSE(MSSQL)NETEZZAORACLEPOSTGRESQLREDSHIFTTERADATASNOWFLAKEVERTICABIGQUERYHANA
