Adding Schema Registry as Catalog

You need to add Schema Registry as a Catalog using the Streaming SQL Console in SQL Stream Builder (SSB) to use Schema Registry with Flink DDL.

  • Make sure that you have Schema Registry service on your cluster.
  • Make sure that you have the right permissions set in Ranger.
  1. Navigate to the Streaming SQL Console.
    1. Navigate to Management Console > Environments, and select the environment where you have created your cluster.
    2. Select the Streaming Analytics cluster from the list of Data Hub clusters.
    3. Select Streaming SQL Console from the list of services.
    The Streaming SQL Console opens in a new window.
  2. Click Data Providers from the main menu.
  3. Click Register Catalog.
    The Add Catalog window appears.
  4. Add a Name to your catalog.
  5. Select Schema Registry from the Catalog Type drop-down.
  6. Select the Kafka cluster you registered as Data Provider.
  7. Add the Schema Registry URL.
    1. Go to your cluster in Cloudera Manager.
    2. Select Schema Registry from the list of services.
    3. Click on Instances.
    4. Copy the Hostname of Schema Registry.
    5. Add the default port of Schema Registry after the hostname.
      Example:
      http://docs-test-1.vpc.cloudera.com:7788/api/v1
  8. Select if you wan to enable TLS for Schema Registry.
    1. If yes, provide the Schema Registry Truststore location and password.
  9. Click on Add Filter.
    1. Provide a Database and Table filter if you want to select specific tables to use from the catalog.
  10. Click on Validate.
  11. If the validation is successful, click Add Tables.
Schema Registry is added as a Catalog and ready to be used in Flink DDL. The already existing schemas in Schema Registry are automatically imported to SSB.