Preparing the Microsoft Azure OpenAI service

Microsoft Azure allows dedicated deployments of OpenAI GPT models. Using Azure’s OpenAI service is much more secure than the publicly hosted OpenAI APIs because the data can be processed in your Virtual Private Cloud (VPC) network. Due to security considerations, Cloudera recommends that you use GPT models in Hue SQL AI Assistant with Azure’s OpenAI service.

  1. Obtain a Microsoft Azure subscription by working with your organization’s IT team.
    Subscriptions vary based on your team and purpose.
  2. Register to access the Azure OpenAI service.
    Azure OpenAI requires registration and is currently only available to approved enterprise customers and partners. Customers who wish to use Azure OpenAI are required to submit a registration form.
  3. Create an Azure OpenAI resource in the Azure portal.
  4. Go to Overview from the left navigation and obtain the resource URL and resource keys from the Develop tab under the resource details page.
    You can use any one of the two available keys.
  5. Go to Azure OpenAI Studio at https://oai.azure.com/portal and create your deployment under Management > Deployments.
  6. Select gpt-35-turbo-16k or higher.
Enable the SQL AI Assistant using Cloudera Manager.