Configure SQL AI Assistant using Cloudera AI Workbench

This topic describes how to deploy and configure the SQL AI Assistant using the Cloudera AI Workbench. With the added support for Cloudera AI Workbench, you can securely deploy and run your own models within a virtual private cloud. This self-contained integration offers enhanced control and privacy within your environment.

To know more about creating and deploying models using Cloudera AI, see Create and deploy the model.

Upon succesuccessful completion of model deployment, log in to the Data Warehouse service.
Go to the Virtual Warehouses tab, locate the Virtual Warehouse on which you want to enable this feature, and click > Edit.

Go to Configurations > Hue, select hue-safety-valve from the Configuration files drop-down menu, and add the following lines :

[desktop]
 [[ai_interface]]
    service='cml'
    model='llama'
    model_ref='[***Place model access key here***]'
    base_url='https://[***RESOURCE***].cloudera.site/model'

Click Apply Changes.

You see

Assistant on the Hue SQL editor, where the SQL AI Assistant utilizes the model hosted in the Cloudera AI Workbench.