Configure SQL AI Assistant using the Cloudera AI Inference service

This topic describes configuring the SQL AI Assistant using the Cloudera AI Inference service.

To know more about securely passing the token and setting up the Cloudera AI Inference service, see Secure approach for passing a token and Prerequisites for setting up the Cloudera AI Inference service.

  1. Upon installing and setting up the Cloudera AI Inference service, log in to the Cloudera Data Warehouse service.
  2. Go to the Virtual Warehouses tab, locate the Virtual Warehouse on which you want to enable this feature, and click > Edit.
  3. Go to Configurations > Hue, select hue-safety-valve from the Configuration files drop-down menu, and add the following lines :
    
    [[ai_interface]]
        service='caii'
        model_name='[***Place MODEL name here***]'
        base_url="https://[***RESOURCE***]/v1"
    
  4. Click Apply Changes.
You see Assistant on the Hue SQL editor, where the SQL AI Assistant utlizes the model hosted inCloudera AI Inference service.