Configure SQL AI Assistant using the Cloudera AI Inference service

This topic describes configuring the SQL AI Assistant using the Cloudera AI Inference service.

To know more about installing and setting up the Cloudera AI Inference service, see Prerequisites for setting up the Cloudera AI Inference service.

  1. Upon installing and setting up the Cloudera AI Inference service, log in to the CDP Management Console as an Administrator.
  2. Go to Environments and select your environment.
  3. Go to the Data Lake tab and click on the CM URL to open Cloudera Manager.
  4. Go to Clusters > Hue service > Configuration and select add the following lines in the Hue Service Advanced Configuration Snippet (Safety Valve) for hue_safety_valve.ini field:
    
    [[ai_interface]]
        service='caii'
        model_name='[***Place MODEL name here***]'
        base_url="https://[***RESOURCE***]/v1"
    
  5. Click Save Changes.
You see Assistant on the Hue SQL editor, where the SQL AI Assistant utlizes the model hosted in Cloudera AI Inference service.