Configure SQL AI Assistant using vLLM

vLLM is an open-source library for LLM inference and serving. This topic describes how to set up SQL AI Assistant with a model hosted using vLLM.

To know more about the installation and its requirements, see the vLLM documentation.

1. Log in to the Cloudera Management Console as an Administrator.
2. Go to Environments and select your environment.
3. Go to the Data Lake tab and click on the CM URL to open Cloudera Manager.
4. Click Save Changes.

You see Assistant on the Hue SQL editor, and the SQL AI Assistant connects to the specified model hosted using vLLM.