Cloudera Docs

Managing AI settings [Technical Preview]

Cloudera Data Visualization offers extensive site-wide configuration options, enabling users with administrative privileges to manage various settings crucial for organizational workflows. You can enable the AI visual, select the AI engine, and specify additional settings.

The AI Settings option is included in the Site Settings menu, which is only available to users with administrative privileges.
  1. Click on the main navigation bar to open the Administration menu and select Site Settings.

    The Site Settings page opens on the Data menu.

  2. Open the AI Settings menu from the left navigation and choose from the available options.

General

In this section, you can enable the AI visual and the redaction of AI visual logs.

Before enabling this feature, review the legal terms and conditions of using the AI visual, displayed in the Info tooltip. When you enable the feature for the first time, a modal window prompts you to accept these terms and conditions. The system records the date and the username of the person who accepts the terms. To ensure compliance, users are required to confirm acceptance of the terms each time they enable the AI features, as the user enabling the feature may differ from the original user who enabled the feature before.

Additionally, you can also enable the redaction of AI visual logs. If enabled, audit logs are redacted to omit information transmitted by the AI visual.

Embeddings

In this section, you can manage your embedding profiles. You can create new profiles, view the list of existing ones, and perform actions such as cloning, editing, or deleting existing profiles, and setting a new default profile.

Creating a new embeddings profile

  1. Click CREATE PROFILE.

    The Create Profile modal window opens.

  2. Provide a name for the profile.

  3. Select the AI engine you want to use for the embeddings.

    You have the following options available: Cloudera AI Hosted MiniLM, Cloudera AI Inference, OpenAI, OpenAI Azure, and Other

  4. Specify the settings for the selected AI engine.

    • Access Key: Required to access the external third-party AI service provider

    • Authorization API Key: Required to access the external third-party AI service provider

    • Service URL: URL for the embedding service used by the AI engine

    • Service input parameter name: Name for the embedding service input

    • Service response parameter name: Name for the embedding service response parameter

    • API Key: Required to access the external third-party AI service provider

      Ensure you review the legal terms and conditions provided in the Info tooltip before proceeding.

    • Service URL: URL for the embedding service used by the AI engine

    • Model: Used for the embeddings

    • API Key: Required to access the external third-party AI service provider

      Ensure you review the legal terms and conditions provided in the Info tooltip before proceeding.

    • Model: Used for the embeddings

    • API Key: Required to access the external third-party AI service provider

      Ensure you review the legal terms and conditions provided in the Info tooltip before proceeding.

    • Service URL: URL for the embedding service used by the AI engine

    • API Key: Required to access the external third-party AI service provider

      Ensure you review the legal terms and conditions provided in the Info tooltip before proceeding.

    • Service URL: URL for the embedding service used by the AI engine

    • AI engine settings: Use this textbox to provide your custom request and response transformer functions in valid Python.
  5. [Optional] Click TEST to validate the model using the specified settings.
  6. Click SAVE.

Cloning an existing embeddings profile

Alternatively, you can clone an existing embeddings profile to create a new profile instance.

  1. Click to open the Create Profile modal window. All details are pre-filled from the original profile, except for the Name field.
  2. Enter a new name for the profile.
  3. Click SAVE.

Managing embeddings profiles

  • Setting a default profile: The current default profile that will be used for new AI visuals is marked with the Default label. To change the default, hover over a non-default profile and click the Set as default option.

  • Deleting a profile:
    1. Click on the profile row.
    2. Click YES to confirm the deletion.
  • Editing a profile:
    1. Click on the profile row to open the Edit Profile modal window.
    2. Make the necessary changes to the profile.
    3. [Optional] Click TEST to validate the model using the new settings.
    4. Click SAVE.

Completion

In this section, you can manage completion profiles. You can create new profiles, view the list of existing ones, and perform actions such as copying, editing, deleting existing profiles, or setting a new default profile.

Creating a new completion profile

  1. Click CREATE PROFILE.

  2. Provide a name for the profile.

  3. Select the AI engine you want to use for the completion.

    You have the following options available: Cloudera AI Hosted Llama, Cloudera AI Inference, OpenAI, OpenAI Azure, and Other

  4. Specify the settings for the selected AI engine.

    • Access Key: Required to access the external third-party AI service provider

      Ensure you review the legal terms and conditions provided in the Info tooltip before proceeding.

    • Authorization API Key: Required to access the external third-party AI service provider

      Ensure you review the legal terms and conditions provided in the Info tooltip before proceeding.

    • Service URL: URL for the completion service used by the AI engine

    • Service input parameter name: Name for the completion service input

    • Service response parameter name: Name for the completion service response parameter

    • Extra arguments: Any additional arguments for the completion query

    • API Key: Required to access the external third-party AI service provider

      Ensure you review the legal terms and conditions provided in the Info tooltip before proceeding.

    • Service URL: URL for the completion service used by the AI engine

    • Model: Used for the completion

    • Temperature: Controls the randomness of the output on a scale from 0 to 2. Lower values produce more focused and deterministic responses, while higher values introduce greater randomness and creativity. The default setting is 1.

    • API Key: Required to access the external third-party AI service provider

      Ensure you review the legal terms and conditions provided in the Info tooltip before proceeding.

    • Model: Used for the completion

    • Temperature: Controls the randomness of the output on a scale from 0 to 2. Lower values produce more focused and deterministic responses, while higher values introduce greater randomness and creativity. The default setting is 1.

    • API Key: Required to access the external third-party AI service provider

      Ensure you review the legal terms and conditions provided in the Info tooltip before proceeding.

    • Service URL: URL for the completion service used by the AI engine

    • API Key: Required to access the external third-party AI service provider

      Ensure you review the legal terms and conditions provided in the Info tooltip before proceeding.

    • Service URL: URL for the completion service used by the AI engine

    • AI engine settings: Use this textbox to provide your custom request and response transformer functions in valid Python.
  5. [Optional] Click TEST to validate the model using the specified settings.
  6. Click SAVE.

Cloning an existing completion profile

Alternatively, you can clone an existing completion profile to create a new profile instance.

  1. Click to open the Create Profile modal window. All details are pre-filled from the original profile, except for the Name field.

  2. Enter a new name for the profile.

  3. Click SAVE.

Managing completion profiles

  • Setting a default profile: The current default profile that will be used for new AI visuals is marked with the Default label. To change the default, hover over a non-default profile and click the Set as default option.

  • Deleting a profile:
    1. Click on the profile row.
    2. Click YES to confirm the deletion.
  • Editing a profile:
    1. Click on the profile row to open the Edit Profile modal window.
    2. Make the necessary changes to the profile.
    3. [Optional] Click TEST to validate the model using the new settings.
    4. Click SAVE.