Supported inference service providers

Enterprise inference service providers connect with Agent Studio to facilitate Large Language Model (LLM) operations and API calls.

The following enterprise inference service providers are supported in Agent Studio:

  • OpenAI
  • OpenAI Compatible (any service conforming to the OpenAI API specification)
  • Azure OpenAI
  • Google Gemini
  • Anthropic
  • AWS Bedrock
  • Cloudera AI Inference service