Supported models and servers in Cloudera AI Inference service

Hugging Face Model Server

Triton Inference Server

NVIDIA NIM Models

Hugging Face Supported Model Architectures

Text Generation Models (123)

afmoeforcausallm, apertusforcausallm, aquilaforcausallm, aquilamodel, arceeforcausallm, arcticforcausallm, baichuanforcausallm, bailingmoeforcausallm, bailingmoev2forcausallm, bambaforcausallm, bloomforcausallm, chatglmforconditionalgeneration, chatglmmodel, cohere2forcausallm, cohereforcausallm, cwmforcausallm, dbrxforcausallm, decilmforcausallm, deepseekforcausallm, deepseekv2forcausallm, deepseekv32forcausallm, deepseekv3forcausallm, dots1forcausallm, ernie4_5_moeforcausallm, ernie4_5forcausallm, exaone4forcausallm, exaoneforcausallm, exaonemoeforcausallm, fairseq2llamaforcausallm, falconforcausallm, falconh1forcausallm, falconmambaforcausallm, flexolmoforcausallm, gemma2forcausallm, gemma3forcausallm, gemma3nforcausallm, gemmaforcausallm, glm4forcausallm, glm4moeforcausallm, glm4moeliteforcausallm, glmforcausallm, gpt2lmheadmodel, gptbigcodeforcausallm, gptjforcausallm, gptneoxforcausallm, gptossforcausallm, graniteforcausallm, granitemoeforcausallm, granitemoehybridforcausallm, granitemoesharedforcausallm, gritlm, grok1forcausallm, grok1modelforcausallm, hcxvisionforcausallm, hunyuandensev1forcausallm, hunyuanmoev1forcausallm, internlm2forcausallm, internlm2veforcausallm, internlm3forcausallm, internlmforcausallm, iquestcoderforcausallm, iquestloopcoderforcausallm, jais2forcausallm, jaislmheadmodel, jambaforcausallm, kimilinearforcausallm, lfm2forcausallm, lfm2moeforcausallm, llama4forcausallm, llamaforcausallm, longcatflashforcausallm, mamba2forcausallm, mambaforcausallm, mimoforcausallm, mimov2flashforcausallm, minicpm3forcausallm, minicpmforcausallm, minimaxforcausallm, minimaxm1forcausallm, minimaxm2forcausallm, minimaxtext01forcausallm, mistralforcausallm, mistrallarge3forcausallm, mixtralforcausallm, mptforcausallm, nemotronforcausallm, nemotronhforcausallm, olmo2forcausallm, olmo3forcausallm, olmoeforcausallm, olmoforcausallm, optforcausallm, orionforcausallm, ouroforcausallm, panguembeddedforcausallm, pangupromoev2forcausallm, panguultramoeforcausallm, persimmonforcausallm, phi3forcausallm, phiforcausallm, phimoeforcausallm, plamo2forcausallm, plamo3forcausallm, qwen2forcausallm, qwen2moeforcausallm, qwen3forcausallm, qwen3moeforcausallm, qwen3nextforcausallm, qwenlmheadmodel, rwforcausallm, seedossforcausallm, solarforcausallm, stablelmepochforcausallm, stablelmforcausallm, starcoder2forcausallm, step1forcausallm, step3p5forcausallm, step3textforcausallm, telechat2forcausallm, telechatforcausallm, teleflmforcausallm, xverseforcausallm, zamba2forcausallm

Embedding Models (35)

bertmodel, bertspladesparseembeddingmodel, bgem3embeddingmodel, clipmodel, decilmforcausallm, gemma2model, gemma3textmodel, glmforcausallm, gpt2forsequenceclassification, gritlm, gtemodel, gtenewmodel, internlm2forrewardmodel, jambaforsequenceclassification, llamabidirectionalmodel, llamamodel, llavanextforconditionalgeneration, mistralmodel, modernbertmodel, nomicbertmodel, phi3forcausallm, phi3vforcausallm, prithvigeospatialmae, qwen2forcausallm, qwen2forprocessrewardmodel, qwen2forrewardmodel, qwen2model, qwen2vlforconditionalgeneration, robertaformaskedlm, robertamodel, siglipmodel, telechat2forcausallm, telechatforcausallm, terratorch, xlmrobertamodel

Cross-Encoder Models (9)

bertforsequenceclassification, bertfortokenclassification, gtenewforsequenceclassification, jinavlforranking, llamabidirectionalforsequenceclassification, modernbertforsequenceclassification, modernbertfortokenclassification, robertaforsequenceclassification, xlmrobertaforsequenceclassification

Multimodal Models (80)

ariaforconditionalgeneration, audioflamingo3forconditionalgeneration, ayavisionforconditionalgeneration, bagelforconditionalgeneration, beeforconditionalgeneration, blip2forconditionalgeneration, chameleonforconditionalgeneration, cohere2visionforconditionalgeneration, deepseekocrforcausallm, deepseekvlv2forcausallm, dotsocrforcausallm, eagle2_5_vlforconditionalgeneration, ernie4_5_vlmoeforconditionalgeneration, fuyuforcausallm, gemma3forconditionalgeneration, gemma3nforconditionalgeneration, glm4vforcausallm, glm4vforconditionalgeneration, glm4vmoeforconditionalgeneration, glmasrforconditionalgeneration, granitespeechforconditionalgeneration, h2ovlchatmodel, hunyuanvlforconditionalgeneration, idefics3forconditionalgeneration, interns1forconditionalgeneration, internvlchatmodel, internvlforconditionalgeneration, isaacforconditionalgeneration, kananavforconditionalgeneration, keyeforconditionalgeneration, keyevl1_5forconditionalgeneration, kimik25forconditionalgeneration, kimivlforconditionalgeneration, lfm2vlforconditionalgeneration, lightonocrforconditionalgeneration, llama4forconditionalgeneration, llama_nemotron_nano_vl, llavaforconditionalgeneration, llavanextforconditionalgeneration, llavanextvideoforconditionalgeneration, llavaonevisionforconditionalgeneration, mantisforconditionalgeneration, midashenglmmodel, minicpmo, minicpmv, minimaxvl01forconditionalgeneration, mistral3forconditionalgeneration, molmo2forconditionalgeneration, molmoforcausallm, nemotronh_nano_vl_v2, nemotronparseforconditionalgeneration, nvlm_d, opencuaforconditionalgeneration, ovis, ovis2_5, paddleocrvlforconditionalgeneration, paligemmaforconditionalgeneration, phi3vforcausallm, phi4mmforcausallm, pixtralforconditionalgeneration, qwen2_5_vlforconditionalgeneration, qwen2_5omniforconditionalgeneration, qwen2_5omnimodel, qwen2audioforconditionalgeneration, qwen2vlforconditionalgeneration, qwen3omnimoeforconditionalgeneration, qwen3vlforconditionalgeneration, qwen3vlmoeforconditionalgeneration, qwenvlforconditionalgeneration, rforconditionalgeneration, skyworkr1vchatmodel, smolvlmforconditionalgeneration, step3vlforconditionalgeneration, stepvlforconditionalgeneration, tarsier2forconditionalgeneration, tarsierforconditionalgeneration, ultravoxmodel, voxtralforconditionalgeneration, voxtralstreaminggeneration, whisperforconditionalgeneration

Speculative Decoding (20)

deepseekmtpmodel, eagle3llamaforcausallm, eagle3qwen2_5vlforcausallm, eagle3qwen3vlforcausallm, eagledeepseekmtpmodel, eaglellama4forcausallm, eaglellamaforcausallm, eagleminicpmforcausallm, eaglemistrallarge3forcausallm, erniemtpmodel, exaonemoemtp, glm4moelitemtpmodel, glm4moemtpmodel, llamaforcausallmeagle3, longcatflashmtpmodel, medusamodel, mimomtpmodel, openpangumtpmodel, qwen3nextmtp, step3p5mtp

Transformers Supported Models (2)

emu3forconditionalgeneration, smollm3forcausallm

Transformers Backend Models (10)

transformersembeddingmodel, transformersforcausallm, transformersforsequenceclassification, transformersmoeembeddingmodel, transformersmoeforcausallm, transformersmoeforsequenceclassification, transformersmultimodalembeddingmodel, transformersmultimodalforcausallm, transformersmultimodalforsequenceclassification, transformersmultimodalmoeforcausallm