Processing the Evaluations

The Evaluations are pocessed in two differnet stages.

Automatic metrics

Upon successful completion of a workflow run, the Automatic Metrics are instantly populated. These metrics are deterministic and do not necessitate an additional LLM call. For more information on the automatic metrics, see Metrics Reference Glossary.

Qualitative analysis

Qualitative metrics require a manual trigger. Click the Run LLM as a judge evals button to initiate this analysis. For more information on the qualitative analysis metrics, see Metrics Reference Glossary.