The Evaluations are pocessed in two differnet stages.
Automatic metrics
Upon successful completion of a workflow run, the Automatic Metrics are instantly
populated. These metrics are deterministic and do not necessitate an additional LLM call.
For more information on the automatic metrics, see Metrics Reference Glossary.
Qualitative analysis
Qualitative metrics require a manual trigger. Click the Run LLM as a judge
evals button to initiate this analysis. For more information on the
qualitative analysis metrics, see Metrics Reference Glossary.