Statement 1: Evaluators in Microsoft Foundry replace the need for configuring token limits. = No
Evaluators are used to assess model or agent output quality, safety, and reliability. They do not replace model configuration settings such as token limits. Microsoft describes evaluators as tools that measure the quality, safety, and reliability of AI responses.
Statement 2: Evaluators in Microsoft Foundry can assess the quality and safety of responses generated by a generative AI model. = Yes
This is correct. Microsoft Foundry includes built-in evaluators for general quality metrics such as coherence and fluency, safety/security metrics, RAG metrics, and agent-specific metrics.
Statement 3: Evaluators in Microsoft Foundry can retrain a deployed generative AI model automatically when quality issues are detected. = No
Evaluators measure and report quality, safety, and reliability issues. They do not automatically retrain deployed generative AI models. Microsoft describes evaluation as measuring model or agent performance against test data, while monitoring can alert when outputs fail quality thresholds.
