Design and implement evaluation and validation strategies for multi-agent solutions
5 practice questions under this official exam objective (AI-500), each with the answer key, an option-by-option explanation and instant feedback.
Questions under this objective
5 total · page 1 of 1Which Evaluator Isolates RAG Retrieval Failures per Agent
When an embedding model change and a custom analyzer change break a Foundry IQ knowledge base RAG pipeline, the failure is in chunk retrieval and rank
How Should You Configure Foundry Multi-Agent Prompt Evaluations?
In a Microsoft Foundry connected-agent ticket-triage solution, the evaluation suite must be mapped so each mandated behavior has a matching evaluator:
Validating Custom Guardrails Across a Multi-Agent Workflow
This AI-500 question tests how to validate a custom guardrail in a Microsoft Foundry intake-retrieval-resolution pipeline. The correct approach (D) us
Which RAG retrieval configuration is most reliable?
This AI-500 retrieval evaluation question asks which RAG search configuration is most reliable across Precision@10, Recall@10 and MRR. Candidate 4 (op
Save the Foundry agent version before running its evaluation
To evaluate updated instructions in Microsoft Foundry, you must first save Agent1 as a new version, creating a versioned target for the synthetic-data