Improving Agent Response Completeness in Microsoft Foundry
Note: This section contains one or more sets of questions with the same scenario and problem. Each question presents a unique solution to the problem. You must determine whether the solution meets the stated goals. More than one solution in the set might solve the problem. It is also possible that none of the solutions in the set solve the problem. After you answer a question in this section, you will NOT be able to return. As a result, these questions do not appear on the Review Screen. You have a Microsoft Foundry project that contains an agent. The agent generates summaries from retrieved policy documents. Users report that some responses omit required regulatory clauses, even when the clauses are present in the retrieved content. You need to improve response completeness. Solution: You run an evaluation flow that scores responses for completeness and blocks responses that fall below a defined threshold. Does this meet the goal?
Community Insight
The core concept is the distinction between monitoring/gating and active remediation; the common trap is assuming that filtering bad outputs equates to fixing the underlying generation quality.
This question evaluates the effectiveness of using evaluation flows to block incomplete AI responses. The correct approach involves understanding that blocking prevents delivery but does not actively improve or regenerate the content for completeness.
Many learners choose 'Yes' because they believe that enforcing a quality threshold ensures only complete responses reach the user, overlooking that the system fails to provide any response rather than correcting it.
Community Discussion (6 comments)
Comments & Corrections
No comments yet — spotted an error or have a note? Share it below.
Expert Analysis
Why the Answer Is Correct
The solution proposes running an evaluation flow to score responses and block those below a threshold. While this prevents poor-quality summaries from being delivered, it does not improve the completeness of the generated output itself. When a response is blocked, the user typically receives an error or no answer, which is a degradation of service rather than an improvement in the summary's content. To actually improve completeness, the system would need mechanisms like self-correction loops, re-generation with specific prompts, or retrieval augmentation adjustments.Why the Other Options Are Wrong
Option A (Yes) is incorrect because it conflates filtering with improvement. Blocking incomplete responses enforces a standard but leaves the root cause unaddressed and provides no value to the user when the threshold is missed. The goal is to have the agent generate complete summaries, not just hide incomplete ones.Community Comment Notes
Community consensus strongly favors Option B. As NVIT2026 noted, "Simply blocking incomplete responses prevents poor output... but it does not fix, improve, or regenerate the response." Cloudera also highlighted that while evaluation is good for monitoring, it doesn't solve the completeness issue. Mattt emphasized that blocking results in a failed request rather than a corrected one.Exam Strategy
When evaluating AI system improvements, distinguish between observability/gating (monitoring and blocking bad outputs) and remediation (fixing or regenerating outputs). If the goal is to 'improve' quality, look for solutions that modify the generation process, not just filter the results.
Frequently Asked Questions
Why isn't blocking bad responses considered an improvement?
Blocking removes the response entirely, leaving the user with an error. Improvement implies the user receives a better, complete summary, which requires regeneration or correction, not just filtering.
How can we actually improve response completeness in Foundry?
Use self-correction loops where the agent reviews its own output against criteria, or adjust the retrieval grounding pipeline to ensure all policy documents are fully ingested and cited.
Related Analysis
Practice All AI-103 Questions
Access 88 questions with complete answers and detailed explanations.
View Full AI-103 Practice Test →