Running On-Demand Bias Drift Monitoring for Real-Time Endpoints with Lambda-Triggered SageMaker Clarify

Monitor model inference.
Answer Correct answer: A — SageMaker Clarify measures bias on deployed endpoints, and invoking its job from Lambda makes the bias drift monitoring on-demand and automated.

Case Study - A company is building a web-based AI application by using Amazon SageMaker. The application will provide the following capabilities and features: ML experimentation, training, a central model registry, model deployment, and model monitoring. The application must ensure secure and isolated use of training data during the ML lifecycle. The training data is stored in Amazon S3. The company needs to run an on-demand workflow to monitor bias drift for models that are deployed to real-time endpoints from the application. Which action will meet this requirement?

  1. Configure the application to invoke an AWS Lambda function that runs a SageMaker Clarify job. Correct Answer
  2. Invoke an AWS Lambda function to pull the sagemaker-model-monitor-analyzer built-in SageMaker image.
  3. Use AWS Glue Data Quality to monitor bias.
  4. Use SageMaker notebooks to compare the bias.

Community Votes

A
100%

100% of anonymous learners picked answer A. Votes are pick records left by other test-takers — they are not the verified answer.

Community Insight

SageMaker Clarify is the service that measures bias, providing both pre-training data bias and post-training model bias analysis, and a Lambda function that invokes a Clarify processing job gives the on-demand, automated trigger the requirement asks for.

A company building a SageMaker-based web application needs an on-demand workflow to monitor bias drift for models deployed to real-time endpoints. The monitoring has to be triggered when the application needs it rather than continuously, and bias measurement is the specific capability required.

Using the sagemaker-model-monitor-analyzer image or Glue Data Quality, neither of which measures bias. The Model Monitor analyzer handles statistics generation and constraint validation against a baseline, not bias, so it cannot deliver bias drift monitoring.

Community Discussion (5 comments)

ninomfr64 👍 6 Selected: A
A. Yes, Clarify allows to get bias - https://docs.aws.amazon.com/sagemaker/latest/dg/clarify-configure-processing-jobs.html B. No, the built-in image sagemaker-model-monitor-analyzer provides a range of model monitoring capabilities (constraint suggestion, statistics generation, constraint validation against a baseline, and emitting Amazon CloudWatch metrics) but you need Clarify for bias C. No, Glue Data Quality doesn't analyze bias D. No, well from a Notebook you can execute pretty much everything including a Clarify Job, however notebooks are for experiments and models development not for enabling real-time application features
Laxma99 👍 1 Selected: A
SageMaker Clarify can be used to analyze bias drift in models. By integrating this with a Lambda function, the workflow can be triggered on-demand whenever the application requires bias monitoring.
S_201996 👍 1 Selected: A
SageMaker Clarify can be used to analyze bias drift in models. By integrating this with a Lambda function, the workflow can be triggered on-demand whenever the application requires bias monitoring.
tigrex73 👍 2 Selected: A
SageMaker Clarify is a tool designed to detect and monitor bias in datasets and models. It provides built-in capabilities for bias analysis, both pre-training (data bias) and post-training (model bias). Using AWS Lambda to invoke the job ensures automation and on-demand execution, reducing operational complexity while meeting the requirement for monitoring bias drift.
GiorgioGss 👍 2 Selected: A
https://docs.aws.amazon.com/sagemaker/latest/dg/clarify-measure-data-bias.html

Comments & Corrections

No comments yet — spotted an error or have a note? Share it below.

Log in to comment, report an error, or add a note about this question.

Submitted for moderation before publishing. Keep it helpful and respectful.

Expert Analysis

Why the Answer Is Correct

The requirement is an on-demand workflow to monitor bias drift for models deployed to real-time endpoints, which splits into a bias measurement capability and an on-demand trigger. SageMaker Clarify is the service that provides bias measurement, supporting both pre-training data bias and post-training model bias analysis, and its processing jobs are the unit of work. Wrapping the Clarify job invocation in a Lambda function gives the application an event-driven, on-demand way to trigger the analysis, which reduces operational complexity because no schedule or manual step is required. The vote was unanimous at 100 for A. ninomfr64 tied each option to its actual capability, noting that Clarify is what provides bias, and tigrex73, Laxma99, and S_201996 all explained that the Lambda invocation is what makes the Clarify job on-demand and automated.

Why the Other Options Are Wrong

Invoking a Lambda function to pull the sagemaker-model-monitor-analyzer built-in image (B) uses the wrong capability, because that image provides statistics generation, constraint suggestion, constraint validation against a baseline, and CloudWatch metrics emission, none of which measure bias; ninomfr64 stated this distinction explicitly. Using AWS Glue Data Quality to monitor bias (C) is also a capability mismatch, since Glue Data Quality validates data quality rules such as completeness and validity rather than measuring bias in a model or dataset. Using SageMaker notebooks to compare the bias (D) relies on manual analysis in an interactive development environment, which is neither an automated on-demand workflow nor a purpose-built bias measurement, and it would not run against a deployed real-time endpoint on demand.

Community Comment Notes

The community was unanimous at 100 for A, and ninomfr64 provided the most complete elimination, walking through all four options and identifying the precise scope of the Model Monitor analyzer image as the reason option B fails. GiorgioGss cited the SageMaker Clarify documentation for measuring data bias. tigrex73, Laxma99, and S_201996 independently arrived at the same two-part justification: Clarify supplies the bias capability and the Lambda function supplies the on-demand automated execution the scenario requires.

Official Reference

https://docs.aws.amazon.com/sagemaker/latest/dg/clarify-configure-processing-jobs.html

Related Analysis

A company wants to reduce the cost of its containerized ML a

A-Grade

An ML engineer needs to process thousands of existing CSV ob

A-Grade

Case study - An ML engineer is developing a fraud detection

S-Grade

Practice All MLA-C01 Questions

Access 115 questions with complete answers and detailed explanations.

View Full MLA-C01 Practice Test →

← Back to MLA-C01 Study Guide