Running On-Demand Bias Drift Monitoring for Real-Time Endpoints with Lambda-Triggered SageMaker Clarify

MLA-C01 By islever Editorial Last updated

Monitor model inference.

Short answer

A SageMaker Clarify measures bias on deployed endpoints, and invoking its job from Lambda makes the bias drift monitoring on-demand and automated.

Question

Case Study - A company is building a web-based AI application by using Amazon SageMaker. The application will provide the following capabilities and features: ML experimentation, training, a central model registry, model deployment, and model monitoring. The application must ensure secure and isolated use of training data during the ML lifecycle. The training data is stored in Amazon S3. The company needs to run an on-demand workflow to monitor bias drift for models that are deployed to real-time endpoints from the application. Which action will meet this requirement?
  1. Configure the application to invoke an AWS Lambda function that runs a SageMaker Clarify job. Correct Answer
  2. Invoke an AWS Lambda function to pull the sagemaker-model-monitor-analyzer built-in SageMaker image.
  3. Use AWS Glue Data Quality to monitor bias.
  4. Use SageMaker notebooks to compare the bias.

Key Takeaways

SageMaker Clarify is the service that measures bias, providing both pre-training data bias and post-training model bias analysis, and a Lambda function that invokes a Clarify processing job gives the on-demand, automated trigger the requirement asks for.

A company building a SageMaker-based web application needs an on-demand workflow to monitor bias drift for models deployed to real-time endpoints. The monitoring has to be triggered when the application needs it rather than continuously, and bias measurement is the specific capability required.

Common mistake: Using the sagemaker-model-monitor-analyzer image or Glue Data Quality, neither of which measures bias. The Model Monitor analyzer handles statistics generation and constraint validation against a baseline, not bias, so it cannot deliver bias drift monitoring.

Expert Analysis

Why the Answer Is Correct

The requirement is an on-demand workflow to monitor bias drift for models deployed to real-time endpoints, which splits into a bias measurement capability and an on-demand trigger. SageMaker Clarify is the service that provides bias measurement, supporting both pre-training data bias and post-training model bias analysis, and its processing jobs are the unit of work. Wrapping the Clarify job invocation in a Lambda function gives the application an event-driven, on-demand way to trigger the analysis, which reduces operational complexity because no schedule or manual step is required. The vote was unanimous at 100 for A. ninomfr64 tied each option to its actual capability, noting that Clarify is what provides bias, and tigrex73, Laxma99, and S_201996 all explained that the Lambda invocation is what makes the Clarify job on-demand and automated.

Why the Other Options Are Wrong

Invoking a Lambda function to pull the sagemaker-model-monitor-analyzer built-in image (B) uses the wrong capability, because that image provides statistics generation, constraint suggestion, constraint validation against a baseline, and CloudWatch metrics emission, none of which measure bias; ninomfr64 stated this distinction explicitly. Using AWS Glue Data Quality to monitor bias (C) is also a capability mismatch, since Glue Data Quality validates data quality rules such as completeness and validity rather than measuring bias in a model or dataset. Using SageMaker notebooks to compare the bias (D) relies on manual analysis in an interactive development environment, which is neither an automated on-demand workflow nor a purpose-built bias measurement, and it would not run against a deployed real-time endpoint on demand.

Community Comment Notes

The community was unanimous at 100 for A, and ninomfr64 provided the most complete elimination, walking through all four options and identifying the precise scope of the Model Monitor analyzer image as the reason option B fails. GiorgioGss cited the SageMaker Clarify documentation for measuring data bias. tigrex73, Laxma99, and S_201996 independently arrived at the same two-part justification: Clarify supplies the bias capability and the Lambda function supplies the on-demand automated execution the scenario requires.

Official Reference

https://docs.aws.amazon.com/sagemaker/latest/dg/clarify-configure-processing-jobs.html

This link opens the official vendor documentation in a new tab.

Community Votes

A
100%

100% of anonymous learners picked answer A. Votes are pick records left by other test-takers — they are not the verified answer.

Discussion 4 contributions

Compiled from public community threads and reader submissions, lightly edited for clarity. Handles and vote tallies are shown as recorded, and comments reflect the views of individual contributors.

From public community threads 4

  1. ninomfr64 👍 6 Answered A
    A. Yes, Clarify allows to get bias - https://docs.aws.amazon.com/sagemaker/latest/dg/clarify-configure-processing-jobs.html B. No, the built-in image sagemaker-model-monitor-analyzer provides a range of model monitoring capabilities (constraint suggestion, statistics generation, constraint validation against a baseline, and emitting Amazon CloudWatch metrics) but you need Clarify for bias C. No, Glue Data Quality doesn't analyze bias D. No, well from a Notebook you can execute pretty much everything including a Clarify Job, however notebooks are for experiments and models development not for enabling real-time application features
  2. tigrex73 👍 2 Answered A
    SageMaker Clarify is a tool designed to detect and monitor bias in datasets and models. It provides built-in capabilities for bias analysis, both pre-training (data bias) and post-training (model bias). Using AWS Lambda to invoke the job ensures automation and on-demand execution, reducing operational complexity while meeting the requirement for monitoring bias drift.
  3. GiorgioGss 👍 2 Answered A
    https://docs.aws.amazon.com/sagemaker/latest/dg/clarify-measure-data-bias.html
  4. Laxma99 👍 1 Answered A
    SageMaker Clarify can be used to analyze bias drift in models. By integrating this with a Lambda function, the workflow can be triggered on-demand whenever the application requires bias monitoring.

Reader comments & corrections

No reader corrections yet — spotted an error or have a note? Share it below.

Log in to comment, report an error, or add a note about this question.

Submitted for moderation before publishing. Keep it helpful and respectful.

Choosing LightGBM in SageMaker for Fraud Detection with Class Imbalance and Correlated Features

S-grade

Processing Mixed CSV JSON XLSX Parquet Files in One S3 Folder with DataBrew and Outputting Apache Parquet

S-grade

Rebuilding the Model Monitor Baseline After a Model Update Causes Data Quality Violations

S-grade

Orchestrating SageMaker ML Workflows as DAGs in Studio with ML Lineage Tracking for Governance

S-grade

Practice All MLA-C01 Questions

Access 115 questions with complete answers and detailed explanations.

View Full MLA-C01 Practice Test →

← Back to MLA-C01 Study Guide