AWS Glue vs MWAA Serverless Pipeline Constraints

DEA-C01 By islever Editorial Last updated

Short answer

A Deploy AWS Glue jobs and workflows to execute scripts in a fully managed, serverless pipeline.

Question

A data engineer needs to deploy a complex pipeline. The stages of the pipeline must be able to run a script. The data engineer must use only fully managed and serverless services in the pipeline.
Which solution will meet these requirements?
  1. Deploy AWS Glue jobs and workflows. Use AWS Glue to run the jobs and workflows on a schedule. Correct Answer
  2. Use Amazon Managed Workflows for Apache Airflow (Amazon MWAA) to build and schedule the pipeline.
  3. Deploy the script to Amazon EC2 instances. Use Amazon EventBridge to run the script on a schedule.
  4. Use Aws Glue DataBrew to build the pipeline. Use Amazon EventBridge to run the pipeline on a schedule.

Key Takeaways

The main trap is confusing Amazon MWAA with serverless services; while managed, MWAA relies on underlying EC2/RDS infrastructure, whereas Glue Jobs are truly serverless.

This question identifies AWS Glue jobs and workflows as the correct serverless solution for scripting pipelines, distinguishing it from MWAA which is managed but not serverless.

Common mistake: Candidates often choose Amazon MWAA (Option B) because it is a popular workflow orchestration tool. However, MWAA is not classified as serverless because it requires managing an Apache Airflow environment on managed infrastructure, violating the specific 'serverless' constraint.

Expert Analysis

The core constraint is the requirement for fully managed and serverless services that can run scripts within a complex pipeline. This question tests the distinction between AWS Glue (serverless) and Amazon Managed Workflows for Apache Airflow (MWAA), as well as the definition of 'serverless' in the context of AWS certifications.

AWS Glue Jobs are explicitly serverless; they execute Python or Spark scripts without requiring the user to provision or manage infrastructure. AWS Glue Workflows provide orchestration for these jobs, creating a fully managed, serverless pipeline solution. This aligns perfectly with the requirements.

Amazon MWAA (Option B) is often confused as serverless because it is managed by AWS. However, MWAA runs on underlying EC2 instances and RDS databases that AWS manages but which are not considered 'serverless' in the strict sense required by this exam objective. The comments highlight this trap, noting that MWAA involves cluster management concepts unlike true serverless offerings. Option C uses EC2, which is clearly not serverless. Option D uses DataBrew, which is a visual data preparation tool, not suitable for running custom scripts in a complex programming pipeline.

Therefore, the boundary here is between 'Managed' (MWAA/EC2) and 'Serverless' (Glue). Only Glue satisfies both script execution and serverless architecture.

Exam Strategy

When encountering questions specifying 'serverless,' eliminate any option involving EC2, ECS, or EKS immediately. For orchestration, distinguish between 'managed' services like MWAA or EMR, which still involve underlying compute clusters, and 'truly serverless' services like AWS Glue, Lambda, or Step Functions. If the question demands script execution in a serverless environment, AWS Glue Jobs or Lambda are usually the intended answers over MWAA.

Frequently Asked Questions

Is Amazon MWAA considered serverless?

No. While Amazon Managed Workflows for Apache Airflow (MWAA) is a managed service, it is not considered serverless because it runs on underlying EC2 instances and RDS databases that AWS manages. In AWS certification contexts, 'serverless' typically refers to services like AWS Glue, Lambda, or Step Functions where no infrastructure provisioning is visible.

Can AWS Glue run Python scripts?

Yes. AWS Glue Jobs can be written in Python (PySpark) or Scala (Spark). They are designed to execute transformation logic in a serverless environment, making them suitable for complex data pipelines that require custom scripting.

More DEA-C01 FAQ →

Community Votes

A
100%

100% of anonymous learners picked answer A. Votes are pick records left by other test-takers — they are not the verified answer.

Discussion 2 contributions

Compiled from public community threads and reader submissions, lightly edited for clarity. Handles and vote tallies are shown as recorded, and comments reflect the views of individual contributors.

From public community threads 2

  1. learner2023 👍 1 Answered A
    WS Glue jobs execute scripts and Glue Workflows orchestrate complex multi-stage pipelines—both fully managed and serverless with no infrastructure management. (B requires MWAA cluster management. C uses EC2 (not serverless). D DataBrew is for data profiling/preparation, not complex scripting pipelines.)
  2. Durgach1989 👍 1 Answered A
    MWAA is not truly serverless hence option A suits more.

Reader comments & corrections

No reader corrections yet — spotted an error or have a note? Share it below.

Log in to comment, report an error, or add a note about this question.

Practice All DEA-C01 Questions

Access 100 questions with complete answers and detailed explanations.

View Full DEA-C01 Practice Test →

← Back to DEA-C01 Study Guide