Which AWS service most cost-effectively orchestrates an Amazon EMR ETL pipeline?

Orchestrate data pipelines. Automate data processing by using AWS services.

Answer Correct answer: C — AWS Step Functions orchestrates the Amazon EMR ETL pipeline cost-effectively with serverless state machines and native EMR integration.

A company uses Amazon EMR as an extract, transform, and load (ETL) pipeline to transform data that comes from multiple sources. A data engineer must orchestrate the pipeline to maximize performance. Which AWS service will meet this requirement MOST cost effectively?

Amazon EventBridge
Amazon Managed Workflows for Apache Airflow (Amazon MWAA)
AWS Step Functions Correct Answer
AWS Glue Workflows

Community Votes

100%

100% of anonymous learners picked answer C. Votes are pick records left by other test-takers — they are not the verified answer.

Community Insight

This question tests which AWS orchestration service best fits an existing Amazon EMR ETL pipeline; the trap is confusing Glue Workflows' Glue-only scope or MWAA's higher always-on cost with general-purpose, pay-per-transition Step Functions.

Amazon EMR ETL pipelines that pull from multiple sources need an orchestrator that can sequence EMR steps and other AWS services. AWS Step Functions is the correct answer (C) because it is serverless, cost-effective, and natively integrates with EMR, unlike MWAA or Glue Workflows.

Choosing AWS Glue Workflows because it sounds like a dedicated ETL orchestrator, even though it can only coordinate AWS Glue jobs and crawlers, not an existing EMR pipeline.

Community Discussion (8 comments)

artworkad 👍 5 Selected: C

Glue Workflows is for Glue job orchestration. C is for orchestration with different AWS services.

hcong 👍 1 Selected: B

Amazon Managed Workflows for Apache Airflow (Amazon MWAA) is the best service for orchestrating complex data pipelines, especially for workloads already using Amazon EMR. Airflow is a powerful workflow orchestration tool that can be integrated with various AWS services, including EMR, to provide flexible scheduling, task dependency management, and monitoring capabilities. Using a hosted Airflow service (MWAA) can reduce administrative overhead while maintaining a familiar workflow orchestration environment.

chrispchrisp 👍 3 Selected: C

B is not cost effective, D is only to orchestrate Glue Jobs and Crawlers within AWS Glue itself. Hence C is correct, Step functions is cost effective and can link together your different AWS services.

andrologin 👍 2 Selected: C

This is EMR not Glue workflows hence step functions EventBridge is best for event driven architecture

LR2023 👍 1 Selected: B

https://aws.amazon.com/blogs/big-data/build-a-concurrent-data-orchestration-pipeline-using-amazon-emr-and-apache-livy/

bakarys 👍 2 Selected: D

The most cost-effective AWS service for orchestrating an ETL pipeline that maximizes performance is D. AWS Glue Workflows. AWS Glue is a fully managed ETL service that makes it easy to move data between your data stores. AWS Glue simplifies and automates the difficult and time-consuming tasks of data discovery, conversion mapping, and job scheduling. AWS Glue Workflows allows you to orchestrate complex ETL jobs involving multiple crawlers, jobs, and triggers. While the other services mentioned (Amazon EventBridge, Amazon MWAA, and AWS Step Functions) can be used for workflow orchestration, they are not specifically designed for ETL workloads and may not be as cost-effective for this use case. AWS Glue is designed for ETL workloads, and its workflows feature is specifically designed for orchestrating ETL jobs, making it the most suitable and cost-effective choice.

HunkyBunky 👍 1 Selected: C

C - becuase AWS Glue can be used only for glue based ETL jobs

tgv 👍 2 Selected: C

While AWS Glue Workflows are excellent for orchestrating Glue-specific ETL tasks, AWS Step Functions is more suitable for orchestrating an Amazon EMR-based ETL pipeline due to its greater flexibility, broader integration capabilities, and effective cost management. Therefore, the correct choice remains [C]

Comments & Corrections

No comments yet — spotted an error or have a note? Share it below.

Expert Analysis

Why the Answer Is Correct

AWS Step Functions is a serverless, pay-per-transition orchestrator that natively integrates with Amazon EMR through optimized service integrations such as RunJobFlow, AddStep, and TerminateCluster. Because the pipeline already uses EMR as the ETL engine, Step Functions can sequence EMR steps, wait for completion, branch for multiple sources, retry failures, and call other AWS services without provisioning infrastructure. It charges only for state transitions and has no idle environment cost, which directly satisfies the question's 'MOST cost effectively' requirement. It also avoids the Glue-only scope of Glue Workflows and the event-routing-only role of EventBridge.

Why the Other Options Are Wrong

A is wrong because Amazon EventBridge is a serverless event bus for routing events, not a workflow engine that can model dependencies, retries, and EMR step sequencing. B is wrong because Amazon MWAA runs a managed Apache Airflow environment with always-on worker and scheduler charges, which is powerful but not the most cost-effective choice for this EMR orchestration. D is wrong because AWS Glue Workflows orchestrates only AWS Glue jobs and crawlers, so it cannot directly manage Amazon EMR cluster steps or non-Glue AWS services. Only Step Functions provides the broad AWS service orchestration and native EMR integration needed here.

Community Comment Notes

Most commenters align with C: artworkad noted "Glue Workflows is for Glue job orchestration" while Step Functions handles different AWS services. chrispchrisp argued that B is not cost effective and that D only orchestrates Glue jobs and crawlers. tgv wrote that Step Functions is more suitable for an Amazon EMR pipeline due to flexibility and cost management. andrologin pointed out EventBridge is better for event-driven architecture, not pipeline orchestration. Some learners such as hcong favored MWAA for complex pipelines, but its always-on environment cost conflicts with the cost-effectiveness wording; LR2023 shared an AWS blog on EMR and Apache Livy, which is a useful EMR orchestration pattern but does not change the service choice.

Official Reference

Exam Strategy

When an AWS question asks for the 'MOST cost effectively' option, eliminate managed environment services like MWAA that bill for always-on workers and services scoped to a single product like Glue Workflows. Step Functions' serverless, pay-per-transition model and native EMR integrations are the cost-performance sweet spot.

Frequently Asked Questions

Why is AWS Glue Workflows not the right orchestrator for this Amazon EMR pipeline?

Glue Workflows only coordinates AWS Glue jobs and crawlers, so it cannot directly manage EMR cluster steps or non-Glue AWS services. The question specifically requires orchestrating an existing EMR ETL pipeline.

Why is Amazon MWAA less cost-effective than Step Functions for EMR orchestration?

MWAA runs an always-on managed Airflow environment with worker and scheduler charges, while Step Functions charges per state transition and scales to zero when idle.

Related Analysis

Practice All DEA-C01 Questions

Access 100 questions with complete answers and detailed explanations.

View Full DEA-C01 Practice Test →

← Back to DEA-C01 Study Guide