Least Refactoring Airflow Migration to AWS
Short answer
C Migrate the existing Airflow orchestration configuration into Amazon Managed Workflows for Apache Airflow (Amazon MWAA). Create the data quality checks during the ingestion to validate the data quality by using SQL tasks in Airflow.
Question
Key Takeaways
The question tests knowledge of managed orchestration services; the trap is choosing custom EC2 deployments or rewriting logic in Step Functions, which increase refactoring effort significantly compared to migrating directly to MWAA.
Migrating on-premises Apache Airflow pipelines to AWS with minimal refactoring requires using Amazon Managed Workflows for Apache Airflow (MWAA). This managed service allows existing configurations and SQL-based data quality checks to run with little to no code changes.
Common mistake: Candidates often select Option B (custom AMI on EC2) because it seems like a direct lift-and-shift, but managing Airflow components manually on EC2 violates the 'AWS managed services' requirement and increases operational overhead compared to the fully managed MWAA.
Expert Analysis
Why the Answer Is Correct
Option C is the correct choice because Amazon Managed Workflows for Apache Airflow (MWAA) is a fully managed service designed specifically to run Apache Airflow. Since the company already uses Airflow, migrating the DAGs and configuration files to MWAA requires the least amount of refactoring. The SQL data quality checks can continue to run as they are, leveraging Airflow's native capabilities without needing to rewrite logic into other AWS services.
Why the Other Options Are Wrong
Option A (Outposts) and Option B (EC2 with custom AMI) involve running Airflow on compute instances rather than using a managed orchestration service, which contradicts the requirement to use AWS managed services for the pipeline orchestration. Option D suggests converting pipelines to AWS Step Functions and rewriting SQL tasks as Python Lambda functions. This represents a significant refactoring effort, changing the orchestration engine and the implementation language of the tasks, which is the opposite of the 'least refactoring' goal.
Community Comment Notes
Community consensus strongly supports Option C. As user HunkyBunky noted, "Amazon MWAA - becuase we already uses Apache Airflow," highlighting that leveraging existing infrastructure reduces migration complexity. User tgv added that "Amazon MWAA is a managed service... allows migrating existing Airflow configurations with minimal changes," reinforcing that this is the standard path for lift-and-shift migrations of Airflow workloads.
Exam Strategy
When a question asks for the 'least refactoring' or 'minimal changes' during migration, look for the managed service that natively supports the existing open-source technology. Avoid options that suggest rewriting code or switching to entirely different architectural patterns unless explicitly required by constraints not met by the managed service.
Frequently Asked Questions
Why not use EC2 with a custom AMI for Airflow?
Can SQL tasks run in Amazon MWAA?
Community Votes
100% of anonymous learners picked answer C. Votes are pick records left by other test-takers — they are not the verified answer.
Discussion 3 contributions
Compiled from public community threads and reader submissions, lightly edited for clarity. Handles and vote tallies are shown as recorded, and comments reflect the views of individual contributors.
From public community threads 3
-
bakarys 👍 3 Answered CThe solution that will meet these requirements with the least amount of refactoring is Option C: Migrate the existing Airflow orchestration configuration into Amazon Managed Workflows for Apache Airflow (Amazon MWAA). Create the data quality checks during the ingestion to validate the data quality by using SQL tasks in Airflow. Amazon Managed Workflows for Apache Airflow (MWAA) is a fully managed service that makes it easy to run open-source versions of Apache Airflow on AWS. It allows you to build workflows to design and visualize pipelines, automate complex tasks, and monitor executions. Since the company is already using Apache Airflow for orchestration, migrating to Amazon MWAA would require minimal refactoring.
-
tgv 👍 3 Answered CAmazon MWAA is a managed service for running Apache Airflow. It allows migrating existing Airflow configurations with minimal changes. Data quality checks can continue to be implemented as SQL tasks in Airflow, similar to the current setup.
-
HunkyBunky 👍 3 Answered CAmazon MWAA - becuase we already uses Apache Airflow
Reader comments & corrections
No reader corrections yet — spotted an error or have a note? Share it below.
Related Analysis
Practice All DEA-C01 Questions
Access 100 questions with complete answers and detailed explanations.
View Full DEA-C01 Practice Test →