Automated Data Ingestion and Obfuscation with AWS Glue

DEA-C01 By islever Editorial Last updated

Short answer

C Configure an AWS Glue job to read the data from the S3 bucket, detect and obfuscate sensitive data, and load the data into Amazon Redshift.

Question

A company needs a solution to automatically ingest data from an Amazon S3 bucket to an Amazon Redshift table every day. The company must obfuscate sensitive data in Amazon Redshift. Users must not be able to view the sensitive data as plaintext.
Which solution will meet these requirements with the LEAST operational overhead?
  1. Enable Amazon Macie for the company's AWS account. Configure a sensitive data discovery job for the S3 bucket. Configure an AWS Glue job to load the data into Amazon Redshift.
  2. Enable Amazon Macie for the company's AWS account. Configure an AWS Glue job to flag and obfuscate data columns based on the Macie analysis. Load the data into Amazon Redshift.
  3. Configure an AWS Glue job to read the data from the S3 bucket, detect and obfuscate sensitive data, and load the data into Amazon Redshift. Correct Answer
  4. Configure an AWS Glue job to load the data into Amazon Redshift. Use Amazon Redshift to detect the sensitive data, create masking policies, and apply dynamic masking.

Key Takeaways

The main trap is confusing Amazon Macie (a discovery tool) with a transformation/ingestion tool. Glue handles both detection and obfuscation natively in the ETL flow, reducing operational overhead compared to multi-service architectures.

This page explains how to use AWS Glue for least-overhead automated ingestion and sensitive data obfuscation from S3 to Redshift. The correct solution leverages Glue's transformation capabilities to handle both tasks in one step.

Common mistake: Choosing Option D (Redshift Dynamic Masking) is common because it keeps data static in Redshift. However, it fails the 'automatic' aspect as it requires manual policy setup and doesn't inherently detect sensitive content without pre-configured masks, leading to higher operational overhead than Glue's automated transformations.

Expert Analysis

The core requirement is to automatically ingest data from S3 to Redshift while simultaneously obfuscating sensitive data, with a mandate for least operational overhead. The key constraint is that users must not see plaintext, implying the obfuscation must occur before or during the load.

Option C is the correct choice because AWS Glue provides built-in capabilities for data transformation, including detection and masking of sensitive data (via Glue Dev Studios or predefined transformation jobs). By configuring a single Glue job to read from S3, transform (obfuscate) the data, and write to Redshift, you consolidate ingestion and security into one managed service. This minimizes operational overhead compared to orchestrating multiple services.

Option A and B involve Amazon Macie. While Macie is excellent for discovering sensitive data in S3, it is a discovery and classification tool, not an ingestion or transformation engine. Using Macie requires additional setup: running discovery jobs, integrating findings with Glue, and managing the lifecycle of these separate processes. This increases operational overhead significantly compared to doing everything within Glue. Furthermore, Macie does not automatically obfuscate data in Redshift; it flags it. You would still need another step to handle the actual obfuscation during load.

Option D suggests using Amazon Redshift’s dynamic data masking. While Redshift supports dynamic masking policies, it does not have a built-in mechanism to detect sensitive data automatically at ingestion time without prior definition of masks. Setting up and maintaining these policies requires manual intervention to define which columns are sensitive and what masking rules apply. Additionally, loading raw data first and then applying masks adds complexity. More importantly, the question asks for automatic ingestion and obfuscation. Glue’s transformation capabilities are designed specifically for this ETL pattern, making it the most streamlined solution for "least operational overhead" in an automated pipeline context.

The comment noting "Redshift has no built-in way to detect sensitive data, Glue does" aligns with this reasoning. Glue can be configured to identify patterns (like PII) and mask them as part of the ETL process, whereas Redshift relies on pre-defined masking policies which require more initial configuration and management.

Official Reference

Exam Strategy

When evaluating solutions for 'least operational overhead,' prioritize integrated services that perform multiple required actions (ingest + transform) over fragmented architectures. If a service like Glue can natively detect and mask data during ETL, it typically beats combining a discovery service (Macie) with a separate ETL service. Always check if the target store (Redshift) offers native automation for the specific task mentioned.

Frequently Asked Questions

Why not use Amazon Macie for automatic obfuscation?

Amazon Macie is a security service for discovering sensitive data in S3. It classifies and alerts but does not perform data transformation or ingestion. Using it would require additional steps to move data and apply changes, increasing operational overhead.

Can Redshift automatically detect sensitive data without pre-defined masks?

No. Redshift dynamic data masking requires administrators to manually define masking policies for specific columns. It does not automatically scan incoming data to identify sensitive patterns like PII or financial data.

More DEA-C01 FAQ →

Community Votes

C
100%

100% of anonymous learners picked answer C. Votes are pick records left by other test-takers — they are not the verified answer.

Discussion 1 contributions

Compiled from public community threads and reader submissions, lightly edited for clarity. Handles and vote tallies are shown as recorded, and comments reflect the views of individual contributors.

From public community threads 1

  1. Verify_Ace 👍 1 Answered C
    C because, Redshift has no built-in way to detect sensitive data, Glue does.

Reader comments & corrections

No reader corrections yet — spotted an error or have a note? Share it below.

Log in to comment, report an error, or add a note about this question.

Practice All DEA-C01 Questions

Access 100 questions with complete answers and detailed explanations.

View Full DEA-C01 Practice Test →

← Back to DEA-C01 Study Guide