S3 Select vs Athena for Parquet Column Query
A data engineer has a one-time task to read data from objects that are in Apache Parquet format in an Amazon S3 bucket. The data engineer needs to query only one column of the data. Which solution will meet these requirements with the LEAST operational overhead?
Community Votes
71% of anonymous learners picked answer B. Votes are pick records left by other test-takers — they are not the verified answer.
Community Insight
The core concept is efficient data retrieval using S3 Select, and the common trap is assuming it only works on CSV/JSON or cannot handle Parquet formats.
This question evaluates the optimal AWS service for querying a single column from Apache Parquet files in S3 with minimal overhead. The correct solution leverages S3 Select's native filtering capabilities to avoid scanning entire objects.
Many learners choose D (Athena) because they believe S3 Select is limited to single files or deprecated, overlooking its support for columnar formats like Parquet and its lower operational overhead.
Community Discussion (8 comments)
Comments & Corrections
No comments yet — spotted an error or have a note? Share it below.
Expert Analysis
Why the Answer Is Correct
B is the correct answer because Amazon S3 Select allows you to retrieve subsets of data from an object using SQL expressions. It supports both CSV and Apache Parquet formats, enabling column-level filtering directly at the storage layer. This avoids downloading full objects, which significantly reduces operational overhead compared to other methods.Why the Other Options Are Wrong
Option A involves Lambda and pandas, which requires writing code and managing compute resources, increasing overhead. Option C, AWS Glue DataBrew, is a visual data preparation tool, not optimized for one-time programmatic queries. Option D uses Athena, which scans full partitions; while effective, it has higher latency and cost than S3 Select for simple column extractions from small datasets.Community Comment Notes
Several commenters argue that S3 Select is discontinued or limited to single objects. As user JoeAWSOCM noted, "S3 select is for querying one object," but this is incorrect as S3 Select can be used programmatically to query multiple objects via batch operations or scripts, though typically it targets specific keys. However, the consensus in the exam context emphasizes S3 Select's efficiency for such tasks despite community skepticism about its scope.Official Reference
Exam Strategy
When asked for 'least operational overhead' for reading specific data from S3, consider S3 Select before launching full services like Athena or EMR. Always verify if the format (like Parquet) is supported by the lighter-weight tool.
Frequently Asked Questions
Does S3 Select support Apache Parquet?
Yes, S3 Select supports both CSV and Apache Parquet formats, allowing efficient column-level filtering.
Is S3 Select discontinued?
No, it is not discontinued. While availability may vary by region or account type, it remains a valid feature for querying objects.
Related Analysis
Practice All DEA-C01 Questions
Access 100 questions with complete answers and detailed explanations.
View Full DEA-C01 Practice Test →