Configuring AWS Glue Crawler for Daily Catalog Updates
A company stores daily records of the financial performance of investment portfolios in .csv format in an Amazon S3 bucket. A data engineer uses AWS Glue crawlers to crawl the S3 data. The data engineer must make the S3 data accessible daily in the AWS Glue Data Catalog. Which solution will meet these requirements?
Community Votes
100% of anonymous learners picked answer B. Votes are pick records left by other test-takers — they are not the verified answer.
Community Insight
The core concept is configuring a serverless AWS Glue Crawler; the common trap is confusing Glue Crawlers with Spark ETL jobs by incorrectly allocating DPUs or specifying S3 output destinations.
This question addresses how to automate the ingestion of CSV data from S3 into the AWS Glue Data Catalog using scheduled crawlers. It establishes that serverless crawlers require specific IAM roles and database targets, not DPU allocations or S3 output paths.
Option D is a common distractor because it includes DPUs, which are used for provisioned Glue ETL jobs, not for serverless crawlers that scale automatically without manual resource allocation.
Community Discussion (5 comments)
Comments & Corrections
No comments yet — spotted an error or have a note? Share it below.
Expert Analysis
Why the Answer Is Correct
Option B is the correct solution because it utilizes theAWSGlueServiceRole policy, which grants the necessary permissions for the crawler to read from S3 and write metadata to the Glue Data Catalog. Specifying a database name is required as the output destination for the schema information. Creating a daily schedule ensures the catalog is updated with new records as requested.Why the Other Options Are Wrong
Options A and C suggest usingAmazonS3FullAccess, which is overly permissive and violates least-privilege principles compared to the managed AWSGlueServiceRole. Furthermore, Option A configures an S3 output path, which is incorrect as crawlers update the Data Catalog, not S3 files. Options C and D mention allocating Data Processing Units (DPUs); this is incorrect because Glue Crawlers are serverless and do not require manual DPU provisioning like Glue ETL jobs do.Community Comment Notes
Community members largely agreed on B, with one user noting that assigning DPUs was the deciding factor against other options. Another commenter clarified that whileAWSGlueServiceRole is sufficient, some users questioned if explicit S3 permissions were needed, but the service role handles this integration securely. Exam Strategy
When dealing with AWS Glue, always distinguish between 'Crawlers' (serverless, no DPU selection) and 'ETL Jobs' (can be serverless or provisioned with DPUs). For crawlers, focus on the IAM role and the Data Catalog database target.
Frequently Asked Questions
Do Glue Crawlers require DPUs?
No. Glue Crawlers are serverless and scale automatically. DPUs are only allocated for provisioned Glue ETL jobs.
Why not use AmazonS3FullAccess?
It violates least-privilege security. The AWSGlueServiceRole provides the specific permissions needed for S3 access and Data Catalog updates.
Related Analysis
Practice All DEA-C01 Questions
Access 100 questions with complete answers and detailed explanations.
View Full DEA-C01 Practice Test →