A company collects customer data every day. The company stores the data as compressed files in an Amazon S3 bucket that is partitioned by date. Every month, analysts download the data, process the data to check the data quality, and then upload the data to Amazon QuickSight dashboards. An ML engineer needs to implement a solution to automatically check the data quality before the data is sent to QuickSight. Which solution will meet these requirements with the LEAST operational overhead?
Select an option, then click Submit answer.
Reference / correct answer:
Run an AWS Glue crawler every month to update the AWS Glue Data Catalog. Use AWS Glue Data Quality rules to check the data quality.
Most accepted answer: A. Run an AWS Glue crawler every month to update the AWS Glue Data Catalog. Use AWS Glue Data Quality rules to check the data quality.
Community votes: A=4, D=1
Selected Answer: A Answer: A. AWS Glue crawler + AWS Glue Data Quality rules Why: Glue Data Quality is a built-in, managed feature purpose-built for automated data quality checks — no custom code needed. Least operational overhead. Why not the others: B. Custom PySpark code = more operational overhead C. Custom Python scripts on Lambda = more code to maintain D. CloudWatch Insights doesn't evaluate data quality upvoted 1 times
Selected Answer: A AWS Glue Crawler + Data Quality Rules ✅ LOWEST OPERATIONAL OVERHEAD upvoted 1 times
Selected Answer: A A. Run an AWS Glue crawler every month to update the AWS Glue Data Catalog. Use AWS Glue Data Quality rules to check the data quality. upvoted 1 times
Selected Answer: A A seems the easiest upvoted 1 times
Selected Answer: D Feels like D is the intended answer here. The wording is tricky. upvoted 1 times