A company has an Amazon S3 bucket that contains 1 ТВ of files from different sources. The S3 bucket contains the following file types in the same S3 folder: CSV, JSON, XLSX, and Apache Parquet. An ML engineer must implement a solution that uses AWS Glue DataBrew to process the data. The ML engineer also must store the final output in Amazon S3 so that AWS Glue can consume the output in the future. Which solution will meet these requirements?
Select an option, then click Submit answer.
Reference / correct answer:
Separate the data into a different folder for each file type. Use DataBrew to process each folder individually. Store the output in Apache Parquet format.
Most accepted answer: C. Separate the data into a different folder for each file type. Use DataBrew to process each folder individually. Store the output in Apache Parquet format.
Community votes: A=3, C=5
Selected Answer: C ✅ Explanation: Problem Summary: The data in S3 is mixed file formats: CSV, JSON, XLSX, and Parquet — all in one folder. You need to use AWS Glue DataBrew to process the data. The processed data must be stored in S3 for AWS Glue to consume later. Key Considerations: DataBrew Input Requirements: DataBrew datasets must be in a consistent format (CSV, JSON, XLSX, or Parquet). DataBrew cannot process mixed formats in a single dataset. You must split the data by format. DataBrew Output Format: Apache Parquet is preferred for: Efficient storage Better performance with AWS Glue and other analytics tools Columnar storage benefits in querying and transformations "AWS Glue Parquet format" does not exist — this is a distractor in the answer options. upvoted 6 times
Selected Answer: C DataBrew requires s3 buckets contains same format of data so it is c upvoted 1 times
Selected Answer: C Confusing, but I'd go with C. upvoted 1 times
Selected Answer: C AWS Glue DataBrew works best when processing files of the same type together. It's designed to apply consistent transformations to datasets with similar structures. When working with multiple file formats (CSV, JSON, XLSX, and Parquet), separating them by type allows for format-specific preprocessing before merging the data. upvoted 3 times
Selected Answer: A 🔑 Keyword: Process mixed file types with AWS Glue DataBrew & store for AWS Glue ✅ Correct Answer: A. Use DataBrew to process the existing S3 folder. Store the output in Apache Parquet format. Why? AWS Glue performs best with Parquet because it is optimized for analytical queries. No need to split data into separate folders—DataBrew can handle mixed file types. Why Others Are Wrong? ❌ B. "AWS Glue Parquet format" is not a valid term. Apache Parquet is the correct format. ❌ C & D. Separating files into different folders is unnecessary—DataBrew can process multiple formats in a single folder. upvoted 2 times