Data-Engineer-Associate Exam Dumps : AWS Certified Data Engineer - Associate (DEA-C01)

A “No space left on device” error typically results from data skew or large shuffle stages. The best actions are:

B. Monitor using Spark UI and Glue metrics to find skewed partitions or executor issues.

D. Use --write-shuffle-files-to-s3 to offload intermediate data to S3 instead of local disk, and apply salting to reduce skew.

“You can reduce the impact of data skew and large shuffle operations by monitoring with Spark UI and enabling the --write-shuffle-files-to-s3 option. Salting can help rebalance the skewed keys.”

– Ace the AWS Certified Data Engineer - Associate Certification - version 2 - apple.pdf

Scaling out workers (A, C) is more costly and less efficient if the root cause (skew) is not fixed.

Amazon SageMaker ML Lineage Tracking provides a unified mechanism to automatically capture and track the lineage of ML artifacts (datasets, jobs, and models). It supports auditability, reproducibility, and compliance by maintaining metadata for every stage of the ML lifecycle.

“Use Amazon SageMaker Lineage Tracking to automatically record and track the lineage of data, training jobs, models, and endpoints to ensure auditability and reproducibility.”

– Ace the AWS Certified Data Engineer - Associate Certification - version 2 - apple.pdf

The correct answer is A because Athena can query new partitions only after the partitions exist in the AWS Glue Data Catalog. Waiting for a nightly crawler creates unnecessary delay. The direct fix is to update the Data Catalog as part of the ETL process by calling the AWS Glue CreatePartition API immediately after each new S3 partition is written. AWS Glue documentation states that CreatePartition creates a new partition and requires the database name, table name, and partition input structure. Copying data to another bucket does not register partitions. DynamoDB Streams is unrelated unless the partition lifecycle is already stored in DynamoDB. StartImportLabelsTaskRun is not the API for partition registration. The correct operational pattern is event/write partition, then immediately register metadata.