AWS Certified Associate Data-Engineer-Associate Full Course Free

The data engineer needs to detect custom categories of PII within the data lake using AWS Glue DataBrew. While DataBrew provides standard data quality rules, the solution must support custom PII categories.

Option B: Implement custom data quality rules in DataBrew. Apply the custom rules across datasets.This option is the most efficient because DataBrew allows the creation of custom data quality rules that can be applied to detect specific data patterns, including custom PII categories. This approach minimizes operational overhead while ensuring that the specific privacy requirements are met.

Options A, C, and D either involve manual intervention or developing custom scripts, both of which increase operational effort compared to using DataBrew ' s built-in capabilities.

Option A (AWS DMS): Lets you replicate only selected tables from Aurora to Redshift. It supports ongoing replication (CDC) and reduces unnecessary data transfers.

Option C (Zero-ETL with Aurora to Redshift): This new integration allows real-time, serverless, and low-maintenance data replication. It ' s designed to reduce operational overhead drastically.

Other options introduce manual processing or inefficient query access (Option D). Glue workflows (Option E) add unnecessary complexity and lag for near-real-time needs.

“Zero-ETL integration between Amazon Aurora and Redshift enables real-time analytics without building complex pipelines.”

Option A is the best answer because AWS DMS documentation recommends that, when practical, you create the replication instance in the same Region as your target endpoint, and in the same VPC or subnet as your target endpoint. In this scenario, the target is the Amazon Redshift cluster in eu-west-1 in Account_B, so placing the replication instance there is the most appropriate design. AWS DMS uses the replication instance to connect to the source, read the source data, transform it as needed, and load it into the target.

This also makes architectural sense because the replication instance must have network connectivity to both endpoints, and colocating it with the Redshift target usually simplifies connectivity to the target warehouse and aligns with AWS guidance. A replication instance in Account_B, eu-west-1 can still connect to the PostgreSQL source in Account_A, eu-east-1, provided the required networking and permissions are configured. AWS DMS supports replication tasks by defining a replication instance plus source and target endpoints.

The study guide also identifies AWS DMS as the correct managed service for database migration and continuous replication scenarios, including full load and change data capture. That matches this cross-account, cross-Region migration use case.

The correct answer is B because AWS Glue streaming ETL jobs are built to continuously consume data from streaming sources such as Amazon Kinesis Data Streams, transform the data, and load the results into Amazon S3 data lakes. The requirement is not just delivery to S3; the telemetry JSON must be flattened before storage, and this needs to happen with low latency. Amazon Data Firehose can deliver streaming data, but the option incorrectly assumes automatic flattening without a transformation layer. SQS plus scheduled batch Glue introduces batch delay and does not meet the lowest-latency requirement. Athena is a query engine, not a real-time transformation and ingestion service for writing flattened streaming output to S3. AWS Glue streaming ETL is the correct serverless streaming transformation layer.