Amazon Web Services AIF-C01 Questions Answers

Sampling bias is the correct type of bias affecting the model output when it disproportionately flags people from a specific ethnic group.

Sampling Bias:

Occurs when the training data is not representative of the broader population, leading to skewed model outputs.

In this case, if the model disproportionately flags people from a specific ethnic group, it likely indicates that the training data was not adequately balanced or representative.

Why Option B is Correct:

Reflects Data Imbalance: A biased sample in the training data could result in unfair outcomes, such as disproportionately flagging a particular group.

Common Issue in ML Models: Sampling bias is a known problem that can lead to unfair or inaccurate model predictions.

Why Other Options are Incorrect:

A. Measurement bias: Involves errors in data collection or measurement, not sampling.

C. Observer bias: Refers to bias introduced by researchers or data collectors, not the model's output.

D. Confirmation bias: Involves favoring information that confirms existing beliefs, not relevant to model output bias.

Fairness refers to the absence of bias in AI models. Using non-representative datasets leads to biased predictions, affecting specific demographics unfairly. Explainability, privacy, and transparency are important but not directly related to this scenario. References: AWS Responsible AI Framework.

The company needs to address the degradation in model inference quality after 4 months in production and prevent future occurrences by receiving notifications. Retraining the model can address the current degradation, likely caused by data drift (changes in the data distribution over time). Amazon SageMaker Model Monitor is designed to detect and monitor model drift, alerting the company when inference quality degrades, thus meeting both requirements.

Exact Extract from AWS AI Documents:

From the Amazon SageMaker Developer Guide:

"Amazon SageMaker Model Monitor enables you to monitor machine learning models in production for data drift, model performance degradation, and other quality issues. It can detect drift in feature distributions and inference quality, sending notifications when deviations are detected, allowing you to take corrective actions such as retraining the model."

(Source: Amazon SageMaker Developer Guide, Monitoring Models with SageMaker Model Monitor)

Detailed Explanation:

Option A: Retrain the model. Monitor model drift by using Amazon SageMaker Clarify.SageMaker Clarify is used for bias detection and explainability, not for monitoring model drift or inference quality in production. This option does not fully meet the requirements.

Option B: Retrain the model. Monitor model drift by using Amazon SageMaker Model Monitor.This is the correct answer. Retraining addresses the current degradation, and SageMaker Model Monitor can detect future drift in inference quality, sending notifications to prevent recurrence, as required.

Option C: Build a new model. Monitor model drift by using Amazon SageMaker Feature Store.SageMaker Feature Store is for managing and sharing features, not for monitoring model drift or inference quality. Building a new model may not be necessary if retraining can address the issue.

Option D: Build a new model. Monitor model drift by using Amazon SageMaker JumpStart.SageMaker JumpStart provides pre-trained models and solutions for quick deployment, but it does not offer specific tools for monitoring model drift or inference quality in production.

Amazon Bedrock Guardrails allow developers to create safeguards that filter harmful content and prevent sensitive topics from being discussed. This functionality helps mitigate prompt injection attacks with minimal implementation effort. According to the official Amazon Bedrock documentation:

“You can configure Guardrails for Amazon Bedrock to define denied topics, use content filters, and apply sensitive information filters, offering protection against prompt injection attacks with minimal development effort.”