AIF-C01 Amazon Web Services Exam Lab Questions

Amazon SageMaker Model Monitor is specifically designed to automatically detect and alert on changes in model quality, such as data drift, prediction drift, or other anomalies in model performance once deployed.

D is correct:

"Amazon SageMaker Model Monitor continuously monitors the quality of machine learning models in production. It automatically detects concept drift, data drift, and other quality issues, enabling teams to take corrective actions."

(Reference: Amazon SageMaker Model Monitor Documentation, AWS Certified AI Practitioner Study Guide)

A (JumpStart) provides prebuilt solutions and models, not monitoring.

B (HyperPod) is for large-scale training, not model monitoring.

C (Data Wrangler) is for data preparation, not ongoing model quality monitoring.

The correct answer is D – F1 score, which is the harmonic mean of precision and recall. AWS documentation states that the F1 score is the preferred metric when evaluating ML models trained on imbalanced datasets, where one class appears significantly more often than others. Accuracy becomes misleading in these situations because a model can achieve high accuracy simply by predicting the majority class. Precision alone measures correctness of positive predictions, while recall measures completeness—neither fully captures class balancing performance. The F1 score provides a combined measurement that reflects how well the model identifies minority classes while avoiding excessive false positives. AWS’s ML Specialty Guide recommends using F1 for classification tasks where “class distribution is uneven or where both false negatives and false positives matter.” This metric provides a fairer assessment of overall model performance across all class categories.

Referenced AWS Documentation:

AWS Certified Machine Learning Specialty Guide – Metrics for Imbalanced Classes

Amazon SageMaker Developer Guide – Evaluating Classification Models

Model fine-tuning adapts a pre-trained model to a specific domain or task using labeled data. This is the preferred approach when you want highly customized behavior for a particular application or subject area.

(Reference: Amazon Bedrock Fine-Tuning)

Data augmentation is used to artificially increase the size of a labeled dataset, usually by transforming or generating variations of the original data. This helps improve model generalization when labeled data is limited.

(Reference: AWS Data Preparation Techniques, AWS AI Practitioner Guide)

Continued pre-training (also called domain-adaptive pre-training) further trains a foundation model on large amounts of unlabeled data from a specific domain, improving the model’s language understanding or generation for that domain.

(Reference: Amazon Bedrock Customization Options)

Providing examples of text passages with corresponding positive or negative labels in the prompt followed by the new text passage to be classified is the correct prompt engineering strategy for using a large language model (LLM) on Amazon Bedrock for sentiment analysis.

Example-Driven Prompts:

This strategy, known as few-shot learning, involves giving the model examples of input-output pairs (e.g., text passages with their sentiment labels) to help it understand the task context.

It allows the model to learn from these examples and apply the learned pattern to classify new text passages correctly.

Why Option A is Correct:

Guides the Model: Providing labeled examples teaches the model how to perform sentiment analysis effectively, increasing accuracy.

Contextual Relevance: Aligns the model's responses to the specific task of classifying sentiment.

Why Other Options are Incorrect:

B. Detailed explanation of sentiment analysis: Unnecessary for the model's operation; it requires examples, not explanations.

C. New text passage without context: Provides no guidance or learning context for the model.

D. Unrelated task examples: Would confuse the model and lead to inaccurate results.