Exactprep AIF-C01 Questions

Comprehensive and Detailed Explanation (AWS AI documents):

Overfitting occurs when an ML model learns patterns too closely from training data, including noise, and fails to generalize to unseen data. According to AWS ML fundamentals, a key indicator of overfitting is high training accuracy combined with reduced accuracy on new or test data.

Option A directly reflects this behavior: the model performs well during training but loses accuracy when evaluated on new data, which is a textbook symptom of overfitting.

Why the other options are not overfitting:

B describes an under-featured model (underfitting risk).

C indicates poor data representativeness, not overfitting.

D reflects limited feature selection, which may lead to underfitting or bias, not overfitting.

AWS AI Study Guide References:

AWS Machine Learning concepts: bias vs. variance

AWS training and evaluation best practices

The correct answer is C because Amazon Bedrock Guardrails provides out-of-the-box configurable safety mechanisms to control the behavior of LLMs in generative AI applications. Guardrails can be configured with denylists, content filters, sensitive topics, and tone enforcement, all without retraining the model.

From AWS documentation:

" Amazon Bedrock Guardrails allows developers to define safety and responsible AI policies directly in the model inference layer, making it easy to prevent harmful, biased, or unsafe outputs with minimal configuration. "

Explanation of other options:

A. Bedrock playgrounds are interactive environments for testing prompts and models but do not provide production-grade safety enforcement.

B. SageMaker Clarify focuses on bias detection and explainability for supervised ML models — it does not directly apply guardrails to LLM outputs.

D. SageMaker JumpStart is for model fine-tuning and deployment, not for enforcing safety policies on LLM responses.

Referenced AWS AI/ML Documents and Study Guides:

Amazon Bedrock Documentation – Guardrails Overview

AWS Responsible AI Whitepaper

AWS Certified ML Specialty Study Guide – Safety in Generative AI

BLEU (Bilingual Evaluation Understudy) is a metric used to evaluate the accuracy of machine-generated translations by comparing them against reference translations. It is commonly used for translation tasks to measure how close the generated output is to professional human translations.

Option A (Correct): " Bilingual Evaluation Understudy (BLEU) " : This is the correct answer because BLEU is specifically designed to evaluate the quality of translations, making it suitable for the company ' s use case.

Option B: " Root mean squared error (RMSE) " is incorrect because RMSE is used for regression tasks to measure prediction errors, not translation quality.

Option C: " Recall-Oriented Understudy for Gisting Evaluation (ROUGE) " is incorrect as it is used to evaluate text summarization, not translation.

Option D: " F1 score " is incorrect because it is typically used for classification tasks, not for evaluating translation accuracy.

AWS AI Practitioner References:

Model Evaluation Metrics on AWS: AWS supports various metrics like BLEU for specific use cases, such as evaluating machine translation models.

Clustering is an unsupervised machine learning technique used to group data points based on similarity without requiring labeled data. AWS documentation explains that clustering is commonly used for customer segmentation, where the goal is to discover natural groupings within a dataset.

In this scenario, the dataset is unlabeled and includes behavioral and demographic features. Clustering algorithms analyze patterns and distances between data points to identify distinct customer groups, making this technique ideal for understanding customer segments.

Regression and classification require labeled outputs, and reinforcement learning focuses on sequential decision-making, not grouping. AWS positions clustering as the correct approach for this use case.