Exactprep AIF-C01 Questions

Amazon SageMaker Ground Truth lets you create data labeling jobs and can integrate with Amazon Mechanical Turk (a distributed human workforce) to label large unlabeled datasets.

A (batch inference) applies models to already-trained data, not labeling.

B (PyTorch Distributed) is for distributed training, not labeling.

D (OCR) applies only to text extraction from images, not transactions.

E is incorrect; Ground Truth is the service for labeling, not " AI labeling job. "

???? Reference:

AWS Documentation – SageMaker Ground Truth

The company is building a chatbot using an LLM to answer questions about HR policies, with access to a large digital documentation base. Retrieval Augmented Generation (RAG) optimizes the LLM’s responses by retrieving relevant information from the documentation base and using it to generate accurate, contextually grounded answers, reducing hallucinations and improving response quality.

Exact Extract from AWS AI Documents:

From the AWS Bedrock User Guide:

" Retrieval Augmented Generation (RAG) enhances the performance of large language models by retrieving relevant information from external knowledge bases, such as documentation or databases, and incorporating it into the generation process. This technique ensures responses are accurate and grounded in the provided data, making it ideal for applications like policy chatbots. "

(Source: AWS Bedrock User Guide, Retrieval Augmented Generation)

Detailed Explanation:

Option A: Use Retrieval Augmented Generation (RAG).This is the correct answer. RAG leverages the documentation base to provide the LLM with relevant HR policy information, optimizing the chatbot’s responses for accuracy and relevance.

Option B: Use few-shot prompting.Few-shot prompting provides a few examples in the prompt to guide the LLM, but it is less effective than RAG for large documentation bases, as it cannot dynamically retrieve specific policy details.

Option C: Set the temperature to 1.Setting the temperature to 1 controls the randomness of the LLM’s output but does not optimize responses using external documentation. This option is unrelated to the documentation base.

Option D: Decrease the token size.Decreasing token size (likely referring to limiting input/output tokens) may reduce response length but does not optimize the quality of responses using the documentation base.

Comprehensive and Detailed Explanation (AWS AI documents):

Overfitting occurs when an ML model learns patterns too closely from training data, including noise, and fails to generalize to unseen data. According to AWS ML fundamentals, a key indicator of overfitting is high training accuracy combined with reduced accuracy on new or test data.

Option A directly reflects this behavior: the model performs well during training but loses accuracy when evaluated on new data, which is a textbook symptom of overfitting.

Why the other options are not overfitting:

B describes an under-featured model (underfitting risk).

C indicates poor data representativeness, not overfitting.

D reflects limited feature selection, which may lead to underfitting or bias, not overfitting.

AWS AI Study Guide References:

AWS Machine Learning concepts: bias vs. variance

AWS training and evaluation best practices

The correct answer is A because Human-in-the-loop (HITL) is a post-processing strategy used to monitor, review, and filter outputs from generative AI models for toxicity, bias, or inappropriate content. It allows human reviewers to approve or reject model responses before they are delivered to end-users, ensuring alignment with ethical guidelines and company policies.

From the AWS documentation:

" Human-in-the-loop (HITL) workflows in generative AI are used to validate and approve outputs of models, especially in applications where content quality, compliance, or harm reduction is critical. HITL is a key step in responsible AI implementations to mitigate hallucinations, bias, and unsafe content. "

Explanation of other options:

B. Data augmentation is a pre-processing technique to increase data diversity, not typically used in post-processing stages.

C. Feature engineering is relevant in traditional ML, especially structured data tasks, not typically used in generative AI post-processing.

D. Adversarial training is a model training strategy, not a post-processing mitigation approach.

Referenced AWS AI/ML Documents and Study Guides:

AWS Responsible AI Practices Whitepaper

AWS Generative AI Developer Guide – Human-in-the-loop and Post-processing

Amazon A2I Documentation – Integrating Human Review in ML Workflows