Amazon Web Services AWS Certified AI Practitioner AIF-C01 New Questions

Creating an Amazon Bedrock knowledge base allows the integration of external or private data sources with a foundation model (FM) like Amazon Titan. This integration helps supplement the model with relevant data from the company's private data sources to enhance its responses.

Option C (Correct): "Create an Amazon Bedrock knowledge base": This is the correct answer as it enables the company to incorporate private data into the FM to improve its effectiveness.

Option A: "Use a different FM" is incorrect because it does not address the need to supplement the current model with private data.

Option B: "Choose a lower temperature value" is incorrect as it affects output randomness, not the integration of private data.

Option D: "Enable model invocation logging" is incorrect because logging does not help in supplementing the model with additional data.

AWS AI Practitioner References:

Amazon Bedrock and Knowledge Integration: AWS explains how creating a knowledge base allows Amazon Bedrock to use external data sources to improve the FM’s relevance and accuracy.

The correct answer is B because Amazon SageMaker JumpStart provides pre-built solutions, including training workflows for popular open-source LLMs such as Falcon, LLaMA, and others. It allows practitioners to quickly launch fine-tuning jobs using predefined templates, minimizing operational setup and code complexity.

From AWS documentation:

"Amazon SageMaker JumpStart enables you to fine-tune and deploy foundation models with minimal setup. It provides easy-to-use interfaces and pre-built configurations for training, which significantly reduces the operational overhead required to train models."

Explanation of other options:

A. PartyRock is designed for prototyping generative AI apps but does not support model training or fine-tuning.

C. Writing a custom script for SageMaker training is flexible but involves more operational effort, including handling infrastructure configuration.

D. Training on EC2 via a Jupyter notebook is fully manual and operationally intensive, including dependency setup, data handling, and resource scaling.

Referenced AWS AI/ML Documents and Study Guides:

Amazon SageMaker JumpStart Developer Guide – Fine-tuning Foundation Models

AWS Certified Machine Learning Specialty Guide – Model Customization and JumpStart

The company is developing an ML model to predict customer churn, a binary classification task (churn or no churn). The F1 score is an evaluation metric that balances precision and recall, making it suitable for assessing the performance of binary classification models, especially when dealing with imbalanced datasets, which is common in churn prediction.

Exact Extract from AWS AI Documents:

From the Amazon SageMaker Developer Guide:

"The F1 score is a metric for evaluating binary classification models, combining precision and recall into a single value. It is particularly useful for tasks like churn prediction, where class imbalance may exist, ensuring the model performs well on both positive and negative classes."

(Source: Amazon SageMaker Developer Guide, Model Evaluation Metrics)

Detailed Explanation:

Option A: F1 scoreThis is the correct answer. The F1 score is ideal for binary classification tasks like churn prediction, as it measures the model’s ability to correctly identify both churners and non-churners.

Option B: Mean squared error (MSE)MSE is used for regression tasks to measure the average squared difference between predicted and actual values, not for binary classification.

Option C: R-squaredR-squared is a metric for regression models, indicating how well the model explains the variability of the target variable. It is not applicable to classification tasks.

Option D: Time used to train the modelTraining time is not an evaluation metric for model performance; it measures the duration of training, not the model’s accuracy or effectiveness.

Amazon SageMaker Model Cards provide a standardized way to document and track model information, including versions and performance. According to AWS documentation:

“SageMaker Model Cards provide a single source of truth for model information including intended use, training details, evaluation metrics, and ethical considerations to support governance and collaboration.”