Amazon Web Services AIF-C01 Online Access

The verified answer is D. Amazon SageMaker Model Monitor. AWS documentation states that Amazon SageMaker Model Monitor monitors the quality of SageMaker AI machine learning models in production. It can set alerts when there are deviations in model quality, enabling early and proactive corrective actions such as retraining models, auditing upstream systems, or fixing quality issues without manually building additional monitoring tooling.

The requirement is to identify changes in original model quality. SageMaker Model Monitor addresses this by creating baselines from training data, computing metrics and constraints, and comparing live or batch inference data against those constraints. AWS documentation states that Model Monitor supports monitoring of data quality, model quality, bias drift, and feature attribution drift. For model quality specifically, it monitors drift in model quality metrics such as accuracy.

Amazon SageMaker JumpStart is incorrect because JumpStart provides prebuilt models, foundation models, notebooks, and solution templates to accelerate ML development. It does not primarily monitor deployed model quality.

Amazon SageMaker HyperPod is incorrect because HyperPod is used for large-scale distributed training infrastructure, especially for foundation models and large ML workloads. It does not identify changes in production model quality.

Amazon SageMaker Data Wrangler is incorrect because Data Wrangler is used for data preparation, transformation, and feature engineering. It helps prepare data before training, but it does not monitor deployed models for quality drift.

Because the company needs to detect changes in model quality after deployment and resolve issues, SageMaker Model Monitor is the correct feature.

Using Amazon Bedrock with large language models (LLMs) allows for efficient utilization of AI to answer queries based on context provided in product manuals. To achieve this cost-effectively, the company should avoid unnecessary use of resources.

Option A (Correct): " Use prompt engineering to add one PDF file as context to the user prompt when the prompt is submitted to Amazon Bedrock " : This is the most cost-effective solution. By using prompt engineering, only the relevant content from one PDF file is added as context to each query. This approach minimizes the amount of data processed, which helps in reducing costs associated with LLMs ' computational requirements.

Option B: " Use prompt engineering to add all the PDF files as context to the user prompt when the prompt is submitted to Amazon Bedrock " is incorrect. Including all PDF files would increase costs significantly due to the large context size processed by the model.

Option C: " Use all the PDF documents to fine-tune a model with Amazon Bedrock " is incorrect. Fine-tuning a model is more expensive than using prompt engineering, especially if done for multiple documents.

Option D: " Upload PDF documents to an Amazon Bedrock knowledge base " is incorrect because Amazon Bedrock does not have a built-in knowledge base feature for directly managing and querying PDF documents.

AWS AI Practitioner References:

Prompt Engineering for Cost-Effective AI: AWS emphasizes the importance of using prompt engineering to minimize costs when interacting with LLMs. By carefully selecting relevant context, users can reduce the amount of data processed and save on expenses.

Providing labeled data with both a prompt field and a completion field is the correct strategy for fine-tuning a foundation model (FM) on Amazon Bedrock.

Fine-Tuning Strategy:

To fine-tune a model, labeled data that pairs input prompts with the correct outputs (completions) is necessary.

This allows the model to learn the desired behavior or response style based on the provided examples.

Why Option A is Correct:

Proper Training Format: The prompt-completion pairs provide the necessary format for training the model to produce accurate outputs.

Customization: Ensures that the model is fine-tuned to the specific requirements of the company’s data and desired outputs.

Why Other Options are Incorrect:

B. Prepare a .txt file in .csv format: This does not align with the specific need for labeled data with prompts and completions.

C. Purchase Provisioned Throughput: Relates to read/write capacity in databases, not to model fine-tuning.

D. Train on journals and textbooks: Lacks the specific format and labeling required for fine-tuning.

Comprehensive and Detailed Explanation From Exact AWS AI documents:

Amazon Bedrock is the managed AWS service designed specifically to develop, customize, and deploy foundation models with minimal effort.

Amazon Bedrock:

Provides direct access to multiple foundation models

Eliminates infrastructure management

Supports customization, evaluation, and deployment

Why the other options are incorrect:

SageMaker AI (B) requires more setup and ML expertise.

PartyRock (C) is for experimentation, not deployment.

Amazon Q Developer (D) is a productivity assistant.

AWS AI document references:

Amazon Bedrock Overview

Foundation Model Deployment on AWS

Reducing Development Effort with Managed AI Services