AWS Certified AI Practitioner AIF-C01 Full Course Free

The company wants to enhance the response quality of an LLM for complex problem-solving tasks requiring detailed reasoning and step-by-step explanations. Chain-of-thought prompting encourages the LLM to break down the problem into intermediate steps, providing a clear reasoning process before arriving at the final answer, which is ideal for this requirement.

Exact Extract from AWS AI Documents:

From the AWS Bedrock User Guide:

" Chain-of-thought prompting improves the reasoning capabilities of large language models by encouraging them to break down complex tasks into intermediate steps, providing a step-by-step explanation that leads to the final answer. This technique is particularly effective for problem-solving tasks requiring detailed reasoning. "

(Source: AWS Bedrock User Guide, Prompt Engineering Techniques)

Detailed Explanation:

Option A: Few-shot promptingFew-shot prompting provides a few examples to guide the LLM but does not explicitly encourage step-by-step reasoning or detailed explanations.

Option B: Zero-shot promptingZero-shot prompting relies on the LLM’s pre-trained knowledge without examples, making it less effective for complex tasks requiring detailed reasoning.

Option C: Directional stimulus promptingDirectional stimulus prompting is not a standard technique in AWS documentation, likely a distractor, and does not address step-by-step reasoning.

Option D: Chain-of-thought promptingThis is the correct answer. Chain-of-thought prompting enhances response quality for complex tasks by guiding the LLM to reason step-by-step, providing detailed explanations.

Comprehensive and Detailed Explanation From Exact AWS AI documents:

In Amazon Bedrock evaluations, Completeness measures how thoroughly a model or agent response addresses all aspects of the user prompt.

AWS evaluation guidance for LLM-as-a-judge explains that:

Completeness focuses on coverage of prompt requirements

It is especially useful for evaluating multi-part questions

It is a built-in qualitative metric in agent evaluation workflows

Why the other options are incorrect:

ROUGE (A) measures text overlap, mainly for summarization.

Following instructions (C) evaluates adherence, not coverage.

Refusal (D) measures appropriate refusal behavior.

AWS AI document references:

Amazon Bedrock Model Evaluation

LLM-as-a-Judge Metrics

Evaluating Agent Responses on AWS

Amazon Bedrock Agents provide the capability to automate repetitive tasks and orchestrate complex workflows using generative AI models. This is particularly beneficial for customer support inquiries, where quick and efficient processing is crucial.

Option B (Correct): " Automation of repetitive tasks and orchestration of complex workflows " : This is the correct answer because Bedrock Agents can automate common customer service tasks and streamline complex processes, improving response times and efficiency.

Option A: " Generation of custom foundation models (FMs) to predict customer needs " is incorrect as Bedrock agents do not create custom models.

Option C: " Automatically calling multiple foundation models (FMs) and consolidating the results " is incorrect because Bedrock agents focus on task automation rather than combining model outputs.

Option D: " Selecting the foundation model (FM) based on predefined criteria and metrics " is incorrect as Bedrock agents are not designed for selecting models.

AWS AI Practitioner References:

Amazon Bedrock Documentation: AWS explains that Bedrock Agents automate tasks and manage complex workflows, making them ideal for customer support automation.

The verified answer is B. Pre-training. The scenario describes the first major training stage for a large language model, where the model starts with randomly initialized weights and learns broad language patterns from a very large corpus of unlabeled or self-supervised text data. AWS describes large language models as very large deep learning models that are pre-trained on vast amounts of data. In this stage, the model is not yet being customized for a narrow business task; instead, it learns general-purpose linguistic and semantic representations from large-scale text.

AWS machine learning guidance explains that pre-training teaches the model broad linguistic and semantic patterns, including grammar, context, world knowledge, reasoning, and token prediction, using self-supervised learning approaches such as masked language modeling or causal language modeling. That exactly matches the question’s description: random weight initialization followed by fitting the model to a large web dataset using a language-modeling objective. This is the core training process used to create a foundation model or LLM before later adaptation.

Option A. Fine-tuning is incorrect because AWS defines fine-tuning as training a pretrained model on a new dataset rather than training from scratch. Fine-tuning adapts an existing model for a specific task or domain and usually requires less data and less training time than pre-training.

Option C. Model selection is incorrect because model selection refers to choosing an appropriate model or architecture, not training the model weights from random initialization. Option D. Deployment is also incorrect because AWS describes deployment as the stage where a trained model is made available for inference or predictions, such as through SageMaker inference endpoints.

Therefore, because the company is training an LLM from initial weights on a large web corpus using a language-modeling objective, the stage is pre-training.