Databricks-Generative-AI-Engineer-Associate Exam Dumps : Databricks Certified Generative AI Engineer Associate

Problem Context : The Generative AI Engineer needs a prompt that will enable an LLM trained on customer call transcripts to classify and respond correctly regarding product availability. The desired response should clearly indicate whether a product is " In Stock " or " Out of Stock, " and it should be formatted in a way that is structured and easy to parse programmatically, such as JSON.

Explanation of Options :

Option A : Respond with “In Stock” if the customer asks for a product. This prompt is too generic and does not specify how to handle the case when a product is not available, nor does it provide a structured output format.

Option B : This option is correctly formatted and explicit. It instructs the LLM to respond based on the availability mentioned in the customer call transcript and to format the response in JSON. This structure allows for easy integration into systems that may need to process this information automatically, such as customer service dashboards or databases.

Option C : Respond with “Out of Stock” if the customer asks for a product. Like option A, this prompt is also insufficient as it only covers the scenario where a product is unavailable and does not provide a structured output.

Option D : While this prompt correctly specifies how to respond based on product availability, it lacks the structured output format, making it less suitable for systems that require formatted data for further processing.

Given the requirements for clear, programmatically usable outputs, Option B is the optimal choice because it provides precise instructions on how to respond and includes a JSON format example for structuring the output, which is ideal for automated systems or further data handling.

In this case, the Generative AI Engineer is developing an application to generate personalized birthday poems, but there’s a need to safeguard against malicious user inputs . The best solution is to implement a safety filter (option A) to detect harmful or inappropriate inputs.

Safety Filter Implementation : Safety filters are essential for screening user input and preventing inappropriate content from being processed by the LLM. These filters can scan inputs for harmful language, offensive terms, or malicious content and intervene before the prompt is passed to the LLM.

Graceful Handling of Harmful Inputs : Once the safety filter detects harmful content, the system can provide a message to the user, such as " I ' m unable to assist with this request, " instead of processing or responding to malicious input. This protects the system from generating harmful content and ensures a controlled interaction environment.

Why Other Options Are Less Suitable :

B (Reduce Interaction Time) : Reducing the interaction time won’t prevent malicious inputs from being entered.

C (Continue the Conversation) : While it’s possible to acknowledge malicious input, it is not safe to continue the conversation with harmful content. This could lead to legal or reputational risks.

D (Increase Compute Power) : Adding more compute doesn’t address the issue of harmful content and would only speed up processing without resolving safety concerns.

Therefore, implementing a safety filter that blocks harmful inputs is the most effective technique for safeguarding the application.

In the Agent Evaluation terminology used by this question, correctness compares the generated response with the expected answer, while context_sufficiency determines whether the retrieved context contains enough information to produce that expected answer. Both therefore depend on ground-truth information supplied through expected_response. Groundedness instead examines whether the response is supported by the retrieved context; it does not inherently need a reference answer. Chunk relevance and relevance to the query assess alignment with the user’s request, while guideline adherence evaluates compliance with specified instructions. Databricks explicitly distinguishes the ground-truth-dependent judges in its migration documentation. In MLflow 3, names and schemas have evolved, including expectations.expected_response and explicitly selected scorers, so the question should be interpreted using its stated legacy judge terminology. Databricks documentation