Power Up Your Study Prep: Black Friday 75% Discount! Use coupon code below to save! - Ends in 0d 00h 00m 00s - Coupon code: big75certs

Generative AI Engineer Databricks-Generative-AI-Engineer-Associate Databricks Study Notes

Databricks Certified Generative AI Engineer Associate Questions and Answers

Question 25

A Generative AI Engineer has deployed a customer-support agent in production that retrieves product documentation and generates responses. SMEs have been reviewing agent responses and providing feedback through a web interface that captures ratings of 1–5 stars and written comments. The engineer needs to systematically collect this feedback and use it to create an evaluation dataset that can be used to compare future agent versions against the current baseline performance.

Which approach should the engineer use to accomplish this task?

Options:

A.

Export only the written SME comments to a text file and manually score them using a custom script, then use the script’s output as the evaluation dataset for future agent comparisons.

B.

Log the SME ratings and comments directly to a Delta table with the corresponding user queries and agent responses, then use MLflow to create an evaluation dataset from this table and register it for future agent evaluations.

C.

Use Unity Catalog to create a view that filters only 5-star-rated interactions, then register this view as the evaluation dataset to benchmark all future agent versions.

D.

Use the customer review app to collect SME feedback, then directly deploy the highest-rated responses as the new agent baseline without storing them as a formal evaluation dataset.

Question 26

A Generative AI Engineer is developing a patient-facing healthcare-focused chatbot. If the patient’s question is not a medical emergency, the chatbot should solicit more information from the patient to pass to the doctor’s office and suggest a few relevant pre-approved medical articles for reading. If the patient’s question is urgent, direct the patient to calling their local emergency services.

Given the following user input:

“I have been experiencing severe headaches and dizziness for the past two days.”

Which response is most appropriate for the chatbot to generate?

Options:

A.

Here are a few relevant articles for your browsing. Let me know if you have questions after reading them.

B.

Please call your local emergency services.

C.

Headaches can be tough. Hope you feel better soon!

D.

Please provide your age, recent activities, and any other symptoms you have noticed along with your headaches and dizziness.

Question 27

A Generative AI Engineer is developing an LLM application that users can use to generate personalized birthday poems based on their names.

Which technique would be most effective in safeguarding the application, given the potential for malicious user inputs?

Options:

A.

Implement a safety filter that detects any harmful inputs and ask the LLM to respond that it is unable to assist

B.

Reduce the time that the users can interact with the LLM

C.

Ask the LLM to remind the user that the input is malicious but continue the conversation with the user

D.

Increase the amount of compute that powers the LLM to process input faster