Weekend Sale 70% Discount Offer - Ends in 0d 00h 00m 00s - Coupon code: save70

Free and Premium Isaca AAIA Dumps Questions Answers

Page: 1 / 7
Total 90 questions

ISACA Advanced in AI Audit (AAIA) Questions and Answers

Question 1

When auditing the transparency of an AI system, which of the following would be the MOST effective way to understand the model's decision-making process?

Options:

A.

Evaluating the diversity of the training data set

B.

Analyzing the complexity of the algorithms used

C.

Assessing the computational cost of the model

D.

Reviewing the explainability of AI outputs

Buy Now
Question 2

An organization is using information gathered from customer accounts to train its AI chatbot. Which of the following is the GREATEST risk associated with this practice?

Options:

A.

Disclosure of personal information

B.

AI bias

C.

Transparency

D.

AI model hallucinations

Question 3

An IS auditor uses an internally developed generative AI tool to prepare a status update for audit stakeholders. Which of the following is the auditor’s MOST appropriate course of action?

Options:

A.

Compare results with a publicly available generative AI tool to ensure outputs are similar.

B.

Assess whether the information provided is complete and accurate.

C.

Regenerate the results to ensure similar outputs are provided.

D.

Share and review the results with management.

Question 4

Which of the following is the GREATEST risk associated with using AI in audit planning?

Options:

A.

Increased planning costs

B.

Scope creep

C.

Incomplete data

D.

Limited knowledge

Question 5

Which of the following is MOST important to have in place when initially populating data into a data frame for an AI model?

Options:

A.

The box charts, histograms, scatterplots, and Venn diagrams that identify correlations and outliers

B.

The code for separating data into training and testing data sets

C.

An analysis of exploratory data that checks for incorrect data types, null values, and duplicate entries

D.

An approved risk assessment for including, excluding, or subsequently dropping data attributes from the model

Question 6

The BEST way to prevent sensitive information disclosure by large language model (LLM) chatbots is through:

Options:

A.

Manual monitoring

B.

Access controls

C.

Data sanitization

D.

Data masking

Question 7

An organization uses an AI image generation platform to create promotional materials. An IS auditor identifies that the platform includes copyrighted images in its training data. Which of the following is the auditor's BEST recommendation to address this issue?

Options:

A.

Implement a manual review process to ensure no copyrighted images are used in generated outputs.

B.

Use a platform that certifies the provenance and licensing of its training data.

C.

Label all AI-generated images to disclaim the possibility of third-party content.

D.

Suspend the use of the platform until the training data is sanitized.

Question 8

A generative AI system has a validation control in place to reject inappropriate questions by checking them against built-in ethical standards. Which of the following enables malicious actors to circumvent this control through prompt engineering?

Options:

A.

Submitting the same questions in a foreign language translated by another AI-based system

B.

Presenting theoretical situations to justify the reason for asking the questions

C.

Asking the same questions later when the algorithm has changed after further learning

D.

Randomly placing keywords unrelated to the main topic

Question 9

An organization is evaluating change management practices for AI-based decision support models. Which of the following BEST demonstrates effective AI-focused change management?

Options:

A.

Engaging an independent expert to review the model's accuracy and precision on a quarterly basis

B.

Assigning a single data science team member to adjust the model in order to establish accountability

C.

Documenting model updates and retraining sessions to ensure traceability

D.

Deploying two separate copies of the model after each adjustment to compare results

Question 10

When auditing a machine learning (ML) solution, false positives can BEST be assessed by examining the level of:

Options:

A.

Precision

B.

Completeness

C.

Accuracy

D.

Recall

Question 11

Which of the following will provide the BEST evidence to support the alignment of an AI model with an organization's business objectives?

Options:

A.

AI model vulnerability assessment

B.

AI change management requests

C.

AI model inventory

D.

AI acceptable use policy

Question 12

Which of the following key performance indicators (KPIs) are MOST important when evaluating whether an AI model meets business objectives?

Options:

A.

Cost of resources required for AI model training

B.

Number of users interacting with the AI model

C.

Frequency of AI model retraining

D.

AI model accuracy in predicting actual outcomes

Question 13

Which of the following is MOST important to consider when deciding whether to implement an AI solution?

Options:

A.

The cost of AI implementation

B.

The speed of AI implementation

C.

The space required for AI hardware

D.

The ethical implications of AI

Question 14

When using off-the-shelf AI models, which of the following is the MOST appropriate way for organizations to approach vendor management?

Options:

A.

Ensure a minimum of three quotes have been obtained for market research and comparison.

B.

Establish responsibility and clear terms for model updates and support.

C.

Only use models from vendors with globally recognized accreditation.

D.

Use the vendor only if the contract has been reviewed by the information security department.

Question 15

An organization is adopting AI for its procurement and inventory teams, raising concern from stakeholders that they will lose their jobs due to AI. Which of the following is the BEST way for the IS auditor to assess whether the potential negative impacts were minimized?

Options:

A.

Review human-centered design practices to determine how they were considered.

B.

Review the AI roadmap for short-term and long-term milestones.

C.

Review how the project management team collected feedback in engagement activities.

D.

Review the current state assessment of how AI may impact the organization.

Question 16

During a pre-implementation risk assessment, an AI model is determined to present a significant risk of bias and potential harm in excess of the organization’s risk tolerance. Which of the following is the MOST appropriate response?

Options:

A.

Postpone deployment until the risk can be safely managed.

B.

Enhance the data that the model is trained on.

C.

Obtain board approval for an exception.

D.

Revisit the risk tolerance to ensure it is appropriate.

Question 17

An IS auditor notes that an AI model achieved significantly better results on training data than on test data. Which of the following problems with the model has the IS auditor identified?

Options:

A.

Underfitting

B.

Overfitting

C.

Generalization

D.

Bias

Question 18

Which of the following is the MOST important consideration when auditing the data used for training an AI model?

Options:

A.

Timeliness

B.

Predictability

C.

Representativeness

D.

Understandability

Question 19

Which of the following AI system characteristics would BEST help an IS auditor evaluate the system's algorithm?

Options:

A.

The AI system algorithm uses training data to inform decision output.

B.

The AI system provides multiple options for model training.

C.

The AI system provides transparent justification of decisions.

D.

The AI system uses archived transaction data to provide decisions.

Question 20

Which of the following is an IS auditor's MOST important course of action when determining whether source data should be entered into approved generative AI tools to assist with an audit?

Options:

A.

Validate that the tool is leveraging the latest model.

B.

Validate that the tool provides a privacy notice.

C.

Determine whether any AI model hallucinations have occurred.

D.

Determine whether the information is reliable.

Question 21

Which of the following is the MOST important course of action for an organization prior to allowing end users to utilize an AI tool?

Options:

A.

Develop an AI policy with guidelines on appropriate use.

B.

Determine the impact to the disaster recovery plan (DRP).

C.

Implement baseline performance metrics.

D.

Ensure a cybersecurity insurance clause is in place to include the use of AI.

Question 22

Which of the following is the PRIMARY purpose of an AI acceptable use policy?

Options:

A.

Establishing guidance on the ethical use of AI

B.

Outlining AI usage monitoring procedures

C.

Educating employees on where to find and how to use AI tools

D.

Explaining the distinction between different types of AI

Question 23

An organization shares an AI model with external partners. One partner reports that sensitive data has been inadvertently exposed through the model’s outputs. Which of the following is the IS auditor's BEST recommendation?

Options:

A.

Limit the model's outputs to anonymized results while investigating further.

B.

Audit the data pipelines of all partners to identify the source of the leak.

C.

Disable the shared model and notify partners of the potential breach.

D.

Retrain the model immediately and implement privacy-preserving techniques.

Question 24

The GREATEST benefit of using AI auditing techniques over traditional methods is that AI auditing techniques can:

Options:

A.

eliminate the need for human intervention.

B.

ensure full compliance with regulations.

C.

identify complex data patterns.

D.

significantly reduce data bias.

Question 25

From a data appropriateness and bias perspective, which of the following should be of GREATEST concern when reviewing an AI model used in a credit scoring system?

Options:

A.

The model incorporates the applicant's loan history to assess spending habits.

B.

The model utilizes historical credit data to predict future credit behavior.

C.

The model considers the applicant's income level as a key factor in the credit decision.

D.

The model uses postal codes as a primary factor in determining creditworthiness.

Question 26

The PRIMARY objective of auditing AI systems is to:

Options:

A.

Identify biases and decision transparency.

B.

Maximize system efficiency and throughput.

C.

Optimize user experience and interface satisfaction.

D.

Minimize algorithm latency and information storage impacts.

Question 27

The PRIMARY objective of machine learning (ML) in data processing is to:

Options:

A.

Analyze data sets to identify visual patterns and trends.

B.

Enhance the explainability of AI model outputs.

C.

Perform actions that would typically require human intelligence.

D.

Draw statistical inferences for creating artificial human intelligence.

Page: 1 / 7
Total 90 questions