Free and Premium ISTQB CT-AI Dumps Questions Answers

The syllabus explains that supervised learning requires correctly labeled data so the algorithm can learn the relationship between input features and output labels:

"In supervised learning, the algorithm creates the ML model from labeled data during the training phase. The labeled data is used to infer the relationship between the input data and output labels."

(Reference: ISTQB CT-AI Syllabus v1.0, Section 3.1.1)

The ISTQB CT-AI syllabus (Section4.3 – Test Environments for AI Systems) describes that, unlike conventional software testing, testing AI systems may requirespecialized toolsfor analyzing and explaining the decisions of ML models. This includes visualization tools, explainability frameworks, and diagnostic utilities to understand why the AI made a certain prediction. Since AI decisions may be non-transparent, the test environment must supportexplainability, making OptionBcorrect.

Option A is incorrect: the syllabus does not state that an autonomous AI system requires an autonomous test environment. Option C is incorrect because test environments mustnot learn; they must remain stable to avoid unpredictable testing conditions. Option D is incorrect because multi-agent systems often involve stochastic interactions, and determinism is neither required nor realistic.

Thus,Option Bis the syllabus-accurate choice.

The syllabus explicitly mentions challenges of handling personal data and ensuring privacy when testing AI-based systems:

"The management of personal data and sensitive data is often a concern during testing, as testing typically requires realistic data and it is difficult to fully anonymize data."

(Reference: ISTQB CT-AI Syllabus v1.0, Section 7.3, page 52 of 99)

TheAI Effectis clearly defined in theISTQB Certified Tester AI Testing Syllabus v1.0under Section1.1 – Definition of AI and AI Effect. The document explains that society’s understanding of what qualifies as “AI” changes over time. Technologies once considered AI—such as expert systems from the 1970s and 1980s or early chess-playing systems—are no longer viewed as AI today. This phenomenon is explicitly labeled the“AI Effect,”described as“the changing perception of what constitutes AI.”The syllabus states that as AI capabilities become routine or widely implemented, they often stop being perceived as true artificial intelligence .

Options B, C, and D do not capture this definition. While AI learning from data (B) is a property of ML, it does not describe the shifting perception of AI. Option C describes a technological achievement, not a perceptual shift. Option D references a historical AI milestone (Deep Blue defeating Kasparov) that the syllabus specifically uses as an example of technology that is no longer considered AI due to the AI Effect. Therefore, onlyOption Aaccurately reflects the AI Effect as defined by the ISTQB syllabus.

A. Regression

Regression is used to predict a continuous value and is not suitable for grouping people based on similar tastes.

B. Association

Association is used to find relationships between variables in large datasets, often in the form of rules (e.g., market basket analysis). It does not directly group individuals but identifies patterns of co-occurrence.

C. Clustering

Clustering is an unsupervised learning method used to group similar data points based on their features. It is ideal for identifying groups of people with similar tastes without prior knowledge of the group labels. This technique will help the company segment its customer base effectively.

D. Classification

Classification is a supervised learning method used to categorize data points into predefined classes. It requires labeled data for training, which is not the case here as we want to identify groups without predefined labels.

Therefore, the correct answer isCbecause clustering is the most suitable method for grouping people with similar tastes for targeted product marketing​​.

The syllabus describes exploratory testing as especially useful when there are poor specifications or test oracle problems:

“Exploratory testing is especially useful when there are poor specifications or test oracle problems, which is often the case for AI-based systems.”

(Reference: ISTQB CT-AI Syllabus v1.0, Section 9.6, page 70 of 99)

The syllabus states:

"Transparency: This is considered to be the ease with which the algorithm and training data used to generate the model can be determined."

Access to the training data is an example of transparency.

(Reference: ISTQB CT-AI Syllabus v1.0, Section 2.7, page 24 of 99)

Section5.3 – AI Support for Defect Predictionof the ISTQB CT-AI syllabus explains that AI-based defect prediction models rely onhistorical patterns, including past defects, code behavior, and similar system configurations. ML models trained on prior defect data can identifycomponents likely to contain defectswhen new changes resemble previous defect-inducing patterns. This directly supports OptionA, which states that defect prediction is most effective when based on previous similar constellations.

Option B is incorrect: ML can predictwhich componentsare likely to fail, not only whether defects exist. Option C is incomplete; code metrics help, but defect prediction relies onmanycontextual features (historical defects, code churn, commit frequency, etc.). Option D is wrong because defect prediction isnotbased on formal principles and typically requiresmany features, not just a few.

Thus,Option Ais the correct and syllabus-consistent answer.

The syllabus explains that ML models can be used to analyze reported defects and suggest which developers are best suited to fix them based on historical data about defect assignment and resolution speed:

"Assignment: ML models can suggest which developers are best suited to fix particular defects, based on the defect content and previous developer assignments."

(Reference: ISTQB CT-AI Syllabus v1.0, Section 11.2, page 78 of 99)

In the syllabus, theevolutioncharacteristic for AI-based systems means the ability of the system to evolve and adapt its behavior in response to changes in the environment or in its own performance:

"Evolution is the system’s ability to change itself to adapt to new situations, different hardware, or a changing operational environment."

(Reference: ISTQB CT-AI Syllabus v1.0, Section 2.3)

The syllabus defines data acquisition as consisting of three steps:

“Data acquisition: The activity of acquiring data relevant to the business problem to be solved by an ML model, typically involving the activities of identifying, gathering and labelling data.”

(Reference: ISTQB CT-AI Syllabus v1.0, Section 4.1, page 33 of 99)

A. The difficulty of defining criteria for improvement before the model can be accepted.

Defining criteria for improvement is a challenge in the acceptance of AI models, but it is not directly related to the performance drop in real-world scenarios. It relates more to the evaluation and deployment phase rather than affecting the model's real-time performance post-deployment.

B. The fast pace of change did not allow sufficient time for testing.

This can significantly affect the model's performance. If the system is self-learning, it needs to adapt quickly, and insufficient testing time can lead to incomplete learning and poor performance.

C. The unknown nature and insufficient specification of the operating environment might have caused the poor performance.

This is highly likely to affect performance. Self-learning AI systems require detailed specifications of the operating environment to adapt and learn effectively. If the environment is insufficiently specified, the model may fail to perform accurately in real-world scenarios.

D. There was an algorithmic bias in the AI system.

Algorithmic bias can significantly impact the performance of AI systems. If the model has biases, it will not perform well across different scenarios and data distributions.

Given the context of the self-learning nature and the need for real-time adaptability, optionAis least likely to describe the fall in performance because it deals with acceptance criteria rather than real-time performance issues​​.

The question refers to a problem where data used for an object detection ML system was labelled incorrectly. This issue is most closely related to "accuracy issues." Here's a detailed explanation:

Accuracy Issues: The primary goal of labeling data in machine learning is to ensure that the model can accurately learn and make predictions based on the given labels. Incorrectly labeled data directly impacts the model's accuracy, leading to poor performance because the model learns incorrect patterns.

Why Not Other Options:

Security Issues: This pertains to data breaches or unauthorized access, which is not relevant to the problem of incorrect data labeling.

Privacy Issues: This concerns the protection of personal data and is not related to the accuracy of data labeling.

Bias Issues: While bias in data can affect model performance, it specifically refers to systematic errors or prejudices in the data rather than outright incorrect labeling.

A. Identifying suitable tests by looking at the complexity of the test cases.

While complexity analysis can help in selecting important test cases, it does not directly address the issue of optimizing the entire regression suite effectively.

B. Using a random subset of tests.

Randomly selecting test cases may miss critical tests and does not ensure an optimized regression suite. This approach lacks a systematic method for ensuring comprehensive coverage.

C. Automating test scripts using AI-based test automation tools.

Automation helps in running tests efficiently but does not inherently optimize the selection of tests to prevent the suite from growing too large.

D. Using an AI-based tool to optimize the regression test suite by analyzing past test results.

This is the most effective approach as AI-based tools can analyze historical test data, identify patterns, and prioritize tests that are more likely to catch defects based on past results. This method ensures an optimized and manageable regression test suite by focusing on the most impactful test cases.

Therefore, the correct answer isDbecause using an AI-based tool to analyze past test results is the best option to optimize regression test selection and manage the size of the regression suite effectively​​.

The syllabus states:

“When testing probabilistic and non-deterministic systems, the same input may produce different outputs. Tests need to be run several times to produce statistically valid test results, ensuring that an appropriate number of answers are accurate.”

(Reference: ISTQB CT-AI Syllabus v1.0, Section 8.4, page 58 of 99)

AI test environments have several unique characteristics that differentiate them from traditional test environments. Let’s evaluate each option:

A. Challenges resulting from low accuracy of the models.

Low accuracy is a common challenge in AI systems, especially during initial development and training phases. Ensuring the model performs accurately in varied and unpredictable scenarios is a critical aspect of AI testing.

B. The challenge of mimicking undefined scenarios generated due to self-learning.

AI systems, particularly those that involve machine learning, can generate undefined or unexpected scenarios due to their self-learning capabilities. Mimicking and testing these scenarios is a unique challenge in AI environments.

C. The challenge of providing explainability to the decisions made by the system.

Explainability, or the ability to understand and articulate how an AI system arrives at its decisions, is a significant and unique challenge in AI testing. This is crucial for trust and transparency in AI systems.

D. Challenges in the creation of scenarios of human handover for autonomous systems.

While important, the creation of scenarios for human handover in autonomous systems is not a characteristic unique to AI test environments. It is more related to the operational and deployment challenges of autonomous systems rather than the intrinsic technology-related characteristics of AI.

Given the above points, optionDis the correct answer because it describes a challenge related to operational deployment rather than a technology-related characteristic unique to AI test environments.

The syllabus states:

“Supervised learning… divides problems into two categories: classification and regression. Regression is used when the problem requires the ML model to predict a numeric output, for example predicting the age of a person based on their habits.”

(Reference: ISTQB CT-AI Syllabus v1.0, Section 3.1.1, Page 26 of 99)

The syllabus explains that input changes that arein the same domainas what was used for training are expected to be handled with adaptability:

"Adaptability refers to the ability of a system to adjust its behavior in response to changes in its environment or inputs. This includes changes to the inputs which are still within the expected operational range of the system, such as resolution changes in images or sensor data."

(Reference: ISTQB CT-AI Syllabus v1.0, Section 7.6 and 8.2)

The syllabus explains that EDA can be used to analyze data to identify outliers and unusual patterns, which can indicate adversarial attacks like data poisoning:

"Testing to detect data poisoning is possible using EDA, as poisoned data may show up as outliers."

(Reference: ISTQB CT-AI Syllabus v1.0, Section 9.1.2, page 67 of 99)

The syllabus defines clustering as:

“Clustering: This is when the problem requires the identification of similarities in input data points that allows them to be grouped based on common characteristics or attributes. For example, clustering is used to categorize different types of customers for the purpose of marketing.”

(Reference: ISTQB CT-AI Syllabus v1.0, Section 3.1.2, page 26 of 99)

Setting model and algorithm hyperparameters is an essential step in the machine learning workflow, primarily occurring during the tuning phase.

Evaluating the model (A): This stage involves assessing the model's performance using metrics and does not typically include the setting of hyperparameters.

Deploying the model (B): Deployment is the stage where the model is put into production and used in real-world applications. Hyperparameters should already be set before this stage.

Tuning the model (C): This is the correct stage where hyperparameters are set. Tuning involves adjusting the hyperparameters to optimize the model's performance.

Data testing (D): Data testing involves ensuring the quality and integrity of the data used for training and testing the model. It does not include setting hyperparameters.

Hence, the most appropriate stage of the ML workflow to set model and algorithm hyperparameters isC. Tuning the model.

 AI-Based Autonomous Functions:An AI-based autonomous system is one that can respond to its environment without human intervention. The other options either involve human decisions or do not use AI at all.

 Reference:ISTQB_CT-AI_Syllabus_v1.0, Sections on Autonomy and Testing Autonomous AI-Based Systems​​​​.

The ISTQB CT-AI syllabus defines these two concepts clearly inSection 2.1 – Flexibility and Adaptability. Flexibility is described as the ability of a system to operate in situationsnot explicitly covered in its original requirements, while adaptability refers to how easily the system can bemodifiedto handle new environments or conditions. The syllabus stresses that both flexibility and adaptability are crucial, particularly inself-learning AI systemsthat may need to respond to changes in their environment and adjust their behavior accordingly. It states that systems must be capable of determiningwhenandhowto adjust behavior in evolving situations, especially when the operational environment is not fully known at deployment time . This directly aligns with OptionA.

Option B reverses definitions—the syllabus states flexibility (not adaptability) relates to unspecified situations. Option C is incorrect: self-learning systems requirebothflexibility and adaptability; they are not categorized as one or the other. Option D incorrectly defines flexibility; the syllabus defines adaptability—not flexibility—as ease of modification.

Thus,Option Acorrectly reflects the syllabus.

 Challenges for Acquiring Test Data in ML Systems:Compliance needs, the changing nature of data over time, and sourcing data from public sources are significant challenges. Data being generated quickly is generally not a challenge; it can actually be beneficial as it provides more data for training and testing.

 Reference:ISTQB_CT-AI_Syllabus_v1.0, Sections on Data Preparation and Data Quality Issues​​​​.

To calculate the accuracy, recall, and specificity from the confusion matrix provided, we use the following formulas:

Confusion Matrix:

Actually Rotten: 45 (True Positive), 8 (False Positive)

Actually Fresh: 5 (False Negative), 42 (True Negative)

Accuracy:

Accuracy is the proportion of true results (both true positives and true negatives) in the total population.

Formula: Accuracy=TP+TNTP+TN+FP+FN\text{Accuracy} = \frac{TP + TN}{TP + TN + FP + FN}Accuracy=TP+TN+FP+FNTP+TN​

Calculation: Accuracy=45+4245+42+8+5=87100=0.87\text{Accuracy} = \frac{45 + 42}{45 + 42 + 8 + 5} = \frac{87}{100} = 0.87Accuracy=45+42+8+545+42​=10087​=0.87

Recall (Sensitivity):

Recall is the proportion of true positive results in the total actual positives.

Formula: Recall=TPTP+FN\text{Recall} = \frac{TP}{TP + FN}Recall=TP+FNTP​

Calculation: Recall=4545+5=4550=0.9\text{Recall} = \frac{45}{45 + 5} = \frac{45}{50} = 0.9Recall=45+545​=5045​=0.9

Specificity:

Specificity is the proportion of true negative results in the total actual negatives.

Formula: Specificity=TNTN+FP\text{Specificity} = \frac{TN}{TN + FP}Specificity=TN+FPTN​

Calculation: Specificity=4242+8=4250=0.84\text{Specificity} = \frac{42}{42 + 8} = \frac{42}{50} = 0.84Specificity=42+842​=5042​=0.84

Therefore, the correct combinations of accuracy, recall, and specificity are 0.87, 0.9, and 0.84 respectively.

Bias detection at thedata levelis performed by reviewingdata acquisition and preprocessing steps, as explained in Section2.3 – Data Quality and Biasof the ISTQB CT-AI syllabus. Sample bias arises when data is distorted or when preprocessing introduces unintended shifts—for example, by filtering, normalization, or labeling steps that disproportionately affect subsets of the data. OptionBcorrectly reflects this: reviewers can identify whether preprocessing steps have altered the dataset in a way that introducessample distortions. This aligns perfectly with syllabus guidance on reviewing data pipelines for bias sources.

Option A is incorrect because algorithmic bias originates from themodel, not data collection procedures. Option C is incorrect because LIME is anexplainabilitymethod applied post-model, not in data reviews. Option D incorrectly states “algorithmic bias,” but preprocessing affectssample bias, not algorithmic bias.

Thus, OptionBcorrectly matches the syllabus’ definition of how bias can be detected during data-related reviews.

The ISTQB CT-AI syllabus explains inSection 4.5 – Testing AI-Specific Risksthat adversarial testing is a structured test activity in which testers applyadversarial attacks—crafted or perturbed inputs—to intentionally expose weaknesses in the ML model. The purpose is to identify vulnerabilities that could be exploited throughdata poisoning,evasion attacks, orinput manipulation. OptionCcorrectly reflects this syllabus definition: adversarial testing is aboutusing attacks to locate weaknesses so they can be removed or mitigated.

Option A is incorrect because regression testing does not verify data sourcing policies; it verifies unchanged functionality after modifications. Option B is incorrect because adversarial examples are oftenaddedto training datasets to improverobustness(a practice called adversarial training), not excluded. Option D is incorrect because AIB testing is not described as superior to exploratory data analysis in outlier detection; both have different purposes, and EDA remains essential for data quality assessment.

Thus,Option Cis consistent with syllabus-defined adversarial testing.

The question asks which test is least likely to be performed during the ML model testing phase. Let's consider each option:

Testing the accuracy of the classification model (A): Accuracy testing is a fundamental part of the ML model testing phase. It ensures that the model correctly classifies the data as intended and meets the required performance metrics.

Testing the API of the service powered by the ML model (B): Testing the API is crucial, especially if the ML model is deployed as part of a service. This ensures that the service integrates well with other systems and that the API performs as expected.

Testing the speed of the training of the model (C): This is least likely to be part of the ML model testing phase. The speed of training is more relevant during the development phase when optimizing and tuning the model. During testing, the focus is more on the model's performance and behavior rather than how quickly it was trained.

Testing the speed of the prediction by the model (D): Testing the speed of prediction is important to ensure that the model meets performance requirements in a production environment, especially for real-time applications.

The syllabus explains:

"Where the internal structure of an AI-based system is too complex for humans to understand, the system can only be tested as a black box. Even when the internal structure is visible, this provides no additional useful information to help with testing."

This confirms that black-box testing is chosen because the tester does not need to understand the system’s internal structure.

(Reference: ISTQB CT-AI Syllabus v1.0, Section 8.5, page 61 of 99)

Section4.3 – Test Levels for AI Systemsclearly defines ML model testing as the level at which testers evaluate whether an ML model fulfills itsfunctional performance criteria, including accuracy, precision, recall, F1, robustness, stability, and fairness. Therefore, Option C is the correct and syllabus-aligned statement.

Option A is incorrect because input data testing focuses onvalidity and correctness of data entering the model, not interactions with all system components. Option B is incorrect: acceptance testing in the syllabus focuses primarily onbusiness and stakeholder requirements, not specifically explainability. Explainability testing may occur at multiple levels depending on context. Option D is also incorrect because API testing belongs tointegration testing, not system testing, even when AI is consumed as a service.

Thus,Option Cis the only statement that precisely matches syllabus definitions.

The ISTQB CT-AI syllabus explains that AI-based decision-support systems benefit strongly fromback-to-back testingandmetamorphic testingwhen oracle problems exist or when limited regression tests are available. In this scenario, CleverPropose replaces an older advisory system.Back-to-back testing(Option A) is ideal because the outputs of the existing conventional system can serve as areference, enabling comparison against the new AI system. This is exactly what the syllabus recommends when AI is replacing a traditional deterministic system.

Metamorphic testing(Option C) is also appropriate, as stated in Section4.6 – Metamorphic Relations. With limited regression tests and complex decision logic, testers can define metamorphic relations such as “if customer income increases, risk rating should not worsen.” These relations allow validation even when exact expected outputs are unavailable.

Exploratory data analysis (Option D) is not a system testing technique. Pairwise testing (Option E) is not well suited for complex AI-based financial advice systems. Adversarial testing (Option B) is more relevant for security-critical or robustness evaluation, not primary system testing for advisory tools.

Thus,A and Care the correct and syllabus-supported choices.

Automation bias is defined in Section4.4 – Human Factors in AI Testingof the ISTQB CT-AI syllabus. It refers to the human tendency to overly trust, rely on, or defer to automated system outputs. The syllabus explains that this bias arises especially indecision-support systems, where humans may accept AI judgments without adequate verification. This aligns directly with Option B.

Option A is incorrect: automation biasdoesinfluence testing, especially when testers rely excessively on AI outputs. The syllabus cautions about testers adopting the same cognitive biases as end users. Option C is incorrect because autonomous systems are not the primary context; rather,systems supporting human decisionsare most impacted. Option D is incorrect because the quality of human inputmatters significantly, and poorly designed user studies can mask or distort automation bias.

Thus,Option Bis the syllabus-accurate description of automation bias.

Back-to-back testing is a method where the same set of tests are run on multiple implementations of the system to compare their outputs. This type of testing is typically used to ensure consistency and correctness by comparing the outputs of different implementations under identical conditions. Let's analyze the options given:

A. Comparison of the results of a current neural network model ML model implemented in platform A (for example Pytorch) with a similar neural network model ML model implemented in platform B (for example Tensorflow), for the same data.

This option describes a scenario where two different implementations of the same type of model are being compared using the same dataset. This is a typical back-to-back testing situation.

B. Comparison of the results of a home-grown neural network model ML model with results in a neural network model implemented in a standard implementation (for example Pytorch) for the same data.

This option involves comparing a custom implementation with a standard implementation, which is also a typical back-to-back testing scenario to validate the custom model against a known benchmark.

C. Comparison of the results of a neural network ML model with a current decision tree ML model for the same data.

This option involves comparing two different types of models (a neural network and a decision tree). This is not a typical scenario for back-to-back testing because the models are inherently different and would not be expected to produce identical results even on the same data.

D. Comparison of the results of the current neural network ML model on the current data set with a slightly modified data set.

This option involves comparing the outputs of the same model on slightly different datasets. This could be seen as a form of robustness testing or sensitivity analysis, but not typical back-to-back testing as it doesn’t involve comparing multiple implementations.

Based on this analysis, optionCis the one that describes a situation of back-to-back testing the least because it compares two fundamentally different models, which is not the intent of back-to-back testing.

The syllabus states:

"Concept drift occurs when the operational environment changes without the trained model changing correspondingly. The outputs of the model become less accurate and less useful. Therefore, the operational model should be regularly evaluated against its acceptance criteria."

(Reference: ISTQB CT-AI Syllabus v1.0, Section 7.6, Page 54 of 99)

Section1.6.3 – Reinforcement Learningof the ISTQB CT-AI syllabus states that reinforcement learning (RL) is based on anagent interacting with an environment, performing actions, and receivingrewards or penalties. The core concept is thereward function, which guides the agent’s learning process. The syllabus emphasizes that training in RL isdriven by rewards, and the agent aims to maximize cumulative reward over time. Therefore, OptionCdirectly reflects the correct description: the agent learns by being rewarded for successful actions .

Option A is incorrect because RL doesnotuse labeled data; that applies to supervised learning. Option B contradicts the syllabus definition: RL fundamentallyrequiresinteraction with the environment. Option D is incorrect because the reward function isdefined by humans, not learned by the agent; the agent learns apolicy, not the reward function itself.

Thus, OptionCis the only statement consistent with RL as defined in the syllabus.

The ISTQB CT-AI syllabus describes severaldata quality aspectsthat affect ML performance. In Section2.2 – Data Preparation, it explains that datasets may suffer from issues such asincomplete data,irrelevant data,incorrect data,unbalanced data, or data lacking preprocessing. “Incomplete data” means thatportions of the required data are missing, often because some time periods, records, or sources were not captured. This aligns exactly with Option A, which correctly identifies missing intervals as incomplete data.

Option B is incorrect: “data not preprocessed” refers to data that has not undergone normalization, cleaning, or transformation—not data recorded incorrectly. Option C is wrong because irrelevant datadoesnegatively affect ML models by introducing noise and unnecessary features. The syllabus explicitly states that including irrelevant features can degrade model learning. Option D is incorrect: “unbalanced data” relates todisproportionate class distribution, not recency or freshness of data.

Thus, OptionAis the only statement that correctly matches the syllabus definition of this data quality aspect.