[Full-Version] 2026 New PassSureExam CT-AI PDF Recently Updated Questions
CT-AI Exam with Guarantee Updated 122 Questions
NEW QUESTION # 21
A car insurance company is using a new AI service to reward defensive driving behavior among its policyholders. The driving behavior is recorded in a rating number (score).
The AI service determines this score from the following input values:
Reference speed v_max in km/h
Average speed v_mean in km/h
Average acceleration a_pos in m/s²
Average braking deceleration a_neg in m/s²
The more defensive the driving behavior is (slow driving, low acceleration, low braking deceleration), the higher is the score.
Three initial test cases (Test 1 to Test 3) are used for testing the AI service. In addition, new test cases A-D are proposed.
Which of the new tests is NOT a follow-up test case for metamorphic testing?
Choose ONE option! (1 out of 4)
- A. Test D is not a follow-up test case.
- B. Test A is not a follow-up test case.
- C. Test C is not a follow-up test case.
- D. Test B is not a follow-up test case.
Answer: D
Explanation:
According to the ISTQB CT-AI syllabus,metamorphic testingworks by applyingmetamorphic relations (MRs): predictable input transformations that should lead to predictable output changes. From the initial test data, clear relations emerge for defensive driving scoring. The score increases when:
* v_mean decreases,
* a_pos decreases,
* a_neg becomes less negative,and decreases when the opposite occurs.
A valid metamorphic follow-up test must modify inputs in a direction consistent with at least one MR while keeping the expected output direction predictable.
Test Alowers v_mean compared to Test 1, with similar acceleration values. This directly satisfies the MR that lower speed # higher score.
Test Cincreases both acceleration and braking intensity compared to Test 2, making the reduced score range (30-70) consistent with more aggressive driving.
Test Dmodifies acceleration and braking magnitudes in ways consistent with Test 3's defensive-driving scoring boundaries.
Test B, however, changes multiple variables in contradictory directions:
* v_mean increases (worse)
* a_pos increases (worse)
* a_neg becomes less negative (better)
Because these changes conflict,the expected score trend becomes unpredictable, violating the premise of a metamorphic follow-up test.
ThusTest B cannot be considered a metamorphic follow-up, which makesOption Ccorrect.
NEW QUESTION # 22
Which ONE of the following tests is LEAST likely to be performed during the ML model testing phase?
SELECT ONE OPTION
- A. Testing the speed of the prediction by the model.
- B. Testing the speed of the training of the model.
- C. Testing the API of the service powered by the ML model.
- D. Testing the accuracy of the classification model.
Answer: B
Explanation:
The question asks which test is least likely to be performed during the ML model testing phase. Let's consider each option:
Testing the accuracy of the classification model (A): Accuracy testing is a fundamental part of the ML model testing phase. It ensures that the model correctly classifies the data as intended and meets the required performance metrics.
Testing the API of the service powered by the ML model (B): Testing the API is crucial, especially if the ML model is deployed as part of a service. This ensures that the service integrates well with other systems and that the API performs as expected.
Testing the speed of the training of the model (C): This is least likely to be part of the ML model testing phase. The speed of training is more relevant during the development phase when optimizing and tuning the model. During testing, the focus is more on the model's performance and behavior rather than how quickly it was trained.
Testing the speed of the prediction by the model (D): Testing the speed of prediction is important to ensure that the model meets performance requirements in a production environment, especially for real-time applications.
Reference:
ISTQB CT-AI Syllabus Section 3.2 on ML Workflow and Section 5 on ML Functional Performance Metrics discuss the focus of testing during the model testing phase, which includes accuracy and prediction speed but not the training speed.
NEW QUESTION # 23
A bank wants to use an algorithm to determine which applicants should be given a loan. The bank hires a data scientist to construct a logistic regression model to predict whether the applicant will repay the loan or not.
The bank has enough data on past customers to randomly split the data into a training data set and a test
/validation data set. A logistic regression model is constructed on the training data set using the following independent variables:
Gender
Marital status
Number of dependents
Education
Income
Loan amount
Loan term
Credit score
The model reveals that those with higher credit scores and larger total incomes are more likely to repay their loans. The data scientist has suggested that there might be bias present in the model based on previous models created for other banks.
Given this information, what is the best test approach to check for potential bias in the model?
- A. Acceptance testing should be used to make sure the algorithm is suitable for the customer. The team can re-work the acceptance criteria such that the algorithm is sure to correctly predict the remaining applicants that have been set aside for the validation data set ensuring no bias is present.
- B. Back-to-back testing should be used to compare the model created using the training data set to another model created using the test data set, if the two models significantly differ, it will indicate there is bias in the original model.
- C. A/B testing should be used to verify that the test data set does not detect any bias that might have been introduced by the original training data. If the two models significantly differ, it will indicate there is bias in the original model.
- D. Experienced-based testing should be used to confirm that the training data set is operationally relevant.
This can include applying exploratory data analysis (EDA) to check for bias within the training data set.
Answer: D
Explanation:
Bias in an AI system occurs when the training data contains inherent prejudices that cause the model to make unfair predictions. Experience-based testing, particularlyExploratory Data Analysis (EDA), helps uncover these biases by analyzing patterns, distributions, and potential discriminatory factors in the training data.
* Option A:"Experience-based testing should be used to confirm that the training data set is operationally relevant. This can include applying exploratory data analysis (EDA) to check for bias within the training data set."
* This is the correct answer. EDA involves examining the dataset for bias, inconsistencies, or missing values, ensuring fairness in ML model predictions.
* Option B:"Back-to-back testing should be used to compare the model created using the training data set to another model created using the test data set. If the two models significantly differ, it will indicate there is bias in the original model."
* Back-to-back testing is used for regression testing and to compare versions of an AI system but is not primarily used to detect bias.
* Option C:"Acceptance testing should be used to make sure the algorithm is suitable for the customer.
The team can re-work the acceptance criteria such that the algorithm is sure to correctly predict the remaining applicants that have been set aside for the validation data set ensuring no bias is present."
* Acceptance testing focuses on meeting predefined business requirements rather than detecting and mitigating bias.
* Option D:"A/B testing should be used to verify that the test data set does not detect any bias that might have been introduced by the original training data. If the two models significantly differ, it will indicate there is bias in the original model."
* A/B testing is used for evaluating variations of a model rather than for explicitly identifying bias.
* Bias Testing Methods:"AI-based systems should be tested for algorithmic bias, sample bias, and inappropriate bias. Experience-based testing and EDA are useful for detecting bias".
* Exploratory Data Analysis (EDA):"EDA helps uncover potential bias in training data through visualization and statistical analysis".
Analysis of the Answer Options:ISTQB CT-AI Syllabus References:Thus,Option A is the best choice for detecting bias in the loan applicant model.
NEW QUESTION # 24
You are testing an autonomous vehicle which uses AI to determine proper driving actions and responses. You have evaluated the parameters and combinations to be tested and have determined that there are too many to test in the time allowed. It has been suggested that you use pairwise testing to limit the parameters. Given the complexity of the software under test, what is likely the outcome from using pairwise testing?
- A. All high priority defects will be identified using this method
- B. Pairwise cannot be applied to this problem because there is AI involved and the evolving values may result in unexpected results that cannot be verified
- C. The number of parameters to test can be reduced to less than a dozen
- D. While the number of tests needed can be reduced, there may still be a large enough set of tests that automation will be required to execute all of them
Answer: D
Explanation:
The syllabus states that while pairwise testing is effective at finding defects by reducing the number of test cases needed, the resulting test suite can still be extensive and require automation:
"Even the use of pairwise testing can result in extensive test suites... automation and virtual test environments often become necessary to allow the required tests to be run." (Reference: ISTQB CT-AI Syllabus v1.0, Section 9.2, Page 67 of 99)
NEW QUESTION # 25
Which ONE of the following options is the MOST APPROPRIATE stage of the ML workflow to set model and algorithm hyperparameters?
SELECT ONE OPTION
- A. Evaluating the model
- B. Deploying the model
- C. Data testing
- D. Tuning the model
Answer: D
Explanation:
Setting model and algorithm hyperparameters is an essential step in the machine learning workflow, primarily occurring during the tuning phase.
* Evaluating the model (A): This stage involves assessing the model's performance using metrics and does not typically include the setting of hyperparameters.
* Deploying the model (B): Deployment is the stage where the model is put into production and used in real-world applications. Hyperparameters should already be set before this stage.
* Tuning the model (C): This is the correct stage where hyperparameters are set. Tuning involves adjusting the hyperparameters to optimize the model's performance.
* Data testing (D): Data testing involves ensuring the quality and integrity of the data used for training and testing the model. It does not include setting hyperparameters.
Hence, the most appropriate stage of the ML workflow to set model and algorithm hyperparameters isC.
Tuning the model.
References:
* ISTQB CT-AI Syllabus Section 3.2 on the ML Workflow outlines the different stages of the ML process, including the tuning phase where hyperparameters are set.
* Sample Exam Questions document, Question #31 specifically addresses the stage in the ML workflow where hyperparameters are configured.
NEW QUESTION # 26
Which of the following statements regarding experience-based testing for AI-based systems is correct?
Choose ONE option (1 out of 4)
- A. Intuitive test case design for AI-based systems involves interactive, hypothesis-driven examination of data for correlations or developmental trends.
- B. Exploratory testing is often used for AI-based systems because there are often insufficient specifications or problems with the test oracle for AI-based systems.
- C. Tour refers to intuitive test case design for AI-based systems based on multiple, sequential test cases using systematically biased training data.
- D. In checklist-based testing of AI-based systems, the existing test cases are dynamically adapted, for example based on metamorphic testing.
Answer: B
Explanation:
The ISTQB CT-AI syllabus explains inSection 4.4 - Experience-Based Testing for AI Systemsthat AI- based systems frequently suffer frominsufficient specifications, unpredictable model behavior, andtest oracle problems, especially when outputs depend on probabilistic or learned patterns. The syllabus explicitly states thatexploratory testingis especially valuable in such contexts because it allows testers to investigate the system interactively, observe unexpected behavior, and evaluate system responses that cannot be fully predicted beforehand. Thus, OptionCaccurately reflects the role and justification of exploratory testing for AI systems.
Option A describes data analysis rather than intuitive test design. Option B is incorrect because checklist- based testing does not dynamically adapt test cases; instead, it follows predetermined checklists. Option D incorrectly defines "tour-based testing"; tours refer to structured exploratory approaches, not biased datasets.
Therefore,Option Cis the syllabus-aligned correct statement.
NEW QUESTION # 27
Consider an AI-system in which the complex internal structure has been generated by another software system. Why would the tester choose to do black-box testing on this particular system?
- A. Black-box testing eliminates the need for the tester to understand the internal structure of the AI-system
- B. Test automation can be built quickly and easily from the test cases developed during black-box testing
- C. The tester wishes to better understand the logic of the software used to create the internal structure
- D. The black-box testing method will allow the tester to check the transparency of the algorithm used to create the internal structure
Answer: A
Explanation:
The syllabus explains:
"Where the internal structure of an AI-based system is too complex for humans to understand, the system can only be tested as a black box. Even when the internal structure is visible, this provides no additional useful information to help with testing." This confirms that black-box testing is chosen because the tester does not need to understand the system's internal structure.
(Reference: ISTQB CT-AI Syllabus v1.0, Section 8.5, page 61 of 99)
NEW QUESTION # 28
Which AI-specific test objective and acceptance criterion should be selected MOST LIKELY for testing GPT_Legal?
Choose ONE option (1 out of 4)
- A. Test objective: Evidence of functional safety
Acceptance criterion: The system recognizes failures in the transmission of information and data with the DPMA system and the evaluation system by means of self-tests. - B. Test objective: Evidence that the data is free from inappropriate bias Acceptance criterion: The DPMA's analysis data is statistically compared to data from other sources.
- C. Test objective: Evidence of compatibility
Acceptance criterion: The system can exchange information with the DPMA system and the evaluation system. - D. Test objective: Evidence of evolution
Acceptance criterion: The quality of the research results does not deteriorate with further training.
Answer: D
Explanation:
The ISTQB CT-AI syllabus introducesAI-specific quality characteristics, includingevolution,functional safety,compatibility, andbias-related data quality. Section5.1 - AI-Specific Test Objectivesexplains that evolutionrefers to an AI system's capability to continue improving or at least maintain performance as it undergoes additional training. GPT_Legal is explicitly described as aself-learning systemexpected to:
* continuously reduce false positives,
* achieve weekly accuracy improvements of 10%,
* reach and maintain 90% accuracy,
* adapt to new environments (patent law firm # corporate legal department).
This aligns perfectly with the syllabus definition ofevidence of evolution: ensuring the model doesnot degrade as additional training data is introduced. OptionBtherefore directly supports the described acceptance criteria for this evolving, self-learning application.
Option A (functional safety) is irrelevant because patent searching and drafting do not constitute safety- critical domains. Option C (compatibility) is necessary but not the primary AI-specific objective. Option D addresses bias, which is important but not central to the described performance and continuous-learning expectations.
Thus,Option Bis the most appropriate AI-specific test objective.
NEW QUESTION # 29
How can a tester check the system for bias as part of a review of data sources, acquisition, and preprocessing?
Choose ONE option (1 out of 4)
- A. It may use the LIME method as part of its data collection review to detect inappropriate bias.
- B. During the review of the preprocessing, the auditor can uncover whether the data has been influenced in a way that could lead to sample distortions.
- C. As part of the review of preprocessing, it can reveal whether the data has been influenced in a way that could lead to algorithmic bias.
- D. During the review, it can uncover algorithmic bias by analysing the procedures used to obtain the training data.
Answer: B
Explanation:
Bias detection at thedata levelis performed by reviewingdata acquisition and preprocessing steps, as explained in Section2.3 - Data Quality and Biasof the ISTQB CT-AI syllabus. Sample bias arises when data is distorted or when preprocessing introduces unintended shifts-for example, by filtering, normalization, or labeling steps that disproportionately affect subsets of the data. OptionBcorrectly reflects this: reviewers can identify whether preprocessing steps have altered the dataset in a way that introducessample distortions. This aligns perfectly with syllabus guidance on reviewing data pipelines for bias sources.
Option A is incorrect because algorithmic bias originates from themodel, not data collection procedures.
Option C is incorrect because LIME is anexplainabilitymethod applied post-model, not in data reviews.
Option D incorrectly states "algorithmic bias," but preprocessing affectssample bias, not algorithmic bias.
Thus, OptionBcorrectly matches the syllabus' definition of how bias can be detected during data-related reviews.
NEW QUESTION # 30
A system was developed for screening the X-rays of patients for potential malignancy detection (skin cancer).
A workflow system has been developed to screen multiple cancers by using several individually trained ML models chained together in the workflow.
Testing the pipeline could involve multiple kind of tests (I - III):
I.Pairwise testing of combinations
II.Testing each individual model for accuracy
III.A/B testing of different sequences of models
Which ONE of the following options contains the kinds of tests that would be MOST APPROPRIATE to include in the strategy for optimal detection?
SELECT ONE OPTION
- A. Only II
- B. I and II
- C. I and III
- D. Only III
Answer: B
Explanation:
The question asks which combination of tests would be most appropriate to include in the strategy for optimal detection in a workflow system using multiple ML models.
* Pairwise testing of combinations (I): This method is useful for testing interactions between different components in the workflow to ensure they work well together, identifying potential issues in the integration.
* Testing each individual model for accuracy (II): Ensuring that each model in the workflow performs accurately on its own is crucial before integrating them into a combined workflow.
* A/B testing of different sequences of models (III): This involves comparing different sequences to determine which configuration yields the best results. While useful, it might not be as fundamental as pairwise and individual accuracy testing in the initial stages.
References:
* ISTQB CT-AI Syllabus Section 9.2 on Pairwise Testing and Section 9.3 on Testing ML Models emphasize the importance of testing interactions and individual model accuracy in complex ML workflows.
NEW QUESTION # 31
A ML engineer is trying to determine the correctness of the new open-source implementation *X", of a supervised regression algorithm implementation. R-Square is one of the functional performance metrics used to determine the quality of the model.
Which ONE of the following would be an APPROPRIATE strategy to achieve this goal?
SELECT ONE OPTION
- A. Drop 10% of the rows randomly and create another model and compare the R-Square scores of both the models.
- B. Add 10% of the rows randomly and create another model and compare the R-Square scores of both the model.
- C. Train various models by changing the order of input features and verify that the R-Square score of these models vary significantly.
- D. Compare the R-Square score of the model obtained using two different implementations that utilize two different programming languages while using the same algorithm and the same training and testing data.
Answer: D
Explanation:
A . Add 10% of the rows randomly and create another model and compare the R-Square scores of both the models.
Adding more data to the training set can affect the R-Square score, but it does not directly verify the correctness of the implementation.
B . Train various models by changing the order of input features and verify that the R-Square score of these models vary significantly.
Changing the order of input features should not significantly affect the R-Square score if the implementation is correct, but this approach is more about testing model robustness rather than correctness of the implementation.
C . Compare the R-Square score of the model obtained using two different implementations that utilize two different programming languages while using the same algorithm and the same training and testing data.
This approach directly compares the performance of two implementations of the same algorithm. If both implementations produce similar R-Square scores on the same training and testing data, it suggests that the new implementation "X" is correct.
D . Drop 10% of the rows randomly and create another model and compare the R-Square scores of both the models.
Dropping data can lead to variations in the R-Square score but does not directly verify the correctness of the implementation.
Therefore, option C is the most appropriate strategy because it directly compares the performance of the new implementation "X" with another implementation using the same algorithm and datasets, which helps in verifying the correctness of the implementation.
NEW QUESTION # 32
Pairwise testing can be used in the context of self-driving cars for controlling an explosion in the number of combinations of parameters.
Which ONE of the following options is LEAST likely to be a reason for this incredible growth of parameters?
SELECT ONE OPTION
- A. Different features like ADAS, Lane Change Assistance etc.
- B. ML model metrics to evaluate the functional performance
- C. Different Road Types
- D. Different weather conditions
Answer: B
Explanation:
Pairwise testing is used to handle the large number of combinations of parameters that can arise in complex systems like self-driving cars. The question asks which of the given options is least likely to be a reason for the explosion in the number of parameters.
Different Road Types (A): Self-driving cars must operate on various road types, such as highways, city streets, rural roads, etc. Each road type can have different characteristics, requiring the car's system to adapt and handle different scenarios. Thus, this is a significant factor contributing to the growth of parameters.
Different Weather Conditions (B): Weather conditions such as rain, snow, fog, and bright sunlight significantly affect the performance of self-driving cars. The car's sensors and algorithms must adapt to these varying conditions, which adds to the number of parameters that need to be considered.
ML Model Metrics to Evaluate Functional Performance (C): While evaluating machine learning (ML) model performance is crucial, it does not directly contribute to the explosion of parameter combinations in the same way that road types, weather conditions, and car features do. Metrics are used to measure and assess performance but are not themselves variable conditions that the system must handle.
Different Features like ADAS, Lane Change Assistance, etc. (D): Advanced Driver Assistance Systems (ADAS) and other features add complexity to self-driving cars. Each feature can have multiple settings and operational modes, contributing to the overall number of parameters.
Hence, the least likely reason for the incredible growth in the number of parameters is C. ML model metrics to evaluate the functional performance.
Reference:
ISTQB CT-AI Syllabus Section 9.2 on Pairwise Testing discusses the application of this technique to manage the combinations of different variables in AI-based systems, including those used in self-driving cars.
Sample Exam Questions document, Question #29 provides context for the explosion in parameter combinations in self-driving cars and highlights the use of pairwise testing as a method to manage this complexity.
NEW QUESTION # 33
Which ONE of the following tests is LEAST likely to be performed during the ML model testing phase?
SELECT ONE OPTION
- A. Testing the speed of the prediction by the model.
- B. Testing the speed of the training of the model.
- C. Testing the API of the service powered by the ML model.
- D. Testing the accuracy of the classification model.
Answer: B
Explanation:
The question asks which test is least likely to be performed during the ML model testing phase. Let's consider each option:
* Testing the accuracy of the classification model (A): Accuracy testing is a fundamental part of the ML model testing phase. It ensures that the model correctly classifies the data as intended and meets the required performance metrics.
* Testing the API of the service powered by the ML model (B): Testing the API is crucial, especially if the ML model is deployed as part of a service. This ensures that the service integrates well with other systems and that the API performs as expected.
* Testing the speed of the training of the model (C): This is least likely to be part of the ML model testing phase. The speed of training is more relevant during the development phase when optimizing and tuning the model. During testing, the focus is more on the model's performance and behavior rather than how quickly it was trained.
* Testing the speed of the prediction by the model (D): Testing the speed of prediction is important to ensure that the model meets performance requirements in a production environment, especially for real- time applications.
:
ISTQB CT-AI Syllabus Section 3.2 on ML Workflow and Section 5 on ML Functional Performance Metrics discuss the focus of testing during the model testing phase, which includes accuracy and prediction speed but not the training speed.
NEW QUESTION # 34
Which performance metric is BEST suited to assess the quality of trained models detecting fraudulent credit card transactions?
Choose ONE option (1 out of 4)
- A. -
- B. F1 value
- C. Sensitivity
- D. Accuracy
Answer: B
Explanation:
The ISTQB CT-AI syllabus explains in Section3.2 - Functional Performance Criteria of ML Modelsthat accuracy becomes unreliable whenclass imbalanceexists. In fraud detection, more than 99% of transactions are non-fraudulent, meaning the dataset is extremely imbalanced. Because accuracy counts all correct non- fraudulent classifications, it will appear artificially high, even if the fraud detection performance is poor.
Therefore, accuracy is not suitable for evaluating fraud detection systems.
The syllabus further explains thatsensitivity (recall)captures the proportion of correctly identified fraudulent cases. This metric is important, as missing fraudulent events can cause high financial loss. However, the client also stresses thatlegitimate transactions must be correctly identified, meaningfalse positives must be minimizedto maintain customer satisfaction.
TheF1 score, defined as the harmonic mean ofprecision and recall, balances both:
* Precision protects legitimate customers by minimizing false alarms.
* Recall ensures fraudulent transactions are detected.
Section 3.2 emphasizes that when both false positives and false negatives have significant consequences, and the data is highly imbalanced,F1 is the most appropriate metricbecause it reflects the combined importance of detecting fraud while avoiding unnecessary alerts. Thus,Option Cis the correct choice.
NEW QUESTION # 35
Which data-labeling approach uses a two-step process where labeling is first done by a tool and then verified or completed by a human?
Choose ONE option (1 out of 4)
- A. Crowdsourced data labeling
- B. Outsourced data labeling
- C. AI-assisted data labeling
- D. Internal data labeling
Answer: C
Explanation:
Section2.4 - Data Labeling Approachesof the ISTQB CT-AI syllabus explicitly definesAI-assisted data labelingas a hybrid process in which an automated tool performs the initial labeling and human annotators subsequently verify, correct, or complete the labels. This two-step process improves efficiency while retaining human oversight to ensure data quality. The syllabus describes this method as an effective compromise when manual labeling alone would be too slow or costly, and when initial automation can identify obvious patterns before a human provides the final authoritative labels .
Option A (internal labeling) refers to labeling conducted by the organization's own staff but does not imply automation. Option B (crowdsourced labeling) leverages a distributed workforce, typically without automation. Option C (outsourced labeling) transfers labeling tasks to external vendors but similarly does not involve an AI-first step. Only OptionDreflects the two-stage automated-then-human workflow described in the syllabus.
Therefore,AI-assisted data labeling(Option D) is unequivocally correct.
NEW QUESTION # 36
Which ONE of the following tests is LEAST likely to be performed during the ML model testing phase?
SELECT ONE OPTION
- A. Testing the speed of the prediction by the model.
- B. Testing the speed of the training of the model.
- C. Testing the API of the service powered by the ML model.
- D. Testing the accuracy of the classification model.
Answer: B
Explanation:
The question asks which test is least likely to be performed during the ML model testing phase. Let's consider each option:
* Testing the accuracy of the classification model (A): Accuracy testing is a fundamental part of the ML model testing phase. It ensures that the model correctly classifies the data as intended and meets the required performance metrics.
* Testing the API of the service powered by the ML model (B): Testing the API is crucial, especially if the ML model is deployed as part of a service. This ensures that the service integrates well with other systems and that the API performs as expected.
* Testing the speed of the training of the model (C): This is least likely to be part of the ML model testing phase. The speed of training is more relevant during the development phase when optimizing and tuning the model. During testing, the focus is more on the model's performance and behavior rather than how quickly it was trained.
* Testing the speed of the prediction by the model (D): Testing the speed of prediction is important to ensure that the model meets performance requirements in a production environment, especially for real- time applications.
References:
* ISTQB CT-AI Syllabus Section 3.2 on ML Workflow and Section 5 on ML Functional Performance Metrics discuss the focus of testing during the model testing phase, which includes accuracy and prediction speed but not the training speed.
NEW QUESTION # 37
Which of the following is an example of an input change where it would be expected that the AI system should be able to adapt?
- A. It has been trained to recognize human faces at a particular resolution and it is given a human face image captured with a higher resolution.
- B. It has been trained to analyze mathematical models and is given a set of landscape pictures to classify.
- C. It has been trained to analyze customer buying trend data and is given information on supplier cost data.
- D. It has been trained to recognize cats and is given an image of a dog.
Answer: A
Explanation:
AI systems, particularly machine learning models, need to exhibit adaptability and flexibility to handle slight variations in input data without requiring retraining. The ISTQB CT-AI syllabus outlines adaptability as a crucial feature of AI systems, especially when the system is exposed to variations in its operational environment.
* Option A:"It has been trained to recognize cats and is given an image of a dog."
* This scenario introduces an entirely new class (dogs), which is outside the AI system's expected scope. If the AI was only trained to recognize cats, it would not be expected to recognize dogs correctly without retraining. This does not demonstrate adaptability as expected from an AI system.
* Option B:"It has been trained to recognize human faces at a particular resolution and it is given a human face image captured with a higher resolution."
* This is an example of an AI system encountering a variation of its training data rather than entirely new data. Most AI-based image processing models can adapt to different resolutions by applying downsampling or other pre-processing techniques. Since the data remains within the domain of human faces, the model should be able to process the higher-resolution image without significant issues.
* Option C:"It has been trained to analyze mathematical models and is given a set of landscape pictures to classify."
* This represents a complete shift in the data type from structured numerical data to unstructured image data. The AI system is unlikely to adapt effectively, as it has not been trained on image classification tasks.
* Option D:"It has been trained to analyze customer buying trend data and is given information on supplier cost data."
* This introduces a significant domain shift. Customer buying trends focus on consumer behavior, while supplier cost data relates to pricing structures and logistics. The AI system would likely require retraining to process the new data meaningfully.
* Adaptability Requirements:The syllabus discusses that AI-based systems must be able to adapt to changes in their operational environment and constraints, including minor variations in input quality (such as resolution changes).
* Autonomous Learning & Evolution:AI systems are expected to improve and handle evolving inputs based on prior experience.
* Challenges in Testing Self-Learning Systems:AI systems should be tested to ensure they function correctly when encountering new but related data, such as different resolutions of the same object.
Analysis of the Answer Options:ISTQB CT-AI Syllabus References:Thus,option Bis the best choice as it aligns with the adaptability characteristics expected from AI-based systems.
NEW QUESTION # 38
A bank wants to use an algorithm to determine which applicants should be given a loan. The bank hires a data scientist to construct a logistic regression model to predict whether the applicant will repay the loan or not.
The bank has enough data on past customers to randomly split the data into a training dataset and a test
/validation dataset. A logistic regression model is constructed on the training dataset using the following independent variables:
* Gender
* Marital status
* Number of dependents
* Education
* Income
* Loan amount
* Loan term
* Credit score
The model reveals that those with higher credit scores and larger total incomes are more likely to repay their loans. The data scientist has suggested that there might be bias present in the model based on previous models created for other banks.
Given this information, what is the best test approach to check for potential bias in the model?
- A. A/B testing should be used to verify that the test data set does not detect any bias that might have been introduced by the original training data. If the two models significantly differ, it will indicate there is bias in the original model.
- B. Back-to-back testing should be used to compare the model created using the training data set to another model created using the test data set. If the two models significantly differ, it will indicate there is bias in the original model.
- C. Acceptance testing should be used to make sure the algorithm is suitable for the customer. The team can re-work the acceptance criteria such that the algorithm is sure to correctly predict the remaining applicants that have been set aside for the validation dataset ensuring no bias is present.
- D. Experience-based testing should be used to confirm that the training data set is operationally relevant.
This can include applying exploratory data analysis (EDA) to check for bias within the training data set.
Answer: D
Explanation:
The syllabus mentions that experience-based testing and EDA are effective for detecting biases:
"Experience-based testing can be used to verify that the training dataset is operationally relevant and identify potential sources of bias. EDA is also useful for exploring the data and understanding any relationships that might lead to bias in the model." (Reference: ISTQB CT-AI Syllabus v1.0, Section 8.3, page 58 of 99)
NEW QUESTION # 39
There is a growing backlog of unresolved defects for your project. You know the developers have an ML model that they have created which has learned which developers work on which type of software and the speed with which they resolve issues. How could you use this model to help reduce the backlog and implement more efficient defect resolution?
- A. Use it to review the code and determine where more defects are likely to occur so that testing can be targeted to those areas.
- B. Use it to determine the root cause of each defect and develop a process improvement plan that can be implemented to remove the most common root causes.
- C. Use it to prioritize defects automatically based on the time expected for the fix to be made, the speed of the fix, and the likelihood of regressions.
- D. Use it to assign defects to the best developer to resolve the problem and to load balance the defect assignments among the developers.
Answer: D
Explanation:
AI and ML models can play a significant role in optimizing defect resolution processes. According to the ISTQB Certified Tester AI Testing (CT-AI) Syllabus, ML models can be used toanalyze defect reports, prioritize critical defects, and assign defects to developersbased on historical defect resolution patterns.
The key AI applications for defect management include:
* Defect Categorization- NLP techniques can analyze defect reports and classify them based on metadata like severity and impact.
* Defect Prioritization- ML models trained on past defects can predict which issues are likely to cause failures, allowing teams toprioritizethe most critical issues.
* Defect Assignment- AI-based models can suggest which developers are best suited for specific defects, optimizing the resolution process based on past performance and specialization.
From the given answer choices:
* Option A (Automatic Prioritization)is useful but does not directlyreduce backlog efficientlyby considering developer expertise and workload balancing.
* Option C (Root Cause Analysis for Process Improvement)is along-term strategybut does not directly address backlog reduction.
* Option D (Defect Prediction for Testing Focus)helps preemptively identify issues but does not resolve the existing backlog.
Thus,Option Bis the best choice as it aligns with AI's capability toassign defects to the most suitable developersbased on historical data, ensuring efficient defect resolution and backlog reduction.
Certified Tester AI Testing Study Guide References:
* ISTQB CT-AI Syllabus v1.0, Section 11.2 (Using AI to Analyze Reported Defects)
* ISTQB CT-AI Syllabus v1.0, Section 11.5 (Using AI for Defect Prediction).
NEW QUESTION # 40
Which ONE of the following options is the MOST APPROPRIATE stage of the ML workflow to set model and algorithm hyperparameters?
SELECT ONE OPTION
- A. Evaluating the model
- B. Deploying the model
- C. Data testing
- D. Tuning the model
Answer: D
Explanation:
Setting model and algorithm hyperparameters is an essential step in the machine learning workflow, primarily occurring during the tuning phase.
Evaluating the model (A): This stage involves assessing the model's performance using metrics and does not typically include the setting of hyperparameters.
Deploying the model (B): Deployment is the stage where the model is put into production and used in real-world applications. Hyperparameters should already be set before this stage.
Tuning the model (C): This is the correct stage where hyperparameters are set. Tuning involves adjusting the hyperparameters to optimize the model's performance.
Data testing (D): Data testing involves ensuring the quality and integrity of the data used for training and testing the model. It does not include setting hyperparameters.
Hence, the most appropriate stage of the ML workflow to set model and algorithm hyperparameters is C. Tuning the model.
Reference:
ISTQB CT-AI Syllabus Section 3.2 on the ML Workflow outlines the different stages of the ML process, including the tuning phase where hyperparameters are set.
Sample Exam Questions document, Question #31 specifically addresses the stage in the ML workflow where hyperparameters are configured.
NEW QUESTION # 41
......
Latest CT-AI Pass Guaranteed Exam Dumps Certification Sample Questions: https://www.passsureexam.com/CT-AI-pass4sure-exam-dumps.html
CT-AI Updated Exam Dumps [2026] Practice Valid Exam Dumps Question: https://drive.google.com/open?id=1SH_sRPbELJlpjiXIAEjimt0-zqhEKpiv