Usability Testing CT-UT ISTQB Study Notes

In usability evaluations, a distinction is made between actual usability problems (where a user struggles to complete a task or is confused by the interface) and suggestions or ideas that users provide based on their preferences or perceived improvements. When a participant offers a new feature idea (such as a quick search box), this is classified as a “good idea” or “feature suggestion,” not necessarily a usability problem. It may inform future design enhancements but does not indicate a failure in usability for existing functionality.

A usability requirement specifies how usable a product or component must be, often in terms of effectiveness, efficiency, and user satisfaction, as defined in ISO 9241-11. These requirements ensure that the product meets specific human-centered design goals, such as allowing users to complete tasks accurately and quickly. Options A and C describe procedural or test setup elements, not actual usability requirements. Option B refers to personnel qualifications, which are not the same as usability requirements related to system behavior or performance.

Usability test reports are more effective when they are balanced and include not only problems but also what worked well. Including positive findings increases credibility, encourages the development team, and helps them understand what should remain unchanged. Option B violates privacy and ethical standards. Option C may dilute focus, and D could worsen the problem by making the report less accessible. Thus, the best practice supported by usability.gov and Nielsen Norman Group is to include both positive and negative findings.

SUS (System Usability Scale), SUMI (Software Usability Measurement Inventory), and WAMMI (Website Analysis and Measurement Inventory) are all validated, standardized usability questionnaires that support benchmarking. They allow comparison against known usability scores from a wide variety of systems. These instruments provide numeric scores that can be interpreted using benchmark datasets or industry standards. Therefore, all three—i, ii, and iii—are true, making D the correct answer.