CTFL-UT Exam Dumps : ISTQB Certified Tester-Foundation Level - Usability Testing

SUS (System Usability Scale), SUMI (Software Usability Measurement Inventory), and WAMMI (Website Analysis and Measurement Inventory) are all validated, standardized usability questionnaires that support benchmarking. They allow comparison against known usability scores from a wide variety of systems. These instruments provide numeric scores that can be interpreted using benchmark datasets or industry standards. Therefore, all three—i, ii, and iii—are true, making D the correct answer.

A pilot usability test session is a critical step prior to conducting the actual usability test. Its purpose is to ensure that the test setup, task design, and moderator instructions are clear and function as expected. According to ISO 9241-210 and the Nielsen Norman Group's best practices, pilot testing helps detect unforeseen issues and fine-tune the process. Options A and B are incorrect because testing conditions must reflect realistic scenarios, and thorough preparation is essential to gather meaningful usability data. Option D is also incorrect; a usability test typically consists of multiple sessions with different users to gather sufficient data for analysis. The pilot session ensures everything works smoothly before involving real participants.

Common mistakes in usability testing include:

Ignoring critical results (ii): A significant issue if findings are not acted upon.

Scheduling the test too late (iv): This can lead to usability problems being discovered too late to be addressed effectively.

Having the wrong focus (v): For instance, focusing on aesthetics instead of usability goals.

Option i ("user is too active") is not a problem—active participation is necessary. Option iii ("no observers involved") is not a typical mistake, since tests can still be valid even with recorded sessions and later review. Hence, the correct answer is A: ii, iv & v are true.