CTFL-UT Exam Dumps : ISTQB Certified Tester-Foundation Level - Usability Testing

A pilot usability test session is a critical step prior to conducting the actual usability test. Its purpose is to ensure that the test setup, task design, and moderator instructions are clear and function as expected. According to ISO 9241-210 and the Nielsen Norman Group's best practices, pilot testing helps detect unforeseen issues and fine-tune the process. Options A and B are incorrect because testing conditions must reflect realistic scenarios, and thorough preparation is essential to gather meaningful usability data. Option D is also incorrect; a usability test typically consists of multiple sessions with different users to gather sufficient data for analysis. The pilot session ensures everything works smoothly before involving real participants.

An informal usability review can be conducted by anyone, including stakeholders or developers, and does not require formal usability training or qualifications. It is typically subjective and based on general impressions. In contrast, an expert usability review (also called heuristic evaluation) is conducted by a trained usability expert who applies recognized usability principles. This is what differentiates the two approaches most clearly. Options A and C are misleading; expert reviews can be informal in format, and informal reviews aren't necessarily based solely on opinion. Option D is incorrect since both informal and expert reviews can be conducted individually or in groups.

Common mistakes in usability testing include:

Ignoring critical results (ii): A significant issue if findings are not acted upon.

Scheduling the test too late (iv): This can lead to usability problems being discovered too late to be addressed effectively.

Having the wrong focus (v): For instance, focusing on aesthetics instead of usability goals.

Option i ("user is too active") is not a problem—active participation is necessary. Option iii ("no observers involved") is not a typical mistake, since tests can still be valid even with recorded sessions and later review. Hence, the correct answer is A: ii, iv & v are true.