The crowd thinks aloud: crowdsourcing usability testing with the thinking aloud method
Thinking aloud (TA) is a widely employed usability testing method and allows identifying usability problems based on testers' verbalization. Conducting TA studies is laborious and expensive due to the recruiting of participants, the required workforce and facilities, and the resulting monetary...
Gespeichert in:
| Veröffentlicht in: | HCI International (23. : 2021 : Online) HCI International 2021 - late breaking papers: Design and user experience |
|---|---|
| 1. Verfasser: | |
| Weitere Verfasser: | , , |
| Pages: | 2021 - |
| Format: | UnknownFormat |
| Sprache: | eng |
| Veröffentlicht: |
2021
|
| Schlagworte: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Tag hinzufügen | Zusammenfassung: | Thinking aloud (TA) is a widely employed usability testing method and allows identifying usability problems based on testers' verbalization. Conducting TA studies is laborious and expensive due to the recruiting of participants, the required workforce and facilities, and the resulting monetary costs. Also, it is usually carried out in very controlled settings like laboratories, thereby limiting participants' diversity, test realism, and the quality of the results. Crowdsourcing, in contrast, provides access to a wide and diverse workforce at moderate costs. Hence, it might help to overcome the limitations of traditional TA. Although usability testing has been successfully crowdsourced with other methods before, there is still no evidence on the feasibility of conducting TA involving unsupervised workers as testers. Thus, we conducted a between-subjects user study using the example of an online web page, both via a traditional remote TA setup and a crowdsourcing setup with a self-developed platform. The results do not show a significant difference between both setups regarding participants' performance, and the quality and quantity of the identified usability problems. Therefore, we conclude that crowdsourcing is a feasible and cost-effective solution to conduct usability testing with the TA method, at least for selected use cases. |
|---|---|
| ISBN: | 9783030902377 |