User testing numbers

Jakob Nielsen suggests only testing 3-5 users because of the decreasing return on investment for more users.

Increase in proportion of usability problems found as a function of number of users tested

The graph from his post suggests that you find most of the errors in user interfaces with in the first few users. He suggests testing five users, then redesigning based on the feedback, then testing five more. It increases quality of data and results in a better product while keeping budget costs under control. It's a more efficient way to go.

The exception is when you have distinct user groups, in which you test 3-4 users of each distinct user group in the same fashion as noted above.

Comments

Post a Comment

Popular posts from this blog

The funnel of the introduction

The funnel shape of an introduction to a dissertation or research proposal represents a broad statement about a topic that then becomes increasingly focussed toward the final question of interest in the particular research proposal. Here is a possible funnel to my question of interest: Americans seem to have embedded in their collective conscience the image of the rugged individual rising to the top through sheer force of will and on their own merits or because of their lone genius. But current research suggests that lasting innovation and successful businesses result from effective collaboration of many people together rather than from solitary contributions of brilliant individuals. As a result, many organizations espouse a growing need for people in the modern workplace to be able to work in teams in order to innovate solutions to rapidly changing problems in myriad disciplines. Research from the last decade or so has shed new light on the attributes of group creativity an...
Read more

Literature review

I met with Dr. Gibbons to talk about some approaches to my question. He suggested some readings for me to peruse. I narrowed down my question a bit after some of my reading. I need to finalize a question, but I'm feeling more confident in the direction.
Read more

Behaviorism and "Cool Hand Luke"

In the movie "Cool Hand Luke," Paul Newman, as the title character, has a tendency toward antisocial activities. At the beginning of the movie, he is arrested and put in jail for cutting off the tops of parking meters with a pipe cutter. (An act that had no discernible motive.) Throughout the movie we see him doing a variety of things that run counter to what might be accepted as normal or expected behavior, even for a miscreant. At one point, the warden (an apparent behaviorist who is pulling out his last card) puts Luke in solitary confinement. After his time in solitary, Luke becomes a poster-boy for obedient, reformed prisoners. The warden seems to relish having tamed Luke. But, the other prisoners seem to watch him with a sense of disappointment at his subservience and at his broken spirit. That is, until Luke absconds with the water truck and escapes from the warden while the prisoners are all performing some community service. I reflected on this movie as I read about ...
Read more