Quantifying the User Experience
Practical Statistics for User ResearchBy
- Jeff Sauro
- James Lewis
You're being asked to quantify usability improvements with statistics. But even with a background in statistics, you are hesitant to statistically analyze the data, as you may be unsure about which statistical tests to use and have trouble defending the use of the small test sample sizes associated with usability studies.
The book is about providing a practical guide on how to use statistics to solve common quantitative problems arising in user research. It addresses common questions you face every day such as: Is the current product more usable than our competition? Can we be sure at least 70% of users can complete the task on the 1st attempt? How long will it take users to purchase products on the website? This book shows you which test to use, and how provide a foundation for both the statistical theory and best practices in applying them. The authors draw on decades of statistical literature from Human Factors, Industrial Engineering and Psychology, as well as their own published research to provide the best solutions. They provide both concrete solutions (excel formula, links to their own web-calculators) along with an engaging discussion about the statistical reasons for why the tests work, and how to effectively communicate the results.
Usability and user experience practitioners, software and web-development professionals, marketers, information architects, interaction designers, business analysts, market researchers, and students in these and related fields
Paperback, 312 Pages
Published: March 2012
Imprint: Morgan Kaufmann
"Quantifying the User Experience will make a terrific textbook for any series of UX research courses I highly recommend this book to anyone who wants to integrate quantitative data into their UX practice."--Technical Communication, May 2013 " as a whole, it provides a pragmatic approach to quantifying UX, without oversimplifying or claiming too much. It delivers what it promises. This book is valuable for both practitioners and students, in virtually any discipline. It can help psychologists transfer their statistical knowledge to UX practice, practitioners quickly assess their envisioned design and analysis, engineers demystify UX, and students appreciate UXs merits."--ComputingReviews.com, March 19, 2013
"The most unique contributions of this book are the logic and practicality used to describe the appropriate application of those measures Sauro and Lewis strike a perfect balance between the complexity of statistical theory and the simplicity of applying statistics practically. Whether you wish to delve deeper into the enduring controversies in statistics, or simply wish to understand the difference between a t-test and Chi-square, you will find your answer in this book. Quantifying the User Experience is an invaluable resource for those who are conducting user research in industry."--
User Experience, Vol. 13, Issue 1, 1st Quarter
"Written in a conversational style for those who measure behavior and attitudes of people as they interact with technology interfaces, this guide walks readers through common questions and problems encountered when conducting, analyzing, and reporting on user research projects using statistics, such as problems related to estimates and confidence intervals, sample sizes, and standardized usability questionnaires. For readers with varied backgrounds in statistics, the book includes discussion of concepts as necessary and gives examples from real user research studies. The book begins with a background chapter overviewing common ways to quantify user research and a review of fundamental statistical concepts. The material provides enough detail in its formulas and examples to let readers do all computations in Excel, and a website offers an Excel calculator for purchase created by the authors, which performs all the computations covered in the book. An appendix offers a crash course on fundamental statistical concepts."--Reference and Research Book News, August 2012, page 186-7
About the Authors
Chapter 1: Introduction and How to Use This Book
Chapter 2: Quantifying User Research
Chapter 3: How Precise Are Our Estimates? Confidence Intervals
Chapter 4: Did We Meet or Exceed Our Goal?
Chapter 5: Is There a Statistical Difference between Designs?
Chapter 6: What Sample Sizes Do We Need? Part 1: Summative Studies
Chapter 7: What Sample Sizes Do We Need? Part 2: Formative Studies
Chapter 8: Standard Usability Questionnaires
Chapter 9: Six Enduring Controversies in Measurement and Statistics
Chapter 10: Wrapping Up