Abstract
The concept of usability is complicated and fuzziness. Fuzzy theory is developed to provide comprehensive evaluation capabilities in the presence of imprecise and uncertain information. Starting with the ISO 9241 dimensions (effectiveness, efficiency and satisfaction), a fuzzy comprehensive model based on fuzzy theory for evaluating usability is proposed instead of conventional methods. The model has ability to assess user experience comprehensively with defuzzied score. Combined with data of summative usability, it can be applied to benchmark product usability, and a case study indicated the approach can quantify user experience directly and comprehensively.
Chapter PDF
Similar content being viewed by others
Keywords
References
Shackel, B.: Usability - context, framework, design and evaluation. In: Shackel, B., Richardson, S. (eds.) Human factors for informatics usability. Cambridge, pp. 21–38 (1991)
Nielsen, J.: Usability Engineering. Academic Press, San Diego (1993)
Rubin, J.: Handbook of Usability Testing: How to plan, design and conduct effective tests. John Wiley & Sons, New York (1994)
Barnum, C.M.: Usability Testing and Research. Longman Publications, New York (2002)
ISO 9241-11: Ergonomic requirements for office work with visual display terminals (VDTs) – part 11: Guidance on usability. International Organization for Standardization (1998)
ISO/IEO 9126 -1: Software engineering- product quality – part 1: Quality model. International Organization for Standardization (2001)
Lin, H.X., Choong, Y.-Y., Salvendy, G.: A Proposed Index of Usability: A Method for Comparing the Relative Usability of Different Software Systems. Behaviour & Information Technology 16, 267–278 (1997)
Kim, K.: A model of digital library information seeking process (DLISP model) as a frame for classifying usability problems. Doctoral dissertation, The State University of New Jersey. New Brunswick, New Jersey (2002)
Newman, W., Taylor, A.: Towards a methodology employing critical parameters to deliver performance improvements in interactive systems. In: Proceedings of IFIP TC.13 International Conference on Human-Computer Interaction, pp. 605–612. IOS Press, Amsterdam (1999)
Hornbæk, K.: Current practice in measuring usability: Challenges to usability studies and research. International Journal of Human-Computer Studies 64, 79–102 (2006)
Babiker, E.M., Fujihara, H., Boyle, C.D.B.: A metric for hypertext usability. In: Proc. 11th Annual International Conference on Systems documentation, pp. 95–104. ACM Press, New York (1991)
Sauro, J., Kindlund, E.: A Method to Standardize Usability Metrics Into a Single Score. In: CHI 2005, Portland, OR, pp. 401–409. ACM Press, New York (2005)
Kirakowski, J.: The Software Usability Measurement Inventory: Background and usage. In: Jordan, P., Thomas, B., Weerdmeester, B. (eds.) Usability Evaluation in Industry, pp. 169–178. Taylor and Francis, London (1996)
Chin, J.P., Diehl, V.A., Norman, K.L.: Development of an instrument measuring user satisfaction of the human-computer interface. In: Proceedings of SIGCHI 1988. ACM/SIGCHI, New York pp. 213–218 (1988)
Harper, B.D., Norman, K.L.: Improving User Satisfaction: The Questionnaire for User Interaction Satisfaction Version 5.5. In: Proceedings of the 1st Annual Mid-Atlantic Human Factors Conference. Virginia Beach, VA, pp. 224–228 (1993)
Lewis, J.R.: IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use. International Journal of Human–Computer Interaction 7, 57–78 (1995)
Lewis, J.R.: Psychometric evaluation of the PSSUQ using data from five years of usability studies. International Journal of Human-Computer Interaction 14, 463–488 (2002)
Ryu, Y.S.: Development of Usability Questionnaires for Electronic Mobile Products and Decision Making Methods. Doctoral dissertation, Virginia Polytechnic Institute and State University. Blacksburg, Virginia (2005)
Liang, Z., Yang, K., Sun, Y., Yuan, J., Zhang, H., Zhang, Z.: Decision support for choice optimal power generation projects: Fuzzy comprehensive evaluation model based on the electricity market. Energy Policy 34, 3359–3364 (2006)
Lan, H., Ding, Y., Hong, J.: Decision support system for rapid prototyping process selection through integration of fuzzy synthetic evaluation and an expert system. International Journal of Production Research 43, 169–194 (2005)
Saaty, T.L.: The analytic hierarchy process. McGraw Hill, New York (1980)
Hsiao, S-W., Chou, J-R.: A Gestalt-like perceptual measure for home page design using a fuzzy entropy approach. International Journal of Human-Computer Studies 64, 137–156 (2006)
Park, K.S., Lim, C.H.: A structured methodology for comparative evaluation of user interface designs using usability criteria and measures. International Journal of Industrial Ergonomics 23, 379–389 (1999)
Vredenburg, K., Isensee, S., Righi, C.: User-Centered Design: An Integrated Approach. Prentice Hall, New Jersey (2001)
Kuo, Y.-F., Chen, L.-S.: Using the fuzzy synthetic decision approach to assess the performance of university teachers in Taiwan. International journal of management 19, 593–604 (2002)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhou, R. (2007). How to Quantify User Experience: Fuzzy Comprehensive Evaluation Model Based on Summative Usability Testing. In: Aykin, N. (eds) Usability and Internationalization. Global and Local User Interfaces. UI-HCII 2007. Lecture Notes in Computer Science, vol 4560. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73289-1_65
Download citation
DOI: https://doi.org/10.1007/978-3-540-73289-1_65
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73288-4
Online ISBN: 978-3-540-73289-1
eBook Packages: Computer ScienceComputer Science (R0)