Skip to main content
SpringerLink
Log in

A Systematic Review of Usability Evaluation in Web Development

  • Conference paper
Book cover Web Information Systems Engineering – WISE 2008 Workshops (WISE 2008)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 5176))

Included in the following conference series:

Abstract

The challenge of developing more usable Web applications has motivated the appearance of a number of techniques, methods and tools to address Web usability issues. Although there are many proposals for supporting the development of usable Web applications, many developers are not aware of them and many organizations do not properly apply them. This paper reports on a systematic review of the use of usability evaluation methods in Web development. The objective of the review is to investigate what usability evaluation methods have been employed by researchers to evaluate Web artifacts and how they were employed. A total of 51 research papers have been reviewed from an initial set of 410 papers. The results show that 45% of the papers reviewed reported the use of evaluation methods specifically crafted for the Web and that the most employed method is user testing. In addition, the results of the review have identified several research gaps. Specifically, 80% of the evaluations are still performed at the implementation phase of Web applications development and 47% of the papers did not present any validation of the usability evaluation method(s) employed.

This work is funded by the META project (TIN2006-15175-C05-05), the Quality-driven model transformations project (UPV), and the CALIPSO research network (TIN2005-24055-E).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Alva, O.M.E., Martínez Prieto, A.B., Cueva Lovelle, J.M., Sagástegui Ch., T.H., López, B.: Comparison of Methods and Existing Tools for the Measurement of Usability in the Web. In: Proc. Int. Conf. on Web Engineering, Spain, pp. 386–389. Springer, Heidelberg (2003)

    Google Scholar 

  2. Baresi, L., Fraternali, P., Houben, G.-J. (eds.): ICWE 2007. LNCS, vol. 4607. Springer, Heidelberg (2007)

    Google Scholar 

  3. Batra, S., Bishu, R.R.: Web Usability and Evaluation: Issues and Concerns. In: Aykin, N. (ed.) HCII 2007. LNCS, vol. 4559, pp. 243–249. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  4. Becker, S.A., Berkemeyer, A.: Rapid Application Design and Testing of Web Usability. IEEE Multimedia 9(4), 38–46 (2002)

    Article  Google Scholar 

  5. Blackmon, M.H., Polson, P.G., Kitajima, M., Lewis, C.: Cognitive walkthrough for the web. In: Proc. of the CHI 2002, Minneapolis, Minnesota, USA, pp. 463–470 (2002)

    Google Scholar 

  6. Bolchini, D., Garzotto, F.: Quality of Web Usability Evaluation Methods: An Empirical Study on MiLE+. In: Proc. of the IWWUA 2007, Nancy, France, pp. 481–492 (2007)

    Google Scholar 

  7. Feldman, S.I., Uretsky, M., Najork, M., Wills, C.E.: Proc. of the International Conference on World Wide Web 2004, pp. 17–20. ACM, New York (2004)

    Google Scholar 

  8. Fenton, N., Pfleeger, S.L.: Software Metrics: A Rigorous and Practical Approach, 2nd edn. International Thomson Computer Press (1996)

    Google Scholar 

  9. Freire, A.P., Goularte, R., Fortes, R.P.M.: Techniques for Developing more Accessible Applications: a Survey Towards a Process Classifications. In: Proc. of the 25th ACM Int. Conference on Design of communication, El Paso, Texas, USA, pp. 162–169 (2007)

    Google Scholar 

  10. Hornbæk, K., Frøkjær, E.: Comparing Usability Problems and Redesign Proposals as Input to Practical Systems Development. In: Proc. of the CHI 2005, Portland, USA, pp. 391–400 (2005)

    Google Scholar 

  11. Hornbæk, K., Frøkjær, E.: Two psychology-based usability inspection techniques studied in a diary experiment. In: Proc. of the 3rd Nordic conference on Human-computer interaction (NordCHI 2004), Tampere, Finland, pp. 3–12 (2004)

    Google Scholar 

  12. ISO – International Standard Organization, ISO 9241-11: Ergonomic requirements for office work with visual display terminals (VDTs) – Part 11: Guidance on usability (1998)

    Google Scholar 

  13. ISO – International Standard Organization, ISO/IEC 12207: Standard for Information Technology – Software Lifecycle Processes (1998)

    Google Scholar 

  14. Kitchenham, B.: Guidelines for Performing Systematic Literature Reviews in Software Engineering. Version 2.3, EBSE Technical Report, Keele University, UK

    Google Scholar 

  15. Koch, N., Fraternali, P., Wirsing, M. (eds.): ICWE 2004. LNCS, vol. 3140. Springer, Heidelberg (2004)

    Google Scholar 

  16. Cueva Lovelle, J.M., Rodríguez, B.M.G., Gayo, J.E.L., Ruiz, M.d.P.P., Aguilar, L.J. (eds.): ICWE 2003. LNCS, vol. 2722. Springer, Heidelberg (2003)

    MATH  Google Scholar 

  17. Lowe, D.G., Gaedke, M. (eds.): ICWE 2005. LNCS, vol. 3579. Springer, Heidelberg (2005)

    Google Scholar 

  18. Matera, M., Rizzo, F., Carughi, G.T.: Web Usability: Principles and Evaluation Methods. In: Mendes, E., Mosley, N. (eds.) Web Engineering, pp. 143–179.

    Google Scholar 

  19. Mendes, E.: A Systematic Review of Web Engineering Research. In: Proc. of the International Symposium on Empirical Software Engineering (ISESE 2005), pp. 498–507 (2005)

    Google Scholar 

  20. Mendes, E., Mosley, N. (eds.): Web Engineering. Springer, Heidelberg (2005)

    Google Scholar 

  21. Neuwirth, C.M., Regli, S.H.: IEEE Internet Computing Special Issue on Usability and the Web. IEEE Internet Computing Special Issue on Usability and the Web 6(2) (March/April 2002)

    Google Scholar 

  22. Sutcliffe, A.: Assessing the Reliability of Heuristic Evaluation for Website Attractiveness and Usability. In: Proc. of the HICSS 2002, vol. 5, pp. 137–141.

    Google Scholar 

  23. Yvory, M., Hearst, M.: The State of the Art in Automating Usability Evaluation of User Interfaces. ACM Computing Surveys 33(4), 470–516 (2001)

    Article  Google Scholar 

  24. Weske, M., Hacid, M.S., Godart, C. (eds.): Web Information Systems Engineering - WISE 2007 Workshops Proceedings, Nancy, France, December 3, 2007. LNCS, vol. 4832. Springer, Heidelberg (2007)

    Google Scholar 

  25. Wolber, D., Calder, N., Brooks, C.H., Ginige, A. (eds.): Proc. of the 6th International Conference on Web Engineering 2006, alo Alto-CA, USA, July 11-14. ACM, New York (2006)

    Google Scholar 

  26. WWW 2003, Proc. of the Twelfth International World Wide Web Conference 2003, Budapest, Hungary, May 20-24, 2003. ACM, New York (2003), http://www2003.org

  27. : WWW 2007, Proc. of the Twelfth International World Wide Web Conference, Banff, Alberta, Canada, May 8-12, 2007. ACM, New York (2007), http://www2007.org

Download references

Author information

Authors and Affiliations

  1. ISSI Group, Department of Information Systems and Computation, Universidad Politécnica de Valencia, Camino de Vera, s/n, 46022, Valencia, Spain

    Emilio Insfran & Adrian Fernandez

Authors
  1. Emilio Insfran
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Adrian Fernandez
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Sven Hartmann Xiaofang Zhou Markus Kirchberg

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Insfran, E., Fernandez, A. (2008). A Systematic Review of Usability Evaluation in Web Development. In: Hartmann, S., Zhou, X., Kirchberg, M. (eds) Web Information Systems Engineering – WISE 2008 Workshops. WISE 2008. Lecture Notes in Computer Science, vol 5176. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85200-1_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-85200-1_10

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-85199-8

  • Online ISBN: 978-3-540-85200-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation