skip to main content
research-article

Modeling web quality using a probabilistic approach: An empirical validation

Published:20 July 2010Publication History
Skip Abstract Section

Abstract

Web-based applications are software systems that continuously evolve to meet users' needs and to adapt to new technologies. Assuring their quality is then a difficult, but essential task. In fact, a large number of factors can affect their quality. Considering these factors and their interaction involves managing uncertainty and subjectivity inherent to this kind of applications. In this article, we present a probabilistic approach for building Web quality models and the associated assessment method. The proposed approach is based on Bayesian Networks. A model is built following a four-step process consisting in collecting quality characteristics, refining them, building a model structure, and deriving the model parameters.

The feasibility of the approach is illustrated on the important quality characteristic of Navigability design. To validate the produced model, we conducted an experimental study with 20 subjects and 40 web pages. The results obtained show that the scores given by the used model are strongly correlated with navigability as perceived and experienced by the users.

References

  1. Albuquerque, A. B. and Belchior, A. D. 2002. E-commerce Websites: A qualitative evaluation. In Proceedings of the 11th International World Wide Web Conference.Google ScholarGoogle Scholar
  2. Basili, V. R., Caldiera, G., and Rombach, H. D. 1994. The goal question metric approach. In The Encyclopedia of Software Engineering. Volume 1, John Wiley & Sons, 469--476.Google ScholarGoogle Scholar
  3. Boldyreff, C., Warren, P., Gaskell, C., and Marshall, A. 2000. WEB-SEM project: Establishing effective Web site evaluation metrics. In Proceedings of the 2nd International Workshop on Web Site Evolution. Scott Tilley, Ed. 17--20.Google ScholarGoogle Scholar
  4. Brajnik, G. 2001. Towards valid quality models for Websites. In Proceedings of the 7th Conference on Human Factors and the Web.Google ScholarGoogle Scholar
  5. Cachero, C., Meliá, S., Genero, M., Poels, G., and Calero, C. 2007. Towards improving the navigability of Web applications: A model-driven approach. Eur. J. Inform. Syst. 16, 4, 420--447.Google ScholarGoogle ScholarCross RefCross Ref
  6. Caro, A., Calero, C., De Salamanca, J., E., and Piattini, M. 2007. Refinement of a tool to assess the data quality in Web portals. In Proceedings of the 7th International Conference on Quality Software. 238--243. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Charland, F., Badri, L., and Malak, G. 2007. WebQuality: Towards a tool supporting the assessment of Web-based applications quality. In Proceedings of the 20th International Conference on Computer Applications in Industry and Engineering.Google ScholarGoogle Scholar
  8. Cook, T. D. and Campbell, D. T. 1979. Quasi-Experimentation—Design and Analysis Issues for Field Settings, Houghton Mifflin Company, Boston, MA.Google ScholarGoogle Scholar
  9. Dalton, S. 1996. A workbench to support development and maintenance of World-Wide Web documents. MSc. Thesis. Department of Computer Science, University of Durham, Durham, UK.Google ScholarGoogle Scholar
  10. Deleuze, C. 2006. Some points affecting web performance. Comput. Netw. 50, 10, 1533--1546.Google ScholarGoogle Scholar
  11. Deshpande, Y., Murugesan, S., Ginige, A., Hansen, S., Schwabe, D., Gaedke, M., and White, B. 2002. Web Engineering. Web Engin. 1, 1, 003--017. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Differding, C., Joisl, B., and Lott, C. M. 1996. Technology package for the goal question metric paradigm, Tech. rep. 281/96, University of Kaiserslautern, Germany.Google ScholarGoogle Scholar
  13. Dubois, D. and Prade, H. 1993. Fuzzy sets and probability: Misunderstanding, bridges and gaps. In Proceedings of the 2nd IEEE International Conference on Fuzzy Systems. Vol. 2, 1059--1068.Google ScholarGoogle Scholar
  14. Fenton, N. E. and Pfleeger, S. L. 1996. Software Metrics: A Rigorous and Practical Approach, 2nd Ed., International Thomson Computer Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Ganesh, J. P. 2007. Probabilistic software quality analysis, Doctoral thesis, University of Virginia, Charlottesville, VA.Google ScholarGoogle Scholar
  16. Guillemot, M. and König, D. 2006. Web testing made easy. In Proceedings of the Dynamic Languages Symposium Companion to the 21st ACM SIGPLAN conference on Object-Oriented Programming Systems, Languages, and Applications. 692--693. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. HHS (U.S. Department of Health and Human Services). 2006. Research-Based Web Design & Usability Guidelines. U.S. Government Printing Office, Internet World Stats. 2008. http://www.internetworldstats.com/stats.htm on May 2008.Google ScholarGoogle Scholar
  18. ISO/IEC 9126-1. 2001. Software Engineering—Product Quality—Part 1: Quality Model, International Organization for Standardization.Google ScholarGoogle Scholar
  19. Ivory, M. Y. 2001. An empirical foundation for automated Web interface evaluation, Doctoral dissertation, Computer Science Department, University of California, Berkeley, CA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Keevil, B. 1998. Measuring the usability index of your Website. In Proceedings of the 16th ACM Annual International Conference on Computer Documentation: Scaling the Heights: the Future of Information Technology (SIGDOC). 271--277. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Kirakowski, J. and Cierlik, B. 1998. Measuring the usability of Web sites. In Proceedings of the Human Factors and Ergonomic Society 42nd Annual Meeting. Vol. 1, 424--428.Google ScholarGoogle Scholar
  22. Lee, Y. and Kozar, K. A. 2006. Investigating the effect of website quality on e-business success: an analytic hierarchy process (AHP) approach. Decision Support Syst. 42, 3, 1383--1401. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Malak, G., Sahraoui, H., Badri, L., and Badri, M. 2006. Modeling Web-based applications quality: Towards a framework using Bayesian networks. In Proceedings of the 7th International Conference on Web Information Systems Engineering. 398--404. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Mavromoustakos, S. and Andreou, A. S. 2007. WAQE: a Web Application Quality Evaluation model. Int. J. Web Engin. Technol. 3, 1, 96--120. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Mich, L., Franch, M., and Gaio, L. 2003. Evaluating and designing Web site quality. IEEE Multimedia 10, 1, 34--43. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Moses, J. 2007. Benchmarking quality measurement. Softw. Qual. Cont. 15, 4, 449--462. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Neapolitan, R. E. 2003. Learning Bayesian Networks, Prentice Hall Series in Artificial Intelligence. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Neil, M., Fenton, N. E., and Nielsen, L. 2000. Building large-scale Bayesian networks. Knowl. Engin. Rev. 15, 3, 257--284. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Newman, M. W. and Landay, J. A. 2000. Sitemaps, storyboards, and specifications: A sketch of Web site design practice as manifested through artifacts. In Proceedings of the 3rd Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques. 263--274. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Nielsen, J. 2000. Designing Web Usability: The Practice of Simplicity, New Riders Publishing. Indianapolis, IN. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Nielsen, J. and Loranger, H. 2006. Prioritizing Web Usability, New Riders Press Publishing, 1st ed. Indianapolis, IN. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Nogier, J. F. 2005. Ergonomie du logiciel et design Web: Le manuel des interfaces utilisateur. 3rd Ed. Editions Dunod, Paris, France.Google ScholarGoogle Scholar
  33. Offut, J. 2002. Quality Attributes of Web Software Applications. IEEE Soft. 25--32. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Olsina, L., Lafuente, G., and Rossi, G. 2001. Specifying quality characteristics and attributes for Web sites. In Web Engineering, Software Engineering and Web Application Development. Lecture Notes in Computer Science, vol. 2016, Springer-Verlag. 266--278. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Olsina, L. and Rossi, G. 2002. Measuring Web application quality with WebQEM. IEEE MultiMedia 9, 4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Olsina, L., Papa, F., and Molina, H. 2007. How to measure and evaluate Web applications in a consistent way. In Web Engineering: Modelling and Implementing Web Applications, Springer, 385--420.Google ScholarGoogle Scholar
  37. Opquast. 2004. Quality best practices for online services. http://en.opquast.com/bonnes-pratiques.Google ScholarGoogle Scholar
  38. Ruiz, J., Calero, C., and Piattini, M. 2003. A three dimensional Web quality model. In Proceedings of the International Conference on Web Engineering. 384--385. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Saba, H., de Freitas Jorge, E. M., Costa, V. F., and de Barros Pereira, H. B. 2006. WEBTESTE: A stress test tool. In Proceedings of the 2nd International Conference on Web Information Systems and Technologies: Internet Technology/Web Interface and Applications. INSTICC Press, 246--249.Google ScholarGoogle Scholar
  40. Sahraoui, H., Boukadoum, M., Chawiche, H. M., Mai, G., and Serhani, M. A. 2002. A fuzzy logic framework to improve the performance and interpretation of rule-based quality prediction models for object-oriented software. In Proceedings of the 26th Computer Software and Applications Conference. 131--138. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Seffah, A., Donyaee, M., R. Kline, B., and Padda, H. K. 2006. Usability measurement and metrics: A consolidated model. Softw. Qual. J. 14, 2, 159--178. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Shubert, P. and Dettling W. 2002. Extended Web Assessment Method (EWAM)—Evaluation of electronic commerce applications from the customer's viewpoint. In Proceedings of the 35th Hawaii International Conference on System Sciences. Vol. 7, 175b. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Stefani, A. and Xenos, M. 2008. E-commerce system quality assessment using a model based on ISO 9126 and belief networks. Softw. Qual. Contr. 16, 1, 107--129. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Trauwaert, E. 1988. On the meaning of Dunn's partition coefficient for fuzzy clusters. Fuzzy Sets Syst. 25, 2, 217--242. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Wohlin, C., Runeson, P., Host, M., Ohlsson, M. C., Regnell, B., and Wesslén, A. 2000. Experimentation in Software Engineering: an Introduction. Kluwer Academic Publishers, Norwell, MA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Zhang, Y., Zhu, H., and Greenwood, S. 2004. Website complexity metrics for measuring navigability. In Proceedings of the 4th International Conference on Quality Software. 172--179. Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Zhou, Y., Leung, H., and Winoto, P. 2007. MNav: A Markov model-based Web site navigability measure. IEEE Trans. Softw. Engin. 33, 12, 869--890. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Modeling web quality using a probabilistic approach: An empirical validation

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image ACM Transactions on the Web
      ACM Transactions on the Web  Volume 4, Issue 3
      July 2010
      166 pages
      ISSN:1559-1131
      EISSN:1559-114X
      DOI:10.1145/1806916
      Issue’s Table of Contents

      Copyright © 2010 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 20 July 2010
      • Accepted: 1 February 2010
      • Revised: 1 November 2009
      • Received: 1 April 2009
      Published in tweb Volume 4, Issue 3

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    ePub

    View this article in ePub.

    View ePub