Abstract
Website evaluation methods are an important tool to gather information for the development and the management of a website in order to ensure a good acceptance by the users. Mainly based on detailed questionnaires administered to actual or potential users, this activity can be costly and time consuming. This paper present methods, based on the statistical bootstrapping techniques, to derive confidence intervals for the evaluations produced by a certain sample of users. It is shown that relatively small (less than 10%) confidence intervals can be achieved even with small sample sizes (less than 20).
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
References
Anderson, A. J., & Vingrys, A. J. (2001). Small Samples: Does Size Matter? Investigative Ophthalmology & Visual Science, 42(7), 1411–1413.
Andrews, D. W. K., & Buchinsky, M. (2000). A Three-Step Method for Choosing the Number of Bootstrap Repetitions. Econometrica, 68, 23–51.
Antonioli Corigliano, M., & Baggio, R. (2004). Italian Tourism on the Internet-New Business Models. In Weiermair, K., Mathies, C. (Eds.), The Tourism and Leisure Industry-Shaping the Future (pp. 301–316). New York: The Haworth Press.
Antonioli Corigliano, M., & Baggio, R. (Eds.) (2002). Internet e Turismo. Milano: Egea.
Baggio, R. (2005). The Relationship Between Virtual and Real Image of Tourism Operators. eReview of Tourism Research, 3(5), http://ertr.tamu.edu.
Buhalis, D. (2003). eTourism: Information technology for strategic tourism management. Harlow, UK: Pearson/Prentice Hall.
Cochran, W. G. (1977). Sampling Techniques (3rd ed.). New York: John Wiley & Sons.
Efron, B. (1979). Bootstrap methods: Another look at the jackknife. The Annals of Statistics, 7, 1–26.
Efron, B., & Tibshirani, R. J. (1993). An introduction to the bootstrap. New York: Chapman & Hall.
Faulkner, L. (2003). Beyond the five-user assumption: Benefits of increased sample sizes in usability testing. Behavior Research Methods, Instruments and Computers, 35(3), 379–383.
Fesenmaier, D. R., Gretzel, U., Hwang, Y., & Y. Wang (2003). The future of destination marketing: e-Commerce in travel and tourism. International Journal of Tourism Sciences, 3(2), 191–200.
Gehrels, N. (1986). Confidence limits for small numbers of events in astrophysical data. Astrophysical Journal, 303, 336–346.
Gray, W. D., & Salzman, M. C. (1998a). Damaged merchandise? A review of experiments that compare usability evaluation methods. Human-Computer Interaction, 13(3), 203–261.
Gray, W. D., & Salzman, M. C. (1998b). Repairing damaged merchandise: A rejoinder. Human-Computer Interaction, 13(3), 325–335.
Hahn, J., & Kauffman, R. J. (2002). Measuring and Comparing the Effectiveness of E-Commerce Website Design”, 14th Workshop on Information Systems and Economics (WISE), IESE Business School, University of Navarra, Barcelona, Spain, Dec 14–15. (Working Paper: http://www.jungpil.net/research.html, last access: September 2005).
Holland, J., & Menzel Baker, S. (2001). Creating Site Brand Loyalty. Journal of Interactive Marketing, 5(4), 34–45.
Jeng J., & Fesenmaier, D.R. (2002). Conceptualizing the Travel Decision-Making Hierarchy: A Review of Recent Developments. Tourism Analysis, 1(1), 15–32.
Karoulis, A., & Pombortsis, A. (2004). The Heuristic Evaluation of Web-Sites Concerning the Evaluators’ Expertise and the Appropriate Criteria List. Informatics in Education, 3(1), 55–74.
Mak, T. K. (2004). Estimating variances for all sample sizes by the bootstrap. Computational Statistics & Data Analysis, 46, 459–467.
Matlab® (2002), Version 6.5, Release 13, June 2002, Natick, MA: The Math Works Inc.
Morrison, A. M., Taylor, J. S., & Douglas, A. (2004). Website Evaluation in Tourism and Hospitality: The Art Is Not Yet Stated. Journal of Travel & Tourism Marketing, 17(2/3), 233–251.
Nielsen, J. (1994). Heuristic Evaluation. In Nielsen & Mack (Eds.), Usability Inspection Methods (pp. 25–62). New York: John Wiley & Sons.
Nielsen, J., & Molich, R. (1990). Heuristic Evaluation of User Interfaces. Proceedings of CHI Conference on Human Factors in Computing Systems (pp. 249–256). New York: ACM.
PhoCusWright (2005). Online Travel Overview: Market Size and Forecasts 2004–2006. Sherman, CT: PhoCusWright.
Rajgopal, S., Venkatachalam, M., & Kotha, S. (2001). Does the Quality of Online Customer Experience Create a Sustainable Competitive Advantage for E-commerce Firms? GSB research paper series #1666, Stanford University Graduate School of Business.
Regener, V. H. (1951). Statistical Significance of Small Samples of Cosmic Ray Counts. Physical Review, 84, 161–162.
Shao, J., & Tu, D. (1995). The Jackknife and Bootstrap. New York: Springer-Verlag.
UNITN (2005). Extended bibliography related to Website Quality Evaluation and Bibliography related to Tourism Website Quality Evaluation. Last updated: 1 September 2005. Online: http://www.economia.unitn.it/etourism/risorseQualita.asp, last access: September 2005.
Virzi, R. A. (1992). Refining the test phase of usability evaluation: How many subjects is enough? Human Factors, 34(4), 457–468.
Woolrych, A., & Cockton, G. (2001). Why and when five test users aren’t enough. In J. Vanderdonckt, A. Blandford, & A. Derycke (Eds.), Proceedings of IHM-HCI 2001 Conference (Vol. 2, pp. 105–108). Toulouse (F): Cépadèus.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Wien
About this paper
Cite this paper
Corigliano, M.A., Baggio, R. (2006). On the Significance of Tourism Website Evaluations. In: Hitz, M., Sigala, M., Murphy, J. (eds) Information and Communication Technologies in Tourism 2006. Springer, Vienna. https://doi.org/10.1007/3-211-32710-X_43
Download citation
DOI: https://doi.org/10.1007/3-211-32710-X_43
Publisher Name: Springer, Vienna
Print ISBN: 978-3-211-30987-2
Online ISBN: 978-3-211-32710-4