skip to main content
10.1145/1056808.1056905acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
Article

Methods for assessing web design through the internet

Published:02 April 2005Publication History

ABSTRACT

Web design guidelines are often derived from best practices, conventional wisdom, or small-scale usability studies conducted in labs. We contend that if Web design guidelines are to inform the design of Web sites serving varied audiences with varied needs, the guidelines must be derived from empirical research that assesses users in their native environments as they interact with real Web sites. While we believe that the delivery of a remote Web-based experiment has many potential benefits, we acknowledge that it can be difficult to exercise experimental control so as to acquire reliable data, capture user behavior unobtrusively, extract meaningful information from server logs, and collect valid survey data. Therefore, we report on how we addressed some of the challenges of conducting remote empirical studies of the effect of navigational cues on Web browsing behavior.

References

  1. Barrick, J., Maust, B., Spyridakis, J.H., Eliot, M., Wei, C., Evans, M. and Mobrand, K. A. Tool for Supporting Web-Based Empirical Research: Providing a Basis for Web Design Guidelines. Proceedings of the IEEE International Professional Communication Conference, (2004), 189--193.Google ScholarGoogle ScholarCross RefCross Ref
  2. Birnbaum, M.H. Human Research and Data Collection via the Internet. Annual Review of Psychology, 55 (2004), 803--832.Google ScholarGoogle ScholarCross RefCross Ref
  3. Evans, M.B., Wei, C., Eliot, M., Barrick, J., Maust, B., and Spyridakis, J.H. The Effect of Informative, Intriguing, and Generic Hyperlink Wording on Web Browsing Behavior. Proceedings of the International Technical Communication Conference, (2004), 313--317.Google ScholarGoogle Scholar
  4. Hong, J.I., Heer, J., Waterson, S., and Landay, J.A. Web-Quilt: A Proxy-based Approach to Remote Web Usability Testing. ACM Transactions on Information Systems, 19, 3 (2001), 263--285. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Kraut, R., Olson, J., Banaji, M., Bruckman, A., Cohen, J., and Couper, M. Psychological Research Online: Report of Board of Scientific Affairs' Advisory Group on the Conduct of Research on the Internet. American Psychologist, 59, 2 (2004), 105--117.Google ScholarGoogle ScholarCross RefCross Ref
  6. Logging in W3C httpd. Available at: http://www.w3.org/Daemon/User/Config/Logging.htmlGoogle ScholarGoogle Scholar
  7. McGraw, K.O., Tew, M. D., and Williams, J.E. The Integrity of Web-delivered Experiments: Can You Trust the Data?" Psychological Science, 11, 6 (2000), 502--506.Google ScholarGoogle ScholarCross RefCross Ref
  8. Mobrand, K.A., and Spyridakis, J.H. A Web-based Study of User Performance with Enhanced Local Navigational Cues. Proceedings of the IEEE International Professional Communication Conference, (2002), 500--508.Google ScholarGoogle ScholarCross RefCross Ref
  9. Reips, U.D., and Stieger, S. Scientific LogAnalyzer: A Web-based tool for analyses of server log files in psychological research. Behavior Research Methods, Instruments and Computers, 36, 2 (2004), 304--311.Google ScholarGoogle ScholarCross RefCross Ref
  10. Schultz, L., and Spyridakis, J.H. The Effect of Heading Frequency on Comprehension of Online Information: A Study of Two Populations. Technical Communication, 51, 4, (2004), 504--518.Google ScholarGoogle Scholar
  11. Spyridakis, J.H., Wei, C., Barrick, J., Cuddihy, E., and Maust, B. Internet-based Research: Providing a Foundation for Web Design Guidelines, IEEE Transactions on Professional Communication, (In press).Google ScholarGoogle Scholar
  12. Waterson, S.J., Hong, J.I., Sohn, T., Landay, J.A., Heer, J., and Matthews, T. What Did They Do? Understanding Clickstreams with the WebQuilt Visualization System, Proceedings of the ACM International Working Conference on Advanced Visual Interfaces, (2002),Trento, Italy. ACM Press, New York. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. WebSift. Available at: http://www.cs.umn.edu/research/websiftGoogle ScholarGoogle Scholar

Index Terms

  1. Methods for assessing web design through the internet

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      CHI EA '05: CHI '05 Extended Abstracts on Human Factors in Computing Systems
      April 2005
      1358 pages
      ISBN:1595930027
      DOI:10.1145/1056808

      Copyright © 2005 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 2 April 2005

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • Article

      Acceptance Rates

      Overall Acceptance Rate6,164of23,696submissions,26%

      Upcoming Conference

      CHI '24
      CHI Conference on Human Factors in Computing Systems
      May 11 - 16, 2024
      Honolulu , HI , USA

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader