skip to main content
10.1145/2461121.2461133acmotherconferencesArticle/Chapter ViewAbstractPublication Pagesw4aConference Proceedingsconference-collections
research-article

Understanding users in the wild

Published: 13 May 2013 Publication History

Abstract

Laboratory studies are a well established practice that present disadvantages in terms of data collection. One of these disadvantages is that laboratories are controlled environments that do not account for unpredicted factors from the real world. Laboratory studies are also obtrusive and therefore possibly biased. The Human-Computer Interaction (HCI) community has acknowledged these problems and has started exploring in-situ observation techniques. These observation techniques allow for bigger participant pools and their environments can conform to the real world. Such real-world observations are particularly important to the accessibility community who has coined the concept accessibility-in-use to differentiate real world from laboratory studies. Real-world observations provide low-level interaction data therefore making a bottom-up analysis possible. This way behaviours emerge from the obtained data instead of looking for predefined models. Some in-situ techniques employ Web logs in which the data is too coarse to infer meaningful user interaction. In some other cases an exhaustive manual modification is required to capture interaction data from a Web application. We describe a tool which is easily deployable in any Web application and captures longitudinal interaction data unobtrusively. It enables the observation of accessibility-in-use and guides the detection of emerging tasks.

References

[1]
R. Atterer, M. Wnuk, and A. Schmidt. Knowing the user's every move: user activity tracking for website usability evaluation and implicit interaction. In Proceedings of the 15th international conference on World Wide Web, WWW '06, pages 203--212, 2006.
[2]
J. P. Bigham, A. C. Cavender, J. T. Brudvik, J. O. Wobbrock, and R. E. Lander. WebinSitu: a comparative analysis of blind and sighted browsing behavior. In Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility, Assets '07, pages 51--58, 2007.
[3]
S. K. Card, T. P. Moran, and A. Newell. The keystroke-level model for user performance time with interactive systems. Commun. ACM, 23(7):396--410, July 1980.
[4]
T. Carta, F. Paternò, and V. Santana. Support for remote usability evaluation of web mobile applications. In Proceedings of the 29th ACM international conference on Design of communication, SIGDOC '11, pages 129--136, 2011.
[5]
J. Cugini and J. Scholtz. VISVIP: 3D visualization of paths through web sites. In Database and Expert Systems Applications, 1999. Proceedings. Tenth International Workshop on, pages 259--263, 1999.
[6]
Q. Guo, E. Agichtein, C. L. A. Clarke, and A. Ashkan. In the mood to click? towards inferring receptiveness to search advertising. In Proceedings of the 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology - Volume 01, WI-IAT '09, pages 319--324, 2009.
[7]
C. Jay, A. Brown, and S. Harper. Predicting whether users view dynamically updating content on the world wide web. ACM Transactions on Computer-Human Interaction, To appear, 2013.
[8]
B. E. John, K. Prevas, D. D. Salvucci, and K. Koedinger. Predictive human performance modeling made easy. In Proceedings of the SIGCHI conference on Human factors in computing systems, CHI '04, pages 455--462, 2004.
[9]
J. H. Kim, D. V. Gunn, E. Schuh, B. Phillips, R. J. Pagulayan, and D. Wixon. Tracking real-time user experience (TRUE): a comprehensive instrumentation solution for complex systems. In Proceedings of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, CHI '08, pages 443--452, 2008.
[10]
K. Radinsky, K. Svore, S. Dumais, J. Teevan, A. Bocharov, and E. Horvitz. Modeling and predicting behavioral dynamics on the web. In Proceedings of the 21st international conference on World Wide Web, WWW '12, pages 599--608, 2012.
[11]
C. Tossell, P. Kortum, A. Rahmati, C. Shepard, and L. Zhong. Characterizing web use on smartphones. In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems, CHI '12, pages 2769--2778, 2012.
[12]
A. Vargas, H. Weffers, and H. V. da Rocha. A method for remote and semi-automatic usability evaluation of web-based applications through users behavior analysis. In Proceedings of the 7th International Conference on Methods and Techniques in Behavioral Research, MB '10, pages 19:1--19:5, 2010.
[13]
M. Vigo and G. Brajnik. Automatic web accessibility metrics: Where we are and where we can go. Interacting with Computers, 23(2):137--155, 2011.
[14]
M. Vigo and S. Harper. Evaluating accessibility-in-use. In Proceedings of the 2013 International Cross Disciplinary Conference on Web Accessibility (W4A), W4A '13, 2013.

Cited By

View all
  • (2024)“Watching over the shoulder of a professional”: Why Hackers Make Mistakes and How They Fix Them2024 IEEE Symposium on Security and Privacy (SP)10.1109/SP54263.2024.00202(350-368)Online publication date: 19-May-2024
  • (2023)Exploring Natural Language Processing Methods for Interactive Behaviour ModellingHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42286-7_1(3-26)Online publication date: 25-Aug-2023
  • (2022)Assisted pattern mining for discovering interactive behaviours on the webInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2019.06.012130:C(196-208)Online publication date: 20-Apr-2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
W4A '13: Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility
May 2013
209 pages
ISBN:9781450318440
DOI:10.1145/2461121
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

  • Web4All Conference

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 May 2013

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. accessibility
  2. ergonomics
  3. usage mining
  4. user behaviour analysis
  5. user issues
  6. web

Qualifiers

  • Research-article

Conference

W4A '13
Sponsor:

Acceptance Rates

W4A '13 Paper Acceptance Rate 7 of 20 submissions, 35%;
Overall Acceptance Rate 171 of 371 submissions, 46%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)13
  • Downloads (Last 6 weeks)2
Reflects downloads up to 07 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2024)“Watching over the shoulder of a professional”: Why Hackers Make Mistakes and How They Fix Them2024 IEEE Symposium on Security and Privacy (SP)10.1109/SP54263.2024.00202(350-368)Online publication date: 19-May-2024
  • (2023)Exploring Natural Language Processing Methods for Interactive Behaviour ModellingHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42286-7_1(3-26)Online publication date: 25-Aug-2023
  • (2022)Assisted pattern mining for discovering interactive behaviours on the webInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2019.06.012130:C(196-208)Online publication date: 20-Apr-2022
  • (2021)MOVING: A User-Centric Platform for Online Literacy Training and Learninge-Science10.1007/978-3-030-66262-2_6(77-97)Online publication date: 20-Mar-2021
  • (2020)Web Accessibility Assessment Through Multi-Agent Support for Visually-Impaired UsersInternational Journal of Cooperative Information Systems10.1142/S0218843020500057Online publication date: 27-Jul-2020
  • (2020)Mobile App Usage Patterns Aware Smart Data PricingIEEE Journal on Selected Areas in Communications10.1109/JSAC.2020.297189638:4(645-654)Online publication date: Apr-2020
  • (2020)Longitudinal Study of Two Virtual Cursors for People With Motor Impairments: A Performance and Satisfaction Analysis on Web NavigationIEEE Access10.1109/ACCESS.2020.30017668(110381-110396)Online publication date: 2020
  • (2020)An approach to support the construction of adaptive Web applicationsInternational Journal of Web Information Systems10.1108/IJWIS-12-2018-0089ahead-of-print:ahead-of-printOnline publication date: 26-Feb-2020
  • (2019)Evidencing How Experience and Problem Format Affect Probabilistic Reasoning Through Interaction AnalysisFrontiers in Psychology10.3389/fpsyg.2019.0154810Online publication date: 4-Jul-2019
  • (2019)Recommendations for Developing Support Tools With People Suffering From Chronic Obstructive Pulmonary Disease: Co-Design and Pilot Testing of a Mobile Health Prototype (Preprint)JMIR Human Factors10.2196/16289Online publication date: 17-Sep-2019
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media