skip to main content
10.1145/2838739.2838827acmotherconferencesArticle/Chapter ViewAbstractPublication PagesozchiConference Proceedingsconference-collections
short-paper

Three is a crowd? Our experience of testing large-scale social software in a usability lab

Authors Info & Claims
Published:07 December 2015Publication History

ABSTRACT

'In the wild' testing has been the cornerstone of HCI in past attempts to create large scale social software, such as conference software. Conversely mobile software is frequently tested in a lab environment, thus banishing typical context of use. In this paper we present our attempt at merging the two approaches for conference social software. We tested in the lab, but attempted to replicate some of the social context of field-based testing. We report our learnings and propose future research for this type of hybrid testing.

References

  1. Bergvall-Kareborn, B., Hoist, M. and Stahlbrost, A. (2009). Concept Design with a Living Lab Approach. System Sciences, 2009. HICSS '09. 42nd Hawaii International Conference on. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Cox, D., Kindratenko, V. and Pointer, D. IntelliBadgeTM: Towards Providing Location-Aware Value-Added Services at Academic Conferences. Proc. UbiComp 03, Springer Berlin Heidelberg. (2003), 264--280.Google ScholarGoogle ScholarCross RefCross Ref
  3. Eshet, E. and Bouwman, H. Addressing the Context of Use in Mobile Computing: a Survey on the State of the Practice. Interacting with Computers 27, 4, (2014).Google ScholarGoogle Scholar
  4. Greifeneder, E. The Impact of Distraction in Natural Environments on User Experience Research Proc. TPDL 11, Springer. (2011), 308--315. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Hoffelder, N. Going to the Open Hardware Summit? Don't Forget Your E-ink Conference Badge, The Digital Reader (2013). Available at: http://the-digital-reader.com/2013/07/27/going-to-the-open-hardware-summit-dont-forget-your-e-ink-conference-badge/Google ScholarGoogle Scholar
  6. Kjeldskov, J. and Graham, C. (2003). A Review of Mobile HCI Research Methods. Human-Computer Interaction with Mobile Devices and Services. L. Chittaro, Springer Berlin Heidelberg. 2795: 317--335.Google ScholarGoogle Scholar
  7. Kjeldskov, J., Skov, M., Als, B. and Høegh, R. Is It Worth the Hassle? Exploring the Added Value of Evaluating the Usability of Context-Aware Mobile Systems in the Field. Proc. Mobile HCI 04, Springer Berlin Heidelberg. (2004), 61--73.Google ScholarGoogle ScholarCross RefCross Ref
  8. McCarthy, J. F., McDonald, D. W., Soroczak, S., Nguyen, D. H. and Rashid, A. M. Augmenting the social space of an academic conference. Proc. CSCW 04, ACM. (2004), 39--48. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. McDonald, D. W., McCarthy, J. F., Soroczak, S., Nguyen, D. H. and Rashid, A. M. Proactive displays: Supporting awareness in fluid social environments. ToCHI 14, 4, (2008) 16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Newell, A. F., Morgan, M. E., Gregor, P. and Carmichael, A. Theatre as an intermediary between users and CHI designers. Proc. CHI 06, ACM. (2006), 111--116. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Rogers, Y., Sharp, H. and Preece, J. Interaction design: beyond human-computer interaction. Chichester, West Sussex, England, Wiley (2007). Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Ross, C., Terras, M., Warwick, C. and Welsh, A. Enabled backchannel: Conference Twitter use by digital humanists. J Doc 67, 2, (2011) 214--237.Google ScholarGoogle ScholarCross RefCross Ref
  13. Sun, X. and May, A. A comparison of field-based and lab-based experiments to evaluate user experience of personalised mobile devices. Adv. in Hum.-Comp. Int. 2013, (2013) 2--2. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Waterson, S., Landay, J. A. and Matthews, T. In the lab and out in the wild: remote web usability testing for mobile devices. Proc. CHI 02, ACM. (2002), 796--797. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Three is a crowd? Our experience of testing large-scale social software in a usability lab

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      OzCHI '15: Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction
      December 2015
      691 pages
      ISBN:9781450336734
      DOI:10.1145/2838739

      Copyright © 2015 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 7 December 2015

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • short-paper
      • Research
      • Refereed limited

      Acceptance Rates

      OzCHI '15 Paper Acceptance Rate47of97submissions,48%Overall Acceptance Rate362of729submissions,50%
    • Article Metrics

      • Downloads (Last 12 months)0
      • Downloads (Last 6 weeks)0

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader