skip to main content
10.1145/3027063.3053072acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
abstract

Towards an Evaluation Framework: Implicit Evaluation of Sense of Agency in a Creative Continuous Control Task

Published: 06 May 2017 Publication History

Abstract

Reducing workload in a UI while still letting users feel in control is not trivial. This workload/control tradeoff is described in the literature and deserves attention in design practice. However, there is no evaluation framework for it supporting both explicit and implicit measurement, mainly because measuring sense of control implicitly is just difficult. A recently proposed implicit evaluation methodology - measuring sense of agency via interval estimation - seems promising and calls for further investigation. We studied its feasibility in a continuous control task - cinematographic camera motion - and compared a multi-touch software joystick to a mid-air gesture UI (N=8). Data was collected both explicitly and implicitly. Our results suggest that the mid-air gesture design does not increase the sense of agency. Both methodologies yielded similar results but the implicit one was more sensitive and the combination of both led to convincing overall results.

References

[1]
Bruno Berberian, Jean-Christophe Sarrazin, Patrick Le Blaye, and Patrick Haggard. 2012. Automation Technology and Sense of Control: A Window on Human Agency. PLoS One 7, 3 (2012), e34075.
[2]
Antonia S. Conti, Carsten Dlugosch, and Klaus Bengler. 2012. Detection Response Tasks: How Do Different Settings Compare?. In Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '12). ACM, Portsmouth, New Hampshire, 257--260.
[3]
David Coyle, James Moore, Per Ola Kristensson, Paul Fletcher, and Alan Blackwell. 2012. I Did That! Measuring Users' Experience of Agency in Their Own Actions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'12). ACM, New York, NY, USA, 2025--2034.
[4]
Nicole David. 2012. New Frontiers in the Neuroscience of the Sense of Agency. Frontiers in Human Neuroscience 6 (2012), 161.
[5]
Beth Arburn Davis. 2004. Development and Validation of a Scale of Perceived Control Across Multiple Domains. Ph.D. Dissertation. Philadelphia College of Osteopathic Medicine.
[6]
John A. Dewey and Günther Knoblich. 2014. Do Implicit and Explicit Measures of the Sense of Agency Measure the Same Thing? PLoS One 9, 10 (Oct. 2014), 1--9.
[7]
Mia Y. Dong, Kristian Sandberg, Bo M. Bibby, Michael N. Pedersen, and Morten Overgaard. 2015. The Development of a Sense of Control Scale. Frontiers in Psychology 6 (2015), 1733.
[8]
Patrick Haggard. 2005. Conscious Intention and Motor Cognition. Trends in Cognitive Sciences 9, 6 (2005), 290 -- 295.
[9]
Sandra G. Hart. 2006. NASA-Task Load Index (NASA-TLX); 20 Years Later. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 50 (2006), 904--908.
[10]
Pamela J. Hinds. 1998. User Control and Its Many Facets: A Study of Perceived Control in Human-Computer Interaction. Technical Report. Hewlett Packard Laboratories.
[11]
Daniel Lakens. 2013. Calculating and Reporting Effect Sizes to Facilitate Cumulative Science: A Practical Primer for T-Tests and Anovas. Frontiers in Psychology 4 (2013), 863.
[12]
Hannah Limerick, David Coyle, and James W. Moore. 2014. The Experience of Agency in Human-Computer Interactions: A Review. Frontiers in Human Neuroscience 8 (2014), 643.
[13]
Hannah Limerick, James W. Moore, and David Coyle. 2015. Empirical Evidence for a Diminished Sense of Agency in Speech Interfaces. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, Seoul, Republic of Korea, 3967--3970.
[14]
Christopher A. Miller and Raja Parasuraman. 2007. Designing for Flexible Interaction Between Humans and Automation: Delegation Interfaces for Supervisory Control. Human Factors: The Journal of the Human Factors and Ergonomics Society 49, 1 (2007), 57--75.
[15]
Fabrizio Pece, James Tompkin, Hanspeter Pfister, Jan Kautz, and Christian Theobalt. 2014. Device Effect on Panoramic Video+Context Tasks. In Proceedings of the 11th European Conference on Visual Media Production (CVMP '14). ACM, London, United Kingdom, 14:1--14:9.
[16]
Jeremy I. Robson and Jonathan M. Crellin. 1989. The Role of User's Perceived Control in Interface Design, Employing Verbal Protocol Analysis. Applied Ergonomics 20, 4 (1989), 246--251.
[17]
Ben Shneiderman, Catherine Plaisant, Maxine Cohen, and Steven Jacobs. 2009. Designing the User Interface: Strategies for Effective Human-Computer Interaction (5th ed.). Addison-Wesley Publishing Company, USA.
[18]
Uri Simonsohn, Leif D. Nelson, and Joseph P. Simmons. 2014. P-Curve: A Key to the File-Drawer. Journal of Experimental Psychology: General 143, 2 (2014), 534--547.
[19]
Matthis Synofzik, Gottfried Vosgerau, and Albert Newen. 2008. Beyond the Comparator Model: A Multifactorial Two-Step Account of Agency. Consciousness and Cognition 17, 1 (2008), 219--239.
[20]
Wen Wen, Atsushi Yamashita, and Hajime Asama. 2015. The Sense of Agency During Continuous Action: Performance Is More Important Than Action-Feedback Association. PLoS One 10, 4 (2015), e0125226.
[21]
Michael J. Wenger. 1991. On the Rhetorical Contract in Human-Computer Interaction. Computers in Human Behavior 7, 4 (1991), 245 -- 262. Locus of Control questionnaire in Appendix D.
[22]
Dingyun Zhu, Tom Gedeon, and Ken Taylor. 2011. "Moving to the Centre": A Gaze-Driven Remote Camera Control for Teleoperation. Interacting with Computers 23, 1 (2011), 85--95.

Cited By

View all
  • (2024)Towards an Evaluation Framework for Extended Reality Authentication SchemesExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651021(1-6)Online publication date: 11-May-2024

Index Terms

  1. Towards an Evaluation Framework: Implicit Evaluation of Sense of Agency in a Creative Continuous Control Task

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI EA '17: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems
    May 2017
    3954 pages
    ISBN:9781450346566
    DOI:10.1145/3027063
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 06 May 2017

    Check for updates

    Author Tags

    1. implicit measures
    2. intentional binding
    3. interval estimation
    4. sense of agency
    5. sense of control
    6. user interface

    Qualifiers

    • Abstract

    Conference

    CHI '17
    Sponsor:

    Acceptance Rates

    CHI EA '17 Paper Acceptance Rate 1,000 of 5,000 submissions, 20%;
    Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)9
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 05 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Towards an Evaluation Framework for Extended Reality Authentication SchemesExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651021(1-6)Online publication date: 11-May-2024

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media