skip to main content
10.1145/3543174.3546847acmconferencesArticle/Chapter ViewAbstractPublication PagesautomotiveuiConference Proceedingsconference-collections
research-article

User Experience of In-Vehicle Gesture Interaction: Exploring the Effect of Autonomy and Competence in a Mock-Up Experiment

Published: 17 September 2022 Publication History

Abstract

To interact with the increasing number of infotainment systems today, touchless gestures are gaining popularity. But only if the interaction is adapted to human needs, the proposed benefits will come into effect. A three-way (2 x 2 x 2) mixed design was adopted examining basic psychological needs and their association with motivation, UX, and the acceptance of gestures. Thereby, the influence of freedom in the gesture execution, visual cues, and motivation framing was investigated. In this study, 27 participants experienced gesture interaction with infotainment content in an experiment with a realistic car mock-up. Results suggest that participants perceived higher autonomy interacting with free gestures and higher competence for the supportive visualization with visual cues. Autonomy, competence, and system relatedness affected the motivation, UX, and acceptance. The present study provides novel insights into the acceptance of in-vehicle gesture interaction and implications for future design of automotive user interfaces.

References

[1]
Emeli Adell. 2010. Acceptance of driver support systems. In Proceedings of the European Conference on Human Centered Design for Intelligent Transport Systems. Humanist VCE, Berlin, Germany, 475–486.
[2]
Franziska Babel, Johannes Kraus, Linda Miller, Matthias Kraus, Nicolas Wagner, Wolfgang Minker, and Martin Baumann. 2021. Small talk with a robot? The impact of dialog content, talk initiative, and gaze behavior of a social robot on trust, acceptance, and proximity. International Journal of Social Robotics 13, 6, 1485–1498.
[3]
Douglas Bates, Martin Maechler, Ben Bolker, and Steven Walker. 2015. Fitting Linear Mixed-Effects Models Using lme4. Journal of Statistical Software 67, 1, 1–48.
[4]
Klaus Bengler, Michael Rettenmaier, Nicole Fritz, and Alexander Feierle. 2020. From HMI to HMIs: Towards an HMI Framework for Automated Driving. Information 11, 2, 61.
[5]
Melanie Berger, Bastian Pfleging, and Regina Bernhaupt. 2021. Designing for a Convenient In-Car Passenger Experience: A Repertory Grid Study. In Human-Computer Interaction – INTERACT 2021, Carmelo Ardito, Rosa Lanzilotti, Alessio Malizia, Helen Petrie, Antonio Piccinno, Giuseppe Desolda and Kori Inkpen, Eds. Lecture Notes in Computer Science. Springer International Publishing, Cham, 117–139.
[6]
Richard W. Brislin. 1970. Back-translation for cross-cultural research. Journal of Cross-Cultural Psychology 1, 3, 185–216.
[7]
Eddie Brown, David R. Large, Hannah Limerick, and Gary Burnett. 2020. Ultrahapticons: “Haptifying” drivers’ mental models to transform automotive mid-air haptic gesture Infotainment Interfaces. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications - AutomotiveUI ‘20. ACM, New York, NY, USA, 54–57.
[8]
Florian Brühlmann, Beat Vollenwyder, Klaus Opwis, and Elisa D. Mekler. 2018. Measuring the “Why” of interaction: Development and validation of the User Motivation Inventory (UMI). In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–13.
[9]
Arthur T. Cabreira and Faustina Hwang. 2018. Text or image? Investigating the effects of instruction type on mid-air gesture making with novice older adults. In Proceedings of the 10th Nordic Conference on Human-Computer Interaction. ACM, New York, NY, USA, 452–459.
[10]
Patricia Cornelio Martinez, Silvana de Pirro, Chi T. Vi, and Sriram Subramanian. 2017. Agency in mid-air interfaces. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 2426–2439.
[11]
N. Dahlbäck, A. Jönsson, and L. Ahrenberg. 1993. Wizard of Oz studies — why and how. Knowledge-Based Systems 6, 4, 258–266.
[12]
Edward L. Deci and Richard M. Ryan. 2000. The “What” and “Why” of goal pursuits: Human needs and the self-determination of behavior. Psychological Inquiry 11, 4, 227–268.
[13]
Henrik Detjen, Sarah Faltaous, Stefan Geisler, and Stefan Schneegass. 2019. User-defined voice and mid-air gesture commands for maneuver-based interventions in automated vehicles. In Proceedings of Mensch und Computer 2019. ACM, New York, NY, USA, 341–348.
[14]
Henrik Detjen, Sarah Faltaous, Bastian Pfleging, Stefan Geisler, and Stefan Schneegass. 2021. How to increase automated vehicles’ acceptance through in-vehicle interaction design: A review. International Journal of Human-Computer Interaction 37, 4, 308–330.
[15]
Yannick Forster, Frederik Naujoks, and Alexandra Neukum. 2017. Increasing anthropomorphism and trust in automated driving functions by adding speech output. In 2017 IEEE Intelligent Vehicles Symposium (IV). IEEE, 365–372.
[16]
Euan Freeman, Stephen Brewster, and Vuokko Lantz. 2016. Do that, there: An interaction technique for addressing in-air gesture systems. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 2319–2331.
[17]
Anna-Katharina Frison, Philipp Wintersberger, and Andreas Riener. 2019. Resurrecting the ghost in the shell: A need-centered development approach for optimizing user experience in highly automated vehicles. Transportation Research Part F: Traffic Psychology and Behaviour 65, 439–456.
[18]
Andrew Gambino, Jesse Fox, and Rabindra Ratan. 2020. Building a Stronger CASA: Extending the Computers Are Social Actors Paradigm. HMC 1, 71–86.
[19]
Michael Geiger. 2003. Berührungslose Bedienung von Infotainment-Systemen im Fahrzeug. Dissertation. Universität München.
[20]
Fiona B. Gillison, Peter Rouse, Martyn Standage, Simon J. Sebire, and Richard M. Ryan. 2019. A meta-analysis of techniques to promote motivation for health behaviour change from a self-determination theory perspective. Health psychology review 13, 1, 110–130.
[21]
D. Gkouskos, C. J. Normark, and S. Lundgren. 2014. What drivers really want: Investigating dimensions in automobile user needs. International Journal of Design 8, 1, 59–71.
[22]
Lisa Graichen, Matthias Graichen, and Josef F. Krems. 2019. Evaluation of gesture-based in-vehicle interaction: User experience and the potential to reduce driver distraction. Human factors 61, 5, 774–792.
[23]
Lisa Graichen, Matthias Graichen, and Josef F. Krems. 2022. Effects of gesture-based interaction on driving behavior: A driving simulator study using the projection-based vehicle-in-the-loop. Human factors 64, 2, 324–342.
[24]
Catherine Harvey, Neville A. Stanton, Carl A. Pickering, Mike McDonald, and Pengjun Zheng. 2011. In-vehicle information systems to meet the needs of drivers. International Journal of Human-Computer Interaction 27, 6, 505–522.
[25]
Marc Hassenzahl. 2003. The Thing and I: Understanding the relationship between user and product. In Funology: From Usability to Enjoyment, Mark A. Blythe, Andrew F. Monk, Kees Overbeeke and Peter C. Wright, Ed. Kluwer Academic Publishers.
[26]
Marc Hassenzahl, Sarah Diefenbach, and Anja Göritz. 2010. Needs, affect, and interactive products – Facets of user experience. Interacting with Computers 22, 5, 353–362.
[27]
ISO. 2010. ISO 9241-210:2010(en).
[28]
Tirza Jung, Christina Kaß, Thomas Schramm, and Dieter Zapf. 2017. So what really is user experience? An experimental study of user needs and emotional responses as underlying constructs. Ergonomics 60, 12, 1601–1620.
[29]
Michael G. Kenward and James H. Roger. 1997. Small sample inference for fixed effects from Restricted Maximum Likelihood. Biometrics 53, 3, 983–997.
[30]
Panayiotis Koutsabasis and Panagiotis Vogiatzidakis. 2019. Empirical research in mid-air interaction: A systematic review. International Journal of Human–Computer Interaction 35, 18, 1747–1768.
[31]
Johannes M. Kraus, Jessica Sturn, Julian E. Reiser, and Martin Baumann. 2015. Anthropomorphic agents, transparent automation and driver personality. In Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications - AutomotiveUI ‘15. ACM Press, New York, NY, USA, 8–13.
[32]
A. Kuznetsova, P. B. Brockhoff, and R. H. B. Christensen. 2017. lmerTest Package: Tests in Linear Mixed Effects Models. Journal of Statistical Software 82, 13, 1–26.
[33]
Bettina Laugwitz, Theo Held, and Martin Schrepp. Construction and evaluation of a User Experience Questionnaire. In HCI and Usability for Education and Work. USAB 2008. Lecture Notes in Computer Science, A. Holzinger, Ed., 5298. Springer-Verlag Berlin Heidelberg, 63–76.
[34]
Younghwa Lee, Jintae Lee, and Yujong Hwang. 2015. Relating motivation to information and communication technology acceptance: Self-determination theory perspective. Computers in Human Behavior 51, 418–428.
[35]
Hannah Limerick, James W. Moore, and David Coyle. 2015. Empirical evidence for a diminished sense of agency in speech interfaces. In Proceedings of the 2015 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 3967–3970.
[36]
Paul März, Daniel Schwahlen, Stefan Geisler, and Thomas Kopinski. 2016. User expectations on touchless gestures in vehicles. In Mensch und Computer 2016 - Workshopband, B. Weyers and A. Dittmar, Eds. Gesellschaft für Informatik e.V., Aachen.
[37]
M Keenan R. May, Thomas M. Gable, and Bruce N. Walker. 2014. A multimodal air gesture interface for in vehicle menu navigation. In Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications - AutomotiveUI ‘14. ACM Press, New York, NY, USA, 1–6.
[38]
Sven Mayer, Lars Lischke, Adrian Lanksweirt, Huy V. Le, and Niels Henze. 2018. How to communicate new input techniques. In Proceedings of the 10th Nordic Conference on Human-Computer Interaction. ACM, New York, NY, USA, 460–472.
[39]
Daniel McNeish. 2017. Small sample methods for multilevel modeling: A colloquial elucidation of REML and the Kenward-Roger correction. Multivariate behavioral research 52, 5, 661–670.
[40]
J. Mueller, R. Walter, G. Bailly, M. Nischt, and Florian Alt. 2012. Looking glass: A field study on noticing interactivity of a shop window. In Proceedings of the 2012 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 297–306.
[41]
Clifford Nass, Jonathan Steuer, and Ellen R. Tauber. 1994. Computers are Social Actors. In Proceedings of SIGCHI ’94 Human Factors in Computing Systems. ACM, 72–78.
[42]
Stavros A. Nikou and Anastasios A. Economides. 2017. Mobile-based assessment: Integrating acceptance and motivational factors into a combined model of Self-Determination Theory and Technology Acceptance. Computers in Human Behavior 68, 83–95.
[43]
Donald A. Norman and Jakob Nielsen. 2010. Gestural interfaces: A step backward in usability. Interactions 17, 5, 46–49.
[44]
Geoff Norman. 2010. Likert scales, levels of measurement and the “laws” of statistics. Advances in health sciences education : theory and practice 15, 5, 625–632.
[45]
Dorian Peters, Rafael A. Calvo, and Richard M. Ryan. 2018. Designing for motivation, engagement and wellbeing in digital experience. Frontiers in psychology 9, 797.
[46]
Bastian Pfleging, Maurice Rang, and Nora Broy. 2016. Investigating user needs for non-driving-related activities during automated driving. In Proceedings of the 15th International Conference on Mobile and Ubiquitous Multimedia. ACM, New York, NY, USA, 91–99.
[47]
Carl A. Pickering, Keith J. Burnham, and Michael J. Richardson. 2007. A research study of hand gesture recognition technologies and applications for human vehicle interaction. 3rd Institution of Engineering and Technology Conference on Automotive Electronics, 1–15.
[48]
A. Riener, A. Ferscha, F. Bachmair, P. Hagmüller, A. Lemme, D. Muttenthaler, D. Pühringer, H. Rogner, and A. Tappe. 2013. Standardization of the in-car gesture interaction space. In Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications - AutomotiveUI ‘13. ACM Press, New York, NY, USA, 14–21.
[49]
Richard M. Ryan and Edward L. Deci. 2000. Intrinsic and extrinsic motivations: Classic definitions and new directions. Contemporary educational psychology 25, 1, 54–67.
[50]
Richard M. Ryan and Edward L. Deci. 2019. Brick by brick: The origins, development, and future of self-determination theory. Advances in Motivation Science 6, 111–156.
[51]
Martin Schrepp, Andreas Hinderks, and Jörg Thomaschewski. 2017. Design and Evaluation of a Short Version of the User Experience Questionnaire (UEQ-S). IJIMAI 4, 6, 103.
[52]
Gözel Shakeri, John H. Williamson, and Stephen Brewster. 2017. Novel multimodal feedback techniques for in-car mid-air gesture interaction. In Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications - AutomotiveUI ‘17. ACM, New York, NY, USA, 84–93.
[53]
Kennon M. Sheldon, Andrew J. Elliot, Youngmee Kim, and Tim Kasser. 2001. What is satisfying about satisfying events? Testing 10 candidate psychological needs. Journal of Personality and Social Psychology 80, 2, 325–339.
[54]
Michael Stecher, Britta Michel, and Andreas Zimmermann. 2018. The benefit of touchless gesture control: An empirical evaluation of commercial vehicle-related use cases. In Advances in Human Aspects of Transportation, Neville A. Stanton, Ed. Advances in Intelligent Systems and Computing. Springer International Publishing, Cham, 383–394.
[55]
Dina Stiegemeier, Sabrina Bringeland, Johannes Kraus, and Martin Baumann. 2022. “Do I really need it?”: An explorative study of acceptance and usage of in-vehicle technology. Transportation Research Part F: Traffic Psychology and Behaviour 84, 65–82.
[56]
Dina Stiegemeier, Johannes Kraus, Sabrina Bringeland, and Martin Baumann. 2022. Motivated to use: Beliefs and motivation influencing the acceptance and use of assistance and navigation systems. International Journal of Human-Computer Interaction.
[57]
James L. Szalma. 2014. On the application of motivation theory to human factors/ergonomics: Motivational design principles for human-technology interaction. Human factors 56, 8, 1453–1471.
[58]
Moustafa Tabbarah, Yusheng Cao, Yi Liu, and Myounghoon Jeon. 2021. Advancing in-vehicle gesture interactions with adaptive hand-recognition and auditory displays. In 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications - AutomotiveUI ‘21. ACM, New York, NY, USA, 204–206.
[59]
Maarten Vansteenkiste, Joke Simons, Willy Lens, Bart Soenens, and Lennia Matos. 2005. Examining the motivational impact of intrinsic versus extrinsic goal framing and autonomy-supportive versus internally controlling communication style on early adolescents’ academic achievement. Child development 76, 2, 483–501.
[60]
Viswanath Venkatesh and Hillol Bala. 2008. Technology Acceptance Model 3 and a research agenda on interventions. Decision Sciences 39, 2, 273-315.
[61]
Jo Vermeulen, Kris Luyten, Elise van den Hoven, and Karin Coninx. 2013. Crossing the bridge over Norman's gulf of execution: Revealing feedforward's true identity. In Proceedings of the 2013 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA.
[62]
Adam Waytz, Joy Heafner, and Nicholas Epley. 2014. The mind in the machine: Anthropomorphism increases trust in an autonomous vehicle. Journal of Experimental Social Psychology 52, 113–117.
[63]
Carolina O. C. Werle, Brian Wansink, and Collin R. Payne. 2015. Is it fun or exercise? The framing of physical activity biases subsequent snacking. Marketing Letters 26, 4, 691–702.
[64]
Hermann Winner and Walther Wachenfeld. 2015. Auswirkungen des autonomen Fahrens auf das Fahrzeugkonzept. In Autonomes Fahren. Technische, rechtliche und gesellschaftliche Aspekte, Markus Maurer, J. C. Gerdes, Barbara Lenz and Hermann Winner, Eds. Springer Vieweg, Berlin, 265–285.
[65]
Yucheng Yang, Jan N. Klinkner, and Klaus Bengler. 2019. How Will the Driver Sit in an Automated Vehicle? – The Qualitative and Quantitative Descriptions of Non-Driving Postures (NDPs) When Non-Driving-Related-Tasks (NDRTs) Are Conducted. In Proceedings of the 20th Congress of the International Ergonomics Association (IEA 2018), Sebastiano Bagnara, Riccardo Tartaglia, Sara Albolino, Thomas Alexander and Yushi Fujita, Eds. Advances in Intelligent Systems and Computing. Springer International Publishing, Cham, 409–420.
[66]
Ilka Zöller, Roman Bechmann, and Bettina Abendroth. 2018. Possible applications for gestures while driving. Automotive and Engine Technology 3, 11–20.

Cited By

View all
  • (2024)GestureGPT: Toward Zero-Shot Free-Form Hand Gesture Understanding with Large Language Model AgentsProceedings of the ACM on Human-Computer Interaction10.1145/36981458:ISS(462-499)Online publication date: 24-Oct-2024
  • (2024)Move, Connect, Interact: Introducing a Design Space for Cross-Traffic InteractionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785808:3(1-40)Online publication date: 9-Sep-2024
  • (2024)Driven by Motivation: Understanding Perceived Mobility Need Satisfaction in On-Demand RidepoolingProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675733(405-416)Online publication date: 22-Sep-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
AutomotiveUI '22: Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
September 2022
371 pages
ISBN:9781450394154
DOI:10.1145/3543174
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 September 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Gesture Interaction
  2. In-Vehicle Interaction
  3. User Experience
  4. User Needs

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

AutomotiveUI '22
Sponsor:

Acceptance Rates

Overall Acceptance Rate 248 of 566 submissions, 44%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)95
  • Downloads (Last 6 weeks)4
Reflects downloads up to 20 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)GestureGPT: Toward Zero-Shot Free-Form Hand Gesture Understanding with Large Language Model AgentsProceedings of the ACM on Human-Computer Interaction10.1145/36981458:ISS(462-499)Online publication date: 24-Oct-2024
  • (2024)Move, Connect, Interact: Introducing a Design Space for Cross-Traffic InteractionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785808:3(1-40)Online publication date: 9-Sep-2024
  • (2024)Driven by Motivation: Understanding Perceived Mobility Need Satisfaction in On-Demand RidepoolingProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675733(405-416)Online publication date: 22-Sep-2024
  • (2024)Development and Validation of a Basic Psychological Needs Scale for Technology UsePsychological Test Adaptation and Development10.1027/2698-1866/a0000625:1(26-45)Online publication date: 1-Jan-2024
  • (2024)Why drivers use in-vehicle technology: The role of basic psychological needs and motivationTransportation Research Part F: Traffic Psychology and Behaviour10.1016/j.trf.2023.11.014100(133-153)Online publication date: Jan-2024
  • (2023)Cueing Car Drivers with Ultrasound Skin StimulationHCI in Mobility, Transport, and Automotive Systems10.1007/978-3-031-35908-8_16(224-244)Online publication date: 23-Jul-2023

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media