skip to main content
10.1145/3428361.3428395acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmumConference Proceedingsconference-collections
research-article

Collaboration Around an Interactive Tabletop Map: Comparing Voice Interactions and a Tangible Shape-changing Controller

Published: 22 November 2020 Publication History

Abstract

Tabletop interactions can support various social activities such as collaborative review of dynamic sales information in the business setting or route planning with an interactive map among others. Sharing control between users of interactive surfaces can be difficult to ensure participation and efficiency for co-located contexts. We explore the differences between two modalities for interacting with a tabletop map including interactions with a voice assistant and tangible interactions with a shape-changing controller. To simulate a shared goal-oriented situation, we use the context of shared autonomous mobility and compare the tangible controller with voice input through simulated tasks of route planning and detours. The findings suggest that the most suitable interaction modality depends on user preferences, scenarios, and contexts. Tangible controls work well for communicating the state of the system and facilitating discussion, while voice can be more pragmatic and task oriented.

References

[1]
Jason Alexander, Anne Roudaut, Jürgen Steimle, Kasper Hornbæk, Miguel Bruns Alonso, Sean Follmer, and Timothy Merritt. 2018. Grand Challenges in Shape-Changing Interface Research. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems(CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3173574.3173873
[2]
Saskia Bakker, Debby Vorstenbosch, Elise van den Hoven, Gerard Hollemans, and Tom Bergman. 2007. Weathergods: tangible interaction in a digital tabletop game. In Proceedings of the 1st international conference on Tangible and embedded interaction(TEI ’07). Association for Computing Machinery, New York, NY, USA, 151–152. https://doi.org/10.1145/1226969.1227000
[3]
BMW Group. 2020. Brand Visions. /content/grpw/websites/bmwgroup_com/en/company/the-next-100-years/brandvisions.html
[4]
Doell, Zach. 2020. New Ford Patent Reveals Shape-Shifting Car Interior - 1178494. https://www.motor1.com/photo/1178494/new-ford-patent-reveals-shape-shifting-car-interior/
[5]
Fredrick Ekman, Mikael Johansson, and Jana Sochor. 2016. To See or Not to See: The Effect of Object Recognition on Users’ Trust in ”Automated Vehicles”. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction(NordiCHI ’16). Association for Computing Machinery, New York, NY, USA, 1–4. https://doi.org/10.1145/2971485.2971551
[6]
Flemisch, Frank O., Adams, Catherine A., Conway, Sheila R., Goodrich, Ken H., Palmer, Michael T., and Schutte, Paul C.2003. The H-Metaphor as a Guideline for Vehicle Automation and Interaction. https://ntrs.nasa.gov/citations/20040031835
[7]
General Motors. 2019. Cruise Automation. https://getcruise.com/
[8]
Marc Hassenzahl and Andrew Monk. 2010. The Inference of Perceived Usability From Beauty. Human–Computer Interaction 25, 3 (Aug. 2010), 235–260. https://doi.org/10.1080/07370024.2010.500139 Publisher: Taylor & Francis _eprint: https://www.tandfonline.com/doi/pdf/10.1080/07370024.2010.500139.
[9]
Honda. 2020. Meet the NeuV: New Electric Urban Vehicle. https://www.honda.com/mobility/NeuV-Concept
[10]
International Transport Forum. 2015. Automated and Autonomous Driving: Regulation under Uncertainty. (April 2015). https://doi.org/10.1787/5jlwvzdfk640-en Publisher: OECD.
[11]
Kennedy, George. 2020. Audi Concept Envisions Cabin of Cars in 2025. https://www.motor1.com/photo/1169308/audi-concept-envisions-cabin-of-cars-in-2025-w-video/
[12]
Jeamin Koo, Dongjun Shin, Martin Steinert, and Larry Leifer. 2016. Understanding driver responses to voice alerts of autonomous car operations. International Journal of Vehicle Design 70, 4 (2016), 377. https://doi.org/10.1504/IJVD.2016.076740
[13]
Sven Krome, Steffen P Walz, and Stefan Greuter. 2016. Contextual Inquiry of Future Commuting in Autonomous Cars. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems(CHI EA ’16). Association for Computing Machinery, New York, NY, USA, 3122–3128. https://doi.org/10.1145/2851581.2892336
[14]
Andrew L. Kun, Susanne Boll, and Albrecht Schmidt. 2016. Shifting Gears: User Interfaces in the Age of Autonomous Driving. IEEE Pervasive Computing 15, 1 (Jan. 2016), 32–38. https://doi.org/10.1109/MPRV.2016.14 Conference Name: IEEE Pervasive Computing.
[15]
Jonathan Lazar, Jinjuan Heidi Feng, and Harry Hochheiser. 2017. Research Methods in Human-Computer Interaction (2 edition ed.). Morgan Kaufmann, Cambridge, MA.
[16]
Jakob Leitner, Michael Haller, Kyungdahm Yun, Woontack Woo, Maki Sugimoto, and Masahiko Inami. 2008. IncreTable, a mixed reality tabletop game experience. In Proceedings of the 2008 International Conference on Advances in Computer Entertainment Technology(ACE ’08). Association for Computing Machinery, New York, NY, USA, 9–16. https://doi.org/10.1145/1501750.1501753
[17]
Todd Litman. 2020. Autonomous Vehicle Implementation Predictions: Implications for Transport Planning. (Jan. 2020). https://trid.trb.org/view/1678741
[18]
Dennis Luxen and Christian Vetter. 2011. Real-time routing with OpenStreetMap data. In Proceedings of the 19th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems(GIS ’11). Association for Computing Machinery, New York, NY, USA, 513–516. https://doi.org/10.1145/2093973.2094062
[19]
Gustavo López, Luis Quesada, and Luis A. Guerrero. 2018. Alexa vs. Siri vs. Cortana vs. Google Assistant: A Comparison of Speech-Based Natural User Interfaces. In Advances in Human Factors and Systems Interaction(Advances in Intelligent Systems and Computing), Isabel L. Nunes (Ed.). Springer International Publishing, Cham, 241–250. https://doi.org/10.1007/978-3-319-60366-7_23
[20]
Mapbox. 2020. mapbox/mapbox-gl-js. https://github.com/mapbox/mapbox-gl-js original-date: 2013-03-07T14:45:24Z.
[21]
MapTiler. 2020. OpenMapTiles. https://openmaptiles.org/
[22]
McCarthy, Lauren. 2020. p5.js. https://p5js.org/
[23]
Michael McTear, Zoraida Callejas, and David Griol. 2016. The Conversational Interface. In The Conversational Interface: Talking to Smart Devices, Michael McTear, Zoraida Callejas, and David Griol (Eds.). Springer International Publishing, Cham, 1–7. https://doi.org/10.1007/978-3-319-32967-3_1
[24]
Mercedes-Benz. 2020. Inspired by the future: The Mercedes-Benz VISION AVTR.https://www.mercedes-benz.com/en/vehicles/passenger-cars/mercedes-benz-concept-cars/vision-avtr/
[25]
Alexander Meschtscherjakov, Manfred Tscheligi, Dalila Szostak, Rabindra Ratan, Roderick McCall, Ioannis Politis, and Sven Krome. 2015. Experiencing Autonomous Vehicles: Crossing the Boundaries between a Drive and a Ride. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems(CHI EA ’15). Association for Computing Machinery, New York, NY, USA, 2413–2416. https://doi.org/10.1145/2702613.2702661
[26]
G. Michelitsch, J. Williams, M. Osen, B. Jimenez, and S. Rapp. 2004. Haptic chameleon: a new concept of shape-changing user interface controls with force feedback. In CHI ’04 Extended Abstracts on Human Factors in Computing Systems(CHI EA ’04). Association for Computing Machinery, New York, NY, USA, 1305–1308. https://doi.org/10.1145/985921.986050
[27]
Clifford Nass and Scott Brave. 2005. Wired for Speech: How Voice Activates and Advances the Human-Computer Relationship. The MIT Press, Cambridge, Mass.
[28]
Noerani Samsoedien and Jacques Terken. [n.d.]. ActuShape : an Approach towards Affordance-based Control Delegation Interfaces in Autonomous Systems. http://samsoedien.com/
[29]
OpenCV. 2020. OpenCV. https://opencv.org/
[30]
Gian Pangaro, Dan Maynes-Aminzade, and Hiroshi Ishii. 2002. The Actuated Workbench: Computer-Controlled Actuation in Tabletop Tangible Interfaces. In Proceedings of the 15th Annual ACM Symposium on User Interface Software and Technology (Paris, France) (UIST ’02). Association for Computing Machinery, New York, NY, USA, 181–190. https://doi.org/10.1145/571985.572011
[31]
Esben Warming Pedersen and Kasper Hornbæk. 2011. Tangible bots: interaction with active tangibles in tabletop interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’11). Association for Computing Machinery, New York, NY, USA, 2975–2984. https://doi.org/10.1145/1978942.1979384
[32]
Martin Porcheron, Joel E. Fischer, Stuart Reeves, and Sarah Sharples. 2018. Voice Interfaces in Everyday Life. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems(CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3174214
[33]
Majken Kirkegård Rasmussen, Timothy Merritt, Miguel Bruns Alonso, and Marianne Graves Petersen. 2016. Balancing User and System Control in Shape-Changing Interfaces: A Designerly Exploration. In Proceedings of the TEI ’16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction (Eindhoven, Netherlands) (TEI ’16). Association for Computing Machinery, New York, NY, USA, 202–210. https://doi.org/10.1145/2839462.2839499
[34]
Corina Sas, Steve Whittaker, Steven Dow, Jodi Forlizzi, and John Zimmerman. 2014. Generating implications for design through design research. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’14). Association for Computing Machinery, New York, NY, USA, 1971–1980. https://doi.org/10.1145/2556288.2557357
[35]
Allison Sauppé and Bilge Mutlu. 2014. Robot deictics: how gesture and context shape referential communication. In Proceedings of the 2014 ACM/IEEE international conference on Human-robot interaction(HRI ’14). Association for Computing Machinery, New York, NY, USA, 342–349. https://doi.org/10.1145/2559636.2559657
[36]
Marc Teyssier, Gilles Bailly, Catherine Pelachaud, and Eric Lecolinet. 2018. MobiLimb: Augmenting Mobile Devices with a Robotic Limb. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology(UIST ’18). Association for Computing Machinery, New York, NY, USA, 53–63. https://doi.org/10.1145/3242587.3242626
[37]
The Volkswagen Group. 2017. Individual mobility redefined: Autonomous driving at the touch of a button. https://www.volkswagenag.com/en/news/2017/03/Autonomous_driving.html#
[38]
Anke van Oosterhout, Miguel Bruns Alonso, and Satu Jumisko-Pyykkö. 2018. Ripple Thermostat: Affecting the Emotional Experience through Interactive Force Feedback and Shape Change. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems(CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3174229
[39]
Waymo. 2020. Waymo. https://waymo.com/
[40]
Mark Weiser. 1991. The Computer for the 21 st Century. Scientific American 265, 3 (1991), 94–105. https://www.jstor.org/stable/24938718 Publisher: Scientific American, a division of Nature America, Inc.
[41]
John Zimmerman, Jodi Forlizzi, and Shelley Evenson. 2007. Research through design as a method for interaction design research in HCI. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’07). Association for Computing Machinery, New York, NY, USA, 493–502. https://doi.org/10.1145/1240624.1240704

Cited By

View all
  • (2023)FabriCar: Enriching the User Experience of In-Car Media Interactions with Ubiquitous Vehicle Interiors using E-textile SensorsProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3595988(1438-1456)Online publication date: 10-Jul-2023
  • (2022)MoLux: Negotiating Control with a Shape-Changing Lamp at HomeNordic Human-Computer Interaction Conference10.1145/3546155.3547271(1-13)Online publication date: 8-Oct-2022

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
MUM '20: Proceedings of the 19th International Conference on Mobile and Ubiquitous Multimedia
November 2020
353 pages
ISBN:9781450388702
DOI:10.1145/3428361
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 November 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. multimodal interface
  2. shape-changing interfaces
  3. tangible
  4. voice interaction

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

MUM 2020

Acceptance Rates

Overall Acceptance Rate 190 of 465 submissions, 41%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)40
  • Downloads (Last 6 weeks)4
Reflects downloads up to 30 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2023)FabriCar: Enriching the User Experience of In-Car Media Interactions with Ubiquitous Vehicle Interiors using E-textile SensorsProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3595988(1438-1456)Online publication date: 10-Jul-2023
  • (2022)MoLux: Negotiating Control with a Shape-Changing Lamp at HomeNordic Human-Computer Interaction Conference10.1145/3546155.3547271(1-13)Online publication date: 8-Oct-2022

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media