research-article

Boxer: a multimodal collision technique for virtual objects

Authors:

Antti OulasvirtaAuthors Info & Claims

ICMI '17: Proceedings of the 19th ACM International Conference on Multimodal Interaction

Pages 252 - 260

https://doi.org/10.1145/3136755.3136761

Published: 03 November 2017 Publication History

Abstract

Virtual collision techniques are interaction techniques for invoking discrete events in a virtual scene, e.g. throwing, pushing, or pulling an object with a pointer. The conventional approach involves detecting collisions as soon as the pointer makes contact with the object. Furthermore, in general, motor patterns can only be adjusted based on visual feedback. The paper presents a multimodal technique based on the principle that collisions should be aligned with the most salient sensory feedback. Boxer (1) triggers a collision at the moment where the pointer's speed reaches a minimum after first contact and (2) is synchronized with vibrotactile stimuli presented to the hand controlling the pointer. Boxer was compared with the conventional technique in two user studies (with temporal pointing and virtual batting). Boxer improved spatial precision in collisions by 26.7 % while accuracy was compromised under some task conditions. No difference was found in temporal precision. Possibilities for improving virtual collision techniques are discussed.

References

[1]

Bruno Araujo, Ricardo Jota, Varun Perumal, Jia Xian Yao, Karan Singh, and Daniel Wigdor. 2016. Snake Charmer: Physically Enabling Virtual Objects. In Proceedings of the TEI’16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 218–226.

Digital Library

[2]

Mahdi Azmandian, Mark Hancock, Hrvoje Benko, Eyal Ofek, and Andrew D Wilson. 2016. Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 1968–1979.

Digital Library

[3]

Kimberly Chu and Chui Yin Wong. 2011. Mobile input devices for gaming experience. In User Science and Engineering (i-USEr), 2011 International Conference on. IEEE, 83–88.

[4]

Christer Ericson. 2004. Real-time collision detection. CRC Press.

[5]

Marc O Ernst and Martin S Banks. 2002. Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415, 6870 (2002), 429–433.

[6]

Marc O Ernst, Martin S Banks, and Heinrich H Bülthoff. 2000. Touch can change visual slant perception. Nature neuroscience 3, 1 (2000), 69–73.

[7]

Marc O Ernst and Heinrich H Bülthoff. 2004. Merging the senses into a robust percept. Trends in cognitive sciences 8, 4 (2004), 162–169.

[8]

Paul M Fitts. 1954. The information capacity of the human motor system in controlling the amplitude of movement. Journal of experimental psychology 47, 6 (1954), 381.

[9]

Sidhant Gupta, Dan Morris, Shwetak N Patel, and Desney Tan. 2013. AirWave: non-contact haptic feedback using air vortex rings. In Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing. ACM, 419–428.

Digital Library

[10]

Anuruddha Hettiarachchi and Daniel Wigdor. 2016. Annexing Reality: Enabling Opportunistic Use of Everyday Objects as Tangible Proxies in Augmented Reality. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 1957–1967.

Digital Library

[11]

Byungjoo Lee and Antti Oulasvirta. 2016. Modelling Error Rates in Temporal Pointing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 1857–1868.

Digital Library

[12]

Ming Li, Katrin Arning, Luisa Vervier, Martina Ziefle, and Leif Kobbelt. 2015. Influence of temporal delay and display update rate in an augmented reality application scenario. In Proceedings of the 14th International Conference on Mobile and Ubiquitous Multimedia. ACM, 278–286.

Digital Library

[13]

Pedro Lopes, Alexandra Ion, and Patrick Baudisch. 2015. Impacto: Simulating Physical Impact by Combining Tactile Stimulation with Electrical Muscle Stimulation. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. ACM, 11–19.

Digital Library

[14]

Richard A Schmidt, Howard Zelaznik, Brian Hawkins, James S Frank, and John T Quinn Jr. 1979. Motor-output variability: A theory for the accuracy of rapid motor acts. Psychological review 86, 5 (1979), 415.

[15]

Richard HY So and German KM Chung. 2005. Sensory motor responses in virtual environments: Studying the effects of image latencies for target-directed hand movement. In 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference. IEEE, 5006–5008.

[16]

Rajinder Sodhi, Ivan Poupyrev, Matthew Glisson, and Ali Israr. 2013. AIREAL: interactive tactile experiences in free air. ACM Transactions on Graphics (TOG) 32, 4 (2013), 134.

Digital Library

[17]

Unity Technologies. 2016. Unity. Game Engine. (2016). Retrieved June 2, 2016 from https://unity3d.com.

[18]

J Tresilian, J Oliver, and T Carroll. 2003. Temporal precision of interceptive action: differential effects of target size and speed. Experimental brain research 148, 4 (2003), 425–438.

[19]

James R Tresilian and Andrew Lonergan. 2002. Intercepting a moving target: effects of temporal precision constraints and movement amplitude. Experimental Brain Research 142, 2 (2002), 193–207.

[20]

Robert J van Beers, Daniel M Wolpert, and Patrick Haggard. 2002. When feeling is more important than seeing in sensorimotor adaptation. Current biology 12, 10 (2002), 834–837.

[21]

Loutfouz Zaman and I Scott MacKenzie. 2013. Evaluation of nano-stick, foam buttons, and other input methods for gameplay on touchscreen phones. In International Conference on Multimedia and Human-Computer Interaction-MHCI 2013.

[22]

69–1.

Cited By

Lee DKim SNoh JLee B(2024)User Performance in Consecutive Temporal Pointing: An Exploratory StudyProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642904(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642904
Deja J(2022)Piano Learning and Improvisation through Adaptive Visualisation and Digital AugmentationCompanion Proceedings of the 2022 Conference on Interactive Surfaces and Spaces10.1145/3532104.3571464(41-45)Online publication date: 20-Nov-2022
https://dl.acm.org/doi/10.1145/3532104.3571464
Deja J(2021)Adaptive Visualisations Using Spatiotemporal and Heuristic Models to Support Piano LearningProceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization10.1145/3450613.3459656(286-290)Online publication date: 21-Jun-2021
https://dl.acm.org/doi/10.1145/3450613.3459656
Show More Cited By

Index Terms

Boxer: a multimodal collision technique for virtual objects
1. Computer systems organization
  1. Dependable and fault-tolerant systems and networks
    1. Redundancy
  2. Embedded and cyber-physical systems
    1. Embedded systems
    2. Robotics
2. Networks
  1. Network properties
    1. Network reliability

Recommendations

Intermediate representation for stiff virtual objects
VRAIS '95: Proceedings of the Virtual Reality Annual International Symposium (VRAIS'95)

A method of intermediate space for controlling haptic interfaces is characterized by updating a virtual plane at a low frequency while maintaining a high update rate at force control loop of the interface. By using the virtual plane, the detection of ...
Physically touching and tasting virtual objects enhances the realism of virtual experiences

Experiment 1 explored the impact of physically touching a virtual object on how realistic the virtual environment (VE) seemed to the user. Subjects in a `no touch' group picked up a 3D virtual image of a kitchen plate in a VE, using a traditional 3D ...
Multimodal prop-based interaction with virtual mock-up: CAD model integration and human performance evaluation
VRST '08: Proceedings of the 2008 ACM symposium on Virtual reality software and technology

This paper presents a methodology for the efficient integration of CAD models in a physical-based virtual reality simulation that provides the user with multi-modal feedback. User interacts with virtual mock-up using a string-based haptic interface. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI '17: Proceedings of the 19th ACM International Conference on Multimodal Interaction

November 2017

676 pages

ISBN:9781450355438

DOI:10.1145/3136755

General Chairs:
Edward Lank
University of Waterloo, Canada
,
Alessandro Vinciarelli
University of Glasgow, UK
,
Program Chairs:
Eve Hoggan
Aarhus University, Denmark
,
Sriram Subramanian
University of Sussex, UK
,
Stephen A. Brewster
University of Glasgow, UK

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 November 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

e National Research Foundation of Korea (NRF)
European Research Council (ERC)

Conference

ICMI '17

Sponsor:

SIGCHI

ICMI '17: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

November 13 - 17, 2017

Glasgow, UK

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
257
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)1

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Lee DKim SNoh JLee B(2024)User Performance in Consecutive Temporal Pointing: An Exploratory StudyProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642904(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642904
Deja J(2022)Piano Learning and Improvisation through Adaptive Visualisation and Digital AugmentationCompanion Proceedings of the 2022 Conference on Interactive Surfaces and Spaces10.1145/3532104.3571464(41-45)Online publication date: 20-Nov-2022
https://dl.acm.org/doi/10.1145/3532104.3571464
Deja J(2021)Adaptive Visualisations Using Spatiotemporal and Heuristic Models to Support Piano LearningProceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization10.1145/3450613.3459656(286-290)Online publication date: 21-Jun-2021
https://dl.acm.org/doi/10.1145/3450613.3459656
Deja J(2021)Encouraging Improvisation in Piano LearningUsing Adaptive Visualisations and Spatiotemporal ModelsAdjunct Publication of the 23rd International Conference on Mobile Human-Computer Interaction10.1145/3447527.3474865(1-4)Online publication date: 27-Sep-2021
https://dl.acm.org/doi/10.1145/3447527.3474865
Do SLee BBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)Improving Reliability of Virtual Collision ResponsesProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376819(1-12)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376819
Kim JOh SPark CChoi SBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)Body-Penetrating Tactile Phantom SensationsProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376619(1-13)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376619
Lee IKim SLee BBrewster SFitzpatrick GCox AKostakos V(2019)Geometrically Compensating Effect of End-to-End Latency in Moving-Target Selection GamesProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300790(1-12)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300790
Kim SLee BOulasvirta AMandryk RHancock MPerry MCox A(2018)Impact Activation Improves Rapid Button PressingProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174145(1-8)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3174145
Oulasvirta AKim SLee BMandryk RHancock MPerry MCox A(2018)Neuromechanics of a Button PressProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174082(1-13)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3174082
Lee BKim SOulasvirta ALee JPark EMandryk RHancock MPerry MCox A(2018)Moving Target SelectionProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173804(1-12)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173804
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten