short-paper

To Dwell or Not to Dwell: An Evaluation of Mid-Air Gestures for Large Information Displays

Authors:

Martin TomitschAuthors Info & Claims

OzCHI '15: Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction

Pages 187 - 191

https://doi.org/10.1145/2838739.2838819

Published: 07 December 2015 Publication History

Abstract

This paper investigates user preferences for mid-air gestures to interact with large public information displays. We designed and implemented a public display application that allows people to navigate between Twitter feeds and to find details about particular tweets. The application supports selection and navigation through (1) point-and-dwell and (2) push and grab-and-pull. A within-subject evaluation with 10 participants found that although point-and-dwell was perceived to be more accurate, push was preferred for selecting items and grab-and-pull was preferred for navigation. Based on our findings we derive recommendations for designing gesture-based information displays.

References

[1]

Ackad, C., Wasinger, R., Gluga, R., Kay, J., and Tomitsch, M. Measuring Interactivity at an Interactive Public Information Display. In Proc. OzCHI 2013, ACM Press (2013), 329--332.

Digital Library

[2]

Aigner, R., Wigdor, D., Benko, H., Haller, M., Lindbauer, D., Ion, A., and Koh, J. T. K. V. Understanding mid-air hand gestures: A study of human preferences in usage of gesture types for hci. Microsoft Research TechReport MSR-TR-2012-111, (2012).

[3]

Alt, F., Schneegass, S., Girgis, M., and Schmidt, A. Cognitive effects of interactive public display applications. In Proc. PerDis 2013, ACM (2013), 13--18.

Digital Library

[4]

Baudel, T. and Beaudouin-Lafon, M. Charade: remote control of objects using free-hand gestures. Communications of the ACM 36,7 (1993), 28--35.

Digital Library

[5]

Camp, F., Schick, A. and Stiefelhagen, R. How to click in mid-air. In Distributed, Ambient, and Pervasive Interactions, volume 8028 of LCNS (2013), 78--86.

[6]

Hespanhol, L., Tomitsch, M., Grace, K., Collins, A. and Kay, J. Investigating intuitiveness and effectiveness of gestures for free spatial interaction with large displays. In Proc. PerDis 2012, ACM Press (2012),1--6.

Digital Library

[7]

Ingram, A., Wang, X. and Ribarsky, W. Towards the establishment of a framework for intuitive multi-touch interaction design. In Proc. AVI 2012, ACM Press (2012), 66--73.

Digital Library

[8]

Hincapié-Ramos, J. D., Guo, X., Moghadasian, M. and Irani, P. Consumed endurance: a metric to quantify arm fatigue of mid-air interactions. In Proc. CHI 2014, ACM (2014), 1063--1072.

Digital Library

[9]

Jurmu, M., Ogawa, M., Boring, S., Riekki, J., & Tokuda, H. Waving to a touch interface: Descriptive field study of a multipurpose multimodal public display. In Proc. PerDis 2013, ACM Press (2013), 7--12.

Digital Library

[10]

Mäkelä, V., Heimonen, T., Luhtala, M., and Turunen, M. Information wall: evaluation of a gesture-controlled public display. In Proc. MUM 2014, ACM Press (2014), 228--231.

Digital Library

[11]

Müller, J., Walter, R., Bailly, G., Nischt, M., & Alt, F. Looking glass: a field study on noticing interactivity of a shop window. In Proc. CHI 2012, ACM Press (2012), 297--306.

Digital Library

[12]

Nancel, M., Wagner, J., Pietriga, E., Chapuis, O. and Mackay, W. Mid-air pan-and-zoom on wall-sized displays. In proc. CHI 2011, ACM (2011), 177--186.

Digital Library

[13]

Peltonen, P., Kurvinen, E., Salovaara, A., Jacucci, G., Ilmonen, T., Evans, J. and Saarikko, P. It's Mine, Don't Touch! interactions at a large multi-touch display in a city centre. In Proc. CHI 2008, ACM Press (2008), 1285--1294.

Digital Library

[14]

Pyryeskin, D., Hancock, M. and Hoey, J. Comparing elicited gestures to designer-created gestures for selection above a multitouch surface. In Proc. ITS 2012, ACM (2012), 1--10.

Digital Library

[15]

Quek, F., McNeill, D., Bryll, R., Duncan, S., Ma, X.-F., Kirbas, C. and Ansari, R. Multimodal human discourse: gesture and speech. TOCHI 9. 3 (2002), 171--193.

Digital Library

[16]

Tomitsch, M., Ackad, C., Dawson, O., Hespanhol, L. and Kay, J. Who cares about the Content? An Analysis of Playful Behaviour at a Public Display. In Proc. PerDis 2014, ACM Press (2014), 160.

Digital Library

[17]

Vanoni, D. Human-Centered Interfaces for Large, High-Resolution Visualization Systems. In Research Exam. UC San Diego Computer Science and Engineering Department, retrieved, (2014).

[18]

Walter, R., Bailly, G. and Müller, J. Strikeapose: revealing mid-air gestures on public displays. In Proc. CHI 2013, ACM Press (2013), 841--850.

Digital Library

[19]

Walter, R., Bailly, G., Valkanova, N. and Müller, J. Cuenesics: using mid-air gestures to select items on interactive public displays. In Proc. MobileHCI 2014, ACM Press (2014), 299--308.

Digital Library

Cited By

Cordeil MServais ATruong GDwyer TVyas DHurter C(2025)The Presenter in the Browser: Design and Evaluation of Human Interactive Overlays with Web ContentMultimodal Technologies and Interaction10.3390/mti90200109:2(10)Online publication date: 27-Jan-2025
https://doi.org/10.3390/mti9020010
Coppens AHermen JSchwartz LMoll CMaquil V(2024)Supporting Mixed-Presence Awareness across Wall-Sized Displays Using a Tracking Pipeline based on Depth CamerasProceedings of the ACM on Human-Computer Interaction10.1145/36646348:EICS(1-32)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3664634
Belkacem ITominski CMédoc NKnudsen SDachselt RGhoniem M(2024)Interactive Visualization on Large High‐Resolution Displays: A SurveyComputer Graphics Forum10.1111/cgf.1500143:6Online publication date: 30-Apr-2024
https://doi.org/10.1111/cgf.15001
Show More Cited By

Index Terms

To Dwell or Not to Dwell: An Evaluation of Mid-Air Gestures for Large Information Displays
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Skeletons and Silhouettes: Comparing User Representations at a Gesture-based Large Display
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

Mid-air gestures offer a promising way to interact with large public displays. User representations are important to attract people to such displays, convey interactivity and provide meaningful gesture feedback. We evaluated two forms of user ...
Call to interact: communicating interactivity and affordances for contactless gesture controlled public displays
PerDis '20: Proceedings of the 9TH ACM International Symposium on Pervasive Displays

Interactive public displays are becoming increasingly commonplace. Two important challenges for these displays exist: 1) how interactivity is communicated to the passer-by and 2) once the audience have engaged, how the interactive affordances are ...
Eliciting Mid-Air Gestures for Wall-Display Interaction
NordiCHI '16: Proceedings of the 9th Nordic Conference on Human-Computer Interaction

Freehand mid-air gestures are a promising input method for interacting with wall displays. However, work on mid-air gestures for wall-display interaction has mainly explored what is technically possible, which might not result in gestures that users ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

OzCHI '15: Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction

December 2015

691 pages

ISBN:9781450336734

DOI:10.1145/2838739

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction
HFESA: Human Factors and Ergonomics Society of Australia Inc.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 December 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Conference

OzCHI '15

OzCHI '15: The Annual Meeting of the Australian Special Interest Group for Computer Human Interaction

December 7 - 10, 2015

VIC, Parkville, Australia

Acceptance Rates

OzCHI '15 Paper Acceptance Rate 47 of 97 submissions, 48%;

Overall Acceptance Rate 362 of 729 submissions, 50%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

25
Total Citations
View Citations
336
Total Downloads

Downloads (Last 12 months)22
Downloads (Last 6 weeks)3

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Cordeil MServais ATruong GDwyer TVyas DHurter C(2025)The Presenter in the Browser: Design and Evaluation of Human Interactive Overlays with Web ContentMultimodal Technologies and Interaction10.3390/mti90200109:2(10)Online publication date: 27-Jan-2025
https://doi.org/10.3390/mti9020010
Coppens AHermen JSchwartz LMoll CMaquil V(2024)Supporting Mixed-Presence Awareness across Wall-Sized Displays Using a Tracking Pipeline based on Depth CamerasProceedings of the ACM on Human-Computer Interaction10.1145/36646348:EICS(1-32)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3664634
Belkacem ITominski CMédoc NKnudsen SDachselt RGhoniem M(2024)Interactive Visualization on Large High‐Resolution Displays: A SurveyComputer Graphics Forum10.1111/cgf.1500143:6Online publication date: 30-Apr-2024
https://doi.org/10.1111/cgf.15001
Remizova VSand AMacKenzie IŠpakov ONyyssönen KRakkolainen IKylliäinen ASurakka VGizatdinova Y(2023)Mid-Air Gestural Interaction with a Large FogscreenMultimodal Technologies and Interaction10.3390/mti70700637:7(63)Online publication date: 24-Jun-2023
https://doi.org/10.3390/mti7070063
Remizova VSand AŠpakov OLylykangas JQin MHelminen TTakio FRantanen KKylliäinen ASurakka VGizatdinova Y(2023)Exploring Mid-air Gestural Interfaces for Children with ADHDProceedings of the 16th ACM SIGGRAPH Conference on Motion, Interaction and Games10.1145/3623264.3624449(1-10)Online publication date: 15-Nov-2023
https://dl.acm.org/doi/10.1145/3623264.3624449
Gentile VFarzand HBonaccorso SRocchesso DMalizia AKhamis MSorce S(2023)User-Centered Evaluation of Different Configurations of a Touchless Gestural Interface for Interactive DisplaysHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42280-5_32(501-520)Online publication date: 25-Aug-2023
https://doi.org/10.1007/978-3-031-42280-5_32
Mäkelä VWinter JSchwab JKoch MAlt F(2022)Pandemic Displays: Considering Hygiene on Public Touchscreens in the Post-Pandemic EraProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501937(1-12)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501937
Tan ZDai NSu YZhang RLi YWu DLi S(2022)Human–Machine Interaction in Intelligent and Connected Vehicles: A Review of Status Quo, Issues, and OpportunitiesIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2021.312721723:9(13954-13975)Online publication date: Sep-2022
https://doi.org/10.1109/TITS.2021.3127217
Sluÿters ASellier QVanderdonckt JParthiban VMaes P(2022)Consistent, Continuous, and Customizable Mid-Air Gesture Interaction for Browsing Multimedia Objects on Large DisplaysInternational Journal of Human–Computer Interaction10.1080/10447318.2022.207846439:12(2492-2523)Online publication date: 27-Jul-2022
https://doi.org/10.1080/10447318.2022.2078464
Sand ARakkolainen ISurakka VRaisamo RBrewster S(2022)Touchless Tactile Interaction with Unconventional Permeable DisplaysUltrasound Mid-Air Haptics for Touchless Interfaces10.1007/978-3-031-04043-6_8(207-223)Online publication date: 17-Sep-2022
https://doi.org/10.1007/978-3-031-04043-6_8
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten