short-paper

Eliciting Mid-Air Gestures for Wall-Display Interaction

Authors:

Markus L. Wittorf,

Mikkel R. JakobsenAuthors Info & Claims

NordiCHI '16: Proceedings of the 9th Nordic Conference on Human-Computer Interaction

Article No.: 3, Pages 1 - 4

https://doi.org/10.1145/2971485.2971503

Published: 23 October 2016 Publication History

Abstract

Freehand mid-air gestures are a promising input method for interacting with wall displays. However, work on mid-air gestures for wall-display interaction has mainly explored what is technically possible, which might not result in gestures that users would prefer. This paper presents a guessability study where 20 participants performed gestures for 25 actions on a three-meter wide display. Based on the resulting 1124 gestures, we describe user-defined mid-air gestures for wall-display interaction and characterize the types of gesture users prefer for this context. The resulting gestures were largely influenced by surface interaction; they tended to be larger and more physically-based than gestures elicited in previous studies using smaller displays.

References

[1]

Ball, R., North, C., and Bowman, D. A. Move to improve: Promoting physical navigation to increase user performance with large displays. In Proc. CHI 2007, ACM (2007), 191--200.

Digital Library

[2]

Figueiredo, L. S., Gonçalves Maciel Pinheiro, M. G., Vilar Neto, E. X., and Teichrieb, V. An open catalog of hand gestures from sci-fi movies. In Proc. CHI EA 2015, ACM (2015), 1319--1324.

Digital Library

[3]

Jota, R., Nacenta, M. A., Jorge, J. A., Carpendale, S., and Greenberg, S. A comparison of ray pointing techniques for very large displays. In Proc. GI 2010, Canadian Information Processing Society (2010), 269--276.

Digital Library

[4]

Knudsen, S., Jakobsen, M. R., and Hornbæk, K. An exploratory study of how abundant display space may support data analysis. In Proc. NordiCHI 2012, ACM (2012), 558--567.

Digital Library

[5]

Markussen, A., Jakobsen, M. R., and Hornbæk, K. Vulture: A mid-air word-gesture keyboard. In Proc. CHI 2014, ACM (2014), 1073--1082.

Digital Library

[6]

Morris, M. R. Web on the wall: Insights from a multimodal interaction elicitation study. In Proc. ITS 2012, ACM (2012), 95--104.

Digital Library

[7]

Morris, M. R., Danielescu, A., Drucker, S., Fisher, D., Lee, B., schraefel, m. c., and Wobbrock, J. O. Reducing legacy bias in gesture elicitation studies. interactions 21, 3 (May 2014), 40--45.

Digital Library

[8]

Morris, M. R., Wobbrock, J. O., and Wilson, A. D. Understanding users' preferences for surface gestures. In Proc. GI 2010, Canadian Information Processing Society (2010), 261--268.

Digital Library

[9]

Nancel, M., Wagner, J., Pietriga, E., Chapuis, O., and Mackay, W. Mid-air pan-and-zoom on wall-sized displays. In Proc. CHI 2011, ACM (2011), 177--186.

Digital Library

[10]

Piumsomboon, T., Clark, A., Billinghurst, M., and Cockburn, A. User-defined gestures for augmented reality. In INTERACT 2013. Springer Berlin Heidelberg, 2013, 282--299.

[11]

Vatavu, R.-D. User-defined gestures for free-hand tv control. In Proc. EuroiTV 2012, ACM (2012), 45--48.

Digital Library

[12]

Vatavu, R.-D., Casiez, G., and Grisoni, L. Small, medium, or large?: Estimating the user-perceived scale of stroke gestures. In Proc. CHI 2013, ACM (2013), 277--280.

Digital Library

[13]

Vogel, D., and Balakrishnan, R. Distant freehand pointing and clicking on very large, high resolution displays. In Proc. UIST 2005, ACM (2005), 33--42.

Digital Library

[14]

Walter, R., Bailly, G., and Müller, J. Strikeapose: Revealing mid-air gestures on public displays. In Proc. CHI 2013, ACM (2013), 841--850.

Digital Library

[15]

Wobbrock, J. O., Aung, H. H., Rothrock, B., and Myers, B. A. Maximizing the guessability of symbolic input. In Ext. Abstracts CHI 2005, ACM (2005), 1869--1872.

Digital Library

[16]

Wobbrock, J. O., Morris, M. R., and Wilson, A. D. User-defined gestures for surface computing. In Proc. CHI 2009, CHI '09, ACM (2009), 1083--1092.

Digital Library

Cited By

Anastasiou DCoppens AMaquil V(2024)Gesture combinations during collaborative decision-making at wall displaysi-com10.1515/icom-2023-003723:1(57-69)Online publication date: 25-Mar-2024
https://doi.org/10.1515/icom-2023-0037
Coppens AHermen JSchwartz LMoll CMaquil V(2024)Supporting Mixed-Presence Awareness across Wall-Sized Displays Using a Tracking Pipeline based on Depth CamerasProceedings of the ACM on Human-Computer Interaction10.1145/36646348:EICS(1-32)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3664634
Rodriguez RSullivan BBarrera Machuca MBatmaz ATornatzky COrtega F(2024)An Artists' Perspectives on Natural Interactions for Virtual Reality 3D SketchingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642758(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642758
Show More Cited By

Index Terms

Eliciting Mid-Air Gestures for Wall-Display Interaction
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Pen + Mid-Air: An Exploration of Mid-Air Gestures to Complement Pen Input on Tablets
NordiCHI '16: Proceedings of the 9th Nordic Conference on Human-Computer Interaction

In this paper, we report on a series of studies, exploring the potential of pen and mid-air input on tablets. We describe a field study with an early prototype of a drawing application and follow-up inquiries, such as the development and comparison of ...
LeapArm-Facilitating Sensory Spaces for Mid-air Gestural Interaction
NordiCHI '16: Proceedings of the 9th Nordic Conference on Human-Computer Interaction

We present the LeapArm system, which combines a Leap Motion controller for mid-air gestural human-computer interaction with a robotic arm. LeapArm actuates in real-time the orientation of the controller towards a user's hand, dynamically expanding the ...
Elicitation and evaluation of zoom gestures for touchless interaction with desktop displays
PerDis '19: Proceedings of the 8th ACM International Symposium on Pervasive Displays

Touchless gestural interaction has been widely studied and adopted in many contexts. Furthermore, the growing availability of low-cost enabling devices, such as Kinect or Leap Motion, boosted up the interest in such interaction both for commercial and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

NordiCHI '16: Proceedings of the 9th Nordic Conference on Human-Computer Interaction

October 2016

1045 pages

ISBN:9781450347631

DOI:10.1145/2971485

General Chairs:
Staffan Björk
University of Gothenburg
,
Eva Eriksson
Chalmers University of Technology
,
Program Chairs:
Morten Fjeld
Chalmers University of Technology
,
Susanne Bødker
University of Aarhus
,
Publications Chairs:
Wolmet Barendregt
University of Gothenburg
,
Mohammad Obaid
Chalmers University of Technology

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

Chalmers University of Technology
SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 October 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Conference

NordiCHI '16

NordiCHI '16: 9th Nordic Conference on Human-Computer Interaction

October 23 - 27, 2016

Gothenburg, Sweden

Acceptance Rates

NordiCHI '16 Paper Acceptance Rate 58 of 231 submissions, 25%;

Overall Acceptance Rate 379 of 1,572 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

36
Total Citations
View Citations
572
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)3

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Anastasiou DCoppens AMaquil V(2024)Gesture combinations during collaborative decision-making at wall displaysi-com10.1515/icom-2023-003723:1(57-69)Online publication date: 25-Mar-2024
https://doi.org/10.1515/icom-2023-0037
Coppens AHermen JSchwartz LMoll CMaquil V(2024)Supporting Mixed-Presence Awareness across Wall-Sized Displays Using a Tracking Pipeline based on Depth CamerasProceedings of the ACM on Human-Computer Interaction10.1145/36646348:EICS(1-32)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3664634
Rodriguez RSullivan BBarrera Machuca MBatmaz ATornatzky COrtega F(2024)An Artists' Perspectives on Natural Interactions for Virtual Reality 3D SketchingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642758(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642758
Belkacem ITominski CMédoc NKnudsen SDachselt RGhoniem M(2024)Interactive Visualization on Large High‐Resolution Displays: A SurveyComputer Graphics Forum10.1111/cgf.1500143:6Online publication date: 30-Apr-2024
https://doi.org/10.1111/cgf.15001
Blaga AFrutos-Pascual MCreed CWilliams I(2024)VR-Grasp: A Human Grasp Taxonomy for Virtual RealityInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2351719(1-17)Online publication date: 26-May-2024
https://doi.org/10.1080/10447318.2024.2351719
Huang CChen YTong WFeng TDeng M(2023)Research on Human-Computer Interaction Technology of Large-Scale High-Resolution Display Wall SystemApplied Sciences10.3390/app1301059113:1(591)Online publication date: 1-Jan-2023
https://doi.org/10.3390/app13010591
Villarreal-Narvaez SSluÿters AVanderdonckt JVatavu R(2023)Brave New GES World: A Systematic Literature Review of Gestures and Referents in Gesture Elicitation StudiesACM Computing Surveys10.1145/363645856:5(1-55)Online publication date: 7-Dec-2023
https://dl.acm.org/doi/10.1145/3636458
Chamunorwa MWozniak MKrämer SMüller HBoll S(2023)An Empirical Comparison of Moderated and Unmoderated Gesture Elicitation Studies on Soft Surfaces and Objects for Smart Home ControlProceedings of the ACM on Human-Computer Interaction10.1145/36042457:MHCI(1-24)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604245
Yamagami MPortnova-Fahreeva AKong JWobbrock JMankoff J(2023)How Do People with Limited Movement Personalize Upper-Body Gestures? Considerations for the Design of Personalized and Accessible Gesture InterfacesProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3608430(1-15)Online publication date: 22-Oct-2023
https://dl.acm.org/doi/10.1145/3597638.3608430
Neate TMaffra SFrier WYou ZWilson S(2023)Using Mid-Air Haptics to Guide Mid-Air InteractionsHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42280-5_3(43-64)Online publication date: 25-Aug-2023
https://doi.org/10.1007/978-3-031-42280-5_3
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten