research-article

Investigating intuitiveness and effectiveness of gestures for free spatial interaction with large displays

Authors:

Judy KayAuthors Info & Claims

PerDis '12: Proceedings of the 2012 International Symposium on Pervasive Displays

Article No.: 6, Pages 1 - 6

https://doi.org/10.1145/2307798.2307804

Published: 04 June 2012 Publication History

Get Access

Abstract

A key challenge for creating large interactive displays in public spaces is in the definition of ways for the user to interact that are effective and easy to learn. This paper presents the outcomes of user evaluation sessions designed to test a series of different gestures for people interacting with large displays in the public space. It is an initial step towards the broader goal of establishing a natural means for immersive interactions. The paper proposes a set of simple gestures for the execution of the basic actions of selecting and rearranging items in a large-scale dashboard. We performed a comparative analysis of the gestures, leading to a more in-depth understanding of the nature of spatial interaction between people and large public displays. More specifically, the analysis focuses on the scenarios when the interaction is restricted to an individual's own body, without any further assistance from associated devices. The findings converge into the elaboration of a model for assisting with the applicability of spatial gestures in response to both the context and the content they are applied to.

References

[1]

Baudisch, P., Sinclair, M., Wilson, A. 2006. Soap: a pointing device that works in mid-air. In Proc. of the 19th annual ACM symposium on User interface software and technology (UIST '06). ACM, New York, NY, USA, 43--46. DOI=10.1145/1166253.1166261

Digital Library

Google Scholar

[2]

Jota, R., Pereira, J. M., Jorge, J. A. 2009. A comparative study of interaction metaphors for large-scale displays. In Proc. of CHI EA '09. ACM, New York, NY, USA, 4135--4140. DOI=10.1145/1520340.1520629

Digital Library

Google Scholar

[3]

Malik, S., Ranjan, A., Balakrishnan, R. 2005. Interacting with large displays from a distance with vision- tracked multi-finger gestural input. In Proc. of UIST '05, ACM Press, 43--52.

Digital Library

Google Scholar

[4]

McCarthy, F. 2003. Public and Situated Displays: Social and Interactional Aspects of Shared Display Technologies, chapter 12: Promoting a sense of community with ubiquitous peripheral displays, Springer, 283--308.

Google Scholar

[5]

Michelis, D., Müller, J. 2011. The Audience Funnel: Observations of Gesture Based Interaction With Multiple Large Displays in a City Center. International Journal of Human-Computer Interaction, 27 (6), 562--579.

Crossref

Google Scholar

[6]

Myers, B., Bhatnagar, R., Nichols, J., Peck, C. H., Kong, D., Miller, R., Long, C. 2002. Interacting at a distance: measuring the performance of laser pointers and other devices. In Proc. of CHI 2002, ACM Press, 33--40.

Digital Library

Google Scholar

[7]

Nancel, M., Wagner, J., Pietriga, E., Chapuis, O., Mackay, W. 2011. Mid-air pan-and-zoom on wall-sized displays. In Proc. of CHI '11. ACM, New York, NY, USA, 177--186. DOI=10.1145/1978942.1978969

Digital Library

Google Scholar

[8]

Vogel, D., Balakrishnan, R. 2004. Interactive public ambient displays: Transitioning from implicit to explicit, public to personal, interaction with multiple users. In Proc. of UIST 2004, ACM Press, 137--146.

Digital Library

Google Scholar

[9]

Vogel, D., Balakrishnan, R. 2005. Distant freehand pointing and clicking on very large, high resolution displays. In Proc. of UIST '05. ACM, New York, NY, USA, 33--42. DOI=10.1145/1095034.1095041

Digital Library

Google Scholar

[10]

Molin, L. 2004. Wizard-of-Oz Prototyping for Cooperative Interaction Design of Graphical User Interfaces. In Proc. of the third Nordic conference on Human-computer interaction (NordiCHI'04). ACM, New York, NY, USA. DOI=10.1145/1028014.1028086

Digital Library

Google Scholar

[11]

van Welie, M., van der Veer, G., Eliëns, A. 1999. Breaking Down Usability. In Proc. of Interact'99, IOS Press, Amsterdam, The Netherlands, 613--620.

Google Scholar

Cited By

View all

Coppens AHermen JSchwartz LMoll CMaquil V(2024)Supporting Mixed-Presence Awareness across Wall-Sized Displays Using a Tracking Pipeline based on Depth CamerasProceedings of the ACM on Human-Computer Interaction10.1145/36646348:EICS(1-32)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3664634
Remizova VSand AMacKenzie IŠpakov ONyyssönen KRakkolainen IKylliäinen ASurakka VGizatdinova Y(2023)Mid-Air Gestural Interaction with a Large FogscreenMultimodal Technologies and Interaction10.3390/mti70700637:7(63)Online publication date: 24-Jun-2023
https://doi.org/10.3390/mti7070063
Remizova VSand AŠpakov OLylykangas JQin MHelminen TTakio FRantanen KKylliäinen ASurakka VGizatdinova Y(2023)Exploring Mid-air Gestural Interfaces for Children with ADHDProceedings of the 16th ACM SIGGRAPH Conference on Motion, Interaction and Games10.1145/3623264.3624449(1-10)Online publication date: 15-Nov-2023
https://dl.acm.org/doi/10.1145/3623264.3624449
Show More Cited By

Index Terms

Investigating intuitiveness and effectiveness of gestures for free spatial interaction with large displays
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Graphics input devices
    2. Interaction paradigms
  2. Interaction design
    1. Interaction design process and methods
      1. User centered design

Recommendations

Comparing Gestures and Traditional Interaction Modalities on Large Displays
INTERACT '09: Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part II

Interfaces based on gesture recognition offer a simple and intuitive alternative to the use of traditional menus, keyboard and mouse. In this paper we explore the field of gestural interaction on large screen displays, presenting the results of a study ...
Developing Intuitive Gestures for Spatial Interaction with Large Public Displays
Proceedings of the Third International Conference on Distributed, Ambient, and Pervasive Interactions - Volume 9189

Freehand gestures used in gestural-based interactive systems are often designed around technical limitations of gesture capturing technologies, resulting in gestures that may not be intuitive to users. In this paper, we investigated freehand gestures ...
Estimating virtual touchscreen for fingertip interaction with large displays
OZCHI '06: Proceedings of the 18th Australia conference on Computer-Human Interaction: Design: Activities, Artefacts and Environments

Large displays are everywhere. However, the computer mouse remains the most common interaction tool for such displays. We propose a new approach for fingertip interaction with large display systems using monocular computer vision. By taking into account ...

Comments

Information & Contributors

Information

Published In

PerDis '12: Proceedings of the 2012 International Symposium on Pervasive Displays

June 2012

122 pages

ISBN:9781450314145

DOI:10.1145/2307798

Conference Chair:
Rui José
University of Minho
,
Program Chair:
Elaine Huang
University of Zurich

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 June 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

PerDis 2012

Sponsor:

UMinho
CCG

PerDis 2012: The International Symposium on Pervasive Displays

June 4 - 5, 2012

Porto, Portugal

Acceptance Rates

PerDis '12 Paper Acceptance Rate 20 of 36 submissions, 56%;

Overall Acceptance Rate 213 of 384 submissions, 55%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

44
Total Citations
View Citations
773
Total Downloads

Downloads (Last 12 months)21
Downloads (Last 6 weeks)4

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Coppens AHermen JSchwartz LMoll CMaquil V(2024)Supporting Mixed-Presence Awareness across Wall-Sized Displays Using a Tracking Pipeline based on Depth CamerasProceedings of the ACM on Human-Computer Interaction10.1145/36646348:EICS(1-32)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3664634
Remizova VSand AMacKenzie IŠpakov ONyyssönen KRakkolainen IKylliäinen ASurakka VGizatdinova Y(2023)Mid-Air Gestural Interaction with a Large FogscreenMultimodal Technologies and Interaction10.3390/mti70700637:7(63)Online publication date: 24-Jun-2023
https://doi.org/10.3390/mti7070063
Remizova VSand AŠpakov OLylykangas JQin MHelminen TTakio FRantanen KKylliäinen ASurakka VGizatdinova Y(2023)Exploring Mid-air Gestural Interfaces for Children with ADHDProceedings of the 16th ACM SIGGRAPH Conference on Motion, Interaction and Games10.1145/3623264.3624449(1-10)Online publication date: 15-Nov-2023
https://dl.acm.org/doi/10.1145/3623264.3624449
Maquil VAnastasiou DAfkari HCoppens AHermen JSchwartz L(2023)Establishing Awareness through Pointing Gestures during Collaborative Decision-Making in a Wall-Display EnvironmentExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585830(1-7)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585830
Song ZDudley JKristensson P(2023)HotGestures: Complementing Command Selection and Use with Delimiter-Free Gesture-Based Shortcuts in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332025729:11(4600-4610)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3320257
Guo JCheng RZhang WXia T(2023)Influence of size and location of buttons on the usability of interface on large touch screensErgonomics10.1080/00140139.2023.217967066:12(2025-2038)Online publication date: 20-Feb-2023
https://doi.org/10.1080/00140139.2023.2179670
Wang JChen C(2023)Cursor control through hand shape and Z dimension movements to assist target acquisition in large displaysUniversal Access in the Information Society10.1007/s10209-023-00999-823:4(1751-1764)Online publication date: 31-May-2023
https://doi.org/10.1007/s10209-023-00999-8
Lou XChen ZHansen PPeng R(2022)Asymmetric Free-Hand Interaction on a Large Display and Inspirations for Designing Natural User InterfacesSymmetry10.3390/sym1405092814:5(928)Online publication date: 2-May-2022
https://doi.org/10.3390/sym14050928
Remizova VGizatdinova YSurakka V(2022)Midair Gestural Techniques for Translation Tasks in Large-Display InteractionAdvances in Human-Computer Interaction10.1155/2022/93629162022Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1155/2022/9362916
Wang JChen C(2022)Freehand Target Acquisition With a Force-Assisted DeviceIEEE Sensors Journal10.1109/JSEN.2021.313712822:3(1972-1979)Online publication date: 1-Feb-2022
https://doi.org/10.1109/JSEN.2021.3137128
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Comparing Gestures and Traditional Interaction Modalities on Large Displays

Developing Intuitive Gestures for Spatial Interaction with Large Public Displays

Estimating virtual touchscreen for fingertip interaction with large displays

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations