research-article

Optimising Free Hand Selection in Large Displays by Adapting to User's Physical Movements

Authors:

Preben HansenAuthors Info & Claims

SUI '16: Proceedings of the 2016 Symposium on Spatial User Interaction

Pages 23 - 31

https://doi.org/10.1145/2983310.2985754

Published: 15 October 2016 Publication History

Abstract

Advance in motion sensing technologies such as Microsoft Kinect and ASUS Xtion has enabled users to select targets on a large display through natural hand gestures. In such interaction, the users move left and right to navigate the display, and they frequently adjust body proximity against the display thus to switch between overall views and focus views. These physical movements benefit information navigation, interaction modality switch, and user interface adaptation. But in more specific context of free hand selection in large displays, the effect of physical movements is less systematically investigated. To explore the potential of physical movements in free hand selection, a physical movements-adapted technique is developed and evaluated. The results show that the new technique has significant improvements in both selection efficiency and accuracy, the more difficult selection task the more obvious improvement in accuracy. Additionally, the new technique is preferred to the baseline of pointer acceleration (PA) technique by participants.

Supplementary Material

MP4 File (p23-lou.mp4)

Download
240.19 MB

References

[1]

Ardito, C., Buono, P., Costabile, M.F., and Desolda, G. 2015. Interaction with Large Displays: A Survey. ACM Computing Surveys. 47, 3, 1--38.

Digital Library

[2]

Ball, R., North, C., and Bowman, D.A. 2007. Move to improve: promoting physical navigation to increase user performance with large displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA, 2007). CHI '07. ACM, New York, NY, 191--200.

Digital Library

[3]

Ballendat, T., Marquardt, N., and Greenberg, S. 2010. Proxemic interaction: designing for a proximity and orientation-aware environment. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (Pittsburgh, PA, USA, 2010). ITS '10. ACM, New York, NY, 121--130.

Digital Library

[4]

Banerjee, A., Burstyn, J., Girouard, A., and Vertegaal, R. 2011. Pointable: an in-air pointing technique to manipulate out-of-reach targets on tabletops. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (Kobe, Japan, 2011). ITS '11. ACM, New York, NY, 11--20.

Digital Library

[5]

Bateman, S., Mandryk, R.L., Gutwin, C., and Xiao, R. 2013. Analysis and comparison of target assistance techniques for relative ray-cast pointing. International Journal of HumanComputer Studies. 71, 5, 511--532.

Digital Library

[6]

Casiez, G. and Roussel, N. 2011. No more bricolage!: methods and tools to characterize, replicate and compare pointing transfer functions. In Proceedings of the 24th annual ACM symposium on User interface software and technology (Santa Barbara, CA, USA, 2011). UIST '11. ACM, New York, NY, 603--614.

Digital Library

[7]

Clark, A., Dünser, A., Billinghurst, M., Piumsomboon, T., and Altimira, D. 2011. Seamless interaction in space. In Proceedings of the 23rd Australian Computer-Human Interaction Conference (Canberra, Australia, 2011). OzCHI '11. ACM, New York, NY, 88--97.

Digital Library

[8]

Czerwinski, M., Robertson, G., Meyers, B., Smith, G., Robbins, D., and Tan, D. 2006. Large display research overview. In CHI '06 Extended Abstracts on Human Factors in Computing Systems. ACM, New York, NY, 69--74.

Digital Library

[9]

Dan R. Olsen, J. and Nielsen, T. 2001. Laser pointer interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Seattle, Washington, USA, 2001). CHI '01. ACM, New York, NY, 17--22.

Digital Library

[10]

Fitts, P.M. 1954. The information capacity of the human motor system in controlling the amplitude of movement. Journal of experimental psychology. 121, 3, 381--391.

[11]

Garzotto, F., Gelsomini, M., Mangano, R., Oliveto, L., and Valoriani, M. 2014. From desktop to touchless interfaces: a model based approach. In Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces (Como, Italy, 2014). AVI '14. ACM, New York, NY, 261--264.

Digital Library

[12]

Haque, F., Nancel, M., and Vogel, D. 2015. Myopoint: Pointing and Clicking Using Forearm Mounted Electromyography and Inertial Motion Sensors. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea, 2015). CHI '15. ACM, New York, NY, 3653--3656.

Digital Library

[13]

Jakobsen, M.R., Haile, Y. S., Knudsen, S., and Hornbaek, K. 2013. Information Visualization and Proxemics: Design Opportunities and Empirical Findings. IEEE Transactions on Visualization and Computer Graphics. 19, 12, 2386--2395.

Digital Library

[14]

Jota, R., Pereira, J.M., and Jorge, J.A. 2009. A comparative study of interaction metaphors for large-scale displays. In Proceedings of the CHI '09 Extended Abstracts on Human Factors in Computing Systems (Boston, MA, USA, 2009). ACM, New York, NY, 4135--4140.

Digital Library

[15]

Jungong, H., Ling, S., Dong, X., and Shotton, J. 2013. Enhanced Computer Vision with Microsoft Kinect Sensor: A Review. IEEE Transactions on Cybernetics. 43, 5, 1318--1334.

[16]

Kim, D., Hilliges, O., Izadi, S., Butler, A.D., Chen, J., Oikonomidis, I., and Olivier, P. 2012. Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor. In Proceedings of the 25th annual ACM symposium on User interface software and technology. ACM, New York, NY, 167--176.

Digital Library

[17]

Kopper, R., Bowman, D. A., Silva, M. G., and Mcmahan, R. P. 2010. A human motor behavior model for distal pointing tasks. International Journal of Human-Computer Studies. 68,10, 603--615.

Digital Library

[18]

Malik, S., Ranjan, A., and Balakrishnan, R. 2005. Interacting with large displays from a distance with vision-tracked multifinger gestural input. In Proceedings of the 18th annual ACM symposium on User interface software and technology (Seattle, WA, USA, 2005). ACM, New York, NY, 43--52.

Digital Library

[19]

Nancel, M., Pietriga, E., Chapuis, O., and Beaudouin-Lafon, M. 2015. Mid-Air Pointing on Ultra-Walls. ACM Transactions on Computer-Human Interaction. 22, 5, 885--889.

Digital Library

[20]

Nancel, M., Wagner, J., Pietriga, E., Chapuis, O., and Mackay, W. 2011. Mid-air pan-and-zoom on wall-sized displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada, 2011). CHI '11. ACM, New York, NY, 177--186.

Digital Library

[21]

Ruddle, R.A., Volkova, E., and Bülthoff, H.H. 2011. Walking improves your cognitive map in environments that are large-scale and large in extent. ACM Transactions on Computer-Human Interaction. 18, 2, 445--470.

Digital Library

[22]

Schwaller, M., Brunner, S., and Lalanne, D. 2013. Two Handed Mid-Air Gestural HCI: Point + Command. In International Conference on Human-Computer Interaction (Las Vegas, NV, USA, 2013). HCII '13. Springer, Berlin, Heidelberg, 388--397.

Digital Library

[23]

Shoemaker, G., Tang, A., and Booth, K.S. 2007. Shadow reaching: a new perspective on interaction for large displays. In Proceedings of the 20th annual ACM symposium on User interface software and technology (Newport, Rhode Island, USA, 2007). UIST '07. ACM, New York, NY, 53--56.

Digital Library

[24]

Shoemaker, G., Tsukitani, T., Kitamura, Y., and Booth, K.S. 2010. Body-centric interaction techniques for very large wall displays. In Proceedings of the Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries (Reykjavik, Iceland, 2010). ACM, New York, NY, 463--472.

Digital Library

[25]

Vogel, D. and Balakrishnan, R. 2004. Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users. In Proceedings of the Proceedings of the 17th annual ACM symposium on User interface software and technology (Santa Fe, NM, USA, 2004). UIST '04. ACM, New York, NY, 137--146.

Digital Library

[26]

Vogel, D. and Balakrishnan, R. 2005. Distant freehand pointing and clicking on very large, high resolution displays. In Proceedings of the 18th annual ACM symposium on User interface software and technology (Seattle, WA, USA, 2005). UIST '05. ACM, New York, NY, 33--42.

Digital Library

[27]

Zhengyou, Z. 2012. Microsoft Kinect Sensor and Its Effect. IEEE multimedia. 19, 2, 4--10.

Digital Library

Cited By

Babic TReiterer HHaller M(2022)Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf SmartphonesMultimodal Technologies and Interaction10.3390/mti61000946:10(94)Online publication date: 19-Oct-2022
https://doi.org/10.3390/mti6100094
Lou XZhao QShi YHansen P(2022)Arm Posture Changes and Influences on Hand Controller Interaction Evaluation in Virtual RealityApplied Sciences10.3390/app1205258512:5(2585)Online publication date: 2-Mar-2022
https://doi.org/10.3390/app12052585
Matulic FVogel DMandryk RHancock MPerry MCox A(2018)MultirayProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173819(1-13)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173819

Index Terms

Optimising Free Hand Selection in Large Displays by Adapting to User's Physical Movements
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. Laboratory experiments
    2. Interaction techniques
      1. Gestural input
  2. Interaction design
    1. Empirical studies in interaction design

Recommendations

Measuring unrestrained gaze on wall-sized displays
ECCE '10: Proceedings of the 28th Annual European Conference on Cognitive Ergonomics

Motivation -- Natural gaze involves the coordinated movements of eye, head and torso. This allows access to a wide field of view, up to a range of 260° (Chen, Solinger, Poncet & Lancet, 1999). The recent increase in large displays places a demand on ...
Developing Intuitive Gestures for Spatial Interaction with Large Public Displays
Proceedings of the Third International Conference on Distributed, Ambient, and Pervasive Interactions - Volume 9189

Freehand gestures used in gestural-based interactive systems are often designed around technical limitations of gesture capturing technologies, resulting in gestures that may not be intuitive to users. In this paper, we investigated freehand gestures ...
Cursor control through hand shape and Z dimension movements to assist target acquisition in large displays
Abstract
This study investigated a “hand cursor” technique which used an open hand to control an area cursor (i.e., a cursor with a larger active area) while using an index finger extended gesture to switch the area cursor into a point cursor (i.e., a ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SUI '16: Proceedings of the 2016 Symposium on Spatial User Interaction

October 2016

236 pages

ISBN:9781450340687

DOI:10.1145/2983310

General Chair:
Christian Sandor
Nara Institute of Science and Technology, Japan
,
Program Chairs:
Robert Teather
Carleton University, Canada
,
Evan Suma
University of Southern California, USA
,
Kyle Johnsen
University Of Georgia, USA

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques
SIGCHI: ACM Special Interest Group on Computer-Human Interaction
VRSJ SIG-MR: Virtual Reality Society of Japan, Special Interest Group on Mixed Reality

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 October 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

China Knowledge Centre for Engineering Science and Technology
Zhejiang Provincial Natural Science Funding

Conference

SUI '16

Sponsor:

SIGGRAPH
SIGCHI
VRSJ SIG-MR

SUI '16: Symposium on Spatial User Interaction

October 15 - 16, 2016

Tokyo, Japan

Acceptance Rates

SUI '16 Paper Acceptance Rate 20 of 77 submissions, 26%;

Overall Acceptance Rate 86 of 279 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
273
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)1

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Babic TReiterer HHaller M(2022)Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf SmartphonesMultimodal Technologies and Interaction10.3390/mti61000946:10(94)Online publication date: 19-Oct-2022
https://doi.org/10.3390/mti6100094
Lou XZhao QShi YHansen P(2022)Arm Posture Changes and Influences on Hand Controller Interaction Evaluation in Virtual RealityApplied Sciences10.3390/app1205258512:5(2585)Online publication date: 2-Mar-2022
https://doi.org/10.3390/app12052585
Matulic FVogel DMandryk RHancock MPerry MCox A(2018)MultirayProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173819(1-13)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173819

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten