skip to main content
10.1145/3544549.3585877acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
Work in Progress

Interaction Region Characteristics for Midair Barehand Targeting on a Television

Published: 19 April 2023 Publication History

Abstract

Recent computer vision advances can enable television control using midair barehand input, for which selecting targets using hand positions is a primary task. Yet, the size and position of a preferred 2D interaction region has not been specifically investigated for this setting. We report on a field study with people in front of their own television in their own home. Controlled variations of target position stimuli were presented while a camera records the natural hand position used by the participant in response. Based on hand and face landmarks, density plots define a preferred input region location and size using a human-scaled unit of face-widths. Distribution of hand positions relative to target stimuli reveals consistency and precision, suggesting an ability for users to map their input space to display space. We elicit an ideal input region from participants and provide a range of dimensions for designers implementing barehand input techniques.

Supplementary Material

MP4 File (3544549.3585877-talk-video.mp4)
Pre-recorded Video Presentation

References

[1]
2020. What is gesture control in Samsung F series smart TV?: Samsung Support. https://www.samsung.com/in/support/tv-audio-video/what-is-gesture-control-in-samsung-f-series-smart-tv/
[2]
Michelle A. Brown and Wolfgang Stuerzlinger. 2016. Exploring the Throughput Potential of In-Air Pointing. In 18th International Conference on Human-Computer Interaction. Interaction Platforms and Techniques, Part II(HCI International ’16, Vol. LNCS 9732). 13–24. https://doi.org/10.1007/978-3-319-39516-6_2
[3]
Xiang Cao and Ravin Balakrishnan. 2004. VisionWand: Interaction Techniques for Large Displays Using a Passive Wand Tracked in 3D. ACM Trans. Graph. 23, 3 (aug 2004), 729. https://doi.org/10.1145/1015706.1015788
[4]
A. Cockburn, P. Quinn, C. Gutwin, G. Ramos, and J. Looser. 2011. Air Pointing: Design and Evaluation of Spatial Target Acquisition with and without Visual Feedback. Int. J. Hum.-Comput. Stud. 69, 6 (June 2011), 401–414. https://doi.org/10.1016/j.ijhcs.2011.02.005
[5]
Faizan Haque, Mathieu Nancel, and Daniel Vogel. 2015. Myopoint: Pointing and Clicking Using Forearm Mounted Electromyography and Inertial Motion Sensors. Association for Computing Machinery, New York, NY, USA, 3653–3656. https://doi.org/10.1145/2702123.2702133
[6]
Juan David Hincapié-Ramos, Xiang Guo, Paymahn Moghadasian, and Pourang Irani. 2014. Consumed Endurance: A Metric to Quantify Arm Fatigue of Mid-Air Interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 1063–1072. https://doi.org/10.1145/2556288.2557130
[7]
Ricardo Jota, Miguel A. Nacenta, Joaquim A. Jorge, Sheelagh Carpendale, and Saul Greenberg. 2010. A Comparison of Ray Pointing Techniques for Very Large Displays. In Proceedings of Graphics Interface 2010 (Ottawa, Ontario, Canada) (GI ’10). Canadian Information Processing Society, CAN, 269–276.
[8]
Keiko Katsuragawa, Krzysztof Pietroszek, James R. Wallace, and Edward Lank. 2016. Watchpoint: Freehand Pointing with a Smartwatch in a Ubiquitous Display Environment. In Proceedings of the International Working Conference on Advanced Visual Interfaces (Bari, Italy) (AVI ’16). Association for Computing Machinery, New York, NY, USA, 128–135. https://doi.org/10.1145/2909132.2909263
[9]
Regis Kopper, Doug A. Bowman, Mara G. Silva, and Ryan P. McMahan. 2010. A human motor behavior model for distal pointing tasks. International Journal of Human-Computer Studies 68, 10 (2010), 603–615. https://doi.org/10.1016/j.ijhcs.2010.05.001
[10]
Regis Kopper, Mara G. Silva, Ryan P. McMahan, and D. Bowman. 2008. Increasing the Precision of Distant Pointing for Large High-Resolution Displays.
[11]
Anders Markussen, Mikkel Rønne Jakobsen, and Kasper Hornbæk. 2014. Vulture: A Mid-Air Word-Gesture Keyboard. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 1073–1082. https://doi.org/10.1145/2556288.2556964
[12]
Zachary Raffensperger. Mary L. Marazita, Seth Weinberg. 2017. 3D Facial Norms Database.FaceBase Consortium (2017). https://doi.org/10.25550/1WWP
[13]
Fabrice Matulic and Daniel Vogel. 2018. Multiray: Multi-Finger Raycasting for Large Displays. Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3173819
[14]
Mathieu Nancel, Olivier Chapuis, Emmanuel Pietriga, Xing-Dong Yang, Pourang P. Irani, and Michel Beaudouin-Lafon. 2013. High-Precision Pointing on Large Wall Displays Using Small Handheld Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI ’13). Association for Computing Machinery, New York, NY, USA, 831–840. https://doi.org/10.1145/2470654.2470773
[15]
Mathieu Nancel, Emmanuel Pietriga, Olivier Chapuis, and Michel Beaudouin-Lafon. 2015. Mid-Air Pointing on Ultra-Walls. ACM Trans. Comput.-Hum. Interact. 22, 5, Article 21 (Aug. 2015), 62 pages. https://doi.org/10.1145/2766448
[16]
Mathieu Nancel, Julie Wagner, Emmanuel Pietriga, Olivier Chapuis, and Wendy Mackay. 2011. Mid-Air Pan-and-Zoom on Wall-Sized Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). Association for Computing Machinery, New York, NY, USA, 177–186. https://doi.org/10.1145/1978942.1978969
[17]
Krzysztof Pietroszek, Anastasia Kuzminykh, James R. Wallace, and Edward Lank. 2014. Smartcasting: A Discount 3D Interaction Technique for Public Displays. In Proceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures: The Future of Design (Sydney, New South Wales, Australia) (OzCHI ’14). Association for Computing Machinery, New York, NY, USA, 119–128. https://doi.org/10.1145/2686612.2686629
[18]
Ondrej Polacek, Martin Klima, Adam J. Sporka, Pavel Zak, Michal Hradis, Pavel Zemcik, and Vaclav Prochazka. 2012. A Comparative Study on Distant Free-Hand Pointing. In Proceedings of the 10th European Conference on Interactive TV and Video (Berlin, Germany) (EuroITV ’12). Association for Computing Machinery, New York, NY, USA, 139–142. https://doi.org/10.1145/2325616.2325644
[19]
Matthias Schwaller and Denis Lalanne. 2013. Pointing in the Air: Measuring the Effect of Hand Selection Strategies on Performance and Effort. https://doi.org/10.1007/978-3-642-39062-3_53
[20]
Shaishav Siddhpuria, Sylvain Malacria, Mathieu Nancel, and Edward Lank. 2018. Pointing at a Distance with Everyday Smart Devices. Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3173574.3173747
[21]
Rafael Veras, Gaganpreet Singh, Farzin Farhadi-Niaki, Ritesh Udhani, Parth Pradeep Patekar, Wei Zhou, Pourang Irani, and Wei Li. 2021. Elbow-Anchored Interaction: Designing Restful Mid-Air Input. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3411764.3445546
[22]
Daniel Vogel and Ravin Balakrishnan. 2005. Distant Freehand Pointing and Clicking on Very Large, High Resolution Displays. In Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology (Seattle, WA, USA) (UIST ’05). Association for Computing Machinery, New York, NY, USA, 33–42. https://doi.org/10.1145/1095034.1095041
[23]
Chadwick A. Wingrave, Brian Williamson, Paul D. Varcholik, Jeremy Rose, Andrew Miller, Emiko Charbonneau, Jared Bott, and Joseph J. LaViola. 2010. The Wiimote and Beyond: Spatially Convenient Devices for 3D User Interfaces. IEEE Computer Graphics and Applications 30, 2 (2010), 71–85. https://doi.org/10.1109/MCG.2009.109
[24]
Ionuţ-Alexandru Zaiţi, Ştefan-Gheorghe Pentiuc, and Radu-Daniel Vatavu. 2015. On free-hand TV control: experimental results on user-elicited gestures with Leap Motion. Personal and Ubiquitous Computing 19, 5 (2015), 821–838. https://doi.org/10.1007/s00779-015-0863-y
[25]
Futian Zhang, Sachi Mizobuchi, Wei Zhou, Taslim Arefin Khan, Wei Li, and Edward Lank. 2021. Leveraging CD Gain for Precise Barehand Video Timeline Browsing On Smart Displays. In Human-Computer Interaction – INTERACT 2021: 18th IFIP TC 13 International Conference, Bari, Italy, August 30 – September 3, 2021, Proceedings, Part IV (Bari, Italy). Springer-Verlag, Berlin, Heidelberg, 72–91. https://doi.org/10.1007/978-3-030-85610-6_5

Index Terms

  1. Interaction Region Characteristics for Midair Barehand Targeting on a Television

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems
    April 2023
    3914 pages
    ISBN:9781450394222
    DOI:10.1145/3544549
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 19 April 2023

    Check for updates

    Author Tags

    1. Barehand input
    2. Smart TV
    3. Targeting

    Qualifiers

    • Work in progress
    • Research
    • Refereed limited

    Conference

    CHI '23
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 154
      Total Downloads
    • Downloads (Last 12 months)86
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 24 Jan 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media