skip to main content
10.1145/3027063.3049795acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
extended-abstract

FistPointer: Target Selection Technique using Mid-air Interaction for Mobile VR Environment

Published: 06 May 2017 Publication History

Abstract

We present a target selection technique using mid-air interaction behind a smartphone for mobile virtual reality (VR) environments. This is realized by using a smartphone as a head-mounted display with a cardboard viewer. Our technique displays a pointer on the screen corresponding to the position of the hand, which is detected by the built-in back camera of the smartphone. The user can move the pointer by moving the hand in a thumbs-up position. The user can also select a target by folding the thumb, similarly to pushing a joystick button. Our technique can be implemented using only a smartphone with a built-in back camera; therefore, it is easy to apply to target selection in mobile VR environments. To test the feasibility of the design, we prototyped a proof-of-concept implementation. Furthermore, we developed a game using our technique and investigated user impressions.

Supplementary Material

suppl.mov (vid1055.mp4)
Supplemental video

Cited By

View all
  • (2024)Experimental Analysis of Freehand Multi-object Selection Techniques in Virtual Reality Head-Mounted DisplaysProceedings of the ACM on Human-Computer Interaction10.1145/36981298:ISS(93-111)Online publication date: 24-Oct-2024
  • (2023)GesMessages: Using Mid-air Gestures to Manage NotificationsProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3618023(1-2)Online publication date: 13-Oct-2023
  • (2023)Low-Fi VR Controller: Improved Mobile Virtual Reality Interaction via Camera-Based TrackingProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614517(1-12)Online publication date: 13-Oct-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI EA '17: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems
May 2017
3954 pages
ISBN:9781450346566
DOI:10.1145/3027063
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 May 2017

Check for updates

Author Tags

  1. cardboard
  2. head-mounted display
  3. pointing
  4. targeting.
  5. virtual reality

Qualifiers

  • Extended-abstract

Conference

CHI '17
Sponsor:

Acceptance Rates

CHI EA '17 Paper Acceptance Rate 1,000 of 5,000 submissions, 20%;
Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)25
  • Downloads (Last 6 weeks)2
Reflects downloads up to 07 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Experimental Analysis of Freehand Multi-object Selection Techniques in Virtual Reality Head-Mounted DisplaysProceedings of the ACM on Human-Computer Interaction10.1145/36981298:ISS(93-111)Online publication date: 24-Oct-2024
  • (2023)GesMessages: Using Mid-air Gestures to Manage NotificationsProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3618023(1-2)Online publication date: 13-Oct-2023
  • (2023)Low-Fi VR Controller: Improved Mobile Virtual Reality Interaction via Camera-Based TrackingProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614517(1-12)Online publication date: 13-Oct-2023
  • (2022)Designing successive target selection in virtual reality via penetrating the intangible interface with handheld controllersInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2022.102835165:COnline publication date: 1-Sep-2022
  • (2021)Expanding One-Handed Input Vocabulary for Smartphone Using In-Air Gesture of Index Finger Captured by Rear CameraProceedings of the Asian CHI Symposium 202110.1145/3429360.3468181(61-63)Online publication date: 8-May-2021
  • (2021)Exploring Text Revision with Backspace and Caret in Virtual RealityProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445474(1-12)Online publication date: 6-May-2021
  • (2021)GestOnHMD: Enabling Gesture-based Interaction on Low-cost VR Head-Mounted DisplayIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.306768927:5(2597-2607)Online publication date: May-2021
  • (2019)Head-Fingers-Arms: Physically-Coupled and Decoupled Multimodal Interaction Designs in Mobile VRProceedings of the 17th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry10.1145/3359997.3365697(1-9)Online publication date: 14-Nov-2019
  • (2019)Text Entry in Virtual Reality: A Comprehensive Review of the LiteratureHuman-Computer Interaction. Recognition and Interaction Technologies10.1007/978-3-030-22643-5_33(419-437)Online publication date: 26-Jul-2019
  • (2018)ExtensionClipExtended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3170427.3188644(1-6)Online publication date: 20-Apr-2018
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media