skip to main content
10.1145/2207676.2207702acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

LightGuide: projected visualizations for hand movement guidance

Published: 05 May 2012 Publication History

Abstract

LightGuide is a system that explores a new approach to gesture guidance where we project guidance hints directly on a user's body. These projected hints guide the user in completing the desired motion with their body part which is particularly useful for performing movements that require accuracy and proper technique, such as during exercise or physical therapy. Our proof-of-concept implementation consists of a single low-cost depth camera and projector and we present four novel interaction techniques that are focused on guiding a user's hand in mid-air. Our visualizations are designed to incorporate both feedback and feedforward cues to help guide users through a range of movements. We quantify the performance of LightGuide in a user study comparing each of our on-body visualizations to hand animation videos on a computer display in both time and accuracy. Exceeding our expectations, participants performed movements with an average error of 21.6mm, nearly 85% more accurately than when guided by video.

Supplementary Material

MP4 File (paperfile1912-3.mp4)
Supplemental video for “LightGuide: projected visualizations for hand movement guidance”

References

[1]
Baird, K. M. and Barfield, W. Evaluating the effectiveness of augmented reality displays for a manual assembly task. Virtual Reality 4, 4, 1999, 250--259.
[2]
Banaji, M. R. Stevens, Stanley Smith (1906-73). Journal of Personality and Social Psychology, 1994.
[3]
Bau, O. and Mackay, W. E. OctoPocus: a dynamic guide for learning gesture-based command sets. Proc. UIST, 2008, 37--46.
[4]
Britannica. http://britannica.com/EBchecked/topic/150794/dance-notation.
[5]
Cao, X. and Balakrishnan, R. Interacting with dynamically defined information spaces using a handheld projector and a pen. Proc. UIST, 2006, 225--234.
[6]
Cao, X., Forlines, C., and Balakrishnan, R. Multi-user interaction using handheld projectors. Proc. UIST, 2007, 43--52.
[7]
Daniel Dementhon, L. D. Model-Based object pose in 25 lines of code. Proc. of IJCV 15, 1 (1995), 123--141.
[8]
Feiner, Steve, Blaire Macintyre, D. S. Knowledge-Based augmented reality. Commun. ACM 36, 7, 1993, 53--62.
[9]
Felzenszwalb, P. F. and Huttenlocher, D. P. Distance transforms of sampled functions. 2004.
[10]
Flagg, M. and Rehg, J. M. Projector guided painting. Proc. UIST, 2006, 235--244.
[11]
Freeman, D., Benko, H., Morris, M. R., and Wigdor, D. ShadowGuides: Visualizations for In-Situ Learning of MultiTouch and Whole-Hand Gestures. Proc. ITS, 2009, 165--172.
[12]
Harrison, C., Benko, H., Wilson, A. D., and Way, O. M. OmniTouch: Wearable multitouch interaction everywhere. Proc. UIST, 2011, 441--450.
[13]
Harrison, C., Tan, D., and Morris, D. Skinput: Appropriating the body as an input surface. Proc. CHI, 2010, 453--462.
[14]
Holz, C. and Wilson, A. Data miming: inferring spatial object descriptions from human gesture. Proc. CHI, 2011, 811--820.
[15]
Hua, H., Brown, L. D., and Gao, C. Scape: Supporting Stereoscopic Collaboration in Projective Environments. Proc. CG, 2004, 66--75.
[16]
InFocus. http://www.infocus.com.
[17]
Jacob, R. The perceptual structure of multidimensional input device selection. Proc. CHI, 1992, 211--218.
[18]
Kane, S. K., Avrahami, D., Wobbrock, J. O., and Harrison, B. Bonfire: A Nomadic system for hybrid laptop-tabletop interaction. Proc. UIST, 2009, 129--138.
[19]
Kirk, D. and Stanton Fraser, D. Comparing remote gesture technologies for supporting collaborative physical tasks. Proc. CHI, 2006, 1191--1200.
[20]
Mistry, P. and Maes, P. WUW-wear Ur world: a wearable gestural interface. Proc. CHI, 2009, 4111--4116.
[21]
Motokawa, Y. and Saito, H. Support system for guitar playing using augmented reality display. Proc. ISMAR, 2006, 243--244.
[22]
Neumann, U. and Majoros, A. Cognitive, performance, and systems issues for augmented reality applications in manufacturing and maintenance. Proc. of VR, 1998, 4--11.
[23]
Palmiter, S. and Elkerton, J. An evaluation of animated demonstrations of learning computer-based tasks. Proc. CHI, 1991, 257--263.
[24]
Pinhanez, C. The Everywhere Displays Projector: A Device to create ubiquitous graphical interfaces. Proc. UbiComp, 2001, 315--331.
[25]
Raskar, R., Beardsley, P., Van Baar, J., et al. RFIG Lamps: interacting with a self-describing world via photosensing wireless tags and projectors. Proc. of SIGGRAPH, 2004, 406-- 415.
[26]
Raskar, R., Welch, G., Cutts, M., Lake, A., Stesin, L., and Fuchs, H. The office of the future: A unified approach to image-based modeling and spatially immersive displays. Proc. SIGGRAPH, 1998, 179--188.
[27]
Raskar, R., Welch, G., Low, K. L., and Bandyopadhyay, D. Shader lamps: Animating real objects with image-based illumination. Proc. Eurographics, 2001, 89.
[28]
Rosenthal, S., Kane, S. K., Wobbrock, J. O., and Avrahami, D. Augmenting On-Screen Instructions with Micro-Projected Guides: When it works, and when it fails. Proc. UbiComp, 2010, 203--212.
[29]
SynchronousObjects. http://synchronousobjects.osu.edu.
[30]
Tan, D. S., Pausch, R., and Hodgins, J. Exploiting the cognitive and social benefits of physically large displays. 2004.
[31]
Watson, G., Curran, R., Butterfield, J., and Craig, C. The effect of using animated work instructions over text and static graphics when performing a small scale engineering assembly. Proc. CE, 2008, 541--550.
[32]
White, S., Lister, L., and Feiner, S. Visual Hints for tangible gestures in augmented reality. Proc. ISMAR, 2007, 1--4.
[33]
Wilson, A. D. and Benko, H. Combining multiple depth cameras and projectors for interactions on, above and between surfaces. Proc. UIST, 2010, 273--282.
[34]
Zhang, Z. Iterative point matching for registration of free-form curves and surfaces. Journal of Computer Vision 13, 2 1994, 119--152.

Cited By

View all
  • (2024)MorphGrip: Haptic Guidance Using a Shape-Changing GripProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701573(196-209)Online publication date: 1-Dec-2024
  • (2024)Casper DPM: Cascaded Perceptual Dynamic Projection Mapping onto HandsSIGGRAPH Asia 2024 Conference Papers10.1145/3680528.3687624(1-10)Online publication date: 3-Dec-2024
  • (2024)AudioMove: Applying the Spatial Audio to Multi-Directional Limb Exercise GuidanceProceedings of the ACM on Human-Computer Interaction10.1145/36764898:MHCI(1-26)Online publication date: 24-Sep-2024
  • Show More Cited By

Index Terms

  1. LightGuide: projected visualizations for hand movement guidance

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
    May 2012
    3276 pages
    ISBN:9781450310154
    DOI:10.1145/2207676
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 05 May 2012

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. appropriated surfaces
    2. on-body computing
    3. on-demand interfaces
    4. spatial augmented reality
    5. tracking

    Qualifiers

    • Research-article

    Conference

    CHI '12
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)101
    • Downloads (Last 6 weeks)7
    Reflects downloads up to 20 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)MorphGrip: Haptic Guidance Using a Shape-Changing GripProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701573(196-209)Online publication date: 1-Dec-2024
    • (2024)Casper DPM: Cascaded Perceptual Dynamic Projection Mapping onto HandsSIGGRAPH Asia 2024 Conference Papers10.1145/3680528.3687624(1-10)Online publication date: 3-Dec-2024
    • (2024)AudioMove: Applying the Spatial Audio to Multi-Directional Limb Exercise GuidanceProceedings of the ACM on Human-Computer Interaction10.1145/36764898:MHCI(1-26)Online publication date: 24-Sep-2024
    • (2024)JollyGesture: Exploring Dual-Purpose Gestures and Gesture Guidance in VR PresentationsProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670965(1-14)Online publication date: 3-Jun-2024
    • (2024)ViRgilites: Multilevel Feedforward for Multimodal Interaction in VRProceedings of the ACM on Human-Computer Interaction10.1145/36586458:EICS(1-24)Online publication date: 17-Jun-2024
    • (2024)avaTTAR: Table Tennis Stroke Training with Embodied and Detached Visualization in Augmented RealityProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676400(1-16)Online publication date: 13-Oct-2024
    • (2024)Exploring Visualizations for Precisely Guiding Bare Hand Gestures in Virtual RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642935(1-19)Online publication date: 11-May-2024
    • (2024)Design Space of Visual Feedforward And Corrective Feedback in XR-Based Motion Guidance SystemsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642143(1-15)Online publication date: 11-May-2024
    • (2023)Poka Yoke in Smart Production Systems with Pick-to-Light Implementation to Increase EfficiencyApplied Sciences10.3390/app13211171513:21(11715)Online publication date: 26-Oct-2023
    • (2023)Studying the Visual Representation of MicrogesturesProceedings of the ACM on Human-Computer Interaction10.1145/36042727:MHCI(1-36)Online publication date: 13-Sep-2023
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media