skip to main content
10.1145/3415255.3422887acmconferencesArticle/Chapter ViewAbstractPublication Pagessiggraph-asiaConference Proceedingsconference-collections
abstract

High-Speed Human Arm Projection Mapping with Skin Deformation

Published: 17 November 2020 Publication History

Abstract

Augmenting the human arm surface via projection mapping can have a great impact on our daily lives with regards to entertainment, human-computer interaction, and education. However, conventional methods ignore skin deformation and have a high latency from motion to projection, which degrades the user experience. In this paper, we propose a projection mapping system that can solve such problems. First, we newly combine a state-of-the-art parametric deformable surface model with an efficient regression-based accuracy compensation method of skin deformation. The compensation method modifies the texture coordinate to achieve high-speed and highly accurate image generation for projection using joint-tracking results. Second, we develop a high-speed system that reduces latency from motion to projection within 10 ms. Compared to the conventional methods, this system provides more realistic experiences.

References

[1]
Madeline Gannon, Tovi Grossman, and George Fitzmaurice. 2016. ExoSkin: On-Body Fabrication. In CHI ’16. 5996–6007.
[2]
Chris Harrison, Hrvoje Benko, and Andrew D. Wilson. 2011. OmniTouch: Wearable Multitouch Interaction Everywhere. In UIST ’11 (Santa Barbara, California, USA). 441–450.
[3]
Thuong Hoang, Martin Reinoso, Zaher Joukhadar, Frank Vetere, and David Kelly. 2017. Augmented Studio: Projection Mapping on Moving Body for Physiotherapy Education. In CHI ’17. 1419–1430.
[4]
Hanbyul Joo, Tomas Simon, and Yaser Sheikh. 2018. Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodies. In CVPR ’18. 8320–8329.
[5]
Matthew Loper, Naureen Mahmood, Javier Romero, Gerard Pons-Moll, and Michael J. Black. 2015. SMPL: A Skinned Multi-Person Linear Model. ACM Trans. Graph. 34, 6, Article 248 (2015), 16 pages.
[6]
Akihiko Murai, Q. Youn Hong, Katsu Yamane, and Jessica K. Hodgins. 2016. Dynamic Skin Deformation Simulation Using Musculoskeletal Model and Soft Tissue Dynamics. Computational Visual Media 3 (2016).
[7]
Oskar&Gaspar. 2015. Ink Mapping: Video Mapping Projection on Tattoos. https://vimeo.com/143296099
[8]
Yoshihiro Watanabe and Masatoshi Ishikawa. 2019. High-Speed and High-Brightness Color Single-Chip DLP Projector Using High-Power LED-Based Light Sources. In IDW ’19. 1350–1352.

Cited By

View all
  • (2022)Apparent Shape Manipulation by Light-Field Projection onto a Retroreflective Surface2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW55335.2022.00291(880-881)Online publication date: Mar-2022
  • (2021)High-Speed Dynamic Projection Mapping onto Human Arm with Realistic Skin DeformationApplied Sciences10.3390/app1109375311:9(3753)Online publication date: 21-Apr-2021
  • (2021)BodyStylus: Freehand On-Body Design and Fabrication of Epidermal InterfacesProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445475(1-15)Online publication date: 6-May-2021

Index Terms

  1. High-Speed Human Arm Projection Mapping with Skin Deformation
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Conferences
        SA '20: SIGGRAPH Asia 2020 Emerging Technologies
        December 2020
        38 pages
        ISBN:9781450381109
        DOI:10.1145/3415255
        Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

        Sponsors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 17 November 2020

        Check for updates

        Author Tags

        1. Augmented Reality
        2. Projection Mapping
        3. Skin Deformation

        Qualifiers

        • Abstract
        • Research
        • Refereed limited

        Conference

        SA '20
        Sponsor:
        SA '20: SIGGRAPH Asia 2020
        December 4 - 13, 2020
        Virtual Event, Republic of Korea

        Acceptance Rates

        Overall Acceptance Rate 178 of 869 submissions, 20%

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)24
        • Downloads (Last 6 weeks)1
        Reflects downloads up to 05 Mar 2025

        Other Metrics

        Citations

        Cited By

        View all
        • (2022)Apparent Shape Manipulation by Light-Field Projection onto a Retroreflective Surface2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW55335.2022.00291(880-881)Online publication date: Mar-2022
        • (2021)High-Speed Dynamic Projection Mapping onto Human Arm with Realistic Skin DeformationApplied Sciences10.3390/app1109375311:9(3753)Online publication date: 21-Apr-2021
        • (2021)BodyStylus: Freehand On-Body Design and Fabrication of Epidermal InterfacesProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445475(1-15)Online publication date: 6-May-2021

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format.

        HTML Format

        Figures

        Tables

        Media

        Share

        Share

        Share this Publication link

        Share on social media