skip to main content
10.1145/2988240.3014572acmconferencesArticle/Chapter ViewAbstractPublication Pagessiggraph-asiaConference Proceedingsconference-collections
abstract

Pinscreen: 3D avatar from a single image

Published: 28 November 2016 Publication History

Abstract

The age of social media and immersive technologies has created a growing need for processing detailed visual representations of ourselves as virtual and augmented reality is growing into the next generation platform for online communication, connecting hundreds of millions of users. A realistic simulation of our presence in a mixed reality environment is unthinkable without a compelling and directable 3D digitization of ourselves. With the wide availability of mobile cameras and internet images, we introduce a technology that can build a realistic 3D avatar from a single photograph. This textured 3D face model includes hair and can be instantly animated by anyone in real-time through natural facial performances captured from a regular RGB camera. Immediate applications include personalized gaming and VR-enabled social networks using automatically digitized 3D avatars, as well as mobile apps such as video messengers (e.g., Snapchat) with face-swapping capabilities. As opposed to existing solutions, our technology enables the automatic generation of a complete head model from a fully unconstrained image.

References

[1]
Hu, L., Ma, C., Luo, L., and Li, H. 2015. Single-view hair modeling using a hairstyle database. ACM Transactions on Graphics (Proceedings SIGGRAPH 2015) 34, 4 (July).
[2]
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., and Darrell, T. 2014. Caffe: Convolutional architecture for fast feature embedding. In Proceedings of the 22nd ACM international conference on Multimedia, ACM, 675--678.
[3]
Saito, S., Li, T., and Li, H. 2016. Real-time facial segmentation and performance capture from rgb input. In Proceedings of the European Conference on Computer Vision (ECCV).

Cited By

View all
  • (2023)Designing Loving-Kindness Meditation in Virtual Reality for Long-Distance Romantic RelationshipsProceedings of the 31st ACM International Conference on Multimedia10.1145/3581783.3612438(7608-7617)Online publication date: 26-Oct-2023
  • (2020)The Rocketbox Library and the Utility of Freely Available Rigged AvatarsFrontiers in Virtual Reality10.3389/frvir.2020.5615581Online publication date: 3-Nov-2020
  • (2019)A Neural Virtual Anchor Synthesizer Based on Seq2Seq and GAN Models2019 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct.2019.00-40(233-236)Online publication date: Oct-2019

Index Terms

  1. Pinscreen: 3D avatar from a single image

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SA '16: SIGGRAPH ASIA 2016 Emerging Technologies
    November 2016
    28 pages
    ISBN:9781450345392
    DOI:10.1145/2988240
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 28 November 2016

    Check for updates

    Author Tags

    1. avatar generation
    2. face capture
    3. hair modeling

    Qualifiers

    • Abstract

    Conference

    SA '16
    Sponsor:
    SA '16: SIGGRAPH Asia 2016
    December 5 - 8, 2016
    Macau

    Acceptance Rates

    Overall Acceptance Rate 178 of 869 submissions, 20%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)10
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 19 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Designing Loving-Kindness Meditation in Virtual Reality for Long-Distance Romantic RelationshipsProceedings of the 31st ACM International Conference on Multimedia10.1145/3581783.3612438(7608-7617)Online publication date: 26-Oct-2023
    • (2020)The Rocketbox Library and the Utility of Freely Available Rigged AvatarsFrontiers in Virtual Reality10.3389/frvir.2020.5615581Online publication date: 3-Nov-2020
    • (2019)A Neural Virtual Anchor Synthesizer Based on Seq2Seq and GAN Models2019 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct.2019.00-40(233-236)Online publication date: Oct-2019

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media