skip to main content
10.1145/3095140.3095164acmotherconferencesArticle/Chapter ViewAbstractPublication PagescgiConference Proceedingsconference-collections
short-paper

Retouch transfer for 3D printed face replica with automatic alignment

Published: 27 June 2017 Publication History

Abstract

Recent developments in 3D scanning make it easy to obtain 3D geometry of a human and produce a 3D replica using a 3D printer. However, the setting for full body scanning enforces low-quality of the facial area due to the lack of image resolution. To solve this issue, artists retouch the raw scanned full body model with a 3D sculpting tool, but it takes a lot of time and effort. In this paper, we present a system to automate the retouching process by transferring a retouched result by an expert to an arbitrary target face model. Our method first identifies facial features, such as the eyes and nose of the 3D models by exploiting 2D face detection. For each facial part, the method establishes dense correspondences between the exemplar and the target using the detection result, and then transfers the geometry of the exemplar to the target by coating transfer. We show that our method improves not only the geometry of model but also the 3D printed replica.

References

[1]
Thabo Beeler, Bernd Bickel, Paul Beardsley, Bob Sumner, and Markus Gross. 2010. High-quality Single-shot Capture of Facial Geometry. In ACM SIGGRAPH 2010 Papers (SIGGRAPH '10). ACM, New York, NY, USA, Article 40, 9 pages.
[2]
Pascal Bérard, Derek Bradley, Markus Gross, and Thabo Beeler. 2016. Lightweight Eye Capture Using a Parametric Model. ACM Trans. Graph. 35, 4, Article 117 (July 2016), 12 pages.
[3]
Chen Cao, Hongzhi Wu, Yanlin Weng, Tianjia Shao, and Kun Zhou. 2016. Real-time Facial Animation with Image-based Dynamic Avatars. ACM Trans. Graph. 35, 4, Article 126 (July 2016), 12 pages.
[4]
Jose I. Echevarria, Derek Bradley, Diego Gutierrez, and Thabo Beeler. 2014. Capturing and Stylizing Hair for 3D Fabrication. ACM Trans. Graph. 33, 4, Article 125 (July 2014), 11 pages.
[5]
Yasutaka Furukawa and Jean Ponce. 2010. Accurate, Dense, and Robust Multiview Stereopsis. IEEE Trans. Pattern Anal. Mach. Intell. 32, 8 (Aug. 2010), 1362--1376.
[6]
Pablo Garrido, Michael Zollhöfer, Dan Casas, Levi Valgaerts, Kiran Varanasi, Patrick Pérez, and Christian Theobalt. 2016. Reconstruction of Personalized 3D Face Rigs from Monocular Video. ACM Trans. Graph. 35, 3, Article 28 (May 2016), 15 pages.
[7]
Pablo Garrido, Michael Zollhöfer, Chenglei Wu, Derek Bradley, Patrick Pérez, Thabo Beeler, and Christian Theobalt. 2016. Corrective 3D Reconstruction of Lips from Monocular Video. ACM Trans. Graph. 35, 6, Article 219 (Nov. 2016), 11 pages.
[8]
Peter Hancock and Bernie Tiddeman. 2013. Stirling/ESRC 3D Face Database. http://pics.stir.ac.uk/ESRC/. (2013). Accessed: 2017-04-06.
[9]
Stefan Hinterstoisser, Vincent Lepetit, Selim Benhimane, Pascal Fua, and Nassir Navab. 2011. Learning Real-Time Perspective Patch Rectification. International Journal of Computer Vision 91, 1 (2011), 107--130.
[10]
Alexandru Eugen Ichim, Sofien Bouaziz, and Mark Pauly. 2015. Dynamic 3D Avatar Creation from Hand-held Video Input. ACM Trans. Graph. 34, 4, Article 45 (July 2015), 14 pages.
[11]
Davis E. King. 2009. Dlib-ml: A Machine Learning Toolkit. Journal of Machine Learning Research 10 (Dec. 2009), 1755--1758. http://dl.acm.org/citation.cfm?id=1577069.1755843
[12]
T. H. Kwok, Y. Zhang, and C. C. L. Wang. 2012. Efficient Optimization of Common Base Domains for Cross Parameterization. IEEE Transactions on Visualization and Computer Graphics 18, 10 (Oct 2012), 1678--1692.
[13]
Vuong Le, Jonathan Brandt, Zhe Lin, Lubomir Bourdev, and Thomas S. Huang. 2012. Interactive Facial Feature Localization. Springer Berlin Heidelberg, Berlin, Heidelberg, 679--692.
[14]
Hao Li, Etienne Vouga, Anton Gudym, Linjie Luo, Jonathan T. Barron, and Gleb Gusev. 2013. 3D Self-portraits. ACM Trans. Graph. 32, 6, Article 187 (Nov. 2013), 9 pages.
[15]
Christos Sagonas, Georgios Tzimiropoulos, Stefanos Zafeiriou, and Maja Pantic. 2013. 300 Faces in-the-Wild Challenge: The First Facial Landmark Localization Challenge. In The IEEE International Conference on Computer Vision (ICCV) Workshops.
[16]
O. Sorkine, D. Cohen-Or, Y. Lipman, M. Alexa, C. Rössl, and H.-P. Seidel. 2004. Laplacian Surface Editing. In Proceedings of the 2004 Eurographics/ACM SIGGRAPH Symposium on Geometry Processing (SGP '04). ACM, New York, NY, USA, 175--184.
[17]
J. R. Tena, M. Mahler, T. Beeler, M. Grosse, H. Yeh, and I. Matthews. 2013. Fabricating 3D Figurines with Personalized Faces. IEEE Computer Graphics and Applications 33, 6 (Nov 2013), 36--46.
[18]
Chenglei Wu, Derek Bradley, Pablo Garrido, Michael Zollhöfer, Christian Theobalt, Markus Gross, and Thabo Beeler. 2016. Model-based Teeth Reconstruction. ACM Trans. Graph. 35, 6, Article 220 (Nov. 2016), 13 pages.
[19]
Matthias Zwicker, Mark Pauly, Oliver Knoll, and Markus Gross. 2002. Pointshop 3D: An Interactive System for Point-based Surface Editing. In Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '02). ACM, New York, NY, USA, 322--329.

Cited By

View all
  • (2019)A System for Efficient 3D Printed Stop-motion Face AnimationACM Transactions on Graphics10.1145/336051039:1(1-11)Online publication date: 18-Oct-2019

Index Terms

  1. Retouch transfer for 3D printed face replica with automatic alignment

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    CGI '17: Proceedings of the Computer Graphics International Conference
    June 2017
    260 pages
    ISBN:9781450352284
    DOI:10.1145/3095140
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 27 June 2017

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. 3D modeling
    2. 3D printing
    3. face alignment
    4. retouch transfer

    Qualifiers

    • Short-paper

    Conference

    CGI '17
    CGI '17: Computer Graphics International 2017
    June 27 - 30, 2017
    Yokohama, Japan

    Acceptance Rates

    Overall Acceptance Rate 35 of 159 submissions, 22%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)7
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 14 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2019)A System for Efficient 3D Printed Stop-motion Face AnimationACM Transactions on Graphics10.1145/336051039:1(1-11)Online publication date: 18-Oct-2019

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media