skip to main content
research-article

A data-driven approach to four-view image-based hair modeling

Published: 20 July 2017 Publication History

Abstract

We introduce a novel four-view image-based hair modeling method. Given four hair images taken from the front, back, left and right views as input, we first estimate the rough 3D shape of the hair observed in the input using a predefined database of 3D hair models, then synthesize a hair texture on the surface of the shape, from which the hair growing direction information is calculated and used to construct a 3D direction field in the hair volume. Finally, we grow hair strands from the scalp, following the direction field, to produce the 3D hair model, which closely resembles the hair in all input images. Our method does not require that all input images are from the same hair, enabling an effective way to create compelling hair models from images of considerably different hairstyles at different views. We demonstrate the efficacy of our method using a wide range of examples.

Supplementary Material

ZIP File (a156-zhang.zip)
Supplemental files.
MP4 File (papers-0224.mp4)

References

[1]
Connelly Barnes, Eli Shechtman, Adam Finkelstein, and Dan B Goldman. 2009. Patch-Match: A Randomized Correspondence Algorithm for Structural Image Editing. ACM Trans. Graph. 28, 3, Article 24 (July 2009), 11 pages.
[2]
Connelly Barnes, Eli Shechtman, Dan B. Goldman, and Adam Finkelstein. 2010. The Generalized Patchmatch Correspondence Algorithm. In ECCV'10. 29--43.
[3]
Pravin Bhat, Brian Curless, Michael Cohen, and C. Lawrence Zitnick. 2008. ECCV. 114--128.
[4]
Volker Blanz and Thomas Vetter. 1999. A Morphable Model for the Synthesis of 3D Faces. In Proc. SIGGRAPH '99. 187--194.
[5]
Chen Cao, Hongzhi Wu, Yanlin Weng, Tianjia Shao, and Kun Zhou. 2016. Real-time Facial Animation with Image-based Dynamic Avatars. ACM Trans. Graph. 35, 4 (2016), 126.
[6]
Menglei Chai, Linjie Luo, Kalyan Sunkavalli, Nathan Carr, Sunil Hadap, and Kun Zhou. 2015. High-quality hair modeling from a single portrait photo. ACM Trans. Graph. 34, 6 (2015), 204.
[7]
Menglei Chai, Tianjia Shao, Hongzhi Wu, Yanlin Weng, and Kun Zhou. 2016. AutoHair: Fully Automatic Hair Modeling from A Single Image. ACM Trans. Graph. 35, 4 (2016), 116.
[8]
Menglei Chai, Lvdi Wang, Yanlin Weng, Xiaogang Jin, and Kun Zhou. 2013. Dynamic hair manipulation in images and videos. ACM Trans. Graph. 32, 4 (2013), 75.
[9]
Menglei Chai, Lvdi Wang, Yanlin Weng, Yizhou Yu, Baining Guo, and Kun Zhou. 2012. Single-view hair modeling for portrait manipulation. ACM Trans. Graph. 31, 4 (2012), 116.
[10]
Nicolas Cherin, Frederic Cordier, and Mahmoud Melkemi. 2014. Modeling piecewise helix curves from 2D sketches. Computer-Aided Design 46 (2014), 258 -- 262.
[11]
Soheil Darabi, Eli Shechtman, Connelly Barnes, Dan B. Goldman, and Pradeep Sen. 2012. Image Melding: Combining Inconsistent Images Using Patch-based Synthesis. ACM Trans. Graph. 31, 4, Article 82 (July 2012), 10 pages.
[12]
Matthew Fisher, Peter Schröder, Mathieu Desbrun, and Hugues Hoppe. 2007. Design of Tangent Vector Fields. ACM Trans. Graph. 26, 3, Article 56 (July 2007).
[13]
Tomas Lay Herrera, Arno Zinke, and Andreas Weber. 2012. Lighting hair from the inside: A thermal approach to hair reconstruction. ACM Trans. Graph. 31, 6 (2012), 146.
[14]
Liwen Hu, Chongyang Ma, Linjie Luo, and Hao Li. 2014. Robust hair capture using simulated examples. ACM Trans. Graph. 33, 4 (2014), 126.
[15]
Liwen Hu, Chongyang Ma, Linjie Luo, and Hao Li. 2015. Single-view hair modeling using a hairstyle database. ACM Trans. Graph. 34, 4 (2015), 125.
[16]
Liwen Hu, Chongyang Ma, Linjie Luo, Li-Yi Wei, and Hao Li. 2014. Capturing Braided Hairstyles. ACM Trans. Graph. 33, 6, Article 225 (Nov. 2014), 9 pages.
[17]
Wenzel Jakob, Jonathan T Moon, and Steve Marschner. 2009. Capturing hair assemblies fiber by fiber. ACM Trans. Graph. 28, 5 (2009), 164.
[18]
Tae-Yong Kim and Ulrich Neumann. 2002. Interactive Multiresolution Hair Modeling and Editing. ACM Trans. Graph. 21, 3 (July 2002), 620--629.
[19]
Yin Li, Jian Sun, Chi-Keung Tang, and Heung-Yeung Shum. 2004. Lazy Snapping. ACM Trans. Graph. 23, 3 (Aug. 2004), 303--308.
[20]
William E. Lorensen and Harvey E. Cline. 1987. Marching Cubes: A High Resolution 3D Surface Construction Algorithm. In SIGGRAPH '87 (SIGGRAPH '87). ACM, 163--169.
[21]
Linjie Luo, Hao Li, and Szymon Rusinkiewicz. 2013. Structure-aware hair capture. ACM Trans. Graph. 32, 4 (2013), 76.
[22]
Microsoft. 2017. UVAtlas. https://github.com/Microsoft/UVAtlas/. (2017).
[23]
Sylvain Paris, Hector M. Briceño, and François X. Sillion. 2004. Capture of Hair Geometry from Multiple Images. ACM Trans. Graph. 23, 3 (Aug. 2004), 712--719.
[24]
Sylvain Paris, Will Chang, Oleg I Kozhushnyan, Wojciech Jarosz, Wojciech Matusik, Matthias Zwicker, and Frédo Durand. 2008. Hair photobooth: geometric and photometric acquisition of real hairstyles. ACM Trans. Graph. 27, 3 (2008), 30.
[25]
Sastien Valette and Jean-Marc Chassery. 2004. Approximated Centroidal Voronoi Diagrams for Uniform Polygonal Mesh Coarsening. Computer Graphics Forum 23, 3 (2004), 381--389.
[26]
Nuttapon Vanakittistien, Attawith Sudsang, and Nuttapong Chentanez. 2016. 3D Hair Model from Small Set of Images. In Proceedings of MIG. ACM, New York, NY, USA, 85--90.
[27]
Lvdi Wang, Yizhou Yu, Kun Zhou, and Baining Guo. 2009. Example-based Hair Geometry Synthesis. ACM Trans. Graph. 28, 3, Article 56 (July 2009), 9 pages.
[28]
Kelly Ward, Florence Bertails, Tae-Yong Kim, Stephen R Marschner, Marie-Paule Cani, and Ming C Lin. 2007. A survey on hair modeling: Styling, simulation, and rendering. IEEE Trans. Vis. Comp. Graph. 13, 2 (2007), 213--234.
[29]
Li-Yi Wei and Marc Levoy. 2001. Texture Synthesis over Arbitrary Manifold Surfaces. In SIGGRAPH '01. ACM, 355--360.
[30]
Yichen Wei, Eyal Ofek, Long Quan, and Heung-Yeung Shum. 2005. Modeling Hair from Multiple Views. ACM Trans. Graph. 24, 3 (July 2005), 816--820.
[31]
Y. Wexler, E. Shechtman, and M. Irani. 2007. Space-Time Completion of Video. IEEE TPAMI 29, 3 (2007), 463--476.
[32]
Xuan Yu, Zhan Yu, Xiaogang Chen, and Jingyi Yu. 2014. A Hybrid image-CAD Based System for Modeling Realistic Hairstyles. In I3D '14. ACM, 63--70.
[33]
Cem Yuksel, Scott Schaefer, and John Keyser. 2009. Hair meshes. ACM Trans. Graph. 28, 5 (2009), 166.
[34]
Hongkai Zhao. 2005. A fast sweeping method for eikonal equations. Mathematics of computation 74, 250 (2005), 603--627.

Cited By

View all
  • (2024)GroomCap: High-Fidelity Prior-Free Hair CaptureACM Transactions on Graphics10.1145/368776843:6(1-15)Online publication date: 19-Dec-2024
  • (2024)MonoHair: High-Fidelity Hair Modeling from a Monocular Video2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.02281(24164-24173)Online publication date: 16-Jun-2024
  • (2024)Dr.Hair: Reconstructing Scalp-Connected Hair Strands without Pre-Training via Differentiable Rendering of Line Segments2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.01947(20601-20611)Online publication date: 16-Jun-2024
  • Show More Cited By

Index Terms

  1. A data-driven approach to four-view image-based hair modeling

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Graphics
    ACM Transactions on Graphics  Volume 36, Issue 4
    August 2017
    2155 pages
    ISSN:0730-0301
    EISSN:1557-7368
    DOI:10.1145/3072959
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 20 July 2017
    Published in TOG Volume 36, Issue 4

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. hair modeling
    2. image-based modeling
    3. patch-based texture synthesis

    Qualifiers

    • Research-article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)23
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 28 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)GroomCap: High-Fidelity Prior-Free Hair CaptureACM Transactions on Graphics10.1145/368776843:6(1-15)Online publication date: 19-Dec-2024
    • (2024)MonoHair: High-Fidelity Hair Modeling from a Monocular Video2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.02281(24164-24173)Online publication date: 16-Jun-2024
    • (2024)Dr.Hair: Reconstructing Scalp-Connected Hair Strands without Pre-Training via Differentiable Rendering of Line Segments2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.01947(20601-20611)Online publication date: 16-Jun-2024
    • (2024)Strand-accurate multi-view facial hair reconstruction and trackingThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-024-03465-540:7(4713-4724)Online publication date: 1-Jul-2024
    • (2024)Human Hair Reconstruction with Strand-Aligned 3D GaussiansComputer Vision – ECCV 202410.1007/978-3-031-72640-8_23(409-425)Online publication date: 29-Sep-2024
    • (2024)InstaFace: Single-View 3D Face Reconstruction with Hair Try-OnAdvances in Information and Communication Technology10.1007/978-3-031-50818-9_30(274-282)Online publication date: 4-Jan-2024
    • (2023)EMS: 3D Eyebrow Modeling from Single-View ImagesACM Transactions on Graphics10.1145/361832342:6(1-19)Online publication date: 5-Dec-2023
    • (2023)GroomGen: A High-Quality Generative Hair Model Using Hierarchical Latent RepresentationsACM Transactions on Graphics10.1145/361830942:6(1-16)Online publication date: 5-Dec-2023
    • (2023)Refinement of Hair Geometry by Strand IntegrationComputer Graphics Forum10.1111/cgf.1497042:7Online publication date: 5-Nov-2023
    • (2022)DeepMVSHair: Deep Hair Modeling from Sparse ViewsSIGGRAPH Asia 2022 Conference Papers10.1145/3550469.3555385(1-8)Online publication date: 29-Nov-2022
    • Show More Cited By

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media