Skip to main content
SpringerLink
Log in

Manifold Constrained Transfer of Facial Geometric Knowledge for 3D Caricature Reconstruction

  • Regular Paper
  • Published:
Journal of Computer Science and Technology Aims and scope Submit manuscript

Abstract

3D caricatures are important attractive elements of the interface in virtual environment such as online game. However, very limited 3D caricatures exist in the real world. Meanwhile, creating 3D caricatures manually is rather costly, and even professional skills are needed. This paper proposes a novel and effective manifold transfer algorithm to reconstruct 3D caricatures according to their original 2D caricatures. We first manually create a small dataset with only 100 3D caricature models and use them to initialize the whole 3D dataset. After that, manifold transfer algorithm is carried out to refine the dataset. The algorithm comprises of two steps. The first is to perform manifold alignment between 2D and 3D caricatures to get a “standard” manifold map; the second is to reconstruct all the 3D caricatures based on the manifold map. The proposed approach utilizes and transfers knowledge of 2D caricatures to the target 3D caricatures well. Comparative experiments show that the approach reconstructs 3D caricatures more effectively and the results conform more to the styles of the original 2D caricatures than the Principal Components Analysis (PCA) based method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Sadimon S B, Sunar M S, Mohamad D, Haron H. Computer generated caricature: A survey. In Proc. the 2010 Int. Conf. Cyberworlds Pages, Oct. 2010, pp.383–390.

  2. Kondo T, Murakami K, Koshimizu H. From coarse to fine correspondence of 3-D facial images and its application to 3-D facial caricaturing. In Proc. Int. Conf. Recent Advances in 3-D Digital Imaging and Modeling, May 1997, pp.283–288.

  3. Fujiwara T, Koshimizu H, Fujimura K et al. A method for 3D face modeling and caricatured figure generation. In Proc. ICME 2002, Aug. 2002, pp.137–140.

  4. Shadbolt A. From 2D photographs to 3D caricatures. Technical Report, Department of Computer Science, University of Sheffield, 2003.

  5. Lim Y K, Fedorov A, Kim S D. 3D caricature generation system on the mobile handset using a single photograph. In Proc. ICPPW2007, Sept. 2007, Article No.37.

  6. Clarke L, Chen M, Mora B (2011) Automatic generation of 3D caricatures based on artistic deformation styles. IEEE Trans Visualization and Computer Graphics 17(6):808–821

    Article  Google Scholar 

  7. Liu JF, Chen YQ, Miao CY et al (2009) Semi-supervised learning in reconstructed manifold space for 3D caricature generation. Computer Graphics Forum 28(8):2104–2116

    Article  Google Scholar 

  8. Li P F, Chen Y Q, Liu J F et al. 3D caricature generation by nonlinear manifold learning. In Proc. ICME, June 2008, pp.941–944.

  9. Fu G H, Chen Y Q, Liu J F et al. Interactive expressive 3D caricatures design. In Proc. ICME, June 2008, pp.965–968.

  10. Akleman E, Reisch J. Modeling expressive 3D caricatures. In Proc. the 31st SIGGRAPH, Aug. 2004, p.61.

  11. Akimoto T, Suenaga Y, Wallace RS (1993) Automatic creation of 3D facial models. Computer Graphics and Applications 13(5):16–22

    Article  Google Scholar 

  12. Pighin F, Hecker J, Lischinski D, Szeliski R, Shalesin D H. Synthesizing realistic facial expressions from photographs. In Proc. the 25th SIGGRAPH, July 1998, pp.75–84.

  13. Liu Z, Zhang Z, Jacobs C, Cohen M. Rapid modeling of animated faces from video. Technical Report, MSR-TR-2000-11, Microsoft Research, February 2000.

  14. Blanz V, Vetter T. A morphable model for the synthesis of 3D-faces. In Proc. the 26th SIGGRAPH, Aug. 1999, pp.187–194.

  15. Jiang D, Hu Y, Yan S et al (2005) Efficient 3D reconstruction for face recognition. Pattern Recognition 38(6):787–798

    Article  Google Scholar 

  16. Lee J, Moghaddam B, Pfister H, Machiraju R. Silhouette-based 3D face shape recovery. In Proc. Graphics Interface 2003, June 2003, pp.21–30.

  17. Nandy D, Ben-Arie J (2001) Shape from recognition: A novel approach for 3-D face shape recovery. IEEE Transactions on Image Processing 10(2):206–217

    Article  MATH  Google Scholar 

  18. Andreetto M, Brusco N, Cortelazzo GM (2004) Automatic 3D modeling of textured cultural heritage objects. IEEE Transactions on Image Processing 13(3):354–369

    Article  Google Scholar 

  19. Roy-Chowdhury AK, Chellappa R (2005) Statistical bias in 3-D reconstruction from a monocular video. IEEE Transactions on Image Processing 14(8):1057–1062

    Article  MathSciNet  Google Scholar 

  20. Ham J, Lee D, Saul L. Semisupervised alignment of manifolds. In Proc. the 10th International Workshop on Artificial Intelligence and Statistics, Jan. 2005, pp.187–194.

  21. Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326

    Article  Google Scholar 

  22. Oliver MA, Webster R (1990) Kriging: A method of interpolation for geographical information system. INT J Geographical Information Systems 4(3):313–332

    Article  Google Scholar 

  23. Dempster AP, Laird NM, Rubin DB (1977) Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society 39(1):1–38

    MathSciNet  MATH  Google Scholar 

  24. Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Computation 15(6):1373–1396

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute of Computing Technology, Chinese Academy of Sciences, Beijing, 100190, China

    Jun-Fa Liu (Senior Member, CCF, Member, ACM, IEEE,), Wen-Jing He & Yi-Qiang Chen (Senior Member, CCF, Member, ACM, IEEE)

  2. Beijing Key Laboratory of Mobile Computing and Pervasive Device, Beijing, 100190, China

    Jun-Fa Liu (Senior Member, CCF, Member, ACM, IEEE,), Wen-Jing He & Yi-Qiang Chen (Senior Member, CCF, Member, ACM, IEEE)

  3. University of Chinese Academy of Sciences, Beijing, 100049, China

    Wen-Jing He

  4. School of Electronic Information and Automation, Chongqing University of Technology, Chongqing, 400054, China

    Tao Chen

Authors
  1. Jun-Fa Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wen-Jing He
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tao Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yi-Qiang Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jun-Fa Liu.

Additional information

This work was supported by the National Natural Foundation of China under Grant Nos. 61070110 and 61173066.

Electronic Supplementary Material

Below is the link to the electronic supplementary material.

(DOC 40.5 KB)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Liu, JF., He, WJ., Chen, T. et al. Manifold Constrained Transfer of Facial Geometric Knowledge for 3D Caricature Reconstruction. J. Comput. Sci. Technol. 28, 479–489 (2013). https://doi.org/10.1007/s11390-013-1349-x

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11390-013-1349-x

Keywords

Search

Navigation