Skip to main content
SpringerLink
Log in

Automatic Photorealistic 3D Inner Mouth Restoration from Frontal Images

  • Conference paper
Book cover Advances in Visual Computing (ISVC 2014)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 8887))

Included in the following conference series:

Abstract

In this paper, we propose a novel method to generate highly photorealistic three-dimensional (3D) inner mouth animation that is well-fitted to an original ready-made speech animation using only frontal captured images and a small-size database. The algorithms are composed of quasi-3D model reconstruction and motion control of teeth and the tongue, and final compositing of photorealistic speech animation synthesis tailored to the original.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Alexander, O., Roger, M., Lambeth, W., Chiang, J.-Y., Ma, W.-C., Wang, C.-C., Debevec, P.: The Digital Emily Project: Achieving a Photorealistic Digital Actor. IEEE Trans. CGA, 20–31 (2010)

    Google Scholar 

  2. Anderson, R., Stenger, B., Wan, V., Cipolla, R.: Expressive Visual Text-To-Speech Using Active Appearance Models. In: Computer Vision and Pattern Recognition, pp. 3382–3389 (2013)

    Google Scholar 

  3. Blanz, V., Basso, C., Poddio, T., Vetter, T.: Reanimating faces in images and video. In: Proc. Eurographics 2003, vol. 22, pp. 641–650 (2003)

    Google Scholar 

  4. Bregler, C., Covell, M., Slaney, M.: Video rewrite: Driving visual speech with audio. In: Proc. SIGGRAPH 1997, pp. 353–360 (1997)

    Google Scholar 

  5. Chang, Y., Ezzat, T.: Transferable videorealistic speech animation. In: Proc. of the 2005 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pp. 143–151 (2005)

    Google Scholar 

  6. Comaniciu, D., Meer, P.: Mean shift: a robust approach toward feature space analysis. IEEE Trans. on Pattern Analysis and Machine Intelligence 24(5), 603–619 (2002)

    Article  Google Scholar 

  7. Huang, H., Chai, J., Tong, X., Wu, H.-T.: Leveraging motion capture and 3D scanning for high-fidelity facial performance acquisition. In: Proc. SIGGRAPH 2011, p. 74 (2011)

    Google Scholar 

  8. Irie, A., Takagiwa, M., Moriyama, K., Yamashita, T.: Improvements to facial contour detection by hierarchical fitting and regression. In: The First Asian Conference on Pattern Recognition, pp. 273–277 (2011)

    Google Scholar 

  9. Jensen, H.W., Legakis, J., Dorsey, J.: Rendering of Wet Materials. In: Proc. the Eurographics Workshop, pp. 273–281 (2011)

    Google Scholar 

  10. Kawai, M., Iwao, T., Maejima, A., Morishima, S.: Video-Realistic Inner Mouth Reanimation. In: Pacific Graphics, pp. 35–40 (2013)

    Google Scholar 

  11. King, A.S., Parent, E.R.: A 3D Parametric Tongue Model for Animated Speech. The Journal of Visualization and Computer Animation 12, 107–115 (2001)

    Article  MATH  Google Scholar 

  12. Li, H., Weise, T., Pauly, M.: Example-based facial rigging. In: Proc. SIGGRAPH 2010, p. 32 (2010)

    Google Scholar 

  13. Mohammed, U., Prince, S.J.D., Kautz, J.: Visio-lization: generating novel facial images. In: Proc. SIGGRAPH 2009, p. 57 (2009)

    Google Scholar 

  14. Perez, P., Gangnet, M., Blake, A.: Poisson image editing. In: Proc. SIGGRAPH 2003, pp. 313–318 (2003)

    Google Scholar 

  15. Seol, Y., Lewis, J.P., Seo, J., Choi, B., Anjyo, K., Noh, J.: Spacetime expression cloning for blendshapes. ACM Transactions on Graphics (TOG) 31(2), 14 (2012)

    Article  Google Scholar 

  16. Szirmay-Kalos, L., Umenhoffer, T.: Displacement Mapping on the GPU - State of the Art. Comput. Graph. Forum, 1567–1592 (2008)

    Google Scholar 

  17. Taylor, S.L., Mahler, M., Theobald, B.-J., Matthews, I.: Dynamic units of visual speech. In: Proc. the 2012 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pp. 275–284 (2012)

    Google Scholar 

  18. Tena, J.R., Torre, F.D., Matthews, I.: Interactive region-based linear 3D face models. In: Proc. SIGGRAPH 2011, p. 76 (2011)

    Google Scholar 

  19. Yang, Y., Guo, X., Vick, J., Torres, G.L., Champbell, T.: Physics-Based Deformable Tongue Visualization. IEEE Trans. on Visualization and Computer Graphics 19, 811–823 (2013)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Waseda Research Institute for Science and Engineering, 3-4-1 Okubo Shinjuku-ku, Tokyo, Japan, 169-8555

    Shigeo Morishima

Authors
  1. Masahide Kawai
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tomoyori Iwao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Akinobu Maejima
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Shigeo Morishima
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science and Engineering, University of Nevada at Reno, USA

    George Bebis

  2. NASA Ames Research Center, Moffett Field, CA, USA

    Richard Boyle

  3. Lawrence Berkeley National Laboratory, Berkeley, CA, USA

    Bahram Parvin

  4. Desert Research Institute, Reno, NV, USA

    Darko Koracin

  5. The University of Texas at Dallas, 75080, Richardson, TX, USA

    Ryan McMahan

  6. NextGen Interactions, 27604, Raleigh, NC, USA

    Jason Jerald

  7. Indiana University, 46202, Indianapolis, IN, USA

    Hui Zhang

  8. Microsoft Research, 1 Microsoft Way, 98052, Redmond, WA, USA

    Steven M. Drucker

  9. University of Delaware, 19716-2712, Newark, DE, USA

    Chandra Kambhamettu

  10. Intel Corp., 95054, Santa Clara, CA, USA

    Maha El Choubassi

  11. Computer Graphics and Interactive Media Lab, Department of Computer Science, University of Houston, 77004, Houston, TX, USA

    Zhigang Deng

  12. NVIDIA, 34788, Leesburg, FL, USA

    Mark Carlson

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Kawai, M., Iwao, T., Maejima, A., Morishima, S. (2014). Automatic Photorealistic 3D Inner Mouth Restoration from Frontal Images. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2014. Lecture Notes in Computer Science, vol 8887. Springer, Cham. https://doi.org/10.1007/978-3-319-14249-4_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-14249-4_6

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-14248-7

  • Online ISBN: 978-3-319-14249-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation