Skip to main content
SpringerLink
Log in

Image-based face illumination transferring using logarithmic total variation models

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

In this paper, we present a novel image-based technique that transfers illumination from a source face image to a target face image based on the Logarithmic Total Variation (LTV) model. Our method does not require any prior information regarding the lighting conditions or the 3D geometries of the underlying faces. We first use a Radial Basis Functions (RBFs)-based deformation technique to align key facial features of the reference 2D face with those of the target face. Then, we employ the LTV model to factorize each of the two aligned face images to an illumination-dependent component and an illumination-invariant component. Finally, illumination transferring is achieved by replacing the illumination-dependent component of the target face by that of the reference face. We tested our technique on numerous grayscale and color face images from various face datasets including the Yale face Database, as well as the application of illumination-preserved face coloring.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Nikolova, M.: A variational approach to remove outliers and impulse noise. J. Math. Imag. Vis. 20(1–2), 99–120 (2004)

    Article  MathSciNet  Google Scholar 

  2. Yin, W., Goldfarb, D., Osher, S.: Total variation based image cartoon-texture decomposition. SIAM J. Multiscale Model. Simul. 6(1), 190–211 (2006)

    Article  MathSciNet  Google Scholar 

  3. Stoschek, A.: Image-based re-rendering of faces for continuous pose and illumination directions. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 01, pp. 582–587 (2000)

  4. Wen, Z., Liu, Z., Huang, T.S.: Face relighting with radiance environment maps. In: Computer Vision and Pattern Recognition, Proceedings, pp. 157–165 (2003)

  5. Peers, P., Tamura, N., Matusik, W., Debevec, P.: Post-production facial performance relighting using reflectance transfer. ACM Trans. Graph. 26(3), 52 (2007)

    Article  Google Scholar 

  6. Hua, G., Wen, Z., Zhang, Z., Wang, Y., Liu, Z., Samaras, D.: Face re-lighting from a single image under harsh lighting conditions. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition 2007, pp. 1–8, June 2007

  7. Shashua, A., Raviv, T.R.: The quotient image: Class-based recognition and synthesis under varying illumination conditions. IEEE Trans. Pattern Anal. Mach. Intell. 02, 262–265 (1999)

    Google Scholar 

  8. Liu, Z., Shan, Y., Zhang, Z.: Expressive expression mapping with ratio images. In: SIGGRAPH’01: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, pp. 271–276. ACM, New York (2001)

    Chapter  Google Scholar 

  9. Marschner, S.R., Greenberg, D.P.: Inverse lighting for photography. In: Proceedings of the Fifth Color Imaging Conference, Society for Imaging Science and Technology, pp. 262–265 (1997)

  10. Chen, T., Yin, W., Zhou, X.S., Comaniciu, D., Huang, T.: Total variation models for variable lighting face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28(9), 1519–1524 (2006)

    Article  Google Scholar 

  11. Noh, J.Y., Fidaleo, D., Neumann, U.: Animated deformations with radial basis functions. In: VRST’00: Proceedings of the ACM Symposium on Virtual Reality Software and Technology, pp. 166–174. ACM, New York (2000)

    Chapter  Google Scholar 

  12. Lewis, J.P., Cordner, M., Fong, N.: Pose space deformation: A unified approach to shape interpolation and skeleton-driven deformation. In: Proc. of ACM SIGGRAPH’2000, pp. 165–172 (2000)

  13. Noh, J.Y., Neumann, U.: Expression cloning. In: Proc. of ACM SIGGRAPH’01, pp. 277–288 (2001)

  14. Deng, Z., Chiang, P.Y., Fox, P., Neumann, U.: Animating blendshape faces by cross-mapping motion capture data. In: Proc. of ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, pp. 43–48, March 2006

  15. Arad, N., Dyn, N., Reisfeld, D., Yeshurun, Y.: Image warping by radial basis functions: Application to facial expressions. Comput. Vis. Graph. Image Process. Graph. Models Image Process. 56(2), 161–172 (1994)

    Google Scholar 

  16. Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J.: Active shape models—their training and application. Comput. Vis. Image Underst. 61(1), 38–59 (1995)

    Article  Google Scholar 

  17. Zhou, Y., Gu, L., Zhang, H.-J.: Bayesian tangent shape model: estimating shape and pose parameters via Bayesian inference. In: Proceedings of IEEE Computer Society Conference, vol. 1, pp. 109–116 (2003)

  18. Goldfarb, D., Yin, W.: Parametric maximum flow algorithms for fast total variation minimization. Rice University CAAM Technical Report TR07-09 (2007)

  19. Georghiades, A.S., Belhumeur, P.N., Kriegman, D.J.: From few to many: Illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Anal. Mach. Intell. 23(6), 643–660 (2001)

    Article  Google Scholar 

  20. http://www.lrv.fri.uni-lj.si/, July 2007

  21. Martinez, A.M., Benavente, R.: The AR face database. CVC Technical Report #24 (1998)

Download references

Author information

Authors and Affiliations

  1. Computer Graphics and Interactive Media Lab, Department of Computer Science, University of Houston, Houston, TX, USA

    Qing Li & Zhigang Deng

  2. Department of Computational and Applied Mathematics, Rice University, Houston, TX, USA

    Wotao Yin

Authors
  1. Qing Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wotao Yin
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhigang Deng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhigang Deng.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Li, Q., Yin, W. & Deng, Z. Image-based face illumination transferring using logarithmic total variation models. Vis Comput 26, 41–49 (2010). https://doi.org/10.1007/s00371-009-0375-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-009-0375-8

Keywords

Search

Navigation