Skip to main content
SpringerLink
Log in

High-dynamic-range image recovery from flash and non-flash image pairs

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

In this paper, we propose a novel method for creating HDR images from only two images—flash and non-flash images. Our method consists of two main steps, namely brightness gamma correction and bi-local chromatic adaptation transform (CAT). The brightness gamma correction performs series of increases and decreases of the non-flash brightness and yields multiple images with various exposure values. The bi-local CAT enhances the quality of each computed image by recovering missing details, using information from the flash image. The final multi-exposure images are then merged together to compute an HDR image. An evaluation shows that our HDR images, obtained by using only two LDR images, are close to HDR images, obtained by combining five manually taken multi-exposure images. Our method does not require the usage of a tripod and it is suitable for images of non-still objects, such as people, candle flames.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Aguerrebere, C., Almansa, A., Gousseau, Y., Delon, J., Muse, P.: Single shot high dynamic range imaging using piecewise linear estimators. In: 2014 IEEE International Conference on Computational Photography (ICCP), pp. 1–10. IEEE (2014)

  2. Bist, C., Cozot, R., Madec, G., Ducloux, X.: Style aware tone expansion for hdr displays. In: Proceedings of graphics interface, pp 57–63 (2016)

  3. Debevec, P.E., Malik, J.: Recovering high dynamic range radiance maps from photographs. In: ACM SIGGRAPH 2008 Classes, p. 31. ACM (2008)

  4. Durand, F., Dorsey, J.: Fast bilateral filtering for the display of high-dynamic-range images. ACM Trans. Graph. (TOG) 21(3), 257–266 (2002)

    Article  Google Scholar 

  5. Eisemann, E., Durand, F.: Flash photography enhancement via intrinsic relighting. In: ACM Transactions on Graphics (Proceedings of Siggraph Conference), vol. 23. ACM Press (2004). http://maverick.inria.fr/Publications/2004/ED04

  6. Fairchild, M.D.: Color Appearance Models. Wiley, Chichester, UK (2013)

    Book  Google Scholar 

  7. Fairchild, M.D., Johnson, G.M.: iCAM framework for image appearance, differences, and quality. J. Electron. Imaging 13(1), 126–138 (2004)

    Article  Google Scholar 

  8. Frigo, O., Sabater, N., Demoulin, V., Pierre, H.: Optimal transportation for example-guided color transfer. In: 12th Asian Conference on Computer Vision (ACCV) (2014)

  9. Gallo, O., Gelfand, N., Chen, W.C., Tico, M., Pulli, K.: Artifact-free high dynamic range imaging. In: 2009 IEEE International Conference on Computational Photography (ICCP), pp. 1–7. IEEE (2009)

  10. Granados, M., Kim, K.I., Tompkin, J., Theobalt, C.: Automatic noise modeling for ghost-free hdr reconstruction. ACM Trans. Graph. (TOG) 32(6), 201 (2013)

    Article  Google Scholar 

  11. Gryaditskaya, Y., Pouli, T., Reinhard, E., Myszkowski, K., Seidel, H.P.: Motion aware exposure bracketing for hdr video. In: Computer Graphics Forum, vol. 34, pp. 119–130. Wiley Online Library (2015)

  12. He, K., Sun, J., Tang, X.: Guided image filtering. In: European Conference on Computer Vision, pp. 1–14. Springer (2010)

  13. Hristova, H., Le Meur, O., Cozot, R., Bouatouch, K.: Style-aware robust color transfer. In: EXPRESSIVE International Symposium on Computational Aesthetics in Graphics, Visualization, and Imaging (2015)

  14. Kalantari, N.K., Shechtman, E., Barnes, C., Darabi, S., Goldman, D.B., Sen, P.: Patch-based high dynamic range video. ACM Trans. Graph. 32(6), 202–211 (2013)

    Article  Google Scholar 

  15. Kuang, J., Johnson, G.M., Fairchild, M.D.: iCAM06: a refined image appearance model for hdr image rendering. J. Vis. Commun. Image Represent. 18(5), 406–414 (2007)

    Article  Google Scholar 

  16. Li, Z., Zheng, J.: Single image brightening via exposure fusion. In: ICASSP (2016)

  17. Mann, S., Picard, R.: On being ”undigital” with digital cameras: extending dynamic range by combining differently exposed pictures. In: Proceedings of Society for Imaging Science and Technologys 48th Annual Conference (1995)

  18. Mantiuk, R., Kim, K.J., Rempel, A.G., Heidrich, W.: Hdr-vdp-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions. In: ACM Transactions on Graphics (TOG), vol. 30, p. 40. ACM (2011)

  19. Mantiuk, R., Myszkowski, K., Seidel, H.P.: A perceptual framework for contrast processing of high dynamic range images. ACM Trans. Appl. Percept. (TAP) 3(3), 286–308 (2006)

    Article  Google Scholar 

  20. Matsuoka, R., Baba, T., Okuda, M., Shirai, K.: High dynamic range image acquisition using flash image. In: 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 1612–1616. IEEE (2013)

  21. Mertens, T., Kautz, J., Van Reeth, F.: Exposure fusion: a simple and practical alternative to high dynamic range photography. In: Computer Graphics Forum, vol. 28, pp. 161–171. Wiley Online Library (2009)

  22. Nayar, S.K., Mitsunaga, T.: High dynamic range imaging: spatially varying pixel exposures. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2000, vol. 1, pp. 472–479. IEEE (2000)

  23. Nayar, S.K., Narasimhan, S.G.: Assorted pixels: multi-sampled imaging with structural models. In: Computer Vision ECCV 2002, pp. 636–652. Springer (2002)

  24. Petschnigg, G., Szeliski, R., Agrawala, M., Cohen, M., Hoppe, H., Toyama, K.: Digital photography with flash and no-flash image pairs. In: ACM Transactions on Graphics (TOG), vol. 23, pp. 664–672. ACM (2004)

  25. Ramirez Orozco, R., Loscos, C., Martin, I., Artusi, A.: Multiview HDR video sequence generation. In: Dufaux, F., Le Callet, P., Mantiuk, R., Mrak, M. (eds.) High Dynamic Range Video: From Acquisition to Display and Applications, pp. 121–138. Academic Press, Elsevier (2016). ISBN 978-0-08-100412-8

  26. Sen, P., Kalantari, N.K., Yaesoubi, M., Darabi, S., Goldman, D.B., Shechtman, E.: Robust patch-based HDR reconstruction of dynamic scenes. ACM Trans. Graph. 31(6), 203 (2012)

    Article  Google Scholar 

  27. Serrano, A., Heide, F., Gutierrez, D., Wetzstein, G., Masia, B.: Convolutional sparse coding for high dynamic range imaging. In: Computer Graphics Forum, vol. 35. Wiley-Blackwell (2016)

  28. Sidibé, D., Puech, W., Strauss, O.: Ghost detection and removal in high dynamic range images. In: Signal Processing Conference, 2009 17th European, pp. 2240–2244. IEEE (2009)

  29. Tocci, M.D., Kiser, C., Tocci, N., Sen, P.: A versatile hdr video production system. ACM Trans. Graph. (TOG) 30(4), 41 (2011)

    Article  Google Scholar 

  30. Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)

    Article  Google Scholar 

  31. Yuan, L., Sun, J., Quan, L., Shum, H.Y.: Image deblurring with blurred/noisy image pairs. In: ACM Transactions on Graphics (TOG), vol. 26, p. 1. ACM (2007)

Download references

Author information

Authors and Affiliations

  1. University of Rennes 1, Rennes, France

    Hristina Hristova, Olivier Le Meur, Remi Cozot & Kadi Bouatouch

Authors
  1. Hristina Hristova
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Olivier Le Meur
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Remi Cozot
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kadi Bouatouch
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hristina Hristova.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hristova, H., Le Meur, O., Cozot, R. et al. High-dynamic-range image recovery from flash and non-flash image pairs. Vis Comput 33, 725–735 (2017). https://doi.org/10.1007/s00371-017-1399-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-017-1399-0

Keywords

Search

Navigation