Skip to main content
SpringerLink
Log in

Online illumination estimation of outdoor scenes based on videos containing no shadow area

  • Research Paper
  • Special Focus
  • Published:
Science China Information Sciences Aims and scope Submit manuscript

Abstract

Real-time estimation of outdoor illumination is one of the key issues for ensuring the illumination consistency of augmented reality. In this paper, we propose a novel framework to estimate the dynamic illumination of outdoor scenes based on an online video sequence captured by a fixed camera. All existing approaches are based on two assumptions, i.e. there exist some shadow areas in the scene and the distribution of the skylight is uniform over the sky. Both assumptions greatly simplify the problem of illumination estimation of outdoor scenes, but they also limit the applicability as well as the accuracy of these approaches. This paper presents a new approach that breaks these two hard constraints. It recovers the lighting parameters of outdoor scenes containing no shadow area through solving a constrained linear least squares problem. By representing the skylight as a parameterized model incorporating an occlusion coefficient, the proposed approach can handle the dynamic variation of non-uniform skylight distribution. Experimental results demonstrate the potential of our approach.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Debevec P. Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In: Proc SIGGRAPH, Orlando, 1998. 189–198

  2. Stumpfel J, Jones A, Wenger A, et al. Direct HDR capture of the sun and sky. In: Proc AfriGraph, Stellenbosch, 2004. 145–149

  3. Xue M, Ling H, Jacobs D. Sparse representation of cast shadows via l1-regularized least squares. In: Proc ICCV, Kyoto, 2009. 583–590

  4. Gibson S, Howard T, Hubbold R. Flexible image-based photometric reconstruction using virtual light sources. Comput Graph Forum, 2001, 20: 203–214

    Article  Google Scholar 

  5. Zhang Y, Yang Y. Multiple illuminant direction detection with application to image synthesis. IEEE Trans Pattern Anal Mach Intell, 2001, 23: 915–920

    Article  Google Scholar 

  6. Madsen C B, Nielsen M. Towards probe-less augmented reality-a position paper. In: Rroc GRAPP, Funchal, 2008. 255–261

  7. Chen X, Wang K, Jin X. Single image based illumination estimation for lighting virtual object in real scene. In: Proc. CAD/Graphics, Jinan, 2011. 450–455

  8. Lalonde J F, Efros A A, Narasimhan S G. Estimating Natural Illumination from a Single Outdoor Image. In: Proc. ICCV, Kyoto, 2009. 183–190

  9. Karsch K, Hedau V, Forsyth D, et al. Rendering Synthetic Objects into Legacy Photographs. In: Proc Siggraph Aisa, Hong Kong, 2011. 157:1–157:12

  10. Liu Y, Qin X, Xu S, et al. Light source estimation of outdoor scenes for mixed reality. Vis Comput, 2009, 25: 637–646

    Article  Google Scholar 

  11. Liu Y, Qin X, Xing G, et al. A new approach to illumination estimation based on statistical analysis for augmented reality. Comput Anim Virt Worlds, 2010, 21: 321–330

    Google Scholar 

  12. Xing G, Liu Y, Qin X, et al. A practical approach for real time illumination estimation of outdoor videos. Comput Graph, 2012, 36: 857–865

    Article  Google Scholar 

  13. Barrow H G, Tenenbaum J M. Recovering intrinsic scene characteristics from images. Comput Vis Syst, 1978, 3: 3–26

    Google Scholar 

  14. Bousseau A, Paris S, Durand F. User-assisted intrinsic images. ACM Trans Graph, 2009, 28: 130:1–130:10

    Article  Google Scholar 

  15. Shen L, Yeo Y. Intrinsic images decomposition using a local and global sparse representation of reflectance. In: Proc CVPR, Colorado, 2011. 697–704

  16. Agrawal A, Raskar R, Chellappa R. Edge suppression by gradient field transformation using crossprojection tensors. In: Proc CVPR, New York, 2006. 301–308

  17. Bell M, Freeman W T. Learning local evidence for shading and reflectance. In: Proc ICCV, Vancouver, 2001. 670–677

  18. Dong Y, Tong X, Pellacini. F, et al. AppGen: interactive material modeling from a single image. ACM Trans Graph, 2011, 30: 146

    Article  Google Scholar 

  19. Ren P, Wang J, Snyder J, et al. Pocket Reflectometry. ACM Trans Graph, 2011, 30: 45

    Article  Google Scholar 

  20. Sinha S N, Steedly D, Szeliski R, et al. Interactive 3d architectural modeling from unordered photo collections. ACM Trans Graph, 2008, 27: 159:1–159:10

    Article  Google Scholar 

  21. Oh B M, Chen M, Dorsey J, et al. Image-based modeling and photo editing. In: Proc SIGGRAPH, Los Angeles, 2001. 433–442

  22. Horry Y, Anjyo K I, Arai K. Tour into the picture: using a spidery mesh interface to make animation from a single image. In: Proc SIGGRAPH, Los Angeles, 1997. 225–232

  23. Hoiem D, Efros A A, HEBERT M. Automatic photo pop-up. ACM Trans Graph, 2005, 24: 577–584

    Article  Google Scholar 

  24. Saxena A, Sun M, NG A Y. Make3d: depth perception from a single still image. In: Proc AAAI, Chicago, 2008. 1571–1576

  25. Madsen C B, Brajesh B L. Outdoor illumination estimation in image sequences for augmented reality. In: Proc GRAPP, Vilamoura, 2011. 129–139

  26. Koppal S J, Narasimhan S G. Clustering appearance for scene analysis. In: Proc CVPR, New York, 2006. 1323–1330

  27. Nakamae E, Harada K, Ishizaki T, et al. A montage method: the overlaying of the computer generated images onto a background photograph. In: Proc SIGGRAPH, Dallas, 1986. 207–214

  28. Jacobs N, Roman N, Pless R. Consistent temporal variations in many outdoor scenes. In: Proc CVPR, Minneapolis, 2007. 1–6

Download references

Author information

Authors and Affiliations

  1. State Key Laboratory of CAD&CG, Zhejiang University, Hangzhou, 310027, China

    GuanYu Xing, XueHong Zhou & QunSheng Peng

  2. School of Computer Science and Technology, Shandong University, Ji’nan, 250100, China

    XueYing Qin

  3. College of Computer Science, Sichuan University, Chengdu, 610065, China

    YanLi Liu

Authors
  1. GuanYu Xing
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. XueHong Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. YanLi Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. XueYing Qin
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. QunSheng Peng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to QunSheng Peng.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Xing, G., Zhou, X., Liu, Y. et al. Online illumination estimation of outdoor scenes based on videos containing no shadow area. Sci. China Inf. Sci. 56, 1–11 (2013). https://doi.org/10.1007/s11432-012-4780-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11432-012-4780-7

Keywords

Search

Navigation