Skip to main content
SpringerLink
Log in

Joint estimation of motion and radiometry of rotating camera for HDR global mosaic

  • Theoretical Advances
  • Published:
Pattern Analysis and Applications Aims and scope Submit manuscript

Abstract

In this paper, we present a global approach for constructing high dynamic range mosaics from multiple images with large exposure differences. To minimize registration errors caused by intensity mismatches in the image intensity space with low dynamic range, we propose the use of a scene radiance space with high dynamic range. By relating image intensities to scene radiances with a convenient distortion model, we robustly estimate registration parameters for the high dynamic range global mosaic, simultaneously estimating scene radiances and distortion parameters in a single framework using a computationally optimized Levenberg–Marquardt approach.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

References

  1. Kim DW, Hong KS (2006) High dynamic range global mosaic. In: Asian conference on computer vision, pp 744–753

  2. Szeliski R (1996) Video mosaics for virtual environments. IEEE Comput Graphics Appl 16:22–30

    Article  Google Scholar 

  3. Kumar R, Anandan P, Irani M, Bergen J, Hanna K (1995) Representation of scenes from collection of images. Workshop on representation of visual scenes

  4. Xiong Y, Turkowski K (1998) Registration, calibration and blending in creating high quality panoramas. Workshop on applications of computer vision, pp 69–74

  5. Kim DW, Hong KS (2003) Fast global registration for image mosaicing. Int Conf Image Process 2:14–17

    Google Scholar 

  6. Davis J (1998) Mosaics of scenes with moving objects. In: International conference on computer vision and pattern recognition, pp 354–360

  7. Sawhney HS, Kumar R, Gendel G, Bergen J, Dixon D, Paragano V (1998) Videobrush: experiences with consumer video mosaicing. Workshop on application of computer vision, pp 56–62

  8. Sawhney HS, Hsu S, Kumar R (1998) Robust video mosaicing through topology inference and local to global alignment. In: European conference on computer vision, vol 2, pp 103–119

  9. Nicolas H (2001) New methods for dynamic mosaicking. IEEE Trans Image Process 10:1239–1251

    Article  MATH  Google Scholar 

  10. Sawhney HS, Kumar R (1999) True multi-image alignment and its application to mosaicing and lens distortion correction. IEEE Trans Pattern Anal Mach Intell 21:235–243

    Article  Google Scholar 

  11. Kim HW, Hong KS (2000) Soccer video mosaicing using self-calibration and line tracking. In: International conference on pattern recognition, pp 592–596

  12. Shum H, Szeliski R (1998) Construction and refinement of panoramic mosaics with global and local alignment. In: International conference on computer vision, pp 953–958

  13. Kang EY, Cohen I, Medioni G (2000) A graph-based global registration for 2d mosaics. In: International conference on pattern recognition, pp 256–260

  14. McLauchlan PF, Jaenickel A (2000) Image mosaicing using sequential bundle adjustment. Workshop on biologically motivated computer vision, pp 616–625

  15. Brown M, Lowe DG (2003) Recognising panoramas. In: International conference on computer vision, vol 2, pp 1218–1225

  16. Mann S, Picard R (1995) Being undigital with digital cameras: extending dynamic range by combining differently exposed pictures. In: IS&T, Society for Imaging Science and Technology 46th Annual Conference, pp 422–428

  17. Debevec PE, Malik J (1997) Recovering high dynamic range radiance maps from photographs. In: Proceedings of ACM SIGGRAPH, pp 369–378

  18. Mitsunaga T, Nayar SK (1999) Radiometric self calibration. In: IEEE Computer Society conference on computer vision and pattern recognition, vol 1, pp 374–380

  19. Mann S (2000) Comparametric equations with practical applications in quantigraphic image processing. IEEE Trans Image Process 9:1389–1406

    Article  MATH  Google Scholar 

  20. Mann S (2001) Quantigraphic imaging: estimating the camera response and exposures from differently exposed images. In: IEEE Computer Society conference on computer vision and pattern recognition, vol 1, pp 842–849

  21. Tsin Y, Ramesh V, Kanade T (2001) Statistical calibration of ccd imaging process. In: IEEE international conference on computer vision, vol 1, pp 480–487

  22. Robertson MA, Borman S, Stevenson RL (2003) Estimation-theoretic approach to dynamic range enhancement using multiple exposures. J Electron Imaging 12:219–228

    Article  Google Scholar 

  23. Grossberg MD, Nayar SK (2004) Modeling the space of camera response functions. IEEE Trans Pattern Anal Mach Intell 26:1272–1282

    Article  Google Scholar 

  24. Pal C, Szeliski R, Uyttendaele M, Jojic N (2004) Probability models for high dynamic range imaging. In: IEEE Computer Society conference on computer vision and pattern recognition, vol 2, pp 173–180

  25. Aggarwal M, Ahuja N (2001) High dynamic range panoramic imaging. In: IEEE international conference on computer vision, vol 1, pp 2–9

  26. Schechner YY, Nayar SK (2003) Generalized mosaicing: high dynamic range in a wide field of view. Int J Comput Vis 53:245–267

    Article  Google Scholar 

  27. Grossberg MD, Nayar SK (2002) What can be known about the radiometric response from images? In: European conference on computer vision, vol 2353, pp 189–205

  28. Ward G (2003) Fast, robust image registration for compsiting hight dynamic range photogrphs from hand-held exposures. J Graphics Tools, pp 17–33

  29. Hasler D, Süsstrunk S (2004) Mapping colour in image stitching applications. J Vis Commun Image Rep 15:65–90

    Article  Google Scholar 

  30. Litvinov A, Schechner YY (2005) Addressing radiometric nonidealities: a unified framework. In: IEEE Computer Society conference on computer vision and pattern recognition, vol 2, pp 52–59

  31. Candocia FM (2002) A least squares approach for the joint domain and range registration of images. In: IEEE internaltional conference on acoustics, speech, and signal processing, vol 4, pp 3237–3240

  32. Horn BKP (1958) Robot vision. MIT Press, Cambridge

    Google Scholar 

  33. Tordoff B, Murray D (2000) Violating rotating camera geometry: the effect of radial distortion on self-calibration. In: International conference on pattern recognition, vol 1, pp 423–427

  34. Hampel FR, Ronchetti EM, Rousseeuw PJ, Stahel WA (1986) Robust statistics: the approach based on influence function. Wiley, New York

    MATH  Google Scholar 

  35. Meer P, Mintz D, Rosenfeld A, Kim DY (1991) Robust regression methods for computer vision: a review. Int J Comput Vis 6:57–70

    Article  Google Scholar 

  36. Black MJ, Rangarajan A (1996) On the unification of line process, outlier rejection, and robust statistics with applications in early vision. Int J Comput Vis 19(1):57–91

    Article  Google Scholar 

  37. Black MJ, Sapiro G, Marimont DH, Heeger D (1998) Robust anisotropic diffusion. IEEE Trans Image Process 7(3):421–432

    Article  Google Scholar 

  38. de Agapito L, Hayman E, Reid I (2001) Self-calibration of rotating and zooming cameras. Int J Comput Vis 42:107–127

    Article  Google Scholar 

  39. Fletcher P (1987) Practical methods of optimization. Wiley, New York

    MATH  Google Scholar 

  40. Reddy BS, Chatterji BN (1996) An fft-based technique for translation, rotation, and scale-invariant image registration. IEEE Trans Image Process 5:1266–1271

    Article  Google Scholar 

  41. Fattal R, Lischinski D, Werman M (2002) Gradient domain high dynamic range compression. In: Proceedings of ACM SIGGRAPH, vol 21, pp 249–256

  42. Reinhard E, Stark M, Shirley P, Ferwerda J (2002) Photographic tone reproduction for digital images. In: Proceedings of ACM SIGGRAPH, vol 21, pp 267–276

  43. Durand F, Dorsey J (2002) Fast bilateral filtering for the display of high-dynamic-range images. In: Proceedings of ACM SIGGRAPH, vol 21, pp 257–266

  44. Meylan L, Süsstrunk S (2006) High dynamic range image rendering using a retinex-based adaptive filter. IEEE Trans Image Process 15:2820–2830

    Article  Google Scholar 

  45. Li Y, Sharan L, Adelson EH (2005) Compressing and companding high dynamic range images with subband architectures. In: Proceedings of ACM SIGGRAPH, vol 24, pp 836–844

Download references

Acknowledgments

The authors would like to thank for the financial support of the Ministry of Education of Korea toward the Electrical and Computer Engineering Division at POSTECH through its Brain Korea 21 (BK21) program. They also thank the anonymous reviewers for their helpful comments, which have improved the quality of this paper.

Author information

Authors and Affiliations

  1. Division of Electrical and Computer Engineering, POSTECH, San 31 Hyoja-Dong, 790-784, Pohang, South Korea

    Dae-Woong Kim & Ki-Sang Hong

Authors
  1. Dae-Woong Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ki-Sang Hong
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dae-Woong Kim.

Additional information

A part of this paper was published as a conference paper [1].

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kim, DW., Hong, KS. Joint estimation of motion and radiometry of rotating camera for HDR global mosaic. Pattern Anal Applic 10, 215–234 (2007). https://doi.org/10.1007/s10044-007-0063-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10044-007-0063-0

Keywords

Search

Navigation