Kanita Karaduzovic Hadziabdic
ABSTRACT
High dynamic range (HDR) images can be generated by capturing a sequence of low dynamic range (LDR) images of the same scene with different exposures and then merging those images to create an HDR image. During capturing of LDR images, any changes in the scene or slightest camera movement results in ghost artifacts in the resultant HDR image. Over the past few years many algorithms have been proposed to produce ghost free HDR images of dynamic scenes. In this study we performed subjective psychophysical experiments to evaluate four algorithms for removing ghost artifacts in the final HDR image. To our best knowledge, no evaluation of deghosting algorithms for HDR imaging has been published. Thus, the aim of this paper is not only to evaluate different ghost removal algorithms but also to introduce a methodology to evaluate such algorithms and to present some of the challenges that exist in evaluating ghost removal algorithms in HDR images. Optical flow algorithms have been shown to produce successful results in aligning input images before merging them into an HDR image. As a result one of the state-of-the-art deghosting algorithm for HDR image alignment is based on optical flow. To test the limits of the evaluated deghosting algorithms the scenes used in our experiments were selected following the criteria proposed by Baker et al. [2011], which is considered as de facto standard for evaluating optical flow methodologies. The scenes used in the experiments serve to provide challenges that need to be dealt with by not only algorithms based on optical flow methodologies but also by other ghost removal algorithms for HDR imaging. The results reveal the scenes for which the evaluated algorithms fail and may serve as a guide for future research in this area.
- adk, M., Wimmer, M., Neumann, L., and Artusi, A. 2008. Evaluation of hdr tone mapping methods using essential perceptual attributes. Computers and Graphics 32, 3, 330--349. Google Scholar
Digital Library
- Akyüz, A. O., Fleming, R., Riecke, B. E., Reinhard, E., and Bülthoff, H. H. 2007. Do hdr displays support ldr content?: a psychophysical evaluation. ACM Trans. Graph. 26, 3 (July). Google ScholarDigital Library
- Akyüz, A. O. 2011. Photographically guided alignment for hdr images. In Eurographics-Areas Papers, 73--74.Google Scholar
- Aydn, T. O., Mantiuk, R., and Seidel, H.-P. 2008. Extending quality metrics to full luminance range images. In Proceedings of SPIE, Spie, 68060B--10.Google Scholar
- Baker, S., Scharstein, D., Lewis, J., Roth, S., Black, M. J., and Szeliski, R. 2011. A database and evaluation methodology for optical flow. International Journal of Computer Vision 92, 1--31. Google ScholarDigital Library
- Chalmers, A., Debattista, K., and Ramic-Brkic, B. 2009. Towards high-fidelity multi-sensory virtual environments. The Visual Computer 25, 12, 1101--1108. Google ScholarDigital Library
- Debevec, P. E., and Malik, J. 2008. Recovering high dynamic range radiance maps from photographs. In ACM SIGGRAPH 2008 classes, ACM, New York, NY, USA, SIGGRAPH '08, 31:1--31:10. Google ScholarDigital Library
- Dukette, D., and Cornish, D. 2009. The essential 20: Twenty components of an excellent health care team. 72--79.Google Scholar
- Engeldrum, P. G. 2000. Psychometric scaling: a toolkit for imaging systems development. Imcotek Press.Google Scholar
- Gallo, O., Gelfand, N., Chen, W., Tico, M., and Pulli, K. 2009. Artifact-free high dynamic range imaging. IEEE International Conference on Computational Photography (ICCP) (April).Google Scholar
- Hasic, J., Chalmers, A., and Sikudova, E. 2010. Perceptually guided high-fidelity rendering exploiting movement bias in visual attention. TAP 8, 1, 6. Google ScholarDigital Library
- Heo, Y. S., Lee, K. M., Lee, S. U., Moon, Y., and Cha, J. 2010. Ghost-free high dynamic range imaging. In ACCV (4)'10, 486--500. Google ScholarDigital Library
- Hulusic, V., Harvey, C., Debattista, K., Tsingos, N., Walker, S., Howard, D., and Chalmers, A. 2012. Acoustic rendering and auditory-visual cross-modal perception and interaction. Comput. Graph. Forum 31, 1, 102--131. Google ScholarDigital Library
- Jacobs, K., Loscos, C., and Ward, G. 2008. Automatic high-dynamic range image generation for dynamic scenes. IEEE Computer Graphics and Applications 28, 2 (Mar - Apr), 84--93. Google ScholarDigital Library
- Kendall, M. G. 1975. Rank Correlation Methods, 4th ed. Griffin Ltd.Google Scholar
- Kuang, J., Yamaguchi, H., Johnson, G. M., and Fairchild, M. D. 2004. Testing hdr image rendering algorithms. In In: Twelth Color imaging conference: Color Science and Engineering Systems, Technologies, and Applications, 315 -- 320.Google Scholar
- Ledda, P., Chalmers, A., and et al. 2005. Evaluation of tone mapping operators using a high dynamic range display. ACM TRANSACTIONS ON GRAPHICS 24, 640--648. Google ScholarDigital Library
- Mann, S., and Picard, R. 1995. "being undigital" with digital cameras: Extending dynamic range by combining differently exposed pictures. In Proceedings of IS&T 48th annual conference, 442--448.Google Scholar
- Mantiuk, R., Krawczyk, G., Mantiuk, R., and Seidel, H.-p. 2007. High dynamic range imaging pipeline: perception-motivated representation of visual content. In Human Vision and Electronic Imaging, B. E. Rogowitz, T. N. Pappas, and S. J. Daly, Eds., no. Section 2, 649212--649212--12.Google Scholar
- Mantiuk, R., Kim, K. J., Rempel, A. G., and Heidrich, W. 2011. HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions. ACM Trans. Graph (Proc. SIGGRAPH) 30, 4 (July), 1. Google ScholarDigital Library
- Mitsunaga, T., and Nayar, S. 1999. Radiometric self calibration. In Computer Vision and Pattern Recognition, 1999. IEEE Computer Society Conference on., vol. 1, 2 vol. (xxiii+637+663).Google Scholar
- Nayar, S., and Mitsunaga, T. 2000. High dynamic range imaging: Spatially varying pixel exposures. In Computer Vision and Pattern Recognition, 2000. Proceedings. IEEE Conference on, vol. 1, IEEE, 472--479.Google Scholar
- Photomatix. 2012. Commercially-available hdr processing software. http://www.hdrsoft.com.Google Scholar
- Photomatix. 2012. Pro user manual. http://www.hdrphotography.com/doc/manual/PhotomatixPro42Manual_Win.pdf.Google Scholar
- Robertson, M. A., Borman, S., and Stevenson, R. L. 1999. Dynamic range improvement through multiple exposures. In In Proc. of the Int. Conf. on Image Processing (ICIP 99), IEEE, 159--163.Google Scholar
- Rubinstein, M., Gutierrez, D., Sorkine, O., and Shamir, A. 2010. A comparative study of image retargeting. ACM Trans. Graph. 29, 6 (Dec.), 160:1--160:10. Google ScholarDigital Library
- Sen, P., Kalantari, N. K., Yaesoubi, M., Darabi, S., Goldman, D. B., and Shechtman, E. 2012. Robust patch-based hdr reconstruction of dynamic scenes. ACM Transactions on Graphics (TOG) (Proceedings of SIGGRAPH Asia 2012) 31, 6, 203:1--203:11. Google ScholarDigital Library
- Siegel, S., and Castellan, J. 1988. Nonparametric statistics for the behavioral sciences. McGrall-Hill International.Google Scholar
- Silverstein, D., and Farrell, J. 2001. Efficient method for paired comparison. Journal of Electronic Imaging 10, 394.Google ScholarCross Ref
- Srikantha, A., and Sidibe, D. 2012. Ghost detection and removal for high dynamic range images: Recent advances. Signal Processing: Image Communication 27, 6, 650 -- 662. Google ScholarDigital Library
- Street, R. A., 1998. High dynamic range segmented pixel sensor array. US Patent 5789737.Google Scholar
- Tomaszewska, A., and Mantiuk, R. 2007. Image registration for multi-exposure high dynamic range image acquisition. In In: Proc. of International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision.Google Scholar
- Urbano, C., Magalhães, L., Moura, J., Bessa, M., Marcos, A., and Chalmers, A. 2010. Tone mapping operators on small screen devices: An evaluation study. Comput. Graph. Forum 29, 8, 2469--2478.Google ScholarCross Ref
- Wen, D. D., 1989. High dynamic range charge-coupled device. US Patent 4873561.Google Scholar
- Zhang, W., and Cham, W.-K. 2012. Gradient-directed multi-exposure composition. Image Processing, IEEE Transactions on 21, 4 (april), 2318 --2323.Google Scholar
- Zimmer, H., Bruhn, A., and Weickert, J. 2011. Freehand HDR imaging of moving scenes with simultaneous resolution enhancement. Computer Graphics Forum (Proceedings of Eurographics) 30, 2, 405--414.Google ScholarCross Ref
Index Terms
- Comparison of Deghosting Algorithms for Multi-exposure High Dynamic Range Imaging
Recommendations
Deep high dynamic range imaging of dynamic scenes
Producing a high dynamic range (HDR) image from a set of images with different exposures is a challenging process for dynamic scenes. A category of existing techniques first register the input images to a reference image and then merge the aligned ...
Assessment of multi-exposure HDR image deghosting methods
Subjective evaluation of multi-exposure HDR deghosting methods has been performed.Evaluation of objective metrics to assess if they can predict deghosting artefacts.HDR-VDP-2 was found to be most reliable for evaluating HDR deghosting algorithms.For ...
Robust artifact-free high dynamic range imaging of dynamic scenes
The irradiance range of the real-world scene is often beyond the capability of digital cameras. Therefore, High Dynamic Range (HDR) images can be generated by fusing images with different exposure of the same scene. However, moving objects pose the most ...
Comments