Skip to main content
SpringerLink
Log in

De-ghosted HDR video acquisition for embedded systems

Ghost-free HDR video of motion objects from stationary cameras

  • Original Research Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

This paper proposes a novel ghost-free High Dynamic Range (HDR) multi-exposure video acquisition suitable for real-time implementation in embedded systems. While the method is limited to stationary cameras, it achieves, with low requirements on resources, results comparable to state-of-the-art de-ghosting methods that are often very computationally expensive and almost impossible to implement in smart cameras and embedded systems. The paper describes the method itself and includes an evaluation of the performance on selected embedded platforms and a comparison of the results to the state of the art using HDR datasets.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Notes

  1. http://www.xilinx.com.

  2. https://github.com/ghostfreehdr/HDR.

References

  1. Bouderbane, M., Dubois, J., Heyrman, B., Lapray, P.J., Ginhac, D.: Ghost removing for hdr real-time video stream generation. In: Real-time image and video processing (2016)

  2. Debevec, P.E., Malik, J.: Recovering high dynamic range radiance maps from photographs. In: ACM Trans. Graph., SIGGRAPH ’97 (1997)

  3. Gallo, O., Gelfandz, N., Chen, W.C., Tico, M., Pulli, K.: Artifact-free high dynamic range imaging. In: 2009 IEEE International conference on computational photography (ICCP), pp 1–7 (2009). https://doi.org/10.1109/ICCPHOT.2009.5559003

  4. Grosch, T.: Fast and robust high dynamic range image generation with camera and object movement (2006)

  5. Grossberg, M.D., Nayar, S.K.: Determining the camera response from images: what is knowable? IEEE Trans. Pattern Anal. Mach. Intell. 25(11), 1455–1467 (2003). https://doi.org/10.1109/TPAMI.2003.1240119

    Article  Google Scholar 

  6. Hu, J., Gallo, O., Pulli, K., Sun, X.: Hdr deghosting: How to deal with saturation? In: 2013 IEEE Conference on computer vision and pattern recognition (2013)

  7. Jacobs, K., Loscos, C., Ward, G.: Automatic high-dynamic range image generation for dynamic scenes. IEEE Comput. Graph. Appl. 28(2), 84–93 (2008). https://doi.org/10.1109/MCG.2008.23

    Article  Google Scholar 

  8. Kang, S.B., Uyttendaele, M., Winder, S., Szeliski, R.: High dynamic range video. ACM Trans. Graph. 22(3), 319–325 (2003)

    Article  Google Scholar 

  9. Karaduzovic-Hadziabdic, K., Hasic, T.J., Mantiuk, R.K.: Multi-exposure image stacks for testing hdr deghosting methods (2017)

  10. Mandel, L.: Fluctuations of photon beams: the distribution of the photo-electrons. Proc Phys Soc 74(3), 233 (1959)

    Article  Google Scholar 

  11. Mantiuk, R., Kim, K.J., Rempel, A.G., Heidrich, W.: Hdr-vdp-2: A calibrated visual metric for visibility and quality predictions in all luminance conditions. ACM Trans. Graph. 30(4), 40:1–40:14 (2011). https://doi.org/10.1145/2010324.1964935

    Article  Google Scholar 

  12. Min, T.H., Park, R.H., Chang, S.: Histogram based ghost removal in high dynamic range images. In: Multimedia and Expo, 2009. ICME 2009. IEEE international conference on. IEEE (2009)

  13. Min, T.H., Park, R.H., Chang, S.: Noise reduction in high dynamic range images. Signal, Image and Video Processing 5(3) (2011). https://doi.org/10.1007/s11760-010-0203-7

  14. Mitsunaga, T., Nayar, S.K.: Radiometric self calibration. In: Proceedings. 1999 IEEE computer society conference on computer vision and pattern recognition (Cat. No PR00149), vol. 1, p. 380 Vol. 1 (1999)

  15. Nosko, S., Musil, M., Zemcik, P., Juranek, R.: Color hdr video processing architecture for smart camera. J. Real-Time Image Process. (2018). https://doi.org/10.1007/s11554-018-0810-z

  16. Pece, F., Kautz, J.: Bitmap movement detection: Hdr for dynamic scenes. In: Visual media production, 2010 conference on, pp. 1–8. IEEE (2010)

  17. Raman, S., Kumar, V., Chaudhuri, S.: Blind de-ghosting for automatic multi-exposure compositing. In: ACM SIGGRAPH ASIA 2009 Posters, SIGGRAPH ASIA ’09. ACM, USA (2009)

  18. Robertson, M.A., Borman, S., Stevenson, R.L.: Estimation-theoretic approach to dynamic range enhancement using multiple exposures. J. Electron. Imaging 12(2), 219–228 (2003)

    Article  Google Scholar 

  19. Sakakibara, M., Kawahito, S., Handoko, D., Nakamura, N., Satoh, H., Higashi, M., Mabuchi, K., Sumi, H.: A high-sensitivity cmos image sensor with gain-adaptive column amplifiers. IEEE J. Solid-State Circuits 40(5), 1147–1156 (2005)

    Article  Google Scholar 

  20. Sen, P., Kalantari, N.K., Yaesoubi, M., Darabi, S., Goldman, D.B., Shechtman, E.: Robust Patch-Based HDR Reconstruction of Dynamic Scenes. ACM SIGGRAPH Asia (2012)

  21. Sidibe, D., Puech, W., Strauss, O.: Ghost detection and removal in high dynamic range images. In: 2009 17th European Signal Processing Conference, pp. 2240–2244 (2009)

  22. Silk, S., Lang, J.: Fast high dynamic range image deghosting for arbitrary scene motion. In: Proceedings of Graphics Interface 2012, GI ’12, pp. 85–92. Canadian Information Processing Society, Toronto, Ont., Canada, Canada (2012). http://dl.acm.org/citation.cfm?id=2305276.2305291

  23. Srikantha, A., Sidibé, D.: Ghost detection and removal for high dynamic range images: recent advances. Sig. Process. 27(6), 650–662 (2012). https://doi.org/10.1016/j.image.2012.02.001https://www.sciencedirect.com/science/article/pii/S0923596512000306

  24. Tamburrino, D., Alleysson, D., Meylan, L., Süsstrunk, S.: Digital camera workflow for high dynamic range images using a model of retinal processing. In: IST/SPIE electronic imaging: digital photography IV, vol. 6817 (2008)

  25. Tocci, M.D., Kiser, C., Tocci, N., Sen, P.: A versatile hdr video production system. In: ACM SIGGRAPH 2011 Papers, SIGGRAPH ’11. USA (2011)

  26. Tursun, O.T., Akyüz, A.O., Erdem, A., Erdem, E.: The state of the art in hdr deghosting: a survey and evaluation. Comput. Graphics Forum 34(2) (2015). https://doi.org/10.1111/cgf.12593

  27. Tursun, O.T., Akyüz, A.O., Erdem, A., Erdem, E.: An objective deghosting quality metric for hdr images. Comput. Graph. Forum 35(2), 139–152 (2016). https://doi.org/10.1111/cgf.12818

    Article  Google Scholar 

  28. Wang, C., Tu, C.: An exposure fusion approach without ghost for dynamic scenes. In: 2013 6th International congress on image and signal processing (CISP), vol. 2, pp. 904–909 (2013). https://doi.org/10.1109/CISP.2013.6745293

  29. Wu, S., Xie, S., Rahardja, S., Li, Z.: A robust and fast anti-ghosting algorithm for high dynamic range imaging. In: 2010 IEEE International Conference on Image Processing, pp. 397–400 (2010). https://doi.org/10.1109/ICIP.2010.5654196

  30. Zhang, W., Cham, W.K.: Gradient-directed composition of multi-exposure images. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 530–536. IEEE (2010)

  31. Zhao, H., Shi, B., Fernandez-Cull, C., Yeung, S.K., Raskar, R.: Unbounded high dynamic range photography using a modulo camera. In: ICCP (2015)

Download references

Acknowledgements

This work was supported by VRASSEO (VI20172020068) and by the Ministry of Education, Youth and Sports of the Czech Republic from the National Programme of Sustainability (NPU II); project IT4Innovations excellence in science - LQ1602.

Author information

Authors and Affiliations

  1. Faculty of Information Technology, Centre of Excellence IT4Innovations, Brno University of Technology, Brno, Czech Republic

    Martin Musil, Svetozar Nosko & Pavel Zemcik

Authors
  1. Martin Musil
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Svetozar Nosko
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pavel Zemcik
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Martin Musil.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (pdf 2261 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Musil, M., Nosko, S. & Zemcik, P. De-ghosted HDR video acquisition for embedded systems. J Real-Time Image Proc 18, 659–668 (2021). https://doi.org/10.1007/s11554-020-01001-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-020-01001-x

Keywords

Search

Navigation