Skip to main content
SpringerLink
Log in

Real-time endoscopy haze removal: a synthetical method

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In endoscopic surgeries, the smoke and haze generated by temperature difference and electrosurgical knife usage degrades the surgical view. While many researches on natural single image haze removal being proposed, few works are done for video haze removal of endoscopy view. In this paper, we proposed a synthetical method for endoscopy haze removal combining a Refined Dark Channel Prior (RDCP), Spatial-Temporal Markov Random Field (STMRF), Color Attenuation Prior (CAP) and parameter self-adaption. Qualitative and quantitative experiment results outperformed some traditional and deep learning based methods. Our proposed method is an effective and practical one.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Cai B, Xiangming X, Tao D (2016a) Real-time video Dehazing based on Spatio-temporal MRF. In: Lecture notes in computer science. Springer International Publishing, Cham. https://doi.org/10.1007/978-3-319-48896-7

    Chapter  Google Scholar 

  2. Cai B, Xu X, Jia K, Qing C, Tao D (2016b) DehazeNet: an end-to-end system for single image haze removal. IEEE Trans on Image Process 25:5187–5198. https://doi.org/10.1109/TIP.2016.2598681

    Article  ADS  MathSciNet  Google Scholar 

  3. He, K, Sun, J, Tang, X (2009) Single image haze removal using dark channel prior, in: 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, 2009, pp. 1956–1963. https://doi.org/10.1109/CVPR.2009.5206515

  4. Kim J-H, Jang W-D, Sim J-Y, Kim C-S (2013) Optimized contrast enhancement for real-time image and video dehazing. J Vis Commun Image Represent 24:410–425. https://doi.org/10.1016/j.jvcir.2013.02.004

    Article  Google Scholar 

  5. Lee S, Yun S, Nam J-H, Won CS, Jung S-W (2016) A review on dark channel prior based image dehazing algorithms. J Image Video Proc 2016:4. https://doi.org/10.1186/s13640-016-0104-y

    Article  Google Scholar 

  6. Leibetseder, A, Primus, MJ, Petscharnig, S, Schoeffmann, K, (2017) Real-time image-based smoke detection in endoscopic videos, in: proceedings of the on thematic workshops of ACM multimedia 2017 - thematic workshops ‘17. Presented at the the, ACM Press, Mountain View, California, USA, pp. 296–304. https://doi.org/10.1145/3126686.3126690

  7. Li B, Peng X, Wang Z, Xu J, Feng D (2017) AOD-Net: All-in-One Dehazing Network. In: 2017 IEEE International Conference on Computer Vision (ICCV). IEEE, Venice, pp 4780–4788. https://doi.org/10.1109/ICCV.2017.511

  8. Liu, X, Ma, Y, Shi, Z, Chen, J, (2019) GridDehazeNet: attention-based multi-scale network for image Dehazing, in: 2019 IEEE/CVF international conference on computer vision (ICCV). Presented at the 2019 IEEE/CVF international conference on computer vision (ICCV), IEEE, Seoul, Korea (south), pp. 7313–7322. https://doi.org/10.1109/ICCV.2019.00741

  9. Luo X, McLeod AJ, Pautler SE, Schlachta CM, Peters TM (2017) Vision-based surgical field defogging. IEEE Trans Med Imaging 36:2021–2030. https://doi.org/10.1109/TMI.2017.2701861

    Article  PubMed  Google Scholar 

  10. Sidorov O, Wang C, Cheikh FA (2019) Generative smoke removal. arXiv preprint arXiv:1902.00311

  11. Tchaka, K, Pawar, VM, Stoyanov, D, (2017) Chromaticity based smoke removal in endoscopic images, in: Styner, M.A., Angelini, E.D. (Eds.), . Presented at the SPIE medical imaging, Orlando, Florida, United States, p. 101331M. https://doi.org/10.1117/12.2254622

  12. Viola P, Jones M (2001) "Rapid object detection using a boosted cascade of simple features," Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001, Kauai, HI, USA, pp. I-I, https://doi.org/10.1109/CVPR.2001.990517

  13. Wang C, Cheikh FA, Kaaniche M, Elle OJ (2018) A smoke removal method for laparoscopic images. arXiv preprint arXiv:1803.08410

  14. Xu K, Wen L, Li G, Bo L, Huang Q (2019) Spatiotemporal CNN for video object segmentation. arXiv preprint arXiv:1904.02363

  15. Zhang J, Li L, Zhang Y, Yang G, Cao X, Sun J (2011) Video dehazing with spatial and temporal coherence. Vis Comput 27:749–757. https://doi.org/10.1007/s00371-011-0569-8

    Article  Google Scholar 

  16. Zhu Q, Mai J, Shao L (2015) A fast single image haze removal algorithm using color attenuation prior. IEEE Trans Image Process 24:3522–3533. https://doi.org/10.1109/TIP.2015.2446191

    Article  ADS  MathSciNet  PubMed  Google Scholar 

  17. Jalal NA, Alshirbaji TA, Mündermann L, Möller K (2017) Features for detecting smoke in laparoscopic videos. Curr Direct Biomed Eng 3. https://doi.org/10.1515/cdbme-2017-0110

Download references

Acknowledgements

The authors would like to thank Prof. Guangquan Zhou from Southeast University for his help in revisiting the manuscript.

Funding

 This work was supported in part by the National Key Project of Research and Development Plan under Grants 2022YFC2401600, 2022YFC2408500 and 2022YFE0116700, and in part by the Student Research Training Program of Southeast University under Grant 202009018.

Author information

Author notes

  1. Xu Zhuo and Chenbin Yang contributed equally as co-first authors.

Authors and Affiliations

  1. Laboratory of Image Science and Technology, School of Computer Science and Engineering, Southeast University, Nanjing, China

    Xu Zhuo & Yang Chen

  2. Tuge Medical Technology Co., Ltd., Nanjing, China

    Chenbin Yang & Ke Wu

  3. School of Computer Science and Engineering, Southeast University, Nanjing, China

    Yuming Gao & Zhihua Wang

  4. Jiangsu Provincial Joint International Research Laboratory of Medical Information Processing, Nanjing, China

    Yang Chen

  5. Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications (Southeast University), Ministry of Education, Nanjing, China

    Yang Chen

Authors
  1. Xu Zhuo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chenbin Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yuming Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhihua Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yang Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Ke Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yang Chen.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhuo, X., Yang, C., Gao, Y. et al. Real-time endoscopy haze removal: a synthetical method. Multimed Tools Appl 83, 31195–31209 (2024). https://doi.org/10.1007/s11042-023-16375-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-16375-w

Keywords

Search

Navigation