Abstract
Saturation artifacts in Optical Coherence Tomography (OCT) images will affect the image quality and reduce the accuracy of clinical diagnosis. Recently, the researcher proposed various OCT image inpainting algorithms for saturation artifacts, and these algorithms were limited to .oct format files only (spectral data) or simple interpolation algorithms, which led to the failure of the best performance on wide saturation artifacts. In this paper, a novel image inpainting model based on a generative model (diffusion model) is proposed, which can recover degraded regions in OCT images. Experimental results show that the average PSNR and SSIM values outperformed existing approaches. Besides, the classification models, vision transformer (ViT), for OCT images were implemented to compare the accuracy difference before and after the proposed image inpainting algorithm. The proposed algorithm presents a promising solution for better OCT image inpainting methods.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Chen, Y., Hu, H.: An improved method for semantic image inpainting with GANs: progressive inpainting. Neural Process. Lett. 49, 1355–1367 (2019)
Croitoru, F.A., Hondru, V., Ionescu, R.T., Shah, M.: Diffusion models in vision: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 45, 10850–10869 (2023)
De Carlo, T.E., Romano, A., Waheed, N.K., Duker, J.S.: A review of optical coherence tomography angiography (OCTA). Int. J. Retina Vitreous 1, 1–15 (2015)
Dhariwal, P., Nichol, A.: Diffusion models beat GANs on image synthesis. Adv. Neural. Inf. Process. Syst. 34, 8780–8794 (2021)
Dosovitskiy, A., et al.: An image is worth 16x16 words: transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020)
Elharrouss, O., Almaadeed, N., Al-Maadeed, S., Akbari, Y.: Image inpainting: a review. Neural Process. Lett. 51, 2007–2028 (2020)
Getreuer, P.: Total variation inpainting using split Bregman. Image Process. On Line 2, 147–157 (2012)
Goodfellow, I., et al.: Generative adversarial networks. Commun. ACM 63(11), 139–144 (2020)
Ho, J., Jain, A., Abbeel, P.: Denoising diffusion probabilistic models. Adv. Neural. Inf. Process. Syst. 33, 6840–6851 (2020)
Kermany, D.S., et al.: Identifying medical diagnoses and treatable diseases by image-based deep learning. Cell 172(5), 1122–1131 (2018)
Li, H., Luo, W., Huang, J.: Localization of diffusion-based inpainting in digital images. IEEE Trans. Inf. Forensics Secur. 12(12), 3050–3064 (2017)
Li, J., Wang, N., Zhang, L., Du, B., Tao, D.: Recurrent feature reasoning for image inpainting. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7760–7768 (2020)
Liu, H., Cao, S., Ling, Y., Gan, Y.: Inpainting for saturation artifacts in optical coherence tomography using dictionary-based sparse representation. IEEE Photon. J. 13(2), 1–10 (2021)
Lugmayr, A., Danelljan, M., Romero, A., Yu, F., Timofte, R., Van Gool, L.: Repaint: inpainting using denoising diffusion probabilistic models. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 11461–11471 (2022)
Nichol, A.Q., Dhariwal, P.: Improved denoising diffusion probabilistic models. In: International Conference on Machine Learning, pp. 8162–8171. PMLR (2021)
Shen, J., Kang, S.H., Chan, T.F.: Euler’s elastica and curvature-based inpainting. SIAM J. Appl. Math. 63(2), 564–592 (2003)
Sridevi, G., Srinivas Kumar, S.: Image inpainting based on fractional-order nonlinear diffusion for image reconstruction. Circuits Syst. Signal Process. 38, 3802–3817 (2019)
Xu, Z., Sun, J.: Image inpainting by patch propagation using patch sparsity. IEEE Trans. Image Process. 19(5), 1153–1165 (2010)
Yan, Z., Li, X., Li, M., Zuo, W., Shan, S.: Shift-Net: image inpainting via deep feature rearrangement. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) Computer Vision – ECCV 2018. LNCS, vol. 11218, pp. 3–19. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01264-9_1
Zhang, X., Chan, T.F.: Wavelet inpainting by nonlocal total variation. Inverse Probl. Imaging 4(1), 191–210 (2010)
Zhang, Y.y., Xie, D.: Detection and segmentation of multi-class artifacts in endoscopy. J. Zhejiang Univ. Sci. B 20(12), 1014 (2019)
Zhao, J., Chen, Z., Zhang, L., Jin, X.: Unsupervised learnable sinogram inpainting network (SIN) for limited angle CT reconstruction. arXiv preprint arXiv:1811.03911 (2018)
Acknowledgement
This work was financially supported by Sichuan Science and Technology Program (NO. 2020YFS0454), NHC Key Laboratory of Nuclear Technology Medical Transformation (MIANYANG CENTRAL HOSPITAL) (Grant No. 2021HYX024, No. 2021HYX031)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Ji, B., He, G., Chen, Z., Zhao, L. (2024). A Novel Diffusion-Model-Based OCT Image Inpainting Algorithm for Wide Saturation Artifacts. In: Liu, Q., et al. Pattern Recognition and Computer Vision. PRCV 2023. Lecture Notes in Computer Science, vol 14437. Springer, Singapore. https://doi.org/10.1007/978-981-99-8558-6_24
Download citation
DOI: https://doi.org/10.1007/978-981-99-8558-6_24
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-8557-9
Online ISBN: 978-981-99-8558-6
eBook Packages: Computer ScienceComputer Science (R0)