Abstract
Effective treatment of degenerative retinal diseases will require robot-assisted intraretinal therapy delivery supported by excellent retinal layer visualisation capabilities. Intra-operative Optical Coherence Tomography (iOCT) is an imaging modality which provides real-time, cross-sectional retinal images partially allowing visualisation of the layers where the sight restoring treatments should be delivered. Unfortunately, iOCT systems sacrifice image quality for high frame rates, making the identification of pertinent layers challenging. This paper proposes a Super-Resolution pipeline to enhance the quality of iOCT images leveraging information from iOCT 3D cube scans. We first explore whether 3D iOCT cube scans can indeed be used as high-resolution images by performing Image Quality Assessment. Then, we apply non-rigid image registration to generate partially aligned pairs, and we carry out data augmentation to increase the available training data. Finally, we use CycleGAN to transfer the quality between low-resolution (LR) and high-resolution (HR) domain. Quantitative analysis demonstrates that iOCT quality increases with statistical significance, but a qualitative study with expert clinicians is inconclusive with regards to their preferences.
L. Da Cruz and C. Bergeles—Supported by King’s Centre for Doctoral Studies - Centre for Doctoral Training in Surgical & Interventional Engineering, and an ERC Starting Grant [714562]. L. Da Cruz and C. Bergeles are equally contributing senior authors.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Adler, D.C., Ko, T.H., Fujimoto, J.G.: Speckle reduction in optical coherence tomography images by use of a spatially adaptive wavelet filter. Opt. Lett. 29(24), 2878–2880 (2004)
da Cruz, L., et al.: Phase 1 clinical study of an embryonic stem cell-derived retinal pigment epithelium patch in age-related macular degeneration. Nat. Biotechnol. 36(4), 328 (2018)
Devalla, S.K., et al.: A deep learning approach to denoise optical coherence tomography images of the optic nerve head. Sci. Rep. 9(1), 1–13 (2019)
Gondara, L.: Medical image denoising using convolutional denoising autoencoders. In: 2016 IEEE 16th International Conference on Data Mining Workshops (ICDMW), pp. 241–246. IEEE (2016)
Goodfellow, I., et al.: Generative adversarial nets. In: Advances in Neural Information Processing Systems, p. 27 (2014)
Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., Hochreiter, S.: GANs trained by a two time-scale update rule converge to a local nash equilibrium. arXiv preprint arXiv:1706.08500 (2017)
Isola, P., Zhu, J.Y., Zhou, T., Efros, A.A.: Image-to-image translation with conditional adversarial networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1125–1134 (2017)
Johnson, J., Alahi, A., Fei-Fei, L.: Perceptual losses for real-time style transfer and super-resolution. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9906, pp. 694–711. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46475-6_43
Jørgensen, T.M., Thomadsen, J., Christensen, U., Soliman, W., Sander, B.A.: Enhancing the signal-to-noise ratio in ophthalmic optical coherence tomography by image registration-method and clinical examples. J. Biomed. Opt. 12(4), 041208 (2007)
Lazaridis, G., Lorenzi, M., Ourselin, S., Garway-Heath, D.: Improving statistical power of glaucoma clinical trials using an ensemble of cyclical generative adversarial networks. Med. Image Anal. 68, 101906 (2021)
Ledig, C., et al.: Photo-realistic single image super-resolution using a generative adversarial network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4681–4690 (2017)
Matkovic, K., Neumann, L., Neumann, A., Psik, T., Purgathofer, W.: Global contrast factor-a new approach to image contrast. Comput. Aesthet. 2005(159–168), 1 (2005)
Mittal, A., Soundararajan, R., Bovik, A.C.: Making a “completely blind’’ image quality analyzer. IEEE Signal Process. Lett. 20(3), 209–212 (2012)
Ozcan, A., Bilenca, A., Desjardins, A.E., Bouma, B.E., Tearney, G.J.: Speckle reduction in optical coherence tomography images using digital filtering. JOSA A 24(7), 1901–1910 (2007)
Ravì, D., Szczotka, A.B., Pereira, S.P., Vercauteren, T.: Adversarial training with cycle consistency for unsupervised super-resolution in endomicroscopy. Med. Image Anal. 53, 123–131 (2019)
Rieke, N., et al.: Surgical tool tracking and pose estimation in retinal microsurgery. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9349, pp. 266–273. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24553-9_33
Roodaki, H., Grimm, M., Navab, N., Eslami, A.: Real-time scene understanding in ophthalmic anterior segment OCT images. Investig. Ophthalmol. Vis. Sci. 60(11), PB095–PB095 (2019)
Russakovsky, O., et al.: Imagenet large scale visual recognition challenge. Int. J. Comput. Vis. 115(3), 211–252 (2015)
Sander, B., Larsen, M., Thrane, L., Hougaard, J.L., Jørgensen, T.M.: Enhanced optical coherence tomography imaging by multiple scan averaging. Br. J. Ophthalmol. 89(2), 207–212 (2005)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
Wolterink, J.M., Dinkla, A.M., Savenije, M.H.F., Seevinck, P.R., van den Berg, C.A.T., Išgum, I.: Deep MR to CT synthesis using unpaired data. In: Tsaftaris, S.A., Gooya, A., Frangi, A.F., Prince, J.L. (eds.) SASHIMI 2017. LNCS, vol. 10557, pp. 14–23. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-68127-6_2
Yang, Q., et al.: Low-dose CT image denoising using a generative adversarial network with Wasserstein distance and perceptual loss. IEEE Trans. Med. Imaging 37(6), 1348–1357 (2018)
Zhou, M., et al.: Precision needle tip localization using optical coherence tomography images for subretinal injection. In: 2018 IEEE International Conference on Robotics and Automation (ICRA), pp. 4033–4040. IEEE (2018)
Zhu, J.Y., Park, T., Isola, P., Efros, A.A.: Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2223–2232 (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Komninos, C. et al. (2021). Intra-operative OCT (iOCT) Image Quality Enhancement: A Super-Resolution Approach Using High Quality iOCT 3D Scans. In: Fu, H., Garvin, M.K., MacGillivray, T., Xu, Y., Zheng, Y. (eds) Ophthalmic Medical Image Analysis. OMIA 2021. Lecture Notes in Computer Science(), vol 12970. Springer, Cham. https://doi.org/10.1007/978-3-030-87000-3_3
Download citation
DOI: https://doi.org/10.1007/978-3-030-87000-3_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-86999-1
Online ISBN: 978-3-030-87000-3
eBook Packages: Computer ScienceComputer Science (R0)
