Abstract
In this paper, we aim at improving the quality of blurry retinal images that are caused by ocular diseases. The blurry images could affect clinical diagnosis for both ophthalmologists and automatic aided system. Inspired by the great success of generative adversarial networks, a data-driven approach is proposed to enhance the blurry images in a weakly supervised manner. That is to say, instead of paired blurry and high-quality images, our approach can be trained with two sets of unpaired images. The advantage of unpaired training setting makes our approach easily applicable, since the annotated data are very limited in medical images. Compared with traditional methods, our model is an end-to-end approach without human designed adjustments or prior knowledge. However, it achieves a superior performance on blurry images. Besides, a dynamic retinal image feature constraint is proposed to guide the generator to improve the performance and avoid over-enhancing the extremely blurry region. Our approach can work on large image resolution which makes it widely beneficial to clinic images.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Chen, Y.S., Wang, Y.C., Kao, M.H., Chuang, Y.Y.: Deep photo enhancer: unpaired learning for image enhancement from photographs with gans. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 6306–6314 (2018)
Goodfellow, I., et al.: Generative adversarial nets. In: Advances in Neural Information processing Systems, pp. 2672–2680 (2014)
He, K., Sun, J., Tang, X.: Single image haze removal using dark channel prior. IEEE Trans. Pattern Anal. Mach. Intell. 33(12), 2341–2353 (2011)
Isola, P., Zhu, J.Y., Zhou, T., Efros, A.A.: Image-to-image translation with conditional adversarial networks. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 5967–5976. IEEE (2017)
Mao, X., Li, Q., Xie, H., Lau, R.Y., Wang, Z., Paul Smolley, S.: Least squares generative adversarial networks. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2794–2802 (2017)
Mitra, A., Roy, S., Roy, S., Setua, S.K.: Enhancement and restoration of non-uniform illuminated fundus image of retina obtained through thin layer of cataract. Comput. Methods Program. Biomed. 156, 169–178 (2018)
Nie, D., et al.: Medical image synthesis with context-aware generative adversarial networks. In: Descoteaux, Maxime, Maier-Hein, Lena, Franz, Alfred, Jannin, Pierre, Collins, D.Louis, Duchesne, Simon (eds.) MICCAI 2017. LNCS, vol. 10435, pp. 417–425. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-66179-7_48
Polesel, A., Ramponi, G., Mathews, V.J.: Image enhancement via adaptive unsharp masking. IEEE Trans. Image Process. 9(3), 505–510 (2000)
Sevik, U., Kose, C., Berber, T., Erdol, H.: Identification of suitable fundus images using automated quality assessment methods. J. Biomed. Opt. 19(4), 046006 (2014)
Starck, J.L., Murtagh, F., Candès, E.J., Donoho, D.L.: Gray and color image contrast enhancement by the curvelet transform. IEEE Trans. Image Process. 12(6), 706–717 (2003)
Xiong, L., Li, H., Xu, L.: An enhancement method for color retinal images based on image formation model. Comput. Methods Program. Biomed. 143, 137–150 (2017)
Zhao, H., Li, H., Maurer-Stroh, S., Cheng, L.: Synthesizing retinal and neuronal images with generative adversarial nets. Med. Image Anal. 49, 14–26 (2018)
Zhou, M., Jin, K., Wang, S., Ye, J., Qian, D.: Color retinal image enhancement based on luminosity and contrast adjustment. IEEE Trans. Biomed. Eng. 65(3), 521–527 (2018)
Zhu, J.Y., Park, T., Isola, P., Efros, A.A.: Unpaired image-to-image translation using cycle-consistent adversarial networks. In: International Conference on Computer Vision, pp. 2242–2251. IEEE (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Zhao, H., Yang, B., Cao, L., Li, H. (2019). Data-Driven Enhancement of Blurry Retinal Images via Generative Adversarial Networks. In: Shen, D., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2019. MICCAI 2019. Lecture Notes in Computer Science(), vol 11764. Springer, Cham. https://doi.org/10.1007/978-3-030-32239-7_9
Download citation
DOI: https://doi.org/10.1007/978-3-030-32239-7_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32238-0
Online ISBN: 978-3-030-32239-7
eBook Packages: Computer ScienceComputer Science (R0)
