Abstract
With the development of information technology, eyes are easily overworked for modern people, which increases the burden of ophthalmologists. This leads to the urgent need of the computer-aided early screening system for vision examination, where the color fundus photography (CFP) is the most economical and noninvasive fundus examination of ophthalmology. The macula, whose center (i.e., fovea) is the most sensitive part of vision, is an important area in fundus images since lesions on it often lead to decreased vision. As macula is usually difficult to identify in a fundus image, automated methods for fovea localization can help a doctor or a screening system quickly determine whether there are macular lesions. However, most localization methods usually can not give realistic locations for fovea with acceptable biases in a large-scale fundus image. To address this issue, we proposed a two-stage framework for accurate fovea localization, where the first stage resorts traditional image processing to roughly find a candidate region of the macula in each fundus image while the second stage resorts a collaborative neural network to obtain a finer location on the candidate region. Experimental results on the dataset of REFUGE2 Challenge suggest that our algorithms can localize fovea accurately and achieve advanced performance, which is potentially useful in practice.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abràmoff, M.D., Garvin, M.K., Sonka, M.: Retinal imaging and image analysis. IEEE Rev. Biomed. Eng. 3, 169–208 (2010)
Asim, K.M., Basit, A., Jalil, A.: Detection and localization of fovea in human retinal fundus images. In: International Conference on Emerging Technologies, pp. 1–5. ICET (2012)
Bochkovskiy, A., Wang, C.Y., Liao, H.Y.M.: YOLOv4: optimal speed and accuracy of object detection. arXiv preprint. arXiv:2004.10934 (2020)
Budai, A., Mogalle, K., Brost, A., Hornegger, J., Michelson, G.: Automatic fovea localization in fundus images. Bildverarbeitung für die Medizin, pp. 114–119 (2014)
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., Zagoruyko, S.: End-to-end object detection with transformers. In: Vedaldi, A., Bischof, H., Brox, T., Frahm, J.M. (eds.) ECCV 2020. LNCS, vol. 12346, pp. 213–229. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58452-8_13
Chung, S.T.: Reading in the presence of macular disease: a mini-review. Ophthalmic Physiol. Opt. 40(2), 171–186 (2020)
Duta, I.C., Liu, L., Zhu, F., Shao, L.: Pyramidal convolution: rethinking convolutional neural networks for visual recognition. arXiv preprint. arXiv:2006.11538 (2020)
Frigo, M., Johnson, S.G.: FFTW: an adaptive software architecture for the FFT. In: IEEE International Conference on Acoustics, Speech and Signal Processing, vol. 3, pp. 1381–1384. IEEE (1998)
Guo, X., Wang, H., Lu, X., Hu, X., Che, S., Lu, Y.: Robust fovea localization based on symmetry measure. IEEE J. Biomed. Health Inform. 24(8), 2315–2326 (2020)
He, K., Gkioxari, G., Dollar, P., Girshick, R.: Mask R-CNN. IEEE Trans. Pattern Anal. Mach. Intell. 42(2), 386–397 (2018)
Huang, Y., Zhong, Z., Yuan, J., Tang, X.: Efficient and robust optic disc detection and fovea localization using region proposal network and cascaded network. Biomed. Sig. Process. Control 60, 101939 (2020)
Li, H., Chutatape, O.: Automated feature extraction in color retinal images by a model based approach. IEEE Trans. Bio-Med. Eng. 51, 246–54 (2004)
Moshkov, N., Mathe, B., Kertesz-Farkas, A., Hollandi, R., Horvath, P.: Test-time augmentation for deep learning-based cell segmentation on microscopy images. Sci. Rep. 10(1), 5068 (2020)
Niemeijer, M., Abramoff, M., Van Ginneken, B.: Automated localization of the optic disc and the fovea. In: 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 3538–3541 (2008)
Orlando, J.I., et al.: Refuge challenge: a unified framework for evaluating automated methods for glaucoma assessment from fundus photographs. Med. Image Anal. 59, 101570 (2020)
Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans. Pattern Anal. Mach. Intell. 39(6), 1137–1149 (2017)
Ronneberger, O., Fischer, P., Brox, T.: U-net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W., Frangi, A. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234-241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28
Sekhar, S., Abd El-Samie, F.E., Yu, P., Al-Nuaimy, W., Nandi, A.K.: Automated localization of retinal features. Appl. Opt. 50(19), 3064–3075 (2011)
Stark, J.A.: Adaptive image contrast enhancement using generalizations of histogram equalization. IEEE Trans. Image Process. 9(5), 889–896 (2000)
Xiao, Z.T., et al.: Automatic localization of macula fovea based on wavelet transformation and gray contours. J. Med. Imaging Health Inform. 5(8), 1816–1820 (2015)
Xie, R., et al.: End-to-end fovea localisation in colour fundus images with a hierarchical deep regression network. IEEE Trans. Med. Imaging 40(1), 116–128 (2021)
Ying, H., Liu, J.C.: Automated localization of macula-fovea area on retina images using blood vessel network topology. In: IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 650–653 (2010)
Zhang, M., Liu, J.C.: Directional local contrast based blood vessel detection in retinal images. In: IEEE International Conference on Image Processing, vol. 4, pp. IV-317–320. IEEE (2007)
Acknowledgments
This work was supported in part by the China Postdoctoral Science Foundation under Grants BX2021333, and in part by the National Natural Science Foundation of China under Grants 61771397.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Chen, Z., Pan, Y., Xia, Y. (2021). CDLRS: Collaborative Deep Learning Model with Joint Regression and Segmentation for Automatic Fovea Localization. In: Fu, H., Garvin, M.K., MacGillivray, T., Xu, Y., Zheng, Y. (eds) Ophthalmic Medical Image Analysis. OMIA 2021. Lecture Notes in Computer Science(), vol 12970. Springer, Cham. https://doi.org/10.1007/978-3-030-87000-3_6
Download citation
DOI: https://doi.org/10.1007/978-3-030-87000-3_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-86999-1
Online ISBN: 978-3-030-87000-3
eBook Packages: Computer ScienceComputer Science (R0)
