Abstract
Accurate segmentation of key anatomical structures in pediatric echocardiography is essential for the diagnosis and treatment of congenital heart disease. However, most of the existing segmentation methods for echocardiography have the problem of loss of detailed information, which has a certain impact on the accuracy of segmentation. Based on this, we propose a multi-directional attention (MDA) network for echocardiographic segmentation. This method uses U-Net as the backbone network to extract the initial features of different layers, and then sends the initial features to our proposed MDA module for feature enhancement. Among them, MDA includes two parts: First, considering the different contribution rates of spatial information in different directions to features, we construct a multi-directional spatial attention (MDSA) module to extract spatial information in different directions. Then to avoid the loss of channel information, we construct a channel weight constraint module (CWC) to constrain the weight of the spatial features extracted by MDSA. Finally, the group fusion feature output by MDA is used as the input of the decoder, and the final segmentation prediction result is obtained by setting the layered feature fusion (LFF) module. We conduct an extensive evaluation of 4,485 two-dimensional (2D) pediatric echocardiograms from 127 echocardiographic videos. Experiments show that the proposed algorithm can achieve the results of pediatric echocardiographic anatomical structures (left ventricle (LV), left atrium (LA)) with the average dice, precision, and recall were 0.9346, 0.9370, and 0.9406.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Zimmerman, M.S., Smith, A.G.C., Sable, C.A., et al.: Global, regional, and national burden of congenital heart disease, 1990–2017: a systematic analysis for the global burden of disease study 2017. Lancet Child Adolesc. Health 4, 185–200 (2020)
Guo, L., Lei, B., Chen, W., et al.: Dual attention enhancement feature fusion network for segmentation and quantitative analysis of paediatric echocardiography. Med. Image Anal. 71,102042 (2021)
Liu, F., Wang, K., Liu, D., et al.: Deep pyramid local attention neural network for cardiac structure segmentation in two-dimensional echocardiography. Med. Image Anal. 67,101873 (2021)
Hu, Y., Xia, B., Mao, M., et al.: AIDAN: an attention-guided dual-path network for pediatric echocardiography segmentation. IEEE Access 8, 29176–29187 (2020)
Li, K., Wang, S., Yu, L., et al.: Dual-teacher++: exploiting intra-domain and inter-domain knowledge with reliable transfer for cardiac segmentation. IEEE Trans. Med. Imaging (2020)
Xu, L., Liu, M., Zhang, J., et al.: Convolutional-neural-network-based approach for segmentation of apical four-chamber view from fetal echocardiography. IEEE Access 8, 80437–80446 (2020)
Ronneberger, O., Fischer, P., Brox, T.: U-net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W., Frangi, A., (eds.) International Conference on Medical image computing and computer-assisted intervention. Lecture Notes in Computer Science, vol. 9351, pp. 234–241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28
Leclerc, S., Smistad, E., Østvik, A., et al.: LU-Net: a multistage attention network to improve the robustness of segmentation of left ventricular structures in 2-D echocardiography. IEEE Trans. Ultrason. Ferroelectr. Freq. Control 67, 2519–2530 (2020)
Woo, S., Park, J., Lee, J.-Y., Kweon, I.S.: CBAM: convolutional block attention module. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11211, pp. 3–19. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01234-2_1
Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7132–7141 (2018)
Qilong, W., Banggu, W., Pengfei, Z., et al.: ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks (2020)
Zhang, Y., Li, K., Li, K., Wang, L., Zhong, B., Fu, Y.: Image super-resolution using very deep residual channel attention networks. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11211, pp. 294–310. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01234-2_18
Fu, J., Liu, J., Tian, H., et al.: Dual attention network for scene segmentation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 3146–3154 (2019)
Yu, C., Wang, J., Peng, C., Gao, C., Yu, G., Sang, N.: BiSeNet: bilateral segmentation network for real-time semantic segmentation. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11217, pp. 334–349. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01261-8_20
Chen, L-C., Papandreou, G., Schroff, F., et al.: Rethinking atrous convolution for se-mantic image segmentation. arXiv preprint arXiv:1706.05587 (2017)
Zhao, H., Shi, J., Qi, X., et al.: Pyramid scene parsing network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2881–2890 (2017)
Badrinarayanan, V., Kendall, A., Cipolla, R.: Segnet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39, 2481–2495 (2017)
Weng, Y., Zhou, T., Li, Y., et al.: NAS-Unet: neural architecture search for medical image segmentation. IEEE Access 7, 44247–44257 (2019)
Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440 (2015)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Xiang, Z. et al. (2021). Multi-directional Attention Network for Segmentation of Pediatric Echocardiographic. In: Ma, H., et al. Pattern Recognition and Computer Vision. PRCV 2021. Lecture Notes in Computer Science(), vol 13021. Springer, Cham. https://doi.org/10.1007/978-3-030-88010-1_42
Download citation
DOI: https://doi.org/10.1007/978-3-030-88010-1_42
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-88009-5
Online ISBN: 978-3-030-88010-1
eBook Packages: Computer ScienceComputer Science (R0)