ABSTRACT
Ultrasound imaging is being used as a new diagnostic tool for identifying sarcopenia. However, the low contrast characteristics of ultrasound images and significant scale variations in muscle areas pose certain challenges to segmentation. Therefore, we propose a segmentation network called RFF-Net to automatically and accurately segment the muscle region in ultrasound images. RFF-Net comprises three novel components: (1) A multi-scale feature subtraction module (MFS) is designed to weaken redundant features to achieve accurate segmentation; (2) A refinement feature feedback module (RFF) is proposed to extract ambiguous boundary features to improve segmentation integrity; (3) A multi-resolution deep supervision module (MDS) is introduced to perform feature selection for different resolution features generating from decoder to improve segmentation accuracy. Experiments on both private and public datasets show our method achieves much higher segmentation accuracy than related methods.
- Dawood Al Chanti, Vanessa Gonzalez Duque, Marion Crouzier, Antoine Nordez, Lilian Lacourpaille, and Diana Mateus. 2021. IFSS-Net: Interactive few-shot siamese network for faster muscle segmentation and propagation in volumetric ultrasound. IEEE Transactions on Medical Imaging 40, 10 (2021), 2615–2628.Google ScholarCross Ref
- Neil J Cronin, Taija Finni, and Olivier Seynnes. 2020. Fully automated analysis of muscle architecture from B-mode ultrasound images with deep learning. arXiv preprint arXiv:2009.04790 (2020).Google Scholar
- Deng-Ping Fan, Ge-Peng Ji, Tao Zhou, Geng Chen, Huazhu Fu, Jianbing Shen, and Ling Shao. 2020. Pranet: Parallel reverse attention network for polyp segmentation. In Medical Image Computing and Computer Assisted Intervention–MICCAI 2020: 23rd International Conference, Lima, Peru, October 4–8, 2020, Proceedings, Part VI 23. Springer, 263–273.Google Scholar
- Yuqi Fang, Cheng Chen, Yixuan Yuan, and Kai-yu Tong. 2019. Selective feature aggregation network with area-boundary constraints for polyp segmentation. In Medical Image Computing and Computer Assisted Intervention–MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13–17, 2019, Proceedings, Part I 22. Springer, 302–310.Google ScholarDigital Library
- Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 770–778.Google ScholarCross Ref
- Francesco Marzola, Nens van Alfen, Jonne Doorduin, and Kristen M Meiburger. 2021. Deep learning segmentation of transverse musculoskeletal ultrasound images for neuromuscular disease assessment. Computers in Biology and Medicine 135 (2021), 104623.Google ScholarDigital Library
- Ozan Oktay, Jo Schlemper, Loic Le Folgoc, Matthew Lee, Mattias Heinrich, Kazunari Misawa, Kensaku Mori, Steven McDonagh, Nils Y Hammerla, Bernhard Kainz, 2018. Attention U-Net: Learning where to look for the pancreas. arXiv preprint arXiv:1804.03999 (2018).Google Scholar
- Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-Net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18. Springer, 234–241.Google ScholarCross Ref
- Massimo Salvi, Cristina Caresio, Kristen M Meiburger, Bruno De Santi, Filippo Molinari, and Marco Alessandro Minetto. 2019. Transverse muscle ultrasound analysis (TRAMA): robust and accurate segmentation of muscle cross-sectional area. Ultrasound in Medicine & Biology 45, 3 (2019), 672–683.Google ScholarCross Ref
- Selim Seferbekov, Vladimir Iglovikov, Alexander Buslaev, and Alexey Shvets. 2018. Feature pyramid network for multi-class land segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 272–275.Google ScholarCross Ref
- Howard J Stringer and Daisy Wilson. 2018. The role of ultrasound as a diagnostic tool for sarcopenia. The Journal of Frailty & Aging 7 (2018), 258–261.Google Scholar
- Xiaoqi Zhao, Lihe Zhang, and Huchuan Lu. 2021. Automatic polyp segmentation via multi-scale subtraction network. In Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part I 24. Springer, 120–130.Google ScholarDigital Library
- Junsheng Zhou, Yiwen Lu, Siyi Tao, Xuan Cheng, and Chenxi Huang. 2021. E-Res U-Net: An improved U-Net model for segmentation of muscle images. Expert Systems with Applications 185 (2021), 115625.Google ScholarDigital Library
- Zongwei Zhou, Md Mahfuzur Rahman Siddiquee, Nima Tajbakhsh, and Jianming Liang. 2018. UNet++: A Nested U-Net Architecture for Medical Image Segmentation. Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support : 4th International Workshop, DLMIA 2018, and 8th International Workshop, ML-CDS 2018, held in conjunction with MICCAI 2018, Granada, Spain, S... 11045 (2018), 3–11.Google Scholar
Index Terms
- RFF-Net: A Refined Feature Feedback Network for Muscle Ultrasound Image Segmentation with Feature Subtraction and Deep Supervision
Recommendations
Segmentation of liver cyst in ultrasound image based on adaptive threshold algorithm and particle swarm optimization
To find the optimum threshold of an image is still an important research topic in the recent years. This paper presents a segmentation of liver cyst for ultrasound image through combining Wellner's thresholding algorithm with particle swarm optimization (...
Segmentation of ultrasound image sequences by combing a novel deep siamese network with a deformable contour model
AbstractDeformable contours are widely applied in medical image segmentation, which are usually derived from appearance cues in medical images. However, the performance of deformed contour is suppressed in ultrasonic image segmentation by the weak, ...
Fast and accurate segmentation method of active shape model with Rayleigh mixture model clustering for prostate ultrasound images
Highlights- Rayleigh mixture model improves active shape model when applied on US images.
- ...
Abstract Background and objectiveThe prostate cancer interventions, which need an accurate prostate segmentation, are performed under ultrasound imaging guidance. However, prostate ultrasound segmentation is facing two challenges. ...
Comments