skip to main content
10.1145/3625343.3625361acmotherconferencesArticle/Chapter ViewAbstractPublication PagesaimlrConference Proceedingsconference-collections
research-article

Dual-stream Assisted U-Net for Thyroid Nodule Segmentation

Published:11 November 2023Publication History

ABSTRACT

Abstract—Accurate and effective segmentation of thyroid nodules in ultrasound images is critical for computer-aided nodule diagnosis and treatment. However, due to the ill-defined margin of ultrasound images and the complexity of thyroid tissue structure, accurate segmentation of fine contours is still challenging. We propose a dual-stream network-assisted U-Net (DA-UNet) for these issues, which fully integrates features extracted by convolutional neural networks and vision transformer (ViT), applying them to the decoder and skip connection stages. The model is evaluated on the publicly available dataset TN3K, and the experimental results show that DA-UNet achieves 84.43% and 85.55% in Dice coefficient and F1-score respectively, with an average improvement of 3.75% and 3.12% compared to the current popular segmentation networks, reaching the optimal level.

References

  1. J. Chen, and H. You. “A review of thyroid gland segmentation and thyroid nodule segmentation methods for medical ultrasound images,” Computer methods and programs in biomedicine, vol. 185, pp. 105329, 2020.Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. J. Zhao, W. Zheng, L. Zhang, and H. Tian. “Segmentation of ultrasound images of thyroid nodule for assisting fine needle aspiration cytology,” Health information science and systems, vol. 1, pp. 1-12, 2013.Google ScholarGoogle ScholarCross RefCross Ref
  3. W. Du, and N. Sang. “An effective method for ultrasound thyroid nodules segmentation,” International symposium on bioelectronics and bioinformatics, pp. 207-210, 2015.Google ScholarGoogle ScholarCross RefCross Ref
  4. H. Gong, G. Chen, R. Wang, X. Xie, M. Mao, and Y. Yu. “Multi-task learning for thyroid nodule segmentation with thyroid region prior,” International symposium on biomedical imaging, pp. 257-261, 2021.Google ScholarGoogle ScholarCross RefCross Ref
  5. H. Bi, C. Cai, J. Sun, Y. Jiang, G. Lu and H. Shu. “BPAT-UNet: Boundary preserving assembled transformer UNet for ultrasound thyroid nodule segmentation,” Computer methods and programs in biomedicine, vol. 238, pp. 107614, 2023.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. O. Ronneberger, P. Fischer, and T. Brox. “U-net: Convolutional networks for biomedical image segmentation,” Medical image computing and computer-assisted intervention, pp. 234-241, 2015.Google ScholarGoogle ScholarCross RefCross Ref
  7. O. Oktay, J. Schlemper, L. L. Folgoc, M. Lee, M. Heinrich, and K. Misawa, “Attention U-Net: learning where to look for the pancreas,” Preprint arXiv:1804.03999, 2018.Google ScholarGoogle Scholar
  8. Z. Zhou, M.Rahman Siddiquee, N. Tajbakhsh, and J. Liang. “Unet++: A nested u-net architecture for medical image segmentation,” Deep learning in medical image analysis and multimodal learning for clinical decision support, pp. 3-11, 2018.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. L. Chen, Y. Zhu, G. Papandreou, and F. Schroff. “Encoder-decoder with atrous separable convolution for semantic image segmentation,” European conference on computer vision, pp. 833-851, 2018.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, and X. Zhai. “An image is worth 16x16 words: Transformers for image recognition at scale,” Preprint arXiv:2010.11929, 2020.Google ScholarGoogle Scholar
  11. J. Chen, Y. Lu, Q. Yu, X. Luo, E. Adeli, and Y. Wang. “Transunet: Transformers make strong encoders for medical image segmentation,” Preprint arXiv:2102.04306, 2021.Google ScholarGoogle Scholar
  12. A. Hatamizadeh, V. Nath, Y. Tang, D. Yang, H. R. Roth, and D. Xu. “Swin UNETR: Swin transformers for semantic segmentation of brain tumors in MRI images,” International miccai brainlesion workshop, pp. 272-284, 2021.Google ScholarGoogle Scholar
  13. Z. Liu, H. Mao, C. Y. Wu, C. Feichtenhofer, T. Darrell, and S Xie. “A convnet for the 2020s,” International conference on computer vision and pattern recognition, pp. 11976-11986, 2022.Google ScholarGoogle ScholarCross RefCross Ref
  14. T. Zhen, D. Hua, Y. Shi, W. Wang, X. Wang, and S. Ren. “Local and context-attention adaptive LCA-Net for thyroid nodule segmentation in ultrasound images,” Sensors, vol. 22(16), pp. 5984, 2022.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Dual-stream Assisted U-Net for Thyroid Nodule Segmentation
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in
          • Published in

            cover image ACM Other conferences
            AIMLR '23: Proceedings of the 2023 Asia Conference on Artificial Intelligence, Machine Learning and Robotics
            September 2023
            133 pages
            ISBN:9798400708312
            DOI:10.1145/3625343

            Copyright © 2023 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 11 November 2023

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • research-article
            • Research
            • Refereed limited
          • Article Metrics

            • Downloads (Last 12 months)16
            • Downloads (Last 6 weeks)6

            Other Metrics

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader

          HTML Format

          View this article in HTML Format .

          View HTML Format