skip to main content
10.1145/3573942.3574042acmotherconferencesArticle/Chapter ViewAbstractPublication PagesaiprConference Proceedingsconference-collections
research-article

Nuclei Segmentation Using Cascaded Bilateral Attention U-Net

Published: 16 May 2023 Publication History

Abstract

Medical image segmentation plays an indispensable role in biomedical development, especially in automatic disease diagnosis and treatment. The task of semantic segmentation is to group parts of an image that belong to the same object class together. In neuroscience studies, automated, accurate, and high-throughput nuclear segmentation methods are of high demand to quantify the number of cells. In this paper, we propose a cascaded U-Net network architecture with bilateral attention gate. In order to obtain nuclei edge for followed counting cell, we design the cascaded networks with different segmentation tasks. A U-Net is used as the first layer of the network to roughly segment the nucleus region, and the next layer uses a bilateral attention U-Net model with a gating mechanism to fine-tune the nucleus segmentation (including nuclei, edges, and background). The bilateral gating mechanism can learn importance of the features at different scales. Using the proposed network, experiments are conducted on a dataset of microscopic nuclear images. According to experimental results, the cascaded multi-task model with bilateral attention gate outperforms individual U-Net network and attention U-Net.

References

[1]
Jha D, Smedsrud P H, Riegler M A, Kvasir-seg: A segmented polyp dataset[C]//International Conference on Multimedia Modeling. Springer, Cham, 2020: 451-462.
[2]
Liu C, Dong W F, Jiang K M, Recognition of dense fluorescent droplets using an improved watershed segmentation algorithm[J]. Chinese Optics, 2019, 12(4):783-790.
[3]
Haijie C, Ning L, Jie P, Infrared image adaptive inverse histogram enhancement technology[J]. Infrared and Laser Engineering, 2020, 49(4): 0426003.
[4]
Zhao Z, Zhao J, Song K, Joint DBN and Fuzzy C-Means unsupervised deep clustering for lung cancer patient stratification[J]. Engineering Applications of Artificial Intelligence, 2020, 91: 103571.
[5]
Ambühl M E, Brepsant C, Meister J J, High‐resolution cell outline segmentation and tracking from phase‐contrast microscopy images[J]. Journal of microscopy, 2012, 245(2): 161-170.
[6]
Seroussi I, Veikherman D, Ofer N, Segmentation and tracking of live cells in phase‐contrast images using directional gradient vector flow for snakes[J]. Journal of microscopy, 2012, 247(2): 137-146.
[7]
Dongmei L, Faliang C. Active contour model for image segmentation based on Retinex correction and saliency[J]. Optics and Precision Engineering, 2019, 27(7): 1593-1600.
[8]
Jaccard N, Griffin L D, Keser A, Automated method for the rapid and precise estimation of adherent cell culture characteristics from phase contrast microscopy images[J]. Biotechnology and bioengineering, 2014, 111(3): 504-517.
[9]
Geng Q, Zhou Z, Cao X. Survey of recent progress in semantic image segmentation with CNNs[J]. Science China Information Sciences, 2018, 61: 1-18.
[10]
Anwar S M, Majid M, Qayyum A, Medical image analysis using convolutional neural networks: a review[J]. Journal of medical systems, 2018, 42: 1-13.
[11]
Ayanzadeh A, ÖZUYSAL Ö Y, Okvur D P, Improved cell segmentation using deep learning in label-free optical microscopyimages[J]. Turkish Journal of Electrical Engineering and Computer Sciences, 2021, 29(8): 2855-2868.
[12]
Badrinarayanan V, Kendall A, Cipolla R. Segnet: A deep convolutional encoder-decoder architecture for image segmentation[J]. IEEE transactions on pattern analysis and machine intelligence, 2017, 39(12): 2481-2495.
[13]
Chen L C, Papandreou G, Kokkinos I, Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs[J]. IEEE transactions on pattern analysis and machine intelligence, 2017, 40(4): 834-848.
[14]
Chen L C, Papandreou G, Schroff F, Rethinking atrous convolution for semantic image segmentation[J]. arXiv preprint arXiv:1706.05587, 2017.
[15]
Long J, Shelhamer E, Darrell T . Fully Convolutional Networks for Semantic Segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 39(4):640-651.
[16]
Ronneberger O, Fischer P, Brox T. U-net: Convolutional networks for biomedical image segmentation[C]//Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18. Springer International Publishing, 2015: 234-241.
[17]
Milletari F, Navab N, Ahmadi S A. V-net: Fully convolutional neural networks for volumetric medical image segmentation[C]//2016 fourth international conference on 3D vision (3DV). IEEE, 2016: 565-571.
[18]
Oktay O, Schlemper J, Folgoc L L, Attention u-net: Learning where to look for the pancreas[J]. arXiv preprint arXiv:1804.03999, 2018.
[19]
Leclerc S, Smistad E, Grenier T, RU-Net: A refining segmentation network for 2D echocardiography[C]//2019 IEEE International Ultrasonics Symposium (IUS). IEEE, 2019: 1160-1163.
[20]
Alom M Z, Yakopcic C, Taha T M, Nuclei segmentation with recurrent residual convolutional neural networks based U-Net (R2U-Net)[C]//NAECON 2018-IEEE National Aerospace and Electronics Conference. IEEE, 2018: 228-233.
[21]
Isensee F, Petersen J, Klein A, nnu-net: Self-adapting framework for u-net-based medical image segmentation[J]. arXiv preprint arXiv:1809.10486, 2018.
[22]
Jha D, Riegler M A, Johansen D, Doubleu-net: A deep convolutional neural network for medical image segmentation[C]//2020 IEEE 33rd International symposium on computer-based medical systems (CBMS). IEEE, 2020: 558-564.
[23]
Schmidt U, Weigert M, Broaddus C, Cell detection with star-convex polygons[C]//Medical Image Computing and Computer Assisted Intervention–MICCAI 2018: 21st International Conference, Granada, Spain, September 16-20, 2018, Proceedings, Part II 11. Springer International Publishing, 2018: 265-273.

Index Terms

  1. Nuclei Segmentation Using Cascaded Bilateral Attention U-Net

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    AIPR '22: Proceedings of the 2022 5th International Conference on Artificial Intelligence and Pattern Recognition
    September 2022
    1221 pages
    ISBN:9781450396899
    DOI:10.1145/3573942
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 16 May 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Attention U-Net
    2. Bilateral attention
    3. Cascading learning
    4. Image segmentation

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    AIPR 2022

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 50
      Total Downloads
    • Downloads (Last 12 months)8
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 01 Mar 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media