Skip to main content

An Attention-Based Deep Learning Model with Interpretable Patch-Weight Sharing for Diagnosing Cervical Dysplasia

  • Conference paper
  • First Online:
Intelligent Systems and Applications (IntelliSys 2021)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 296))

Included in the following conference series:

  • 1482 Accesses

Abstract

Diagnosis of cervical dysplasia by visual inspection is a difficult problem. Most of the recent approaches use deep learning techniques to extract features and detect a region of interest (RoI) in the image. Such approaches can lead to loss of visual detail that appears weak and local within the cervical image. Also, it requires manual annotation to extract the RoI. Moreover, there are not many labeled data due to the medical image’s characteristics. To mitigate the problem, we present an approach that extracts global and local features in the image without manual annotation when there is a shortage of data. The proposed approach is applied to classify cervix cancer, and the results are demonstrated. First of all, we divide the cervix image into nine patches to extract visual features when high-resolution images are unavailable. Second, we generate a deep learning model sharing a weight between patches of the image by considering the patch-patch and patch-image relationship. We also apply an attention mechanism to the model to train the visual features of the image and show an interpretable result. Finally, we add a loss weighting inspired by the domain knowledge to the training process, which guides the learning better while preventing overfitting. The evaluation results indicate improvements over the state-of-the-art methods in sensitivity.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 229.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 299.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. WHO: Human papillomavirus and related cancers in the world, in: Summary report. ICO Information Centre on HPV and Cancer, August 2014

    Google Scholar 

  2. Hartmann, K.E., Hall, S.A., Nanda, K., Boggess, J.F., Zolnoun, D.: Screening for Cervical Cancer. Agency for Healthcare Research and Quality (US), Rockville (MD) (January 2002)

    Google Scholar 

  3. Xu, T., Zhang, H., Huang, X., Zhang, S., Metaxas, D.N.: Multimodal deep learning for cervical dysplasia diagnosis. In: Ourselin, S., Joskowicz, L., Sabuncu, M.R., Unal, G., Wells, W. (eds.) MICCAI 2016. LNCS, vol. 9901, pp. 115–123. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46723-8_14

    Chapter  Google Scholar 

  4. Alyafeai, Z., Ghouti, L.: A fully-automated deep learning pipeline for cervical cancer classification. Exp. Syst. Appl. 141, 112951 (2020)

    Article  Google Scholar 

  5. Gorantla, R., Singh, R.K., Pandey, R., Jain, M.: Cervical Cancer diagnosis using CervixNet - a deep learning approach. In: 2019 IEEE 19th International Conference on Bioinformatics and Bioengineering (BIBE), pp. 397–404, October 2019

    Google Scholar 

  6. Mustafa, S., Dauda, M.: Evaluating convolution neural network optimization algorithms for classification of cervical cancer macro images. In: 2019 15th International Conference on Electronics, Computer and Computation (ICECCO), pp. 1–5, December 2019

    Google Scholar 

  7. Kudva, V., Prasad, K., Guruvare, S.: Transfer learning for classification of uterine cervix images for cervical cancer screening. In: Kalya, S., Kulkarni, M., Shivaprakasha, K.S. (eds.) Advances in Communication, Signal Processing, VLSI, and Embedded Systems. LNEE, vol. 614, pp. 299–312. Springer, Singapore (2020). https://doi.org/10.1007/978-981-15-0626-0_25

    Chapter  Google Scholar 

  8. Vasudha, Mittal, A., Juneja, M.: Cervix Cancer classification using colposcopy images by deep learning method. Int. J. Eng. Technol. Sci. Res. (IJETSR) 5(3), 426-432 (2018)

    Google Scholar 

  9. Xu, T., et al.: Multi-feature based benchmark for cervical dysplasia classification evaluation. Patt. Recogn. 63, 468–475 (2017)

    Article  Google Scholar 

  10. Nithya, B., Ilango, V.: Optimized machine learning based classifications of staging in gynecological cancers using feature subset through fused feature selection process. Int. J. Adv. Comput. Sci. Appl. 11, 154–161 (2020)

    Google Scholar 

  11. National Library of Medicine (U.S.) - The Cleveland Clinic: An Innovative Treatment for Cervical Precancer (UH3), ClinicalTrials.gov Identifier: NCT03084081. https://www.clinicaltrials.gov/ct2/show/NCT03084081. First posted: 2017, Last posted: 2021

  12. Herrero, R., et al.: Design and methods of a population-based natural history study of cervical neoplasia in a rural province of Costa Rica: the Guanacaste Project. Rev. Panam. Salud Publica 1(5), 362–375 (1997)

    Google Scholar 

  13. Korea clinical laboratory(KCL): understanding of cervicography in the case study. Korean Association Obstetricians Gynecologists 64, 8–17 (2017)

    Google Scholar 

Download references

Acknowledgments

We would like to express our gratitude to Dr. Mark Schiffman, Division of Cancer Epidemiology & Genetics, U.S. National Cancer Institute, for allowing us to use one of the NCI datasets. This research was supported by the MSIT (Ministry of Science, ICT), Korea, under the High-Potential Individuals Global Training Program) (2019-0-01599) supervised by the IITP (Institute for Information and Communications Technology Planning and Evaluation).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jihie Kim .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Chae, J., Zhang, Y., Zimmermann, R., Kim, D., Kim, J. (2022). An Attention-Based Deep Learning Model with Interpretable Patch-Weight Sharing for Diagnosing Cervical Dysplasia. In: Arai, K. (eds) Intelligent Systems and Applications. IntelliSys 2021. Lecture Notes in Networks and Systems, vol 296. Springer, Cham. https://doi.org/10.1007/978-3-030-82199-9_43

Download citation

Publish with us

Policies and ethics