Skip to main content

A Two-Stage Approach for Automated Prostate Lesion Detection and Classification with Mask R-CNN and Weakly Supervised Deep Neural Network

  • Conference paper
  • First Online:
Artificial Intelligence in Radiation Therapy (AIRT 2019)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 11850))

Included in the following conference series:

Abstract

Early diagnosis of prostate cancer is very crucial to reduce the mortality rate. Multi-parametric magnetic resonance imaging (MRI) can provide detailed visualization of prostate tissues and lesions. Their malignancy can be diagnosed before any necessary invasive approaches, such as needle biopsy, at the risk of damage to or inflammation of the periprostatic nerves, prostate and bladder neck. However, the prostate tissue malignancy on magnetic resonance (MR) images can also be difficult to determine, with often inconclusive results among the clinicians. With the progress in artificial intelligence (AI), research on MR image-based lesion classification with AI tools are being explored increasingly. So far, existing classification approaches heavily rely on manually labelling of lesion areas, which is a labor-intensive and time-consuming process. In this paper, we present a novel two-stage method for fully-automated prostate lesion detection and classification, using input sequences of T2-weighted images, apparent diffusion coefficient (ADC) maps and high b-value diffusion-weighted images. In the first stage, a Mask R-CNN model is trained to automatically segment prostate structures. In the second stage, a weakly supervised deep neural network is developed to detect and classify lesions in a single run. To validate the accuracy of our system, we tested our method on two datasets, one from the PROSTATEx Challenge and the other from our local cohort. Our method can achieve average area-under-the-curve (AUC) of 0.912 and 0.882 on the two datasets respectively. The proposed approach present a promising tool for radiologists in their clinical practices.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Prostate Cancer International Inc. https://prostatecancerinfolink.net/2018/01/09/prostate-cancer-projections-for-2018/. Accessed 02 Apr 2019

  2. American Cancer Society Inc. https://www.cancer.org/cancer/prostate-cancer/about/key-statistics.html. Accessed 02 Apr 2019

  3. Oberlin, D.T., Casalino, D.D., Miller, F.H., Meeks, J.J.: Dramatic increase in the utilization of multiparametric magnetic resonance imaging for detection and management of prostate cancer. Abdom. Radiol. 42(4), 1255–1258 (2017)

    Article  Google Scholar 

  4. Hassanzadeh, E., Glazer, D.I., Dunne, R.M., Fennessy, F.M., Harisinghani, M.G., Tempany, C.M.: Prostate imaging reporting and data system version 2 (PI-RADS v2): a pictorial review. Abdom. Radiol. 42(1), 278–289 (2017)

    Article  Google Scholar 

  5. Sonn, G.A., Fan, R.E., Ghanouni, P., et al.: Prostate magnetic resonance imaging interpretation varies substantially across radiologists. Eur. Urol. Focus 5(4), 592–599 (2017)

    Article  Google Scholar 

  6. Karimi, D., Ruan, D.: Synergistic combination of learned and hand-crafted features for prostate lesion classification in multiparametric magnetic resonance imaging. In: Descoteaux, M., Maier-Hein, L., Franz, A., Jannin, P., Collins, D.L., Duchesne, S. (eds.) MICCAI 2017. LNCS, vol. 10435, pp. 391–398. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-66179-7_45

    Chapter  Google Scholar 

  7. Liu, S., Zheng, H., Feng, Y., Li, W.: Prostate cancer diagnosis using deep learning with 3D multiparametric MRI. In: Samuel, G.A., Nicholas, A.P. (eds.) Medical Imaging 2017: Computer-Aided Diagnosis. International Society for Optics and Photonics, vol. 10134, p. 1013428 (2017). https://doi.org/10.1117/12.2277121

  8. Kiraly, A.P., et al.: Deep convolutional encoder-decoders for prostate cancer detection and classification. In: Descoteaux, M., Maier-Hein, L., Franz, A., Jannin, P., Collins, D.L., Duchesne, S. (eds.) MICCAI 2017. LNCS, vol. 10435, pp. 489–497. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-66179-7_56

    Chapter  Google Scholar 

  9. He, K., Gkioxari, G., Dollár, P., Girshick, R.: Mask r-cnn. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2961–2969 (2017)

    Google Scholar 

  10. Litjens, G., Debats, O., Barentsz, J., Karssemeijer, N., et al.: Computer-aided detection of prostate cancer in MRI. IEEE Trans. Med. Imaging 33(5), 1083–1092 (2014)

    Article  Google Scholar 

  11. Lemaitre, G., Marti, R., Freixenet, J., Vilanova, J.C., Walker, P.M., et al.: Computer-aided detection and diagnosis for prostate cancer based on mono and multi-parametric MRI: a review. Comput. Biol. Med. 60, 8–31 (2015)

    Article  Google Scholar 

  12. Li, C., Xu, C., Gui, C., et al.: Distance regularized level set evolution and its application to image segmentation. IEEE Trans. Image Process. 19(12), 3243–3254 (2010)

    Article  MathSciNet  Google Scholar 

  13. Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)

  14. Alkadi, R., Taher, F., El-baz, A., Werghi, N.: A Deep Learning-based approach for the detection and localization of prostate cancer in t2 magnetic resonance images. J. Digit. Imaging, 1–15 (2018)

    Google Scholar 

Download references

Acknowledgements

This work is supported by the Research Grants Council (RGC) of HK (Ref. No.: 17202317, 17227616, 17206818, 27209515), and Innovation and Technology Commission (Ref. No.: UIM/353).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ka-Wai Kwok .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Liu, Z. et al. (2019). A Two-Stage Approach for Automated Prostate Lesion Detection and Classification with Mask R-CNN and Weakly Supervised Deep Neural Network. In: Nguyen, D., Xing, L., Jiang, S. (eds) Artificial Intelligence in Radiation Therapy. AIRT 2019. Lecture Notes in Computer Science(), vol 11850. Springer, Cham. https://doi.org/10.1007/978-3-030-32486-5_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-32486-5_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-32485-8

  • Online ISBN: 978-3-030-32486-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics