Abstract
Multi-parametric MRI (mp-MRI) has recently been established in major guidelines as a first-line diagnostic test for men suspected of having prostate cancer (PCa) primarily to detect and classify clinically significant lesions. However, widespread utilization is still challenged by 1) the difficulty of interpretation specifically for radiologists less experienced in reading mp-MRI scans, and 2) decreased productivity associated with increased time spent per case for reading these complex scans. Deep learning based lesion detection and segmentation methods have been proposed for radiologists to perform their tasks more accurately and efficiently. In this work, we present a novel panoptic lesion detection and segmentation method with both semantic and instance branches as well as an attention module to optimally incorporate both local and global image features. In a free-response receiver operating characteristics (FROC) analysis for lesion sensitivity on an independent dataset with 243 patients, our method has achieved 89% sensitivity and 85% with 0.94 and 0.62 false positives per patient, respectively. Using the proposed method, we have achieved an unprecedented area under ROC curve (AUC) of 0.897 in identifying clinically significant cases.
ProstateAI Clinical Collaborators–A list of members and affiliations appears at the end of the paper.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bray, F., Ferlay, J., Soerjomataram, I., Siegel, R.L., Torre, L.A., Jemal, A.: Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA: Cancer J. Clin. 68(6), 394–424 (2018)
Cao, R., et al.: Joint prostate cancer detection and gleason score prediction in MP-MRI via FocalNet. IEEE TMI 38(11), 2496–2506 (2019)
He, K., Gkioxari, G., Dollár, P., Girshick, R.: Mask R-CNN. In: Proceedings of ICCV, pp. 2961–2969 (2017)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of CVPR, pp. 770–778 (2016)
Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. In: Proceedings of CVPR, pp. 7132–7141 (2018)
Jaeger, P.F., et al.: Retina U-net: Embarrassingly simple exploitation of segmentation supervision for medical object detection. In: Machine Learning for Health Workshop, pp. 171–183 (2020)
Kasivisvanathan, V., et al.: MRI-targeted or standard biopsy for prostate-cancer diagnosis. NEJM 378(19), 1767–1777 (2018)
Kirillov, A., Girshick, R., He, K., Dollár, P.: Panoptic feature pyramid networks. In: Proceedings of CVPR, pp. 6399–6408 (2019)
Kirillov, A., He, K., Girshick, R., Rother, C., Dollár, P.: Panoptic segmentation. In: Proceedings of CVPR, pp. 9404–9413 (2019)
Li, Y., et al.: Attention-guided unified network for panoptic segmentation. In: Proceedings of CVPR, pp. 7026–7035 (2019)
Lin, T.Y., Dollár, P., Girshick, R., He, K., Hariharan, B., Belongie, S.: Feature pyramid networks for object detection. In: Proceedings of CVPR, pp. 2117–2125 (2017)
Litjens, G., Debats, O., Barentsz, J., Karssemeijer, N., Huisman, H.: Computer-aided detection of prostate cancer in MRI. IEEE TMI 33(5), 1083–1092 (2014)
Liu, D., Zhang, D., Song, Y., Zhang, C., Zhang, F., O’Donnell, L., Cai, W.: Nuclei segmentation via a deep panoptic model with semantic feature fusion. In: Proceedings of the International Joint Conference on Artificial Intelligence, pp. 861–868. AAAI Press (2019)
Loffroy, R., et al.: Current role of multiparametric magnetic resonance imaging for prostate cancer. Quant. Imaging Med. Surg. 5(5), 754 (2015)
Pinto, F., et al.: Imaging in prostate cancer diagnosis: present role and future perspectives. Urol. Int. 86(4), 373–382 (2011)
Purysko, A.S., Rosenkrantz, A.B., Barentsz, J.O., Weinreb, J.C., Macura, K.J.: PI-RADS version 2: a pictorial update. Radiographics 36(5), 1354–1372 (2016)
Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Advances in Neural Information Processing Systems, pp. 91–99 (2015)
Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28
Song, Y., et al.: Computer-aided diagnosis of prostate cancer using a deep convolutional neural network from multiparametric MRI. J. Magn. Reson. Imaging 48(6), 1570–1577 (2018)
Tsehay, Y.K., et al.: Convolutional neural network based deep-learning architecture for prostate cancer detection on multiparametric magnetic resonance images. In: Medical Imaging 2017: Computer-Aided Diagnosis, vol. 10134, p. 1013405. International Society for Optics and Photonics (2017)
Wang, Y., et al.: Deep attentive features for prostate segmentation in 3D transrectal ultrasound. IEEE TMI 38(12), 2768–2778 (2019)
Wu, Y., He, K.: Group normalization. In: Proceedings of ECCV), pp. 3–19 (2018)
Yacoub, J.H., Verma, S., Moulton, J.S., Eggener, S., Oto, A.: Imaging-guided prostate biopsy: conventional and emerging techniques. Radiographics 32(3), 819–837 (2012)
Yu, X., et al.: False positive reduction using multiscale contextual features for prostate cancer detection in multi-parametric MRI scans. In: Proceedings of ISBI, pp. 1355–1359. IEEE (2020)
Zhang, D., et al.: Panoptic segmentation with an end-to-end cell R-CNN for pathology image analysis. In: Frangi, A.F., Schnabel, J.A., Davatzikos, C., Alberola-López, C., Fichtinger, G. (eds.) MICCAI 2018. LNCS, vol. 11071, pp. 237–244. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00934-2_27
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Yu, X. et al. (2020). Deep Attentive Panoptic Model for Prostate Cancer Detection Using Biparametric MRI Scans. In: Martel, A.L., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2020. MICCAI 2020. Lecture Notes in Computer Science(), vol 12264. Springer, Cham. https://doi.org/10.1007/978-3-030-59719-1_58
Download citation
DOI: https://doi.org/10.1007/978-3-030-59719-1_58
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-59718-4
Online ISBN: 978-3-030-59719-1
eBook Packages: Computer ScienceComputer Science (R0)
