Abstract
Building an interpretable AI diagnosis system for breast cancer is an important embodiment of AI assisted medicine. Traditional breast cancer diagnosis methods based on machine learning are easy to explain, but the accuracy is very low. Deep neural network greatly improves the accuracy of diagnosis, but the black box model does not provide transparency and interpretation. In this work, we propose a semantic embedding self-explanatory Breast Diagnostic Capsules Network (BDCN). This model is the first to combine the capsule network with semantic embedding for the AI diagnosis of breast tumors, using capsules to simulate semantics. We pre-trained the extraction word vector by embedding the semantic tree into the BERT and used the capsule network to improve the semantic representation of multiple heads of attention to construct the extraction feature, the capsule network was extended from the computer vision classification task to the text classification task. Simultaneously, both the back propagation principle and dynamic routing algorithm are used to realize the local interpretability of the diagnostic model. The experimental results show that this breast diagnosis model improves the model performance and has good interpretability, which is more suitable for clinical situations.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Chinese Anti-Cancer Association: Committee of Breast Cancer Society.: Chinese Anti-Cancer Association Guidelines and Specifications for Diagnosis and Treatment of Breast Cancer 2019 Edition. Chin. J. Cancer (2019)
Mengwan, W., et al.: A Benign and malignant breast tumor classification method via efficiently combining texture and morphological features on ultrasound images. Comput. Math. Methods Med. Engl. (2020)
Wei, L., Yang, Y., Nishikawa, R.M.: Microcalcification classification assisted by content-based image retrieval for breast cancer diagnosis. Patt. Recogn. 42(6), 1126–1132 (2009)
Wang, Z., Li, M., Wang, H., Jiang, H., Yao, Y., Zhang, H., Xin, J.: Breast cancer detection using extreme learning machine based on feature fusion with cnn deep features. IEEE Access 7, 105146–105158 (2019)
Zhao, W., Ye, J., Yang, M., Lei, Z., Zhang, S., and Zhao, Z.: Investigating capsule networks with dynamic routing for text classification. arXiv preprint arXiv:1804.00538 (2018)
Chen, D., Huang, M., Li, W.: Knowledge-powered deep breast tumor classification with multiple medical reports. In: IEEE/ACM Transactions on Computational Biology and Bioinformatics, CA, USA (2019)
Jiang, D., He, J.: Tree framework with BERT word embedding for the recognition of Chinese implicit discourse relations. IEEE Access 8, 162004–162011 (2020)
Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440. Boston (2015)
Tang, G., Müller, M., Rios, A., Sennrich, R.: Why self-attention? a targeted evaluation of neural machine translation architectures. arXiv preprint arXiv:1808.08946 (2018)
Sabour, S., Frosst, N., Hinton, G. E.: Dynamic routing between capsules. In: Proceedings of the 31st International Conference on Neural Information Processing Systems. pp. 3859–3869 (2017)
Zhao, W., Peng, H., Eger, S., Cambria, E., Yang, M.: Towards scalable and reliable capsule networks for challenging NLP applications. arXiv preprint arXiv:1906.02829 (2019)
Wang, Z., Hu, X., Ji, S.: iCapsNets: towards interpretable capsule networks for text classification. arXiv preprint arXiv:2006.00075 (2020)
Zhang, W., Cai, L., Chen, M., Wang, N.: Progress in interpretability. In: International Conference on Mobile Computing, Applications, and Services, pp. 155-168. Springer, Cham (2019)
Rakhlin, A.: Convolutional Neural Networks for Sentence Classification. GitHub (2016)
Kalchbrenner, N., Danihelka, I., Graves, A.: Grid long short-term memory. arXiv preprint arXiv:1507.01526 (2015)
Bock, S., Weiß, M.: A proof of local convergence for the Adam optimizer. In: 2019 International Joint Conference on Neural Networks, IJCNN, Budapest (2019)
Aini, H., Haviluddin, H.: Crude palm oil prediction based on backpropagation neural network approac. Knowl. Eng, Data Sci. 2(1), 1–9 (2019)
Cerda-Mardini, P., Araujo, V., Soto, A.: Translating natural language instructions for behavioral robot navigation with a multi-head attention mechanism. arXiv preprint arXiv:2006.00697 (2020)
Devlin, J., Chang, M. W., Lee, K., Toutanova, K.: Bert: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)
Liu, W., et al..: K-bert: enabling language representation with knowledge graph. In: Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34: pp. 901–2908 (2020)
Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in: vector space. arXiv preprint arXiv:1301.3781 (2013)
Acknowledgements
We would like to thank the anonymous reviewers for their helpful comments. This work was financially supported by the National Key R&D Program of China under Grant 2019YFE0190500.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Chen, D., Zhong, K., He, J. (2021). BDCN: Semantic Embedding Self-explanatory Breast Diagnostic Capsules Network. In: Li, S., et al. Chinese Computational Linguistics. CCL 2021. Lecture Notes in Computer Science(), vol 12869. Springer, Cham. https://doi.org/10.1007/978-3-030-84186-7_28
Download citation
DOI: https://doi.org/10.1007/978-3-030-84186-7_28
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-84185-0
Online ISBN: 978-3-030-84186-7
eBook Packages: Computer ScienceComputer Science (R0)