Cited By
View all- Li SZhang TChen BChen C(2023)MIA-Net: Multi-Modal Interactive Attention Network for Multi-Modal Affective AnalysisIEEE Transactions on Affective Computing10.1109/TAFFC.2023.325901014:4(2796-2809)Online publication date: 1-Oct-2023
Hybrid Self-Interactive Attentive Siamese Network for Medical Textual Semantic Similarity
Authors: 
Hongda An, Di Wu, Zhengguang LiAuthors Info & Claims
Hongda An, Di Wu, Zhengguang LiAuthors Info & ClaimsPages 52 - 56
Abstract
The rapid development of medicine produces a large number of medical texts, but it is difficult to process these texts due to many similar sentences. Therefore, estimating the similarity of medical texts has become a key technology, filtering out medical texts quickly. Nowadays, many methods for estimation similarity between medical sentences extract semantic features mainly via Siamese network. However; these methods don't achieve the best results due to the large amount of noise in the texts. To improve the performance of the Siamese network, a hybrid self-interactive attention model is proposed in this paper. The aim is to reduce the noise of the text and strengthen the token with high correlation between the two texts. In addition, this proposed model also uses BERT as the embedding layer to carry out a preliminary pre-training of text. Then, two datasets are employed to verify the effectiveness of our method and our method achieves better results on Pearson correlation coefficient, compared with the other existing methods. The experimental results still indicate that the results of pre-trained BERT are better than that of Word2Vec, and the hybrid self-interactive attention model obtains better results due to the effect of interactive attention.
References
[1]
Gerard Salton and Michael Lesk. 1968. Computer Evaluation of Indexing and Text Processing. J. Acm 15, 1 (1968), 8--36.
[2]
Yogesh Kumar Meena and Dinesh Gopalani. 2015. Evolutionary Algorithms for Extractive Automatic Text Summarization. Procedia Comput. Sci. 48, (2015), 244--249.
[3]
Kishore Papineni, Salim Roukos, Todd Ward, and Wei Jing Zhu. 2002. BLEU: a Method for Automatic Evaluation of Machine Translation. In Proc Meeting of the Association for Computational Linguistics.
[4]
N. P. Prestage, R. G. Luckhurst, B. R. Paterson, C. S. Bevins, and C. G. Yuile. 1994. MeasuringtheSemanticSimilarityofT exts. Sol. Phys. June (1994), 13--18.
[5]
Rada Mihalcea, Courtney Corley, and Carlo Strapparava. 2006. Corpus-based and knowledge-based measures of text semantic similarity. Proc. Natl. Conf. Artif. Intell. 1, (2006), 775--780.
[6]
James R Hein and Tracey A Conrad. 2012. Convolutional Neural Network Architectures for Matching Natural Language Sentences. 34th Int. Geol. Congr. (2012), 95060.
[7]
Paul Neculoiu, Maarten Versteegh, and Mihai Rotaru. 2016. Learning Text Similarity with Siamese Recurrent Networks. (2016), 148--157.
[8]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Adv. Neural Inf. Process. Syst. 2017-Decem, Nips (2017), 5999--6009.
[9]
Huy Thanh Nguyen and Minh Le Nguyen. 2018. Effective Attention Networks for Aspect-level Sentiment Classification. Proc. 2018 10th Int. Conf. Knowl. Syst. Eng. KSE 2018 (2018), 25--30.
[10]
Tianyang Zhang, Minlie Huang, and Li Zhao. 2018. Learning structured representation for text classificationxvia reinforcement learning. 32nd AAAI Conf. Artif. Intell. AAAI 2018 (2018), 6053--6060.
[11]
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Mlm (2018). Retrieved from http://arxiv.org/abs/1810.04805
[12]
Wenhao Zhu, Tengjun Yao, Wu Zhang, and Baogang Wei. 2019. Part-of-speech-based long short-term memory network for learning sentence representations. IEEE Access 7, (2019), 51810--51816.
[13]
Hua He, Kevin Gimpel, and Jimmy Lin. 2015. Multi-perspective sentence similarity modeling with convolutional neural networks. Conf. Proc. - EMNLP 2015 Conf. Empir. Methods Nat. Lang. Process. September (2015), 1576--1586.
[14]
Alexandre Yukio Ichida, Felipe Meneguzzi, and Duncan D. Ruiz. 2018. Measuring Semantic Similarity between Sentences Using A Siamese Neural Network. Proc. Int. Jt. Conf. Neural Networks 2018-July, (2018).
Index Terms
- Hybrid Self-Interactive Attentive Siamese Network for Medical Textual Semantic Similarity
Recommendations
Siamese BERT Architecture Model with attention mechanism for Textual Semantic Similarity
AbstractTextual Semantic Similarity is a crucial part of text matching tasks, and it has a very wide range of applications in natural language processing (NLP) tasks such as search engines, question-answering systems, information retrieval, natural ...
Self-attentive Pyramid Network for Single Image De-raining
Neural Information ProcessingAbstractRain Streaks in a single image can severely damage the visual quality, and thus degrade the performance of current computer vision algorithms. To remove the rain streaks effectively, plenty of CNN-based methods have recently been developed, and ...
FS2Net: Fiber Structural Similarity Network (FS2Net) for Rotation Invariant Brain Tractography Segmentation Using Stacked LSTM Based Siamese Network
Computer Analysis of Images and PatternsAbstractIn this paper, we propose a novel deep learning architecture combining stacked Bi-directional LSTM and LSTMs with the Siamese network architecture for segmentation of brain fibers, obtained from tractography data, into anatomically meaningful ...
Comments
Information & Contributors
Information
Published In
January 2020
301 pages
ISBN:9781450376419
DOI:10.1145/3380625
Copyright © 2020 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
In-Cooperation
- China University of Geosciences
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 19 May 2020
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
ICMSS 2020
ICMSS 2020: 2020 4th International Conference on Management Engineering, Software Engineering and Service Sciences
January 17 - 19, 2020
Wuhan, China
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 79Total Downloads
- Downloads (Last 12 months)5
- Downloads (Last 6 weeks)1
Reflects downloads up to 03 Mar 2025
Other Metrics
Citations
Cited By
View all- Li SZhang TChen BChen C(2023)MIA-Net: Multi-Modal Interactive Attention Network for Multi-Modal Affective AnalysisIEEE Transactions on Affective Computing10.1109/TAFFC.2023.325901014:4(2796-2809)Online publication date: 1-Oct-2023
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in