Haoyu Jiang
ABSTRACT
People convey their emotions and thoughts through words, the medium of human thoughts. Up against the vigorous development of streaming media, the calculation of text similarity is imperative in the field of natural language processing. Any text-related field is inseparable from text semantic similarity. The calculation of text semantic similarity plays a key role in document management, document classification, and document relevance. Besides, popular natural language processing tasks in some trendy fields, such as artificial intelligence, human-machine translation, problem system, intelligent chat system, and nomenclature recognition, are intertwined with text semantic similarity calculation. In recent years, many excellent researchers have studied the algorithms and models of text semantic similarity from different dimensions. In this paper, a new short-text cosine similarity calculation model of the BERT-based Siamese network is proposed.
- Chengcheng H A N, Lei L I, Tingting L I U, Approaches for semantic textual similarity[J]. Journal of East China Normal University (Natural Science), 2020, 2020(5): 95Google Scholar
- Mikolov T, Chen K, Corrado G, Efficient estimation of word representations in vector space[J]. arXiv preprint arXiv:1301.3781, 2013.Google Scholar
- Pennington J, Socher R, Manning C D. Glove: Global vectors for word representation[C]//Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). 2014: 1532-1543.Google Scholar
- Joulin A, Grave E, Bojanowski P, Bag of tricks for efficient text classification[J]. arXiv preprint arXiv:1607.01759, 2016.Google Scholar
- Peters, M., Neumann, M., Iyyer, M. .Deep contextualized word representations[J]. arXiv preprint arXiv:1802.05365, 2018.Google Scholar
- Devlin J, Chang M W, Lee K, Bert: Pre-training of deep bidirectional transformers for language understanding[J]. arXiv preprint arXiv:1810.04805, 2018.Google Scholar
- Radford A, Narasimhan K, Salimans T, Improving language understanding by generative pre-training[J]. 2018.Google Scholar
- Huang P S, He X, Gao J, Learning deep structured semantic models for web search using clickthrough data[C]//Proceedings of the 22nd ACM international conference on Information & Knowledge Management. 2013: 2333-2338.Google Scholar
- Yin W, Schütze H, Xiang B, Abcnn: Attention-based convolutional neural network for modeling sentence pairs[J]. Transactions of the Association for Computational Linguistics, 2016, 4: 259-272.Google ScholarCross Ref
- Vaswani A, Shazeer N, Parmar N, Attention is all you need[J]. Advances in neural information processing systems, 2017, 30.Google Scholar
- Reimers N, Gurevych I. Sentence-bert: Sentence embeddings using siamese bert-networks[J]. arXiv preprint arXiv:1908.10084, 2019.Google Scholar
Index Terms
- Short-Text Semantic Similarity Model of BERT-Based Siamese Network
Recommendations
Chinese Text Similarity Calculation Model Based on Multi-Attention Siamese Bi-LSTM
CSSE '21: Proceedings of the 4th International Conference on Computer Science and Software EngineeringMeasuring text similarity is a key research area in natural language processing technology. In this research, we proposed a multi-attention Siamese bi-directional long short-term memory (MAS-Bi-LSTM) to calculate the semantic similarity between two ...
Siamese BERT Architecture Model with attention mechanism for Textual Semantic Similarity
AbstractTextual Semantic Similarity is a crucial part of text matching tasks, and it has a very wide range of applications in natural language processing (NLP) tasks such as search engines, question-answering systems, information retrieval, natural ...
Learning similarity with cosine similarity ensemble
This paper proposes a cosine similarity ensemble (CSE) method to learn similarity.CSE is a selective ensemble and combines multiple cosine similarity learners.A learner redefines the pattern vectors and determines its threshold adaptively.Experimental ...
Comments