Skip to main content
SpringerLink
Log in

Semantic association computation: a comprehensive survey

  • Published:
Artificial Intelligence Review Aims and scope Submit manuscript

Abstract

Semantic association computation is the process of quantifying the strength of a semantic connection between two textual units, based on different types of semantic relations. Semantic association computation is a key component of various applications belonging to a multitude of fields, such as computational linguistics, cognitive psychology, information retrieval and artificial intelligence. The field of semantic association computation has been studied for decades. The aim of this paper is to present a comprehensive survey of various approaches for computing semantic associations, categorized according to their underlying sources of background knowledge. Existing surveys on semantic computation have focused on a specific aspect of semantic associations, such as utilizing distributional semantics in association computation or types of spatial models of semantic associations. However, this paper has put a multitude of computational aspects and factors in one picture. This makes the article worth reading for those researchers who want to start off in the field of semantic associations computation. This paper introduces the fundamental elements of the association computation process, evaluation methodologies and pervasiveness of semantic measures in a variety of fields, relying on natural language semantics. Along the way, there is a detailed discussion on the main categories of background knowledge sources, classified as formal and informal knowledge sources, and the underlying design models, such as spatial, combinatorial and network models, that are used in the association computation process. The paper classifies existing approaches of semantic association computation into two broad categories, based on their utilization of background knowledge sources: knowledge-rich approaches; and knowledge-lean approaches. Each category is divided further into sub-categories, according to the type of underlying knowledge sources and design models of semantic association. A comparative analysis of strengths and limitations of various approaches belonging to each research stream is also presented. The paper concludes the survey by analyzing the pivotal factors that affect the performance of semantic association measures.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

Notes

  1. A measure for assessing the degree to which two or more raters agree on assigning data to different categories

  2. Further details can be found on http://nltk.googlecode.com/svn/trunk/nltk_data/index.xml and https://catalog.ldc.upenn.edu/byproject.

  3. https://en.wiktionary.org/wiki/Wiktionary:Statistics.

  4. Freely available at http://wordnet.princeton.edu/wordnet/.

  5. http://www.cyc.com/.

  6. http://www.britannica.com/.

  7. http://en.wikipedia.org/.

  8. http://www.nlm.nih.gov/medlineplus/.

  9. http://www.nlm.nih.gov/mesh/.

  10. The layout of this section is devised following the work of Mohammad and Hirst (2012). However, they focused only on distributional measures of similarity.

  11. http://wacky.sslmit.unibo.it/doku.php?id=corpora.

References

  • Adhikesavan K (2015) An integrated approach for measuring semantic similarity between words and sentences using web search engine. Int Arab J Inf Technol 12(6):589–596

    Google Scholar 

  • Aggarwal CC (2018) Opinion mining and sentiment analysis. Springer, Berlin, pp 413–434

    Google Scholar 

  • Agirre E, Alfonseca E, Hall K, Kravalova J, Paşca M, Soroa A (2009) A study on similarity and relatedness using distributional and WordNet-based approaches. In: Proceedings of Human language technologies: the 2009 annual conference of the North American chapter of the association for computational linguistics (NAACL ’09), pp 19–27

  • Agirre E, Unibertsitatea EH, Rigau G (1996) Word sense disambiguation using conceptual distance. In: Proceedings of the 16th conference on computational linguistics (COLING ’96), vol 1, pp 16–22

  • Al-Mubaid H, Nguyen HA (2009) Measuring semantic similarity between biomedical concepts within multiple ontologies. IEEE Trans Syst Man Cybern Part C 39(4):389–398

    Google Scholar 

  • Almarsoomi FA, O’Shea J, Bandar Z, Crockett KA (2013) AWSS: an algorithm for measuring Arabic word semantic similarity. In: 2013 IEEE international conference on systems, man, and cybernetics, pp 504–509

  • Alonso O, Strötgen J, Baeza-Yates R, Gertz M (2011) Temporal information retrieval: challenges and opportunities. In: Proceedings of the 1st international temporal web analytics workshop (TWAW ’11), pp 1–8

  • Androutsopoulos I, Malakasiotis P (2010) A survey of paraphrasing and textual entailment methods. J Artif Intell Res 38(1):135–187

    MATH  Google Scholar 

  • Banerjee S, Pedersen T (2003) Extended gloss overlaps as a measure of semantic relatedness. In: Proceedings of the 18th international joint conference on artificial intelligence, (IJCAI ’03), pp 805–810

  • Banerjee S, Ramanathan K, Gupta A (2007) Clustering short texts using Wikipedia. In: Proceedings of the 30th annual international ACM SIGIR conference on research and development in information retrieval (SIGIR ’07), pp 787–788

  • Barnbrook G, Danielsson P, Mahlberg M (2005) Meaningful texts: the extraction of semantic information from monolingual and multilingual corpora. Bloomsbury Publishing, London

    Google Scholar 

  • Barzilay R, Elhadad M (1997) Using lexical chains for text summarization. In: Proceedings of the ACL workshop on intelligent scalable text summarization, pp 10–17

  • Batet M, Sánchez D, Valls A (2011) An ontology-based measure to compute semantic similarity in biomedicine. J Biomed Inform 44(1):118–125

    Google Scholar 

  • Bayerl PS, Paul KI (2011) What determines inter-coder agreement in manual annotations? A meta-analytic investigation. Comput Linguist 37(4):699–725

    Google Scholar 

  • Bengio Y, Ducharme R, Vincent P, Jauvin C (2003) A neural probabilistic language model. J Mach Learn Res 3:1137–1155

    MATH  Google Scholar 

  • Bhaskar P (2013) Multi-document summarization using automatic key-phrase extraction. In: Recent advances in natural language processing, RANLP 2013, 9-11 Sept 2013, Hissar, Bulgaria, pp 22–29

  • Blei DM, Ng AY, Jordan MI (2003) Latent dirichlet allocation. J Mach Learn Res 3:993–1022

    MATH  Google Scholar 

  • Bollegala D, Matsuo Y, Ishizuka M (2011) A web search engine-based approach to measure semantic similarity between words. IEEE Trans Knowl Data Eng 23(7):977–990

    Google Scholar 

  • Bolshakov I, Gelbukh A (2004) Synonymous paraphrasing using WordNet and internet. In: Proceedings of 9th international conference on applications of natural language to information systems (NLDB ’04), vol 3136, pp 312–323

  • Bolukbasi T, Chang KW, Zou JY, Saligrama V, Kalai AT (2016) Man is to computer programmer as woman is to homemaker? Debiasing word embeddings. In: Advances in neural information processing systems 29. Curran Associates, Inc., pp 4349–4357

  • Brants T, Chen F, Tsochantaridis I (2002) Topic-based document segmentation with probabilistic latent semantic analysis. In: Proceedings of the 11th international conference on information and knowledge management (CIKM ’02), pp 211–218

  • Bridge DG (1998) Defining and combining symmetric and asymmetric similarity measures. In: Advances in case-based reasoning: proceedings of 4th European workshop on case-based reasoning, vol 1488, pp 52–63

  • Bruni E, Tran N, Baroni M (2014) Multimodal distributional semantics. J Artif Intell Res 49:1–47

    MathSciNet  MATH  Google Scholar 

  • Brussee R, Wartena C (2008) Automatic thesaurus generation using co-occurrence. In: Proceedings of the 20th Belgian Netherlands conference on artificial intelligence (BNAIC 2008), pp 41–48

  • Budanitsky A, Hirst G (2001) Semantic distance in WordNet: an experimental, application-oriented evaluation of five measures. In: Proceedings of the workshop on WordNet and other lexical resources, second meeting of the North American chapter of the association for computational linguistics

  • Budanitsky A, Hirst G (2006) Evaluating wordnet-based measures of lexical semantic relatedness. Comput Linguist 32:13–47

    MATH  Google Scholar 

  • Bullinaria J, Levy J (2007) Extracting semantic representations from word co-occurrence statistics: a computational study. J Behav Res Methods 39(3):510–526

    Google Scholar 

  • Carpineto C, Osiński S, Romano G, Weiss D (2009) A survey of web clustering engines. ACM Comput Surv 41(3):17:1–17:38

    Google Scholar 

  • Carpineto C, Romano G (2012) A survey of automatic query expansion in information retrieval. ACM Comput Surv 44(1):1–50

    MATH  Google Scholar 

  • Caselles-Dupré H, Lesaint F, Royo-Letelier J (2018) Word2vec applied to recommendation: hyperparameters matter. CoRR arXiv:1804.04212

  • Cassidy PJ (2000) An investigation of the semantic relations in the Roget’s thesaurus: preliminary results. In: Proceedings of the 1st international conference on intelligent text processing and computational linguistics (CICLing ’00), pp 181–204

  • Caviedes JE, Cimino JJ (2004) Towards the development of a conceptual distance metric for the umls. J Biomed Inform 37(2):77–85

    Google Scholar 

  • Cerisara C, Krl P, Lenc L (2018) On the effects of using word2vec representations in neural networks for dialogue act recognition. Comput Speech Lang 47(C):175–193

    Google Scholar 

  • Chaplot DS, Salakhutdinov R (2018) Knowledge-based word sense disambiguation using topic models. CoRR arXiv:1801.01900

  • Chen HH, Lin MS, Wei YC (2006) Novel association measures using web search with double checking. In: Proceedings of the 21st international conference on computational linguistics and the 44th annual meeting of the association for computational linguistics (ACL ’06), pp 1009–1016

  • Chen Y, Huang S, Shen C, Lee H, Lee L (2018) Phonetic-and-semantic embedding of spoken words with applications in spoken content retrieval. CoRR arXiv:1807.08089

  • Chen Z, Liu S, Wenyin L, Pu G, Ma WY (2003) Building a web thesaurus from web link structure. In: Proceedings of the 26th annual international ACM SIGIR conference on research and development in information retrieval (SIGIR ’03), pp 48–55

  • Chinniyan K, Gangadharan S, Sabanaikam K (2017) Semantic similarity based web document classification using support vector machine. Int Arab J Inf Technol 14(3):285–292

    Google Scholar 

  • Church KW, Hanks P (1990) Word association norms, mutual information, and lexicography. Comput Linguist 16(1):22–29

    Google Scholar 

  • Cilibrasi RL, Vitanyi PMB (2007) The google similarity distance. IEEE Trans Knowl Data Eng 19(3):370–383

    Google Scholar 

  • Clifton C, Cooley R, Rennie J (2004) Topcat: data mining for topic identification in a text corpus. IEEE Trans Knowl Data Eng 16(8):949–964

    Google Scholar 

  • Collins-Thompson K, Callan J (2005) Query expansion using random walk models. In: Proceedings of the 14th ACM international conference on information and knowledge management (CIKM ’05), pp 704–711

  • Collobert R, Weston J, Bottou L, Karlen M, Kavukcuoglu K, Kuksa P (2011) Natural language processing (almost) from scratch. J Mach Learn Res 12:2493–2537

    MATH  Google Scholar 

  • Conneau A, Schwenk H, Barrault L, LeCun Y (2016) Very deep convolutional networks for natural language processing. CoRR arXiv:1606.01781

  • Coursey K, Mihalcea R (2009) Topic identification using Wikipedia graph centrality. In: Proceedings of Human language technologies: the 2009 annual conference of the north American chapter of the association for computational linguistics, (NAACL-Short ’09), pp 117–120

  • Dallmann A, Niebler T, Lemmerich F, Hotho A (2016) Extracting semantics from random walks on Wikipedia: comparing learning and counting methods. In: Wiki, Papers from the 2016 ICWSM workshop, Cologne, Germany, May 17, 2016

  • Deerwester S, Dumais ST, Furnas GW, Landauer TK, Harshman R (1990) Indexing by latent semantic analysis. J Am Soc Inf Sci (JASIS) 41(6):391–407

    Google Scholar 

  • Delpech J (2018) Unsupervised word sense disambiguation in dynamic semantic spaces. CoRR arXiv:1802.02605

  • Dice LR (1945) Measures of the amount of ecologic association between species. Ecology 26:297–302

    Google Scholar 

  • Erekhinskaya T, Moldovan D (2013) Lexical chains on WordNet and extensions. In: Proceedings of the 26th international Florida artificial intelligence research society conference (FLAIRS ’13), pp 52–57

  • Etzioni O, Banko M, Soderland S, Weld DS (2008) Open information extraction from the web. Commun ACM 51(12):68–74

    Google Scholar 

  • Faruqui M, Dodge J, Jauhar SK, Dyer C, Hovy EH, Smith NA (2014) Retrofitting word vectors to semantic lexicons. CoRR arXiv:1411.4166

  • Fernández-Reyes FC, Valadez JH, Montes-y-Gómez M (2018) A Prospect–Guided global query expansion strategy using word embeddings. Inf Process Manage 54(1):1–13

    Google Scholar 

  • Fernendo S, Stevenson M (2008) A semantic similarity approach to paraphrase detection. In: Proceedings of the computational linguistics UK (CLUK ’04) 11th annual research colloquium

  • Finkelstein L, Gabrilovich E, Matias Y, Rivlin E, Solan Z, Wolfman G, Ruppin E (2002) Placing search in context: the concept revisited. ACM Trans Inf Syst 20(1):116–131

    Google Scholar 

  • Firth JR (1957) A synopsis of linguistic theory 1930-1955. Stud linguist Anal 1952–59:1–32

    Google Scholar 

  • Florescu C, Caragea C (2017) A new scheme for scoring phrases in unsupervised keyphrase extraction. In: Advances in information retrieval—39th European conference on IR research, ECIR 2017, Aberdeen, UK, April 8-13, 2017, Proceedings, pp 477–483

  • Gabrilovich E, Markovitch S (2006) Overcoming the brittleness bottleneck using Wikipedia: Enhancing text categorization with encyclopedic knowledge. In: Proceedings of the 21st National conference on artificial intelligence (AAAI ’06), vol 2, pp 1301–1306

  • Gabrilovich E, Markovitch S (2007) Computing semantic relatedness using Wikipedia-based explicit semantic analysis. In: Proceedings of the 20th international joint conference on artificial intelligence, (IJCAI ’07), pp 1606–1611

  • Gerz D, Vulic I, Hill F, Reichart R, Korhonen A (2016) SimVerb-3500: a large-scale evaluation set of verb similarity. CoRR arXiv:1608.00869

  • Gledson A, Keane J (2008) Using web-search results to measure word-group similarity. In: Proceedings of the 22nd international conference on computational linguistics (COLING ’08), vol 1, pp 281–288

  • Gracia J, Mena E (2008) Web-based measure of semantic relatedness. In: Proceedings of 9th international conference on web information systems engineering (WISE ’08), vol 5175, pp 136–150

  • Gurevych I (2005) Using the structure of a conceptual network in computing semantic relatedness. In: Proceedings of the 2nd international joint conference on natural language processing (IJCNLP ’05), pp 767–778

  • Hakami H, Bollegala D (2017) Compositional approaches for representing relations between words: a comparative study. Knowl Based Syst 136:172–182

    Google Scholar 

  • Halavais A, Lackaffb D (2008) An analysis of topical coverage of Wikipedia. J Comput Mediat Commun 13(2):429–440

    Google Scholar 

  • Halawi G, Dror G, Gabrilovich E, Koren Y (2012) Large-scale learning of word relatedness with constraints. In: Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining (KDD ’12), pp 1406–1414

  • Harispe S, Ranwez S, Janaqi S, Montmain J (2013) Semantic measures for the comparison of units of language, concepts or entities from text and knowledge base analysis. CoRR arXiv:1310.1285

  • Harris ZS (1968) Mathematical structures of language. Wiley, New York

    MATH  Google Scholar 

  • Hasan KS, Ng V (2014) Automatic keyphrase extraction: a survey of the state of the art. In: Proceedings of the 52nd annual meeting of the association for computational linguistics (Volume 1: Long Papers). Association for Computational Linguistics, pp 1262–1273

  • Hassan S, Mihalcea R (2009) Cross-lingual semantic relatedness using encyclopedic knowledge. In: Proceedings of the 2009 conference on empirical methods in natural language processing: Volume 3–Volume 3, EMNLP ’09. Association for Computational Linguistics, pp 1192–1201

  • Hassan S, Mihalcea R (2011) Semantic relatedness using salient semantic analysis. In: Proceedings of the 25th conference on artificial intelligence (AAAI ’11), pp 884–889

  • Hauke J, Tomasz K (2011) Comparison of values of Pearson’s and Spearman’s correlation coefficients on the same sets of data. Quaest Geogr 30(2):87–93

    Google Scholar 

  • He X, Ding CHQ, Zha H, Simon HD (2001) Automatic topic identification using webpage clustering. In: Proceedings of IEEE international conference on data mining (ICDM ’01), pp 195–202

  • Hennig L (2009) Topic-based multi-document summarization with probabilistic latent semantic analysis. In: Proceedings of the international conference on recent advances in natural language processing (RANLP ’09), pp 144–149

  • Henry S, Cuffy C, McInnes BT (2018) Vector representations of multiword terms for semantic relatedness. J Biomed Inform 77:111–119

    Google Scholar 

  • Hestilow TJ, Huang Y (2009) Clustering of gene expression data based on shape similarity. EURASIP J Bioinform Syst Biol 2009:3:1–3:12

    Google Scholar 

  • Higgins D (2004) Which statistics reflect semantics? Rethinking synonymy and word similarity. In: Proceedings of international conference on linguistic evidence, pp 265–284

  • Hill F, Reichart R, Korhonen A (2015) Simlex-999: evaluating semantic models with (genuine) similarity estimation. Comput Linguist 41(4):665–695

    MathSciNet  Google Scholar 

  • Hirst G, Budanitsky A (2005) Correcting real-word spelling errors by restoring lexical cohesion. Nat Lang Eng 11:87–111

    Google Scholar 

  • Hirst G, St Onge D (1998) Lexical Chains as representation of context for the detection and correction malapropisms. MIT Press, Cambridge

    Google Scholar 

  • Hofmann T (1999) Probabilistic latent semantic indexing. In: Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval (SIGIR ’99), pp 50–57

  • Hu X, Zhang X, Lu C, Park EK, Zhou X (2009) Exploiting Wikipedia as external knowledge for document clustering. In: Proceedings of the 15th ACM SIGKDD international conference on knowledge discovery and data mining (KDD ’09), pp 389–396

  • Huang A (2008) Similarity measures for text document clustering. In: Proceedings of the sixth New Zealand computer science research student conference (NZCSRSC2008), pp 49–56

  • Huang A, Milne DN, Frank E, Witten IH (2009) Clustering documents using a Wikipedia-based concept representation. In: Proceedings of the 13th Pacific-Asia conference on advances in knowledge discovery and data mining (PAKDD ’09), pp 628–636

  • Iosif E, Potamianos A (2013) Similarity computation using semantic networks created from web-harvested data. Nat Lang Eng 21:49–79

    Google Scholar 

  • Islam A, Inkpen D (2006) Second order co-occurrence PMI for determining the semantic similarity of words. In: Proceedings of the international conference on language resources and evaluation (LREC ’06), pp 1033–1038

  • Islam A, Inkpen D (2009) Real-word spelling correction using google web it 3-grams. In: Proceedings of the 2009 conference on empirical methods in natural language processing (EMNLP ’09), vol 3, pp 1241–1249

  • Jabeen S, Gao X, Andreae P (2012) Harnessing Wikipedia semantics for computing contextual relatedness. In: In proceedings of Pacific Rim international conference on artificial intelligence (PRICAI ’12): trends in artificial intelligence, vol 7458, pp 861–865

  • Jabeen S, Gao X, Andreae P (2013) CPRel: semantic relatedness computation using wikipedia based context profiles. Res Comput Sci 70:55–66

    Google Scholar 

  • Jabeen S, Gao X, Andreae P (2013) Directional context helps: guiding semantic relatedness computation by asymmetric word associations. In: Web information systems engineering (WISE ’13), vol 8180, pp 92–101

  • Jabeen S, Gao X, Andreae P (2014a) A hybrid model for learning semantic relatedness using Wikipedia-based features. In: Web information systems engineering (WISE ’14), pp 523–533

  • Jabeen S, Gao X, Andreae, P (2014b) Probabilistic associations as a proxy for semantic relatedness. In: Web information systems engineering (WISE ’14), pp 512–522

  • Jaccard P (1912) The distribution of the flora in the alpine zone. 1. New Phytol 11(2):37–50

    Google Scholar 

  • Jarmasz M, Szpakowicz S (2012) Roget’s thesaurus: a lexical resource to treasure. CoRR arXiv:1204.0258

  • Jiang J, Conrath DW (1997) Semantic similarity based on corpus statistics and lexical taxonomy. In: Proceedings of international conference research on computational linguistics (ROCLING), pp 19–33

  • Jurczyk T, Deshmane A, Choi JD (2018) Analysis of Wikipedia-based corpora for question answering. CoRR arXiv:1801.02073

  • Keller F, Lapata M, Ourioupina O (2002) Using the web to overcome data sparseness. In: Proceedings of the ACL-02 conference on empirical methods in natural language processing (EMNLP ’02), vol 10, pp 230–237

  • Kilgarriff A, Grefenstette G (2003) Introduction to the special issue on the web as corpus. J Comput Linguist 29(3):333–347

    MathSciNet  Google Scholar 

  • Kim J, Vasardani M, Winter S (2017) Similarity matching for integrating spatial information extracted from place descriptions. Int J Geogr Inf Sci 31(1):56–80

    Google Scholar 

  • Koehn P (2010) Statistical machine translation, 1st edn. Cambridge University Press, New York

    MATH  Google Scholar 

  • Kottur S, Vedantam R, Moura JMF, Parikh D (2015) Visual word2vec (vis-w2v): learning visually grounded word embeddings using abstract scenes. CoRR arXiv:1511.07067

  • Laatar R, Aloulou C, Belghuith LH (2018) Word2vec for arabic word sense disambiguation. In: Silberztein M, Atigui F, Kornyshova E, Métais E, Meziane F (eds) Natural language processing and information systems. Springer, Berlin, pp 308–311

    Google Scholar 

  • Lai S, Liu K, He S, Zhao J (2016) How to generate a good word embedding. IEEE Intell Syst 31(6):5–14

    Google Scholar 

  • Landauer T, Foltz P, Laham D (1998) An introduction to latent semantic analysis. Discourse Process 25:259–284

    Google Scholar 

  • Landauer TK, Dumais ST (1997) A solution to Plato’s problem: the latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychol Rev 104:211–240

    Google Scholar 

  • Landauer TK, Laham D, Rehder B, Schreiner ME (1991) How well can passage meaning be derived without using word order:a comparison of latent semantic analysis and humans. In: Proceedings of the 19th annual meeting of the cognitive science society, (CogSci ’91), pp 412–417

  • Lastra-Díaz JJ, García-Serrano A, Batet M, Fernández M, Chirigati F (2017) HESML: a scalable ontology-based semantic similarity measures library with a set of reproducible experiments and a replication dataset. Inf Syst 66:97–118

    Google Scholar 

  • Leacock C, Chodorow M (1998) Combining local context and WordNet similarity for word sense identification, chap. 11. MIT Press, pp 265–283

  • Lebret R, Collobert R (2014) Word embeddings through hellinger PCA. In: EACL. The Association for Computer Linguistics, pp 482–490

  • Lee H, Peirsman Y, Chang A, Chambers N, Surdeanu M, Jurafsky D (2011) Stanford’s multi-pass sieve coreference resolution system at the conll-2011 shared task. In: Proceedings of the 15th conference on computational natural language learning: shared task (CONLL ’11), pp 28–34

  • Leech G (1993) 100 million words of english. Engl Today 9:9–15

    Google Scholar 

  • Lenat DB (1995) Cyc: a large-scale investment in knowledge infrastructure. Commun ACM 38(11):33–38

    Google Scholar 

  • Lesk M (1986) Automatic sense disambiguation using machine readable dictionaries: How to tell a pine cone from an ice cream cone. In: Proceedings of the 5th annual international conference on systems documentation (SIGDOC ’86), pp 24–26

  • Levin E, Sharifi M, Ball J (2006) Evaluation of utility of LSA for word sense discrimination. In: Proceedings of the Human language technology conference of the NAACL, companion volume (NAACL ’06), pp 77–80

  • Levy O, Goldberg Y (2014) Linguistic regularities in sparse and explicit word representations. In: Proceedings of the 18th conference on computational natural language learning, CoNLL 2014, Baltimore, Maryland, USA, June 26-27, 2014, pp 171–180

  • Li W, Zhu L, Guo K, Shi Y, Zheng Y (2018) Build a tourism-specific sentiment lexicon via word2vec. Ann Data Sci 5(1):1–7

    Google Scholar 

  • Liberman S, Markovitch S (2009) Compact hierarchical explicit semantic representation. In: Proceedings of the IJCAI 2009 workshop on user-contributed knowledge and artificial intelligence: an evolving synergy (WikiAI09)

  • Lin D (1998) An information-theoretic definition of similarity. In: 15th international conference on machine learning (ICML ’98), pp 296–304

  • Ling W, Dyer C, W Black A, Trancoso I (2015) Two/too simple adaptations of word2vec for syntax problems. In: Proceedings of the 2015 conference of the North American chapter of the association for computational linguistics: Human language technologies. Association for Computational Linguistics, pp 1299–1304

  • Liu H, Bao H, Xu D (2012) Concept vector for semantic similarity and relatedness based on wordnet structure. J Syst Softw 85:370–381

    Google Scholar 

  • Liu H, Singh P (2004) Commonsense reasoning in and over natural language. In: Proceeding of international conference on knowledge-based and intelligent information & engineering systems (KES ’04), vol 3215, pp 293–306

  • Lopez A (2008) Statistical machine translation. ACM Comput Surv 40(3):8:1–8:49

    Google Scholar 

  • Lund K, Burgess C (1996) Producing high-dimensional semantic spaces from lexical co-occurrence. Behav Res Methods Instrum Comput 28:203–208

    Google Scholar 

  • Luong MT, Socher R, Manning C (2013) Better word representations with recursive neural networks for morphology. In: Proceedings of the 17th conference on computational natural language learning. Association for Computational Linguistics, pp 104–113

  • Marcus MP, Santorini B, Marcinkiewicz MA (1993) Building a large annotated corpus of English: the Penn Treebank. Comput Linguist 19(2):313–330

    Google Scholar 

  • Marton Y, Callison-Burch C, Resnik P (2009) Improved statistical machine translation using monolingually-derived paraphrases. In: Proceedings of the 2009 conference on empirical methods in natural language processing (EMNLP ’09), vol 1, pp 381–390

  • Matsuo Y, Sakaki T, Uchiyama K, Ishizuka M (2006) Graph-based word clustering using a web search engine. In: Proceedings of the 2006 conference on empirical methods in natural language processing (EMNLP ’06), pp 542–550

  • Matuszek C, Cabral J, Witbrock M, Deoliveira J (2006) An introduction to the syntax and content of Cyc. Proceedings of the 2006 AAAI spring symposium on formalizing and compiling background knowledge and its applications to knowledge representation and question answering, vol 3864(1447), pp 44–49

  • Matuszek C, Witbrock M, Kahlert RC, Cabral J, Schneider D, Shah P, Lenat D (2005) Searching for common sense: Populating Cyc from the web. In: Proceedings of the 20th national conference on artificial intelligence, pp 1430–1435

  • McInnes BT, Pedersen T (2013) Evaluating measures of semantic similarity and relatedness to disambiguate terms in biomedical text. J Biomed Inform 46(6):1116–1124

    Google Scholar 

  • Medelyan O, Witten IH, Milne D (2008) Topic indexing with Wikipedia. In: Proceedings of of association for the advancement of artificial intelligence (AAAI ’08), Wikipedia and artificial intelligence: an evolving synergy. Papers from the 2008 AAAI workshop, pp 19–24

  • Michael S, Ponzetto SP (2006) Wikirelate! computing semantic relatedness using Wikipedia. In: Proceedings of the 21st national conference on Artificial intelligence (AAAI ’06), vol 2, pp 1419–1424

  • Mihalcea R, Corley C, Strapparava C (2006) Corpus-based and knowledge-based measures of text semantic similarity. In: Proceedings of the association for the advancement of artificial intelligence (AAAI ’06), pp 775–780

  • Mihalcea R, Csomai A (2007) Wikify!: linking documents to encyclopedic knowledge. In: Proceedings of the 16th ACM conference on information and knowledge management, (CIKM ’07), pp 233–242

  • Mihalcea R, Moldovan DI (1999) A method for word sense disambiguation of unrestricted text. In: Proceedings of the 37th annual meeting of the association for computational linguistics on computational linguistics (ACL ’99), pp 152–158

  • Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. CoRR arXiv:1301.3781

  • Mikolov T, Karafiát M, Burget L, Cernocký J, Khudanpur S (2010) Recurrent neural network based language model. In: INTERSPEECH. ISCA, pp 1045–1048

  • Mikolov T, Kombrink S, Burget L, Cernocký J, Khudanpur S (2011) Extensions of recurrent neural network language model. In: ICASSP, pp 5528–5531. IEEE

  • Mikolov T, Yih Wt, Zweig G (2013) Linguistic regularities in continuous space word representations. In: HLT-NAACL, pp 746–751

  • Miller GA (1995) Wordnet: a lexical database for english. Commun ACM 38(11):39–41

    Google Scholar 

  • Miller GA, Charles WG (1991) Contextual correlates of semantic similarity. Lang Cog Process 6(1):1–28

    MathSciNet  Google Scholar 

  • Milne D, Medelyan O, Witten IH (2006) Mining domain-specific thesauri from Wikipedia: a case study. In: 2006 IEEE/WIC/ACM international conference on web intelligence (WI 2006 main conference proceedings) (WI ’06), pp 442–448

  • Milne D, Witten IH (2008) An effective, low-cost measure of semantic relatedness obtained from Wikipedia links. In: Proceeding of AAAI workshop on Wikipedia and artificial intelligence: an evolving synergy, pp 25–30

  • Milne D, Witten IH (2008) Learning to link with Wikipedia. In: Proceedings of the 17th ACM conference on information and knowledge management, (CIKM ’08), pp 509–518

  • Milne D, Witten IH (2013) An open-source toolkit for mining Wikipedia. Artif Intell 194:222–239 (Artificial Intelligence, Wikipedia and Semi-Structured Resources)

    MathSciNet  Google Scholar 

  • Mnih A, Kavukcuoglu K (2013) Learning word embeddings efficiently with noise-contrastive estimation. In: Advances in neural information processing systems 26. Curran Associates, Inc., pp 2265–2273

  • Mohammad S, Hirst G (2012) Distributional measures of semantic distance: A survey. CoRR arXiv:1203.1858

  • Morris J, Hirst G (2004) Non-classical lexical semantic relations. In: Proceedings of the HLT-NAACL workshop on computational lexical semantics (CLS ’04), pp 46–51

  • Mrksic N, Séaghdha DÓ, Thomson B, Gasic M, Rojas-Barahona LM, Su P, Vandyke D, Wen T, Young SJ (2016) Counter-fitting word vectors to linguistic constraints. CoRR arXiv:1603.00892

  • Narayanan S, Harabagiu S (2004) Question answering based on semantic structures. In: Proceedings of the 20th international conference on computational linguistics (COLING ’04). Association for Computational Linguistics

  • Navigli R (2009) Word sense disambiguation: a survey. ACM Comput Surv 41(2):1–69

    Google Scholar 

  • Navigli R, Ponzetto SP (2010) BabelNet: building a very large multilingual semantic network. In: Proceedings of the 48th annual meeting of the association for computational linguistics. Association for Computational Linguistics, pp 216–225

  • Navigli R, Ponzetto SP (2012) Babelrelate! a joint multilingual approach to computing semantic relatedness. In: Proceedings of the 26th conference on artificial intelligence (AAAI ’12)

  • Nejja M, Yousfi A (2017) Context’s impact on the automatic spelling correction. IJAISC 6(1):56–74

    Google Scholar 

  • Nelson DL, Mcevoy CL, Schreiber TA (2004) The university of south florida free association, rhyme, and word fragment norms. J Behav Res Methods Instrum Comput 36:402–407

    Google Scholar 

  • Ng V (2007) Shallow semantics for coreference resolution. In: Proceedings of the 20th international joint conference on artificial intelligence, pp 1689–1694

  • Oussalah M, Kostakos P (2017) On web based sentence similarity for paraphrasing detection. In: Proceedings of the 9th international joint conference on knowledge discovery, knowledge engineering and knowledge management—(Volume 1), Funchal, Madeira, November 1-3, 2017, pp 289–292

  • Pal AR, Saha D (2015) Word sense disambiguation: a survey. CoRR arXiv:1508.01346

  • Pang B, Lee L (2008) Opinion mining and sentiment analysis. Found Trends Inf Retr 2:1–135

    Google Scholar 

  • Patwardhan S, Banerjee S, Pedersen T (2003) Using measures of semantic relatedness for word sense disambiguation. In: Proceedings of the 4th international conference on intelligent text processing and computational linguistics, (CICLing ’03), pp 241–257

  • Pedersen T (2010) Information content measures of semantic similarity perform better without sense-tagged text. In: Human language technologies: the 2010 annual conference of the North American chapter of the association for computational linguistics (HLT ’10). Association for Computational Linguistics, pp 329–332

  • Pedersen T, Pakhomov SVS, Patwardhan S, Chute CG (2007) Measures of semantic similarity and relatedness in the biomedical domain. Biomed Inform 40:288–299

    Google Scholar 

  • Pennington J, Socher R, Manning CD (2014) Glove: Global vectors for word representation. In: Proceedings of the 2014 conference on empirical methods in natural language processing, EMNLP 2014, October 25-29, 2014, Doha, Qatar, a meeting of SIGDAT, a special interest group of the ACL, pp 1532–1543

  • Pexman P, Siakaluk P, Yap M (2013) Introduction to the research topic meaning in mind: semantic richness effects in language processing. Front Hum Neurosci 7:723

    Google Scholar 

  • Ponzetto SP, Strube M (2007) Knowledge derived from Wikipedia for computing semantic relatedness. J Artif Intell Res (JAIR) 30:181–212

    MATH  Google Scholar 

  • Rada R, Mili H, Bicknell E, Blettner M (1989) Development and application of a metric on semantic nets. IEEE Trans Syst Man Cybern 19(1):17–30

    Google Scholar 

  • Radhakrishnan P, Varma V (2013) Extracting semantic knowledge from Wikipedia category names. In: Proceedings of the 2013 workshop on automated knowledge base construction, AKBC@CIKM 13, San Francisco, California, USA, October 27-28, 2013, pp 109–114

  • Radinsky K, Agichtein E, Gabrilovich E, Markovitch S (2011) A word at a time: computing word relatedness using temporal semantic analysis. In: Proceedings of the 20th international conference on World Wide Web (WWW ’11), pp 337–346

  • Ramage D, Rafferty AN, Manning CD (2009) Random walks for text semantic similarity. In: Proceedings of the 2009 workshop on graph-based methods for natural language processing (TextGraphs-4 ’09), pp 23–31

  • Recchia G, Jones M (2012) The semantic richness of abstract concepts. Front Hum Neurosci 6:315

    Google Scholar 

  • Reed SL, Lenat DB (2002) Mapping ontologies into Cyc. In: Proceedings of the AAAI 2002 conference workshop on ontologies for the semantic web, pp 1–6

  • Resnik P (1995) Using information content to evaluate semantic similarity in a taxonomy. In: Proceedings of the 14th international joint conference on artificial intelligence (AAAI ’95), pp 448–453

  • Resnik P (1999) Semantic similarity in a taxonomy: an information-based measure and its application to problems of ambiguity in natural language. J Artif Intell Res (JAIR) 11:95–130

    MATH  Google Scholar 

  • Resnik P, Diab M (2000) Measuring verb similarity. In: Proceedings of the 22nd annual meeting of the cognitive science society, Philadelphia, pp 399–404

  • Richman AE, Schone P (2008) Mining wiki resources for multilingual named entity recognition. In: Proceedings of the 46th annual meeting of the association for computational linguistics: Human language technologies (ACL ’08), pp 1–9

  • Roget PM (1852) Roget’s Thesaurus of English words and phrases. Project Gutenberg, Illinois Benedictine College, Lisle

    Google Scholar 

  • Rohde DLT, Gonnerman LM, Plaut DC (2006) An improved model of semantic similarity based on lexical co-occurence. Commun ACM 8:627–633

    Google Scholar 

  • Rubenstein H, Goodenough JB (1965) Contextual correlates of synonymy. Commun ACM 8:627–633

    Google Scholar 

  • Ruiz-Casado M, Alfonseca E, Castells P (2005) Using context-window overlapping in synonym discovery and ontology extension. In: Proceedings of the international conference on recent advances in natural language processing (RANLP ’05)

  • Rybinski M, Montes JFA (2016) tESA: a distributional measure for calculating semantic relatedness. J Biomed Semant 7:67:1–67:14

    Google Scholar 

  • Sahami M, Heilman TD (2006) A web-based kernel function for measuring the similarity of short text snippets. In: Proceedings of the 15th international conference on World Wide Web (WWW ’06), pp 377–386

  • Sahlgren M (2001) Vector-based semantic analysis: Representing word meanings based on random labels. In: Proceedings of ESSLI Workshop on Semantic Knowledge Acquisition and Categorization. Kluwer Academic Publishers

  • SáNchez D, Batet M (2011) Semantic similarity estimation in the biomedical domain: an ontology-based information-theoretic perspective. J Biomed Inform 44(5):749–759

    Google Scholar 

  • Sánchez-Vega F, Montes-y-Gómez M, Rosso P, Pineda LV (2013) Inaoe\_upv-core: extracting word associations from document corpora to estimate semantic textual similarity. In: Proceedings of the second joint conference on lexical and computational semantics, *SEM 2013, June 13-14, 2013, Atlanta, Georgia, USA. pp 229–233

  • Schonhofen P (2006) Identifying document topics using the Wikipedia category network. In: Proceedings of the international conference on web intelligence (WI ’06). IEEE Computer Society, pp 456–462

  • Schütze H (1998) Automatic word sense discrimination. J Comput Linguist 24(1):97–123

    Google Scholar 

  • Schütze H (1992) Dimensions of meaning. In: Proceedings of supercomputing ’92, pp 787–796

  • Sehgal S, Kumar B, Rampal L, Chaliya A (2018) A modification to graph based approach for extraction based automatic text summarization. In: Saeed K, Chaki N, Pati B, Bakshi S, Mohapatra DP (eds) Progress in advanced computing and intelligent engineering. Springer, Singapore, pp 373–378

    Google Scholar 

  • Sheth AP, Aleman-Meza B, Arpinar IB, Bertram C, Warke YS, Ramakrishnan C, Halaschek-Wiener C, Anyanwu K, Avant D, Arpinar FS, Kochut KJ (2005) Semantic association identification and knowledge discovery for national security applications. J Database Manag 16:33–53

    Google Scholar 

  • Simpson GG (1943) Mammals and the nature of continents. Am J Sci 241(1):1–31

    MathSciNet  Google Scholar 

  • Singh J, Kumar R (2017) Lexical co-occurrence and contextual window-based approach with semantic similarity for query expansion. IJIIT 13(3):57–78

    Google Scholar 

  • Solomon A, Bar A, Yanai C, Shapira B, Rokach L (2018) Predict demographic information using word2vec on spatial trajectories. In: Proceedings of the 26th conference on user modeling, adaptation and personalization, UMAP ’18, pp 331–339. ACM

  • Stanchev L (2014) Creating a phrase similarity graph from Wikipedia. In: 2014 IEEE international conference on semantic computing, Newport Beach, June 16-18, 2014, pp 68–75

  • Steinbach M, Karypis G, Kumar V (2000) A comparison of document clustering techniques. In: Proceedings of the KDD workshop on text mining, vol 400, pp 525–526

  • Strehl A., Strehl E, Ghosh J, Mooney R (2000) Impact of similarity measures on web-page clustering. In: Workshop on artificial intelligence for web search (AAAI 2000), pp 58–64. AAAI

  • Strötgen J, Alonso O, Gertz M (2012) Identification of top relevant temporal expressions in documents. In: Proceedings of the 2nd temporal web analytics workshop (TempWeb ’12), pp 33–40

  • Suchanek FM, Kasneci G, Weikum G (2008) YAGO: a large ontology from Wikipedia and WordNet. Web Semant 6(3):203–217

    Google Scholar 

  • Sun Q, Li R, Luo D, Wu X (2008) Text segmentation with LDA-based fisher kernel. In: Proceedings of the 46th annual meeting of the association for computational linguistics on human language technologies: short papers, pp 269–272

  • Szumlanski SR, Gomez F, Sims VK (2013) A new set of norms for semantic relatedness measures. In: ACL (2). The Association for Computer Linguistics, pp 890–895

  • tau Yih W, Chang MW, He X, Gao J (2015) Semantic parsing via staged query graph generation: question answering with knowledge base. In: Association of computational linguistics. The Association for Computer Linguistics, pp 1321–1331

  • Taieb MAH, Aouicha MB, Hamadou AB (2013) Computing semantic relatedness using Wikipedia features. Knowl Based Syst 50:260–278

    Google Scholar 

  • Tang J, Yao L, Chen D (2009) Multi-topic based query-oriented summarization. In: proceedings of the Siam international conference on data mining (SDM ’09), pp 1147–1158

  • Turney P (2000) Learning algorithms for keyphrase extraction. Inf Retr 2:303–336

    Google Scholar 

  • Turney PD (2001) Mining the web for synonyms: PMI-IR versus LSA on TOEFL. In: Proceedings of the 12th European conference on machine learning (EMCL ’01), pp 491–502

  • Varelas G, Voutsakis E, Petrakis E, Milios E, Raftopoulou P (2005) Semantic similarity methods in WordNet and their application to information retrieval on the web. In: Proceedings of the 7th ACM international workshop on Web information and data management (WIDM ’05). ACM Press, pp 10–16

  • Vasilescu F, Langlais P, Lapalme G (2004) Evaluating variants of the Lesk approach for disambiguating words. In: Proceedings of language resources and evaluation (LREC 2004), pp 633–636

  • Viviani M, Pasi G (2017) Credibility in social media: opinions, news, and health information—a survey. Wiley Iinterdiscip Rev Data Min Knowl Discov 7(5):e1209

    Google Scholar 

  • Voorhees E (1994) Query expansion using lexical-semantic relations. Springer, New York, pp 61–69

    Google Scholar 

  • Voorhees EM (1993) Using WordNet to disambiguate word senses for text retrieval. In: Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval (SIGIR ’93), pp 171–180. ACM

  • Wang JZ, Du Z, Payattakool R, Yu PS, Chen CF (2007) A new method to measure the semantic similarity of GO terms. Bioinformatics 23(10):1274–1281

    Google Scholar 

  • Wang Y, Lee H, Lee L (2018) Segmental audio word2vec: Representing utterances as sequences of vectors with applications in spoken term detection. CoRR arXiv:1808.02228

  • Weale T, Brew C, Fosler-Lussier E (2009) Using the Wiktionary graph structure for synonym detection. In: Proceedings of the 2009 workshop on the People’s Web meets NLP: collaboratively constructed semantic resources (People’s Web ’09), pp 28–31

  • Weeds J, Weir D (2003) A general framework for distributional similarity. In: Proceedings of the 2003 conference on empirical methods in natural language processing (EMNLP ’03), pp 81–88

  • Wei M (1993) An analysis of word relatedness correlation measures. Ph.D. thesis, Master’s thesis, University of Western Ontario

  • Wettler M, Rapp R (1993) Computation of word associations based on the co-occurrences of words in large corpora. In: Proceedings of the 1st workshop on very large corpora, pp 84–93

  • Wu F, Weld DS (2010) Open information extraction using Wikipedia. In: Proceedings of the 48th annual meeting of the association for computational linguistics (ACL ’10), pp 118–127

  • Wu L, Yen IE, Xu K, Xu F, Balakrishnan A, Chen P, Ravikumar P, Witbrock MJ (2018) Word mover’s embedding: from word2vec to document embedding. CoRR arXiv:1811.01713

  • Wu Z, Palmer M (1994) Verbs semantics and lexical selection. In: Proceedings of the 32nd annual meeting on association for computational linguistics (ACL ’94), pp 133–138

  • Yang D, Powers DMW (2005) Measuring semantic similarity in the taxonomy of WordNet. In: Proceedings of the 28th Australasian conference on computer science (ACSC ’05), vol 38, pp 315–322

  • Yao Z, Sun Y, Ding W, Rao N, Xiong H (2018) Dynamic word embeddings for evolving semantic discovery. In: Proceedings of the 11th ACM international conference on Web search and data mining, WSDM ’18, pp 673–681. ACM

  • Yazdani M, Popescu-Belis A (2013) Computing text semantic relatedness using the contents and links of a hypertext encyclopedia. Artif Intell 194:176–202

    MathSciNet  MATH  Google Scholar 

  • Yeh E, Ramage D, Manning CD, Agirre E, Soroa A (2009) Wikiwalk: random walks on Wikipedia for semantic relatedness. In: 2009 workshop on graph-based methods for natural language processing (TextGraphs-4 ’09), pp 41–49

  • Yih W, Qazvinian V (2012) Measuring word relatedness using heterogeneous vector space models. In: Proceedings of the 2012 conference of the North American chapter of the association for computational linguistics: Human language technologies (NAACL HLT ’12), pp 616–620

  • Zesch T, Gurevych I (2006) Automatically creating datasets for measures of semantic relatedness. In: Proceedings of the workshop on linguistic distances, (ACL ’06), pp 16–24

  • Zesch T, Gurevych I (2010) Wisdom of crowds versus wisdom of linguists, measuring the semantic relatedness of words. Nat Lang Eng 16(1):25–59

    Google Scholar 

  • Zesch T, Gurevych I, Mühlhäuser M (2007) Comparing Wikipedia and German WordNet by evaluating semantic relatedness on multiple datasets. In: Proceedings of Human language technologies: the annual conference of the North American chapter of the association for computational linguistics (NAACL-HLT ’07), pp 205–208

  • Zesch T, Müller C, Gurevych I (2008) Using Wiktionary for computing semantic relatedness. In: Proceedings of the 23rd national conference on artificial intelligence (AAAI ’08), vol 2, pp 861–866

  • Zhai C (2008) Statistical language models for information retrieval a critical review. Found Trends Inf Retr 2(3):137–213

    Google Scholar 

  • Zhang D, Xu H, Su Z, Xu Y (2015) Chinese comments sentiment classification based on word2vec and SVMperf. Expert Syst Appl 42(4):1857–1863

    Google Scholar 

  • Zhang W, Feng W, Wang J (2013) Integrating semantic relatedness and words’ intrinsic features for keyword extraction. In: Proceedings of the 23rd international joint conference on artificial intelligence (IJCAI ’13), pp 2225–2231

  • Zhang Z, Gentile A, Ciravegna F (2012) Recent advances in methods of lexical semantic relatedness-a survey. Nat Lang Eng 1(1):1–69

    Google Scholar 

  • Zobel J, Moffat A (1998) Exploring the similarity space. SIGIR Forum 32(1):18–34

    Google Scholar 

  • Zohar H, Liebeskind C, Schler J, Dagan I (2013) Automatic thesaurus construction for cross generation corpus. ACM J Comput Cult Herit 6(1):1–19

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Applied Sciences, Pakistan Institute of Engineering and Technology (PIET), Multan, Pakistan

    Shahida Jabeen

  2. School of Engineering and Computer Science, Victoria University of Wellington, Wellington, New Zealand

    Xiaoying Gao & Peter Andreae

Authors
  1. Shahida Jabeen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiaoying Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Peter Andreae
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shahida Jabeen.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jabeen, S., Gao, X. & Andreae, P. Semantic association computation: a comprehensive survey. Artif Intell Rev 53, 3849–3899 (2020). https://doi.org/10.1007/s10462-019-09781-w

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10462-019-09781-w

Keywords

Search

Navigation