Abstract
The success of machine learning approaches to word sense disambiguation (WSD) is largely dependent on the representation of the context in which an ambiguous word occurs. Typically, the contexts are represented as the vector space using ”Bag of Words (BoW)” technique. Despite its ease of use, BoW representation suffers from well-known limitations, mostly due to its inability to exploit semantic similarity between terms. In this paper, we apply the exponential kernel, which models semantic similarity by means of a diffusion process on a graph defined by lexicon and co-occurrence information, to smooth the BoW representation for WSD. Exponential kernel virtually exploits higher order co-occurrences to infer semantic similarities in an elegant way. The superiority of the proposed method is demonstrated experimentally with several SensEval disambiguation tasks.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Navigli, R.: Word Sense Disambiguation: A Survey. ACM Computing Surveys 41(2), 1–69 (2009)
Shawe-Taylor, J., Cristianini, N.: Kernel Methods for Pattern Analysis. Cambridge University Press, New York (2004)
Lee, Y.K., Ng, H.T.: An Empirical Evaluation of Knowledge Sources and Learning Algorithms for Word Sense Disambiguation. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing, Philadelphia, USA, pp. 41–48 (2002)
Lee, Y.K., Ng, H.T., Chia, T.K.: Supervised Word Sense Disambiguation with Support Vector Machines and Multiple Knowledge Sources. In: Proceedings of Senseval–3: Third International Workshop on the Evaluation of Systems for the Semantic Analysis of Text, Barcelona, Spain, pp. 137–140 (2004)
Jin, P., Li, F., Zhu, D., Wu, Y., Yu, S.: Exploiting External Knowledge Sources to Improve Kernel-based Word Sense Disambiguation. In: Proceedings of IEEE International Conference on Natural Language Processing and Knowledge Engineering, Beijing, China, pp. 1–8 (2008)
Giuliano, C., Gliozzo, A., Strapparava, C.: Kernel Methods for Minimally Supervised WSD. Computational Linguistics 35(4), 513–528 (2009)
Popescu, M.: Regularized Least-squares Classification for Word Sense Disambiguation. In: Proceedings of Senseval–3: Third International Workshop on the Evaluation of Systems for the Semantic Analysis of Text, Barcelona, Spain, pp. 209–212 (2004)
Deerwester, S., Dumais, S.T., Furnas, G.W., Landauer, T.K., Harshman, R.: Indexing by Latent Semantic Analysis. Journal of the American Society for Information Science 41(6), 391–407 (1990)
Cristianini, N., Shawe-Taylor, J., Lodhi, H.: Latent Semantic Kernels. Journal of Intelligent Information Systems 18(2-3), 127–152 (2002)
Kandola, J., Shawe-Taylor, J., Cristianini, N.: Learning Semantic Similarity. In: Advances in Neural Information Processing Systems, vol. 15, pp. 657–664 (2003)
Lemaire, B., Denhière, G.: Effects of High-order Co-occurrences on Word Semantic Similarity. Current Psychology Letters 18(1) (2006)
Chakraborti, S., Wiratunga, N., Lothian, R., Watt, S.: Acquiring Word Similarities with Higher Order Association Mining. In: Proceedings of the 7th International Conference on Case-Based Reasoning: Case-Based Reasoning Research and Development, Belfast, UK, pp. 61–76 (2007)
Kontostathis, A., Pottenger, W.M.: A Framework for Understanding Latent Semantic Indexing (LSI) Performance. Information Processing and Management 42(1), 56–73 (2006)
Honkela, T., Hyvärinen, A., Väyrynen, J.: WordICA-Emergence of Linguistic Representations for Words by Independent Component Analysis. Natural Language Engineering 16(3), 277–308 (2010)
Fan, R.E., Chang, K.W., Hsieh, C.J., Wang, X.R., Lin, C.J.: LIBLINEAR: A Library for Large Linear Classification. Journal of Machine Learning Research 9, 1871–1874 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wang, T., Rao, J., Zhao, D. (2013). Using Exponential Kernel for Word Sense Disambiguation. In: Mladenov, V., Koprinkova-Hristova, P., Palm, G., Villa, A.E.P., Appollini, B., Kasabov, N. (eds) Artificial Neural Networks and Machine Learning – ICANN 2013. ICANN 2013. Lecture Notes in Computer Science, vol 8131. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40728-4_68
Download citation
DOI: https://doi.org/10.1007/978-3-642-40728-4_68
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-40727-7
Online ISBN: 978-3-642-40728-4
eBook Packages: Computer ScienceComputer Science (R0)