Abstract
Ontology-based relevance assessment of documents is an important task. When viewing this in a business context, approaches are commonly based on the use of one ontology describing the enterprise. A more specific problem is then how to assess the relevance of a set of ontology concepts with respect to a user profile expressed within the same ontology. Semantic similarity measures have been widely used and described in literature, but few experiments have been performed to show the benefits and drawbacks of certain measures. In this paper we describe how a set of measures have been combined, tested, and evaluated. The evaluation was performed through a rank correlation coefficient comparing the measured results with a manually constructed “gold standard”. Conclusions are that certain combinations of measures seem less suitable for solving this type of problem. On the other hand a set of combinations perform quite well, although the detailed performance of most combined measures seem to depend heavily on the structure of the ontology used.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Sandkuhl, K.: Information logistics in networked organisations: Selected concepts and applications. In: Cardoso, J., Cordeiro, J., Filipe, J. (eds.) Enterprise Information Systems VIII. LNBIP. Springer, Heidelberg (to appear, 2008)
Billig, A., Blomqvist, E., Lin, F.: Semantic matching based on enterprise ontologies. In: Meersman, R., Tari, Z. (eds.) OTM 2007, Part I. LNCS, vol. 4803, pp. 1161–1168. Springer, Heidelberg (2007)
Rodríguez, M.A., Egenhofer, M.J.: Comparing geospatial entity classes: An asymmetric and context-dependent similarity measure. International Journal of Geographical Information Science 18(3) (April-May 2004)
Andreasen, T., Bulskov, H., Knappe, R.: From ontology over similarity to query evaluation. In: Proceedings of the 2nd CoLogNET-ElsNET Symposium - Questions and Answers: Theoretical and Applied Perspectives, Amsterdam, Holland, December 18, 2003, pp. 39–50 (2003)
Janowicz, K.: Kinds of contexts and their impact on semantic similarity measurement. In: Proceedings of the Sisth Annual IEEE International Conference on Pervasive Computing and Communications (2008)
Blanchard, E., Harzallah, M., Briand, H., Kuntz, P.: A typology of ontology-based semantic measures. In: Proc. of the Open Interop Workshop on Enterprise Modelling and Ontologies for Interoperability (June 2005)
Raftopoulou, P., Petrakis, E.: Semantic Similarity Measures: a Comparison Study. Technical report, Technical University of Crete. Department of Electronic and Computer Engineering (January 2005)
Sussna, M.: Word sense disambiguation for free-text indexing using a massive semantic network. In: Proceedings of the second international conference on Information and Knowledge Management. ACM Press, New York (1993)
Rada, R., Mili, H., Bicknell, E., Blettner, M.: Development and application of a metric on semantic nets. IEEE Transactions on Systems, Man, and Cybernetics 19, 17–30 (1989)
Leacock, C., Chodorow, M.: Combining local context and wordnet similarity for word sense identification. In: WordNet: An electronic lexical database, pp. 265–283. MIT Press, Cambridge (1998)
Wu, Z., Palmer, M.: Verb semantics and lexical selection. In: Proceedings of the 32nd Annual Meeting of the Associations for the Computational Linguistics, pp. 133–138 (1994)
Eiter, T., Mannila, H.: Distance measures for point sets and their computation. Acta Informatica (1997)
Ramon, J., Bruynooghe, M.: A polynomial time computable metric between point sets. Acta Informatica 37(10) (July 2001)
Kalousis, A., Hilario, M.: Representational issues in meta-learning. In: Proceedings of the Twentieth International Conference on Machine Learning (ICML 2003), Washington, DC (2003)
Cross, V., Sun, Y.: Semantic, fuzzy set and fuzzy measure similarity for the gene ontology. In: IEEE International Fuzzy Systems Conference, 2007. FUZZ-IEEE 2007, pp. 1–6 (2007)
Couto, F.M., Silva, M.J., Coutinho, P.M.: Measuring semantic similarity between gene ontology terms. Data & Knowledge Engineering 61(1), 137–152 (2007)
Lord, P., Stevens, R., Brass, A., Goble, C.: Semantic similarity measures as tools for exploring the gene ontology. In: Proceedings of the 8th Pacific Symposium on Biocomputing (2003)
Petrakis, E.G., Varelas, G., Hliaoutakis, A., Raftopoulou, P.: Design and evaluation of semantic similarity measures for concepts stemming from the same or different ontologies. In: 4th Workshop on Multimedia Semantics (WMS 2006), Chania, Crete, Greece, pp. 44–52 (2006)
Siegel, S.: Nonparametric statistics for the behavioral sciences. McGraw-Hill, New York (1956)
Miller, G.A., Charles, W.G.: Contextual correlates of semantic similarity. Language and Cognitive Processes 6, 1–28 (1991)
Resnik, P.: Using information content to evaluate semantic similarity in a taxonomy. In: Proceedings of IJCAI 1995 (1995)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ricklefs, M., Blomqvist, E. (2008). Ontology-Based Relevance Assessment: An Evaluation of Different Semantic Similarity Measures. In: Meersman, R., Tari, Z. (eds) On the Move to Meaningful Internet Systems: OTM 2008. OTM 2008. Lecture Notes in Computer Science, vol 5332. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-88873-4_23
Download citation
DOI: https://doi.org/10.1007/978-3-540-88873-4_23
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-88872-7
Online ISBN: 978-3-540-88873-4
eBook Packages: Computer ScienceComputer Science (R0)