Abstract
Ontologies have become increasingly important in many areas. Building ontology, however, is a time-consuming activity which requires many resources. Consequently, the need for the automatic ontology extraction tool has been increased for the last two decades, and many tools have been developed for this purpose. Yet, there is no comprehensive framework for evaluating such tools. In this paper, we identified important tool evaluation metrics and developed a set of criteria that guide us to evaluate the quality of ontology extraction tools. We carried out experiments and assessed four popular extraction tools using our proposed evaluation framework. The proposed framework can be applied as a useful benchmark when developers want to build ontology extraction tools.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Berners-Lee, T., Hendler, J., Lassila, O.: The Semantic Web. Scientific American 284, 34–43 (2001)
Biebow, B., Szulman, S.: TERMINAE: a linguistic-based tool for the building of a domain ontology. In: Proceedings of the 11th European Workshop on Knowledge Acquisition, Modeling and management. Dagstuhl, Germany (1999)
Brank, J., Mladenic, D., Grobelnik, M.: Gold standard based ontology evlauaiotn using instance assighnment. In: Proceedings of the 4th International Workshop on Evaluation of Ontologies for the Web (EON), Edinburgh, UK (2006)
Buitelaar, P., Olejnik, D., Sintek, M.: A Protégé Plug-In for Ontology Extraction from Text Based on Linguistic Analysis. In: Proceedings of the 1st European Semantic Web Symposium (ESWS), Heraklion, Greece (May 2004)
Burton-Jones, A., Storey, V., Sugumaran, V., Ahluwalia, P.: A semiotic metrics suite for assessing the quality of ontologies. Data & Knowledge Engineering 55, 84–102 (2005)
Ding, Y., Foo, S.: Ontology research and development: Part 1- a review of ontology generation. Journal of Information Science 28(5), 375–388 (2002)
Duineveld, A., Stoter, R., Weiden, M., Kenepa, B., Benjamins, V.: Wondertools? A comprehensive study of ontological engineering tool. In: Proceedings of the 12th Workshop on Knowledge Acquisition, Modeling and Management, Nanff, Canada (1999)
Faure, D., Nedellec, C.: Knowledge Acquisition of Predicate Argument Structures from Technical Texts Using Machine Learning: The System ASIUM. In: Fensel, D., Studer, R. (eds.) EKAW 1999. LNCS (LNAI), vol. 1621, Springer, Heidelberg (1999)
Gal, A., Modica, G.: OntoBuilder: fully automatic extraction and consolidation of ontologies from Web sources. In: Proceedings of the 20th International Conference on Data Engineering (ICDE) (2004)
Gangemi, A., Catenacci, C., Ciaramita, M., Lehmann, J.: A theoretical framework for ontology evaluation and validation. In: Proceedings of the Semantic Web Applications and Perspectives (SWAP), Trento, Italy (2005)
Gomez-Perez, A., Manzano-Macho, D.: An overview of methods and tools for ontology learning form texts. The Knowledge Engineering Review 19(3), 187–212 (2002)
Lambrix, P., Edberg, A.: Evaluation of ontology merging tools in bioinformatics. In: Proceedings of the Pacific Symposium on Biocomputing, vol. 8, pp. 589–600 (2003)
Maedche, A., Volz, R.: The Text-To-Onto Ontology Extraction and Maintenance Environment. In: Proceedings of the ICDM Workshop on integrating data mining and knowledge management, San Jose, California, USA (2001)
Murshed, A., Singh, R.: Evaluation and ranking of ontology construction tools. Technical Report DIT-05-013, University of Trento (2005)
Velardi, P., Navigli, R., Missikoff, M.: Integrated approach for Web ontology learning and engineering. IEEE Computer (November 2002)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Park, J., Cho, W., Rho, S. (2007). Evaluation Framework for Automatic Ontology Extraction Tools: An Experiment. In: Meersman, R., Tari, Z., Herrero, P. (eds) On the Move to Meaningful Internet Systems 2007: OTM 2007 Workshops. OTM 2007. Lecture Notes in Computer Science, vol 4805. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-76888-3_74
Download citation
DOI: https://doi.org/10.1007/978-3-540-76888-3_74
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-76887-6
Online ISBN: 978-3-540-76888-3
eBook Packages: Computer ScienceComputer Science (R0)