Skip to main content
Springer Nature Link
Log in

Evaluating Ontology Matchers Using Arbitrary Ontologies and Human Generated Heterogeneities

  • Conference paper
On the Move to Meaningful Internet Systems: OTM 2012 (OTM 2012)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 7566))

Abstract

Automatic ontology matching is a hard problem. To address this problem many ontology matchers have evolved in the past several years. Consequently the evaluation of ontology matchers has become crucial in order to help improve a matcher’s performance. The evaluation frameworks used so far are limited to available pairs of ontologies in certain domains and require the reference alignments (i.e., gold standards) to be specified manually. In this paper we present a novel ontology matcher evaluation approach which can accept any OWL ontology as the source ontology. With little human efforts to specify the changes to the source ontology, our system can automatically construct the target ontology and generate the gold standard of correspondences. Compared to well-known evaluators (e.g., OAEI), our approach can provide more meaningful feedback besides traditional accuracy and completeness measures by indicating the performance of ontology matchers according to various types of heterogeneities.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. http://oaei.ontologymatching.org/

  2. http://protege.cim3.net/file/pub/ontologies/camera/camera.owl

  3. Cruz, I.F., Antonelli, F.P., Stroe, C.: Agreementmaker: Efficient matching for large real-world schemas and ontologies. PVLDB 2(2), 1586–1589 (2009)

    Google Scholar 

  4. David, J., Guillet, F., Briand, H.: Matching directories and OWL ontologies with AROMA. In: CIKM, pp. 830–831 (2006)

    Google Scholar 

  5. Doshi, P., Kolli, R., Thomas, C.: Inexact matching of ontology graphs using expectation-maximization. J. Web Sem. 7(2), 90–106 (2009)

    Article  Google Scholar 

  6. Euzenat, J.: An API for Ontology Alignment. In: McIlraith, S.A., Plexousakis, D., van Harmelen, F. (eds.) ISWC 2004. LNCS, vol. 3298, pp. 698–712. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  7. Euzenat, J., Shvaiko, P.: Ontology Matching. Springer (2007)

    Google Scholar 

  8. Hanif, M.S., Aono, M.: An efficient and scalable algorithm for segmented alignment of ontologies of arbitrary size. J. Web Sem. 7(4), 344–356 (2009)

    Article  Google Scholar 

  9. Jian, N., Hu, W., Cheng, G., Qu, Y.: FalconAO: Aligning Ontologies with Falcon. In: K-CAP Integrating Ontologies Workshop, pp. 85–91 (2005)

    Google Scholar 

  10. Lambrix, P., Tan, H.: A Tool for Evaluating Ontology Alignment Strategies. In: Spaccapietra, S., Atzeni, P., Fages, F., Hacid, M.-S., Kifer, M., Mylopoulos, J., Pernici, B., Shvaiko, P., Trujillo, J., Zaihrayeu, I. (eds.) Journal on Data Semantics VIII. LNCS, vol. 4380, pp. 182–202. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  11. Noy, N.F., Musen, M.A.: PROMPT: Algorithm and Tool for Automated Ontology Merging and Alignment. In: AAAI/IAAI, pp. 450–455 (2000)

    Google Scholar 

  12. Rosoiu, M.E., dos Santos, C.T., Euzenat, J.: Ontology matching benchmarks: generation and evaluation. In: The Sixth International Workshop on Ontology Matching (2011)

    Google Scholar 

  13. Shvaiko, P., Euzenat, J.: Ontology Matching: State of the Art and Future Challenges. IEEE Transactions on Knowledge and Data Engineering (2011) (accepted)

    Google Scholar 

  14. Visser, P.R.S., Jones, D.M., Bench-capon, T.J.M., Shave, M.J.R.: An Analysis of Ontology Mismatches; Heterogeneity Versus Interoperability. In: AAAI 1997 Spring Symposium on Ontological Engineering, pp. 164–172 (1997)

    Google Scholar 

  15. Wang, P., Xu, B.: Lily: Ontology Alignment Results for OAEI 2009. In: The Fourth International Workshop on Ontology Matching, pp. 186–192 (2009)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer and Information Science, University of Oregon, Eugene, OR, 97403, USA

    Nafisa Afrin Chowdhury & Dejing Dou

Authors
  1. Nafisa Afrin Chowdhury
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dejing Dou
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science, Semantic Technology and Application Research Laboratory (STARLab), Vrije Universiteit Brussel, Building G-10, Pleinlaan 2, 1050, Brussels, Belgium

    Robert Meersman

  2. Research Centre for Automatic Control, School of Engineering in Information Technology, Campus scientifique, University of Lorraine, CNRS, BP 70239, 54506, Vandoeuvre-les-Nancy, France

    Hervé Panetto

  3. La Trobe University, Melbourne, VIC, Australia

    Tharam Dillon

  4. Faculty of Computer Science, University of Vienna, 1010, Vienna, Austria

    Stefanie Rinderle-Ma

  5. Institute of Databases and Information Systems, Ulm University, Germany

    Peter Dadam

  6. School of Information Technology and Electrical Engineering, University of Queensland, QLD 4072, Brisbane, Australia

    Xiaofang Zhou

  7. HP Labs, Bristol, UK

    Siani Pearson

  8. Johannes Kepler University, Linz, Austria

    Alois Ferscha

  9. Università di Modena e Reggio Emilia, Modena, Italy

    Sonia Bergamaschi

  10. ADVIS Lab, Department of Computer Science, University of Illinois at Chicago, Chicago, IL, USA

    Isabel F. Cruz

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Chowdhury, N.A., Dou, D. (2012). Evaluating Ontology Matchers Using Arbitrary Ontologies and Human Generated Heterogeneities. In: Meersman, R., et al. On the Move to Meaningful Internet Systems: OTM 2012. OTM 2012. Lecture Notes in Computer Science, vol 7566. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33615-7_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-33615-7_15

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-33614-0

  • Online ISBN: 978-3-642-33615-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics