Skip to main content
SpringerLink
Log in

On the Impact and Proper Use of Heuristics in Test-Driven Ontology Debugging

  • Conference paper
  • First Online:
Rules and Reasoning (RuleML+RR 2018)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 11092))

Included in the following conference series:

Abstract

Given an ontology that does not meet required properties such as consistency or the (non-)entailment of certain axioms, Ontology Debugging aims at identifying a set of axioms, called diagnosis, that must be properly modified or deleted in order to resolve the ontology’s faults. As there are, in general, large numbers of competing diagnoses and the choice of each diagnosis leads to a repaired ontology with different semantics, Test-Driven Ontology Debugging (TOD) aims at narrowing the space of diagnoses until a single (highly probable) one is left. To this end, TOD techniques automatically generate a sequence of queries to an interacting oracle (domain expert) about (non-)entailments of the correct ontology. Diagnoses not consistent with the answers are discarded. To minimize debugging cost (oracle effort), various heuristics for selecting the best next query have been proposed. We report preliminary results of extensive ongoing experiments with a set of such heuristics on real-world debugging cases. In particular, we try to answer questions such as “Is some heuristic always superior to all others?”, “On which factors does the (relative) performance of the particular heuristics depend?” or “Under which circumstances should I use which heuristic?”.

This work is supported by Carinthian Science Fund (KWF), contract KWF-3520/26767/38701.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    See, e.g., OBO project (http://obo.sourceforge.net) or NCI-Thesaurus (http://ncit.nci.nih.gov).

  2. 2.

    We consider the slightly modified version \(\mathsf {RIO}'\) of the original \(\mathsf {RIO}\) [22], as suggested in [18].

  3. 3.

    Note, due to the comprehensiveness (large number of factor combinations tested) of our evaluations, experiments are very time-consuming (up to several weeks for one ontology).

  4. 4.

    To reproduce the experiments or access logs see http://isbi.aau.at/ontodebug/evaluation.

  5. 5.

    http://isbi.aau.at/ontodebug.

References

  1. Baader, F., Calvanese, D., McGuinness, D.L., Nardi, D., Patel-Schneider, P.F. (eds.): The Description Logic Handbook. Cambridge University Press, Cambridge (2007)

    Google Scholar 

  2. De Kleer, J., Raiman, O.: Trading off the costs of inference vs. probing in diagnosis. In: IJCAI 1995, pp. 1736–1741 (1995)

    Google Scholar 

  3. Felfernig, A., Friedrich, G., Jannach, D., Stumptner, M.: Consistency-based diagnosis of configuration knowledge bases. Artif. Intell. 152(2), 213–234 (2004)

    Article  MathSciNet  Google Scholar 

  4. Felfernig, A., Mairitsch, M., Mandl, M., Schubert, M., Teppan, E.: Utility-based repair of inconsistent requirements. In: Chien, B.-C., Hong, T.-P., Chen, S.-M., Ali, M. (eds.) IEA/AIE 2009. LNCS (LNAI), vol. 5579, pp. 162–171. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-02568-6_17

    Chapter  Google Scholar 

  5. Ferré, S., Rudolph, S.: Advocatus Diaboli – Exploratory Enrichment of Ontologies with Negative Constraints. In: ten Teije, A., et al. (eds.) EKAW 2012. LNCS (LNAI), vol. 7603, pp. 42–56. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-33876-2_7

    Chapter  Google Scholar 

  6. Grau, B.C., Horrocks, I., Motik, B., Parsia, B., Patel-Schneider, P.F., Sattler, U.: OWL 2: The next step for OWL. JWS 6(4), 309–322 (2008)

    Article  Google Scholar 

  7. Hyafil, L., Rivest, R.L.: Constructing optimal binary decision trees is NP-complete. Inf. Process. Lett. 5(1), 15–17 (1976)

    Article  MathSciNet  Google Scholar 

  8. Kalyanpur, A.: Debugging and repair of OWL ontologies. Ph.D. thesis, University of Maryland, College Park (2006)

    Google Scholar 

  9. Kalyanpur, A., Parsia, B., Sirin, E., Cuenca-Grau, B.: Repairing unsatisfiable concepts in OWL ontologies. In: Sure, Y., Domingue, J. (eds.) ESWC 2006. LNCS, vol. 4011, pp. 170–184. Springer, Heidelberg (2006). https://doi.org/10.1007/11762256_15

    Chapter  Google Scholar 

  10. de Kleer, J., Raiman, O., Shirley, M.: One step lookahead is pretty good. In: Readings in Model-Based Diagnosis, pp. 138–142 (1992)

    Google Scholar 

  11. de Kleer, J., Williams, B.C.: Diagnosing multiple faults. Artif. Intell. 32(1), 97–130 (1987)

    Article  Google Scholar 

  12. Moret, B.M.: Decision trees and diagrams. ACM Comput. Surv. (CSUR) 14(4), 593–623 (1982)

    Article  Google Scholar 

  13. Nikitina, N., Rudolph, S., Glimm, B.: Reasoning-supported interactive revision of knowledge bases. In: IJCAI 2011, pp. 1027–1032 (2011)

    Google Scholar 

  14. Rector, A., et al.: OWL pizzas: practical experience of teaching OWL-DL: common errors & common patterns. In: Motta, E., Shadbolt, N.R., Stutt, A., Gibbins, N. (eds.) Engineering Knowledge in the Age of the Semantic Web, EKAW 2004. LNCS, vol. 3257, pp. 63–81. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-540-30202-5_5

  15. Reiter, R.: A theory of diagnosis from first principles. Artif. Intell. 32(1), 57–95 (1987)

    Article  MathSciNet  Google Scholar 

  16. Rodler, P.: Interactive debugging of knowledge bases. Ph.D. thesis, University of Klagenfurt (2015). http://arxiv.org/pdf/1605.05950v1.pdf

  17. Rodler, P.: Towards better response times and higher-quality queries in interactive knowledge base debugging. Technical report, University of Klagenfurt (2016). http://arxiv.org/pdf/1609.02584v2.pdf

  18. Rodler, P.: On active learning strategies for sequential diagnosis. In: International Workshop on Principles of Diagnosis (DX 2017), pp. 264–283 (2018)

    Google Scholar 

  19. Rodler, P., Schekotihin, K.: Reducing model-based diagnosis to knowledge base debugging. In: International Workshop on Principles of Diagnosis (DX 2017), pp. 284–296 (2018)

    Google Scholar 

  20. Rodler, P., Schmid, W., Schekotihin, K.: A generally applicable, highly scalable measurement computation and optimization approach to sequential model-based diagnosis (2017). http://arxiv.org/abs/1711.05508

  21. Rodler, P., Schmid, W., Schekotihin, K.: Inexpensive cost-optimized measurement proposal for sequential model-based diagnosis. In: International Workshop on Principles of Diagnosis (DX 2017), pp. 200–218 (2018)

    Google Scholar 

  22. Rodler, P., Shchekotykhin, K., Fleiss, P., Friedrich, G.: RIO: minimizing user interaction in ontology debugging. In: Faber, W., Lembo, D. (eds.) RR 2013. LNCS, vol. 7994, pp. 153–167. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39666-3_12

    Chapter  Google Scholar 

  23. Roussey, C., Corcho, O., Vilches-Blázquez, L.M.: A catalogue of OWL ontology antipatterns. In: K-CAP 2009, pp. 205–206 (2009)

    Google Scholar 

  24. Schekotihin, K., Rodler, P., Schmid, W.: OntoDebug: interactive ontology debugging plug-in for Protégé. In: Ferrarotti, F., Woltran, S. (eds.) FoIKS 2018. LNCS, vol. 10833, pp. 340–359. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-90050-6_19

    Chapter  Google Scholar 

  25. Schlobach, S., Huang, Z., Cornet, R., Harmelen, F.: Debugging incoherent terminologies. J. Autom. Reason. 39(3), 317–349 (2007)

    Article  MathSciNet  Google Scholar 

  26. Settles, B.: Active Learning. Morgan and Claypool Publishers (2012)

    Google Scholar 

  27. Shchekotykhin, K., Friedrich, G., Fleiss, P., Rodler, P.: Interactive ontology debugging: two query strategies for efficient fault localization. JWS 12–13, 88–103 (2012)

    Article  Google Scholar 

  28. Shchekotykhin, K., Friedrich, G., Rodler, P., Fleiss, P.: Sequential diagnosis of high cardinality faults in knowledge-bases by direct diagnosis generation. In: ECAI 2014, pp. 813–818 (2014)

    Google Scholar 

  29. Stuckenschmidt, H.: Debugging OWL ontologies - a reality check. In: EON 2008, pp. 1–12 (2008)

    Google Scholar 

  30. Troquard, N., Confalonieri, R., Galliani, P., Penaloza, R., Porello, D., Kutz, O.: Repairing ontologies via axiom weakening (2017). http://arxiv.org/abs/1711.03430

Download references

Author information

Authors and Affiliations

  1. Alpen-Adria Universität Klagenfurt, 9020, Klagenfurt, Austria

    Patrick Rodler & Wolfgang Schmid

Authors
  1. Patrick Rodler
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wolfgang Schmid
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Patrick Rodler .

Editor information

Editors and Affiliations

  1. Computer Science, Freie Universität Berlin, Berlin, Germany

    Christoph Benzmüller

  2. University of Calabria, Rende, Italy

    Francesco Ricca

  3. Université du Luxembourg, Esch-sur-Alzette, Luxembourg

    Xavier Parent

  4. SINTEF/University of Oslo, Oslo, Norway

    Dumitru Roman

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Rodler, P., Schmid, W. (2018). On the Impact and Proper Use of Heuristics in Test-Driven Ontology Debugging. In: Benzmüller, C., Ricca, F., Parent, X., Roman, D. (eds) Rules and Reasoning. RuleML+RR 2018. Lecture Notes in Computer Science(), vol 11092. Springer, Cham. https://doi.org/10.1007/978-3-319-99906-7_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-99906-7_11

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-99905-0

  • Online ISBN: 978-3-319-99906-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation