skip to main content
10.1145/3589334.3645648acmconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
research-article
Open access

Dual Box Embeddings for the Description Logic EL++

Published: 13 May 2024 Publication History

Abstract

OWL ontologies, whose formal semantics are rooted in Description Logic (DL), have been widely used for knowledge representation. Similar to Knowledge Graphs (KGs), ontologies are often incomplete, and maintaining and constructing them has proved challenging. While classical deductive reasoning algorithms use the precise formal semantics of an ontology to predict missing facts, recent years have witnessed growing interest in inductive reasoning techniques that can derive probable facts from an ontology. Similar to KGs, a promising approach is to learn ontology embeddings in a latent vector space, while additionally ensuring they adhere to the semantics of the underlying DL. While a variety of approaches have been proposed, current ontology embedding methods suffer from several shortcomings, especially that they all fail to faithfully model one-to-many, many-to-one, and many-to-many relations and role inclusion axioms. To address this problem and improve ontology completion performance, we propose a novel ontology embedding method named Box2EL for the DL EL++, which represents both concepts and roles as boxes (i.e., axis-aligned hyperrectangles), and models inter-concept relationships using a bumping mechanism. We theoretically prove the soundness of Box2EL and conduct an extensive experimental evaluation, achieving state-of-the-art results across a variety of datasets on the tasks of subsumption prediction, role assertion prediction, and approximating deductive reasoning.

Supplemental Material

MP4 File
video presentation
MP4 File
Supplemental video

References

[1]
Ralph Abboud, .Ismail. Ilkan Ceylan, Thomas Lukasiewicz, and Tommaso Salvatori. 2020. BoxE : A Box Embedding Model for Knowledge Base Completion. In Advances in Neural Information Processing Systems, Vol. 33. 9649--9661.
[2]
Michael Ashburner, Catherine A Ball, Judith A Blake, David Botstein, Heather Butler, J Michael Cherry, Allan P Davis, Kara Dolinski, Selina S Dwight, Janan T Eppig, et al. 2000. Gene ontology: tool for the unification of biology. Nature genetics, Vol. 25, 1 (2000), 25--29.
[3]
Franz Baader, Sebastian Brandt, and Carsten Lutz. 2005 a. Pushing the EL envelope. In Proceedings of the Nineteenth International Joint Conference on Artificial Intelligence, Vol. 5. 364--369.
[4]
Franz Baader, Sebastian Brandt, and Carsten Lutz. 2005 b. Pushing the EL Envelope. LTCS-Report LTCS-05-01. Institute for Theoretical Computer Science, TU Dresden. http://lat.inf.tu-dresden.de/research/reports.html
[5]
Franz Baader, Ian Horrocks, and Ulrike Sattler. 2005 c. Description logics as ontology languages for the semantic web. In Mechanizing mathematical reasoning. Springer, 228--248.
[6]
Garrett Birkhoff and John Von Neumann. 1936. The Logic of Quantum Mechanics. Annals of Mathematics, Vol. 37, 4 (1936), 823--843. showeprint[jstor]1968621
[7]
Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, and Oksana Yakhnenko. 2013. Translating Embeddings for Modeling Multi-relational Data. In Advances in Neural Information Processing Systems, Vol. 26.
[8]
Jiaoyan Chen, Yuan He, Yuxia Geng, Ernesto Jiménez-Ruiz, Hang Dong, and Ian Horrocks. 2023. Contextual semantic embeddings for ontology subsumption prediction. World Wide Web (2023), 1--23.
[9]
Jiaoyan Chen, Pan Hu, Ernesto Jimenez-Ruiz, Ole Magnus Holter, Denvar Antonyrajah, and Ian Horrocks. 2021. OWL2Vec*: Embedding of OWL ontologies. Machine Learning, Vol. 110, 7 (2021), 1813--1845.
[10]
Damion M. Dooley, Emma J. Griffiths, Gurinder S. Gosal, Pier L. Buttigieg, Robert Hoehndorf, Matthew C. Lange, Lynn M. Schriml, Fiona S. L. Brinkman, and William W. L. Hsiao. 2018. FoodOn : A Harmonized Food Ontology to Increase Global Food Traceability, Quality Control and Data Integration. npj Science of Food, Vol. 2, 1 (Dec. 2018), 23.
[11]
Dinesh Garg, Shajith Ikbal, Santosh K Srivastava, Harit Vishwakarma, Hima Karanam, and L Venkata Subramaniam. 2019. Quantum embedding of knowledge for reasoning. Advances in Neural Information Processing Systems, Vol. 32 (2019).
[12]
Birte Glimm, Ian Horrocks, Boris Motik, Giorgos Stoilos, and Zhe Wang. 2014. HermiT : An OWL 2 Reasoner. Journal of Automated Reasoning, Vol. 53, 3 (2014), 245--269.
[13]
Bernardo Cuenca Grau, Ian Horrocks, Boris Motik, Bijan Parsia, Peter Patel-Schneider, and Ulrike Sattler. 2008. OWL 2: The next Step for OWL. Journal of Web Semantics, Vol. 6, 4 (2008), 309--322.
[14]
Shu Guo, Quan Wang, Lihong Wang, Bin Wang, and Li Guo. 2016. Jointly Embedding Knowledge Graphs and Logical Rules. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. 192--202.
[15]
Junheng Hao, Muhao Chen, Wenchao Yu, Yizhou Sun, and Wei Wang. 2019. Universal representation learning of knowledge bases by jointly embedding instances and ontological concepts. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 1709--1719.
[16]
Mihá ly Hé der. 2014. Semantic Web for the Working Ontologist, Second edition: Effective modeling in RDFS and OWL. Knowl. Eng. Rev., Vol. 29, 3 (2014), 404--405.
[17]
Robert Hoehndorf, Michel Dumontier, Anika Oellrich, Sarala Wimalaratne, Dietrich Rebholz-Schuhmann, Paul Schofield, and Georgios V. Gkoutos. 2011. A Common Layer of Interoperability for Biomedical Ontologies Based on OWL EL. Bioinformatics, Vol. 27, 7 (April 2011), 1001--1008.
[18]
Aidan Hogan, Eva Blomqvist, Michael Cochez, Claudia d'Amato, Gerard de Melo, Claudio Gutierrez, Sabrina Kirrane, José Emilio Labra Gayo, Roberto Navigli, Sebastian Neumaier, et al. 2021. Knowledge graphs. ACM Computing Surveys (CSUR), Vol. 54, 4 (2021), 1--37.
[19]
Yevgeny Kazakov, Markus Krötzsch, and Frantiv sek Simanv cík. 2014. The Incredible ELK. Journal of Automated Reasoning, Vol. 53, 1 (2014), 1--61.
[20]
Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In 3rd International Conference on Learning Representations.
[21]
Markus Krötzsch. 2012. OWL 2 Profiles : An Introduction to Lightweight Ontology Languages. In Reasoning Web. Semantic Technologies for Advanced Query Answering. Reasoning Web 2012. Vol. 7487. 112--183.
[22]
Maxat Kulmanov, Wang Liu-Wei, Yuan Yan, and Robert Hoehndorf. 2019. EL Embeddings: Geometric Construction of Models for the Description Logic EL. In Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence. 6103--6109.
[23]
Yankai Lin, Zhiyuan Liu, Maosong Sun, Yang Liu, and Xuan Zhu. 2015. Learning Entity and Relation Embeddings for Knowledge Graph Completion. In Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence. 2181--2187.
[24]
Julian Mendez. 2012. Jcel: A Modular Rule-Based Reasoner. In Proceedings of the 1st International Workshop on OWL Reasoner Evaluation, Vol. 858.
[25]
Sutapa Mondal, Sumit Bhatia, and Raghava Mutharaju. 2021. EmEL : Embeddings for el Description Logic. In Proceedings of the AAAI 2021 Spring Symposium on Combining Machine Learning and Knowledge Engineering (CEUR Workshop Proceedings, Vol. 2846).
[26]
Christopher J. Mungall, Carlo Torniai, Georgios V. Gkoutos, Suzanna E. Lewis, and Melissa A. Haendel. 2012. Uberon, an Integrative Multi-Species Anatomy Ontology. Genome Biology, Vol. 13, 1 (2012), R5.
[27]
Mojtaba Nayyeri, Chengjin Xu, Mirza Mohtashim Alam, Jens Lehmann, and Hamed Shariat Yazdi. 2021. LogicENN : A Neural Based Knowledge Graphs Embedding Model with Logical Rules. IEEE Transactions on Pattern Analysis and Machine Intelligence (2021).
[28]
Mojtaba Nayyeri, Chengjin Xu, Sahar Vahdati, Nadezhda Vassilyeva, Emanuel Sallinger, Hamed Shariat Yazdi, and Jens Lehmann. 2020. Fantastic Knowledge Graph Embeddings and How to Find the Right Space for Them. In The Semantic Web. 438--455.
[29]
Özgür Lütfü Özc cep, Mena Leemhuis, and Diedrich Wolter. 2020. Cone Semantics for Logics with Negation. In Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, Vol. 2. 1820--1826.
[30]
Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Kopf, Edward Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala. 2019. PyTorch : An Imperative Style, High-Performance Deep Learning Library. In Advances in Neural Information Processing Systems, Vol. 32. 8024--8035.
[31]
Xi Peng, Zhenwei Tang, Maxat Kulmanov, Kexin Niu, and Robert Hoehndorf. 2022. Description Logic EL Embeddings with Intersectional Closure. arxiv: 2202.14018
[32]
Alan L Rector, Jeremy E Rogers, and Pam Pole. 1996. The GALEN high level ontology. In Medical Informatics Europe '96. IOS Press, 174--178.
[33]
Tim Rockt"aschel, Sameer Singh, and Sebastian Riedel. 2015. Injecting Logical Background Knowledge into Embeddings for Relation Extraction. In Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics : Human Language Technologies. 1119--1129.
[34]
Stefan Schulz, Boontawee Suntisrivaraporn, Franz Baader, and Martin Boeker. 2009. SNOMED Reaching Its Adolescence: Ontologists ' and Logicians' Health Check. International Journal of Medical Informatics, Vol. 78 (April 2009), S86--S94.
[35]
Fatima Zohra Smaili, Xin Gao, and Robert Hoehndorf. 2019. OPA2Vec: Combining formal and informal content of biomedical ontologies to improve similarity-based prediction. Bioinformatics, Vol. 35, 12 (2019), 2133--2140.
[36]
Barry Smith, Michael Ashburner, Cornelius Rosse, Jonathan Bard, William Bug, Werner Ceusters, Louis J Goldberg, Karen Eilbeck, Amelia Ireland, Christopher J Mungall, et al. 2007. The OBO Foundry: coordinated evolution of ontologies to support biomedical data integration. Nature biotechnology, Vol. 25, 11 (2007), 1251--1255.
[37]
Steffen Staab and Rudi Studer. 2010. Handbook on ontologies. Springer Science & Business Media.
[38]
Damian Szklarczyk, Annika L Gable, Katerina C Nastou, David Lyon, Rebecca Kirsch, Sampo Pyysalo, Nadezhda T Doncheva, Marc Legeay, Tao Fang, Peer Bork, Lars J Jensen, and Christian von Mering. 2021. The STRING Database in 2021: Customizable Proteintextendash Protein Networks, and Functional Characterization of User-Uploaded Gene/Measurement Sets. Nucleic Acids Research, Vol. 49, D1 (2021), D605--D612.
[39]
Théo Trouillon, Johannes Welbl, Sebastian Riedel, Eric Gaussier, and Guillaume Bouchard. 2016. Complex Embeddings for Simple Link Prediction. In Proceedings of The 33rd International Conference on Machine Learning. PMLR, 2071--2080.
[40]
Quan Wang, Zhendong Mao, Bin Wang, and Li Guo. 2017. Knowledge graph embedding: A survey of approaches and applications. IEEE Transactions on Knowledge and Data Engineering, Vol. 29, 12 (2017), 2724--2743.
[41]
Quan Wang, Bin Wang, and Li Guo. 2015. Knowledge Base Completion Using Embeddings and Rules. In Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence.
[42]
Zhen Wang, Jianwen Zhang, Jianlin Feng, and Zheng Chen. 2014. Knowledge graph embedding by translating on hyperplanes. In Proceedings of the AAAI conference on artificial intelligence, Vol. 28.
[43]
Yuejia Xiang, Ziheng Zhang, Jiaoyan Chen, Xi Chen, Zhenxi Lin, and Yefeng Zheng. 2021. OntoEA: Ontology-guided Entity Alignment via Joint Knowledge Graph Embedding. In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021. 1117--1128.
[44]
Bo Xiong, Nico Potyka, Trung-Kien Tran, Mojtaba Nayyeri, and Steffen Staab. 2022. Faithful Embeddings for el Knowledge Bases. In Proceedings of the 21st International Semantic Web Conference, Vol. 13489. 22--38.
[45]
Bishan Yang, Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao, and Li Deng. 2015. Embedding Entities and Relations for Learning and Inference in Knowledge Bases. In Proceedings of the International Conference on Learning Representations.
[46]
Xiaofang Zhai, Lei Huang, and Zhifeng Xiao. 2010. Geo-spatial query based on extended SPARQL. In 2010 18th International Conference on Geoinformatics. 1--4.

Cited By

View all
  • (2024)FaithEL: Strongly TBox Faithful Knowledge Base Embeddings for Rules and Reasoning10.1007/978-3-031-72407-7_14(191-199)Online publication date: 17-Sep-2024
  • (2024)Lattice-Preserving $$\mathcal {ALC}$$ Ontology EmbeddingsNeural-Symbolic Learning and Reasoning10.1007/978-3-031-71167-1_19(355-369)Online publication date: 10-Sep-2024
  • (2024)Enhancing Geometric Ontology Embeddings for  with Negative Sampling and Deductive Closure FilteringNeural-Symbolic Learning and Reasoning10.1007/978-3-031-71167-1_18(331-354)Online publication date: 9-Sep-2024

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
WWW '24: Proceedings of the ACM Web Conference 2024
May 2024
4826 pages
ISBN:9798400701719
DOI:10.1145/3589334
This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 May 2024

Check for updates

Author Tags

  1. description logic
  2. link prediction
  3. ontology completion
  4. ontology embedding
  5. web ontology language

Qualifiers

  • Research-article

Funding Sources

Conference

WWW '24
Sponsor:
WWW '24: The ACM Web Conference 2024
May 13 - 17, 2024
Singapore, Singapore

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)334
  • Downloads (Last 6 weeks)47
Reflects downloads up to 05 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2024)FaithEL: Strongly TBox Faithful Knowledge Base Embeddings for Rules and Reasoning10.1007/978-3-031-72407-7_14(191-199)Online publication date: 17-Sep-2024
  • (2024)Lattice-Preserving $$\mathcal {ALC}$$ Ontology EmbeddingsNeural-Symbolic Learning and Reasoning10.1007/978-3-031-71167-1_19(355-369)Online publication date: 10-Sep-2024
  • (2024)Enhancing Geometric Ontology Embeddings for  with Negative Sampling and Deductive Closure FilteringNeural-Symbolic Learning and Reasoning10.1007/978-3-031-71167-1_18(331-354)Online publication date: 9-Sep-2024

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media