skip to main content
10.1145/3539618.3591711acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
research-article

Learn from Relational Correlations and Periodic Events for Temporal Knowledge Graph Reasoning

Published: 18 July 2023 Publication History

Abstract

Reasoning on temporal knowledge graphs (TKGR), aiming to infer missing events along the timeline, has been widely studied to alleviate incompleteness issues in TKG, which is composed of a series of KG snapshots at different timestamps. Two types of information, i.e., intra-snapshot structural information and inter-snapshot temporal interactions, mainly contribute to the learned representations for reasoning in previous models. However, these models fail to leverage (1) semantic correlations between relationships for the former information and (2) the periodic temporal patterns along the timeline for the latter one. Thus, such insufficient mining manners hinder expressive ability, leading to sub-optimal performances. To address these limitations, we propose a novel reasoning model, termed RPC, which sufficiently mines the information underlying the Relational correlations and Periodic patterns via two novel Correspondence units, i.e., relational correspondence unit (RCU) and periodic correspondence unit (PCU). Concretely, relational graph convolutional network (RGCN) and RCU are used to encode the intra-snapshot graph structural information for entities and relations, respectively. Besides, the gated recurrent units (GRU) and PCU are designed for sequential and periodic inter-snapshot temporal interactions, separately. Moreover, the model-agnostic time vectors are generated by time2vector encoders to guide the time-dependent decoder for fact scoring. Extensive experiments on six benchmark datasets show that RPC outperforms the state-of-the-art TKGR models, and also demonstrate the effectiveness of two novel strategies in our model.

References

[1]
Wendong Bi, Bingbing Xu, Xiaoqian Sun, Zidong Wang, Huawei Shen, and Xueqi Cheng. 2022. Company-as-Tribe: Company Financial Risk Assessment on Tribe-Style Graph with Hierarchical Graph Neural Networks. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2712--2720.
[2]
Wendong Bi, Bingbing Xu, Xiaoqian Sun, Li Xu, Huawei Shen, and Xueqi Cheng. 2023. Predicting the Silent Majority on Graphs: Knowledge Transferable Graph Neural Network. arXiv preprint arXiv:2302.00873 (2023).
[3]
Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, and Oksana Yakhnenko. 2013. Translating embeddings for modeling multi-relational data. Proc. of NeurIPS (2013).
[4]
Dan Busbridge, Dane Sherburn, Pietro Cavallo, and Nils Y Hammerla. 2019. Relational Graph Attention Networks. (2019).
[5]
Jiaao Chen, Jianshu Chen, and Zhou Yu. 2019. Incorporating structured commonsense knowledge in story completion. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 6244--6251.
[6]
Jiajun Chen, Huarui He, Feng Wu, and Jie Wang. 2021. Topology-aware correlations between relations for inductive link prediction in knowledge graphs. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35. 6271--6278.
[7]
Wei-Yu Chiu, Gary G Yen, and Teng-Kuei Juan. 2016. Minimum manhattan distance approach to multiple criteria decision making in multiobjective optimization problems. IEEE Transactions on Evolutionary Computation, Vol. 20, 6 (2016), 972--985.
[8]
Shib Sankar Dasgupta, Swayambhu Nath Ray, and Partha Talukdar. 2018. Hyte: Hyperplane-based temporally aware knowledge graph embedding. In Proc. of EMNLP.
[9]
Alberto Garca-Duran, Sebastijan Dumancic, and Mathias Niepert. 2018. Learning Sequence Encoders for Temporal Knowledge Graph Completion. In EMNLP.
[10]
Alberto Garcia-Duran, Sebastijan Dumancic, and Mathias Niepert. 2018. Learning Sequence Encoders for Temporal Knowledge Graph Completion. In EMNLP.
[11]
Alberto García-Durán, Sebastijan Dumancic, and Mathias Niepert. 2018. Learning Sequence Encoders for Temporal Knowledge Graph Completion. In EMNLP.
[12]
Yuxia Geng, Jiaoyan Chen, Wen Zhang, Jeff Z Pan, Mingyang Chen, Huajun Chen, and Song Jiang. 2022. Relational Message Passing for Fully Inductive Knowledge Graph Completion. arXiv preprint arXiv:2210.03994 (2022).
[13]
Justin Gilmer, Samuel S Schoenholz, Patrick F Riley, Oriol Vinyals, and George E Dahl. 2017. Neural message passing for quantum chemistry. In International conference on machine learning. PMLR, 1263--1272.
[14]
John Clifford Gower. 1985. Properties of Euclidean and non-Euclidean distance matrices. Linear algebra and its applications, Vol. 67 (1985), 81--97.
[15]
Zhen Han, Peng Chen, Yunpu Ma, and Volker Tresp. 2020a. Explainable subgraph reasoning for forecasting on temporal knowledge graphs. In Proc. of ICLR.
[16]
Zhen Han, Zifeng Ding, Yunpu Ma, Yujia Gu, and Volker Tresp. 2021. Learning neural ordinary equations for forecasting future links on temporal knowledge graphs. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. 8352--8364.
[17]
Zhen Han, Yunpu Ma, Yuyi Wang, Stephan Günnemann, and Volker Tresp. 2020b. Graph hawkes neural network for forecasting on temporal knowledge graphs. arXiv preprint arXiv:2003.13432 (2020).
[18]
Yongquan He, Peng Zhang, Luchen Liu, Qi Liang, Wenyuan Zhang, and Chuang Zhang. 2021. HIP Network: Historical Information Passing Network for Extrapolation Reasoning on Temporal Knowledge Graph. In Proc. of IJCAI.
[19]
Woojeong Jin, Meng Qu, Xisen Jin, and Xiang Ren. 2019. Recurrent event network: Autoregressive structure inference over temporal knowledge graphs. arXiv preprint arXiv:1904.05530 (2019).
[20]
Seyed Mehran Kazemi, Rishab Goel, Sepehr Eghbali, Janahan Ramanan, Jaspreet Sahota, Sanjay Thakur, Stella Wu, Cathal Smyth, Pascal Poupart, and Marcus Brubaker. 2019. Time2vec: Learning a vector representation of time arXiv preprint arXiv:1907.05321 (2019).
[21]
Timothee Lacroix, Guillaume Obozinski, and Nicolas Usunier. 2019. Tensor Decompositions for Temporal Knowledge Base Completion. In Proc. of ICLR.
[22]
Liang Li, Siwei Wang, Xinwang Liu, En Zhu, Li Shen, Kenli Li, and Keqin Li. 2022c. Local Sample-Weighted Multiple Kernel Clustering With Consensus Discriminative Graph. IEEE Transactions on Neural Networks and Learning Systems (2022), 1--14. https://doi.org/10.1109/TNNLS.2022.3184970
[23]
Qian Li, Shu Guo, Yangyifei Luo, Cheng Ji, Lihong Wang, Jiawei Sheng, and Jianxin Li. 2023. Attribute-Consistent Knowledge Graph Representation Learning for Multi-Modal Entity Alignment. arXiv preprint arXiv:2304.01563 (2023).
[24]
Xingwang Li, Yijia Zhang, Jian Wang, Mingyu Lu, and Hongfei Lin. 2022d. Knowledge-Enhanced Dual Graph Neural Network for Robust Medicine Recommendation. In 2022 IEEE International Conference on Bioinformatics and Biomedicine (BIBM). IEEE, 477--482.
[25]
Yujia Li, Shiliang Sun, and Jing Zhao. 2022b. TiRGN Time-Guided Recurrent Graph Network with Local-Global Historical Patterns for Temporal Knowledge Graph Reasoning. ijcai22 (2022).
[26]
Zixuan Li, Saiping Guan, Xiaolong Jin, Weihua Peng, Yajuan Lyu, Yong Zhu, Long Bai, Wei Li, Jiafeng Guo, and Xueqi Cheng. 2022a. Complex Evolutional Pattern Learning for Temporal Knowledge Graph Reasoning. In Proc. of ACL.
[27]
Zixuan Li, Xiaolong Jin, Saiping Guan, Wei Li, Jiafeng Guo, Yuanzhuo Wang, and Xueqi Cheng. 2021a. Search from History and Reason for Future: Two-stage Reasoning on Temporal Knowledge Graphs. In ACL.
[28]
Zixuan Li, Xiaolong Jin, Wei Li, Saiping Guan, Jiafeng Guo, Huawei Shen, Yuanzhuo Wang, and Xueqi Cheng. 2021b. Temporal knowledge graph reasoning based on evolutional representation learning. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 408--417.
[29]
Zixuan Li, Xiaolong Jin, Wei Li, Saiping Guan, Jiafeng Guo, Huawei Shen, Yuanzhuo Wang, and Xueqi Cheng. 2021c. Temporal knowledge graph reasoning based on evolutional representation learning. In Proc. of SIGIR.
[30]
Ke Liang, Yue Liu, Sihang Zhou, Xinwang Liu, and Wenxuan Tu. 2022a. Relational Symmetry based Knowledge Graph Contrastive Learning.
[31]
Ke Liang, Lingyuan Meng, Meng Liu, Yue Liu, Wenxuan Tu, Siwei Wang, Sihang Zhou, Xinwang Liu, and Fuchun Sun. 2022b. Reasoning over Different Types of Knowledge Graphs: Static, Temporal and Multi-Modal. arXiv preprint arXiv:2212.05767 (2022).
[32]
Ke Liang, Sifan Wu, and Jiayi Gu. 2021. MKA: A Scalable Medical Knowledge-Assisted Mechanism for Generative Models on Medical Conversation Tasks. Computational and Mathematical Methods in Medicine, Vol. 2021.
[33]
Meng Liu and Yong Liu. 2021. Inductive representation learning in temporal networks via mining neighborhood and community influences. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2202--2206.
[34]
Meng Liu, Jiaming Wu, and Yong Liu. 2022b. Embedding global and local influences for dynamic graphs. In Proceedings of the 31st ACM International Conference on Information and Knowledge Management. 4249--4253.
[35]
Yue Liu, Wenxuan Tu, Sihang Zhou, Xinwang Liu, Linxuan Song, Xihong Yang, and En Zhu. 2022a. Deep graph clustering via dual correlation reduction. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 36. 7603--7611.
[36]
Yue Liu, Xihong Yang, Sihang Zhou, Xinwang Liu, Zhen Wang, Ke Liang, Wenxuan Tu, Liang Li, Jingcan Duan, and Cancan Chen. 2022c. Hard Sample Aware Network for Contrastive Deep Graph Clustering. arXiv preprint arXiv:2212.08665 (2022).
[37]
Zhenghao Liu, Chenyan Xiong, Maosong Sun, and Zhiyuan Liu. 2018. Entity-duet neural ranking: Understanding the role of knowledge graph semantics in neural information retrieval. arXiv preprint arXiv:1805.07591 (2018).
[38]
Namyong Park, Fuchen Liu, Purvanshi Mehta, Dana Cristofor, Christos Faloutsos, and Yuxiao Dong. 2022. EvoKG: Jointly Modeling Event Time and Network Structure for Reasoning over Temporal Knowledge Graphs. In Proc. of WSDM.
[39]
Ali Sadeghian, Miguel Rodriguez, Daisy Zhe Wang, and Anthony Colas. 2016. Temporal reasoning over event knowledge graphs. In Workshop on Knowledge Base Construction, Reasoning and Mining.
[40]
Michael Schlichtkrull, Thomas N Kipf, Peter Bloem, Rianne Van Den Berg, Ivan Titov, and Max Welling. 2018. Modeling relational data with graph convolutional networks. In The Semantic Web: 15th International Conference, ESWC 2018, Heraklion, Crete, Greece, June 3-7, 2018, Proceedings 15. Springer, 593--607.
[41]
Youngjoo Seo, Michaël Defferrard, Pierre Vandergheynst, and Xavier Bresson. 2018. Structured sequence modeling with graph convolutional recurrent networks. In International conference on neural information processing. Springer, 362--373.
[42]
Chao Shang, Yun Tang, Jing Huang, Jinbo Bi, Xiaodong He, and Bowen Zhou. 2019. End-to-end structure-aware convolutional networks for knowledge base completion. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 3060--3067.
[43]
Haohai Sun, Jialun Zhong, Yunpu Ma, Zhen Han, and Kun He. 2021. TimeTraveler: Reinforcement Learning for Temporal Knowledge Graph Forecasting. In Proc. of EMNLP.
[44]
Komal Teru, Etienne Denis, and Will Hamilton. 2020. Inductive relation prediction by subgraph reasoning. In Proc. of ICML.
[45]
Rakshit Trivedi, Hanjun Dai, Yichen Wang, and Le Song. 2017. Know-evolve: Deep temporal reasoning for dynamic knowledge graphs. In international conference on machine learning. PMLR, 3462--3471.
[46]
Rakshit Trivedi, Mehrdad Farajtabar, Prasenjeet Biswal, and Hongyuan Zha. 2019. Dyrep: Learning representations over dynamic graphs. In International conference on learning representations.
[47]
Wenxuan Tu, Sihang Zhou, Xinwang Liu, Xifeng Guo, Zhiping Cai, En Zhu, and Jieren Cheng. 2021. Deep Fusion Clustering Network. In Proceedings of The Thirty-Fifth AAAI Conference on Artificial Intelligence. 9978--9987.
[48]
Hongwei Wang, Fuzheng Zhang, Jialin Wang, Miao Zhao, Wenjie Li, Xing Xie, and Minyi Guo. 2018. Ripplenet: Propagating user preferences on the knowledge graph for recommender systems. In Proceedings of the 27th ACM international conference on information and knowledge management. 417--426.
[49]
Lei Wang, Ee-Peng Lim, Zhiwei Liu, and Tianxiang Zhao. 2022. Explanation guided contrastive learning for sequential recommendation. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 2017--2027.
[50]
Jiapeng Wu, Yishi Xu, Yingxue Zhang, Chen Ma, Mark Coates, and Jackie Chi Kit Cheung. 2021. Tie: A framework for embedding-based incremental temporal knowledge graph completion. In Proc. of SIGIR.
[51]
Chengjin Xu, Yung-Yu Chen, Mojtaba Nayyeri, and Jens Lehmann. 2021. Temporal knowledge graph completion using a linear temporal regularizer and multivector embeddings. In Proc. of NAACL.
[52]
Chenjin Xu, Mojtaba Nayyeri, Fouad Alkhoury, Hamed Yazdi, and Jens Lehmann. 2020. Temporal knowledge graph completion based on time series gaussian embedding. In Proc. of ISWC.
[53]
Fuwei Zhang, Zhao Zhang, Xiang Ao, Fuzhen Zhuang, Yongjun Xu, and Qing He. 2022. Along the Time: Timeline-traced Embedding for Temporal Knowledge Graph Completion. In Proc. of CIKM.
[54]
Mingda Zhang, Keren Ye, Rebecca Hwa, and Adriana Kovashka. 2020. Story completion with explicit modeling of commonsense knowledge. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. 376--377.
[55]
Yingying Zhang, Xian Wu, Quan Fang, Shengsheng Qian, and Changsheng Xu. 2023. Knowledge-enhanced attributed multi-task learning for medicine recommendation. ACM Transactions on Information Systems, Vol. 41, 1 (2023), 1--24.
[56]
Shan Zhao, Minghao Hu, Zhiping Cai, and Fang Liu. 2020. Modeling Dense Cross-Modal Interactions for Joint Entity-Relation Extraction. In Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence. 4032--4038.
[57]
Cunchao Zhu, Muhao Chen, Changjun Fan, Guangquan Cheng, and Yan Zhang. 2021. Learning from history: Modeling temporal knowledge graphs with sequential copy-generation networks. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35. 4732--4740.

Cited By

View all
  • (2025)One-Step Multi-View Clustering With Diverse RepresentationIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2024.337819436:3(5774-5786)Online publication date: Mar-2025
  • (2025)ATPF: An Adaptive Temporal Perturbation Framework for Adversarial Attacks on Temporal Knowledge GraphIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.351068937:3(1091-1104)Online publication date: Mar-2025
  • (2025)PUMA: Efficient Continual Graph Learning for Node Classification With Graph CondensationIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.348569137:1(449-461)Online publication date: 1-Jan-2025
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGIR '23: Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval
July 2023
3567 pages
ISBN:9781450394086
DOI:10.1145/3539618
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 July 2023

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. extrapolation relation reasoning
  2. graph learning
  3. temporal knowledge graph reasoning

Qualifiers

  • Research-article

Funding Sources

  • National Key R&D Program of China

Conference

SIGIR '23
Sponsor:

Acceptance Rates

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)645
  • Downloads (Last 6 weeks)44
Reflects downloads up to 01 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2025)One-Step Multi-View Clustering With Diverse RepresentationIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2024.337819436:3(5774-5786)Online publication date: Mar-2025
  • (2025)ATPF: An Adaptive Temporal Perturbation Framework for Adversarial Attacks on Temporal Knowledge GraphIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.351068937:3(1091-1104)Online publication date: Mar-2025
  • (2025)PUMA: Efficient Continual Graph Learning for Node Classification With Graph CondensationIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.348569137:1(449-461)Online publication date: 1-Jan-2025
  • (2025)A rule- and query-guided reinforcement learning for extrapolation reasoning in temporal knowledge graphsNeural Networks10.1016/j.neunet.2025.107186185(107186)Online publication date: May-2025
  • (2025)ALPPA: An accuracy-lossless and privacy-preserving aggregation strategy for federated knowledge graph completion modelNeurocomputing10.1016/j.neucom.2025.129693630(129693)Online publication date: May-2025
  • (2025)RTA: A reinforcement learning-based temporal knowledge graph question answering modelNeurocomputing10.1016/j.neucom.2024.128994617(128994)Online publication date: Feb-2025
  • (2025)RE-SEGNN: recurrent semantic evidence-aware graph neural network for temporal knowledge graph forecastingScience China Information Sciences10.1007/s11432-023-4073-y68:2Online publication date: 8-Jan-2025
  • (2024)Unleashing the Power of Decoders: Temporal Knowledge Graph Extrapolation with Householder TransformationSymmetry10.3390/sym1609116616:9(1166)Online publication date: 6-Sep-2024
  • (2024)Temporal knowledge graph extrapolation via causal subhistory identificationProceedings of the Thirty-Third International Joint Conference on Artificial Intelligence10.24963/ijcai.2024/365(3298-3306)Online publication date: 3-Aug-2024
  • (2024)LLM-based multi-level knowledge generation for few-shot knowledge graph completionProceedings of the Thirty-Third International Joint Conference on Artificial Intelligence10.24963/ijcai.2024/236(2135-2143)Online publication date: 3-Aug-2024
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media