Ke Liang
ABSTRACT
Reasoning on temporal knowledge graphs (TKGR), aiming to infer missing events along the timeline, has been widely studied to alleviate incompleteness issues in TKG, which is composed of a series of KG snapshots at different timestamps. Two types of information, i.e., intra-snapshot structural information and inter-snapshot temporal interactions, mainly contribute to the learned representations for reasoning in previous models. However, these models fail to leverage (1) semantic correlations between relationships for the former information and (2) the periodic temporal patterns along the timeline for the latter one. Thus, such insufficient mining manners hinder expressive ability, leading to sub-optimal performances. To address these limitations, we propose a novel reasoning model, termed RPC, which sufficiently mines the information underlying the Relational correlations and Periodic patterns via two novel Correspondence units, i.e., relational correspondence unit (RCU) and periodic correspondence unit (PCU). Concretely, relational graph convolutional network (RGCN) and RCU are used to encode the intra-snapshot graph structural information for entities and relations, respectively. Besides, the gated recurrent units (GRU) and PCU are designed for sequential and periodic inter-snapshot temporal interactions, separately. Moreover, the model-agnostic time vectors are generated by time2vector encoders to guide the time-dependent decoder for fact scoring. Extensive experiments on six benchmark datasets show that RPC outperforms the state-of-the-art TKGR models, and also demonstrate the effectiveness of two novel strategies in our model.
- Wendong Bi, Bingbing Xu, Xiaoqian Sun, Zidong Wang, Huawei Shen, and Xueqi Cheng. 2022. Company-as-Tribe: Company Financial Risk Assessment on Tribe-Style Graph with Hierarchical Graph Neural Networks. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2712--2720.Google Scholar
Digital Library
- Wendong Bi, Bingbing Xu, Xiaoqian Sun, Li Xu, Huawei Shen, and Xueqi Cheng. 2023. Predicting the Silent Majority on Graphs: Knowledge Transferable Graph Neural Network. arXiv preprint arXiv:2302.00873 (2023).Google Scholar
- Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, and Oksana Yakhnenko. 2013. Translating embeddings for modeling multi-relational data. Proc. of NeurIPS (2013).Google Scholar
- Dan Busbridge, Dane Sherburn, Pietro Cavallo, and Nils Y Hammerla. 2019. Relational Graph Attention Networks. (2019).Google Scholar
- Jiaao Chen, Jianshu Chen, and Zhou Yu. 2019. Incorporating structured commonsense knowledge in story completion. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 6244--6251.Google ScholarDigital Library
- Jiajun Chen, Huarui He, Feng Wu, and Jie Wang. 2021. Topology-aware correlations between relations for inductive link prediction in knowledge graphs. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35. 6271--6278.Google ScholarCross Ref
- Wei-Yu Chiu, Gary G Yen, and Teng-Kuei Juan. 2016. Minimum manhattan distance approach to multiple criteria decision making in multiobjective optimization problems. IEEE Transactions on Evolutionary Computation, Vol. 20, 6 (2016), 972--985.Google ScholarCross Ref
- Shib Sankar Dasgupta, Swayambhu Nath Ray, and Partha Talukdar. 2018. Hyte: Hyperplane-based temporally aware knowledge graph embedding. In Proc. of EMNLP.Google ScholarCross Ref
- Alberto Garca-Duran, Sebastijan Dumancic, and Mathias Niepert. 2018. Learning Sequence Encoders for Temporal Knowledge Graph Completion. In EMNLP.Google Scholar
- Alberto Garcia-Duran, Sebastijan Dumancic, and Mathias Niepert. 2018. Learning Sequence Encoders for Temporal Knowledge Graph Completion. In EMNLP.Google Scholar
- Alberto García-Durán, Sebastijan Dumancic, and Mathias Niepert. 2018. Learning Sequence Encoders for Temporal Knowledge Graph Completion. In EMNLP.Google Scholar
- Yuxia Geng, Jiaoyan Chen, Wen Zhang, Jeff Z Pan, Mingyang Chen, Huajun Chen, and Song Jiang. 2022. Relational Message Passing for Fully Inductive Knowledge Graph Completion. arXiv preprint arXiv:2210.03994 (2022).Google Scholar
- Justin Gilmer, Samuel S Schoenholz, Patrick F Riley, Oriol Vinyals, and George E Dahl. 2017. Neural message passing for quantum chemistry. In International conference on machine learning. PMLR, 1263--1272.Google Scholar
- John Clifford Gower. 1985. Properties of Euclidean and non-Euclidean distance matrices. Linear algebra and its applications, Vol. 67 (1985), 81--97.Google Scholar
- Zhen Han, Peng Chen, Yunpu Ma, and Volker Tresp. 2020a. Explainable subgraph reasoning for forecasting on temporal knowledge graphs. In Proc. of ICLR.Google Scholar
- Zhen Han, Zifeng Ding, Yunpu Ma, Yujia Gu, and Volker Tresp. 2021. Learning neural ordinary equations for forecasting future links on temporal knowledge graphs. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. 8352--8364.Google ScholarCross Ref
- Zhen Han, Yunpu Ma, Yuyi Wang, Stephan Günnemann, and Volker Tresp. 2020b. Graph hawkes neural network for forecasting on temporal knowledge graphs. arXiv preprint arXiv:2003.13432 (2020).Google Scholar
- Yongquan He, Peng Zhang, Luchen Liu, Qi Liang, Wenyuan Zhang, and Chuang Zhang. 2021. HIP Network: Historical Information Passing Network for Extrapolation Reasoning on Temporal Knowledge Graph.. In Proc. of IJCAI.Google ScholarCross Ref
- Woojeong Jin, Meng Qu, Xisen Jin, and Xiang Ren. 2019. Recurrent event network: Autoregressive structure inference over temporal knowledge graphs. arXiv preprint arXiv:1904.05530 (2019).Google Scholar
- Seyed Mehran Kazemi, Rishab Goel, Sepehr Eghbali, Janahan Ramanan, Jaspreet Sahota, Sanjay Thakur, Stella Wu, Cathal Smyth, Pascal Poupart, and Marcus Brubaker. 2019. Time2vec: Learning a vector representation of time arXiv preprint arXiv:1907.05321 (2019).Google Scholar
- Timothee Lacroix, Guillaume Obozinski, and Nicolas Usunier. 2019. Tensor Decompositions for Temporal Knowledge Base Completion. In Proc. of ICLR.Google Scholar
- Liang Li, Siwei Wang, Xinwang Liu, En Zhu, Li Shen, Kenli Li, and Keqin Li. 2022c. Local Sample-Weighted Multiple Kernel Clustering With Consensus Discriminative Graph. IEEE Transactions on Neural Networks and Learning Systems (2022), 1--14. https://doi.org/10.1109/TNNLS.2022.3184970Google ScholarCross Ref
- Qian Li, Shu Guo, Yangyifei Luo, Cheng Ji, Lihong Wang, Jiawei Sheng, and Jianxin Li. 2023. Attribute-Consistent Knowledge Graph Representation Learning for Multi-Modal Entity Alignment. arXiv preprint arXiv:2304.01563 (2023).Google Scholar
- Xingwang Li, Yijia Zhang, Jian Wang, Mingyu Lu, and Hongfei Lin. 2022d. Knowledge-Enhanced Dual Graph Neural Network for Robust Medicine Recommendation. In 2022 IEEE International Conference on Bioinformatics and Biomedicine (BIBM). IEEE, 477--482.Google Scholar
- Yujia Li, Shiliang Sun, and Jing Zhao. 2022b. TiRGN Time-Guided Recurrent Graph Network with Local-Global Historical Patterns for Temporal Knowledge Graph Reasoning. ijcai22 (2022).Google Scholar
- Zixuan Li, Saiping Guan, Xiaolong Jin, Weihua Peng, Yajuan Lyu, Yong Zhu, Long Bai, Wei Li, Jiafeng Guo, and Xueqi Cheng. 2022a. Complex Evolutional Pattern Learning for Temporal Knowledge Graph Reasoning. In Proc. of ACL.Google ScholarCross Ref
- Zixuan Li, Xiaolong Jin, Saiping Guan, Wei Li, Jiafeng Guo, Yuanzhuo Wang, and Xueqi Cheng. 2021a. Search from History and Reason for Future: Two-stage Reasoning on Temporal Knowledge Graphs. In ACL.Google Scholar
- Zixuan Li, Xiaolong Jin, Wei Li, Saiping Guan, Jiafeng Guo, Huawei Shen, Yuanzhuo Wang, and Xueqi Cheng. 2021b. Temporal knowledge graph reasoning based on evolutional representation learning. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 408--417.Google ScholarDigital Library
- Zixuan Li, Xiaolong Jin, Wei Li, Saiping Guan, Jiafeng Guo, Huawei Shen, Yuanzhuo Wang, and Xueqi Cheng. 2021c. Temporal knowledge graph reasoning based on evolutional representation learning. In Proc. of SIGIR.Google ScholarDigital Library
- Ke Liang, Yue Liu, Sihang Zhou, Xinwang Liu, and Wenxuan Tu. 2022a. Relational Symmetry based Knowledge Graph Contrastive Learning.Google Scholar
- Ke Liang, Lingyuan Meng, Meng Liu, Yue Liu, Wenxuan Tu, Siwei Wang, Sihang Zhou, Xinwang Liu, and Fuchun Sun. 2022b. Reasoning over Different Types of Knowledge Graphs: Static, Temporal and Multi-Modal. arXiv preprint arXiv:2212.05767 (2022).Google Scholar
- Ke Liang, Sifan Wu, and Jiayi Gu. 2021. MKA: A Scalable Medical Knowledge-Assisted Mechanism for Generative Models on Medical Conversation Tasks. Computational and Mathematical Methods in Medicine, Vol. 2021.Google ScholarCross Ref
- Meng Liu and Yong Liu. 2021. Inductive representation learning in temporal networks via mining neighborhood and community influences. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2202--2206.Google ScholarDigital Library
- Meng Liu, Jiaming Wu, and Yong Liu. 2022b. Embedding global and local influences for dynamic graphs. In Proceedings of the 31st ACM International Conference on Information and Knowledge Management. 4249--4253.Google ScholarDigital Library
- Yue Liu, Wenxuan Tu, Sihang Zhou, Xinwang Liu, Linxuan Song, Xihong Yang, and En Zhu. 2022a. Deep graph clustering via dual correlation reduction. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 36. 7603--7611.Google ScholarCross Ref
- Yue Liu, Xihong Yang, Sihang Zhou, Xinwang Liu, Zhen Wang, Ke Liang, Wenxuan Tu, Liang Li, Jingcan Duan, and Cancan Chen. 2022c. Hard Sample Aware Network for Contrastive Deep Graph Clustering. arXiv preprint arXiv:2212.08665 (2022).Google Scholar
- Zhenghao Liu, Chenyan Xiong, Maosong Sun, and Zhiyuan Liu. 2018. Entity-duet neural ranking: Understanding the role of knowledge graph semantics in neural information retrieval. arXiv preprint arXiv:1805.07591 (2018).Google Scholar
- Namyong Park, Fuchen Liu, Purvanshi Mehta, Dana Cristofor, Christos Faloutsos, and Yuxiao Dong. 2022. EvoKG: Jointly Modeling Event Time and Network Structure for Reasoning over Temporal Knowledge Graphs. In Proc. of WSDM.Google ScholarDigital Library
- Ali Sadeghian, Miguel Rodriguez, Daisy Zhe Wang, and Anthony Colas. 2016. Temporal reasoning over event knowledge graphs. In Workshop on Knowledge Base Construction, Reasoning and Mining.Google Scholar
- Michael Schlichtkrull, Thomas N Kipf, Peter Bloem, Rianne Van Den Berg, Ivan Titov, and Max Welling. 2018. Modeling relational data with graph convolutional networks. In The Semantic Web: 15th International Conference, ESWC 2018, Heraklion, Crete, Greece, June 3-7, 2018, Proceedings 15. Springer, 593--607.Google ScholarDigital Library
- Youngjoo Seo, Michaël Defferrard, Pierre Vandergheynst, and Xavier Bresson. 2018. Structured sequence modeling with graph convolutional recurrent networks. In International conference on neural information processing. Springer, 362--373.Google ScholarDigital Library
- Chao Shang, Yun Tang, Jing Huang, Jinbo Bi, Xiaodong He, and Bowen Zhou. 2019. End-to-end structure-aware convolutional networks for knowledge base completion. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 3060--3067.Google ScholarDigital Library
- Haohai Sun, Jialun Zhong, Yunpu Ma, Zhen Han, and Kun He. 2021. TimeTraveler: Reinforcement Learning for Temporal Knowledge Graph Forecasting. In Proc. of EMNLP.Google ScholarCross Ref
- Komal Teru, Etienne Denis, and Will Hamilton. 2020. Inductive relation prediction by subgraph reasoning. In Proc. of ICML.Google Scholar
- Rakshit Trivedi, Hanjun Dai, Yichen Wang, and Le Song. 2017. Know-evolve: Deep temporal reasoning for dynamic knowledge graphs. In international conference on machine learning. PMLR, 3462--3471.Google Scholar
- Rakshit Trivedi, Mehrdad Farajtabar, Prasenjeet Biswal, and Hongyuan Zha. 2019. Dyrep: Learning representations over dynamic graphs. In International conference on learning representations.Google Scholar
- Wenxuan Tu, Sihang Zhou, Xinwang Liu, Xifeng Guo, Zhiping Cai, En Zhu, and Jieren Cheng. 2021. Deep Fusion Clustering Network. In Proceedings of The Thirty-Fifth AAAI Conference on Artificial Intelligence. 9978--9987.Google ScholarCross Ref
- Hongwei Wang, Fuzheng Zhang, Jialin Wang, Miao Zhao, Wenjie Li, Xing Xie, and Minyi Guo. 2018. Ripplenet: Propagating user preferences on the knowledge graph for recommender systems. In Proceedings of the 27th ACM international conference on information and knowledge management. 417--426.Google ScholarDigital Library
- Lei Wang, Ee-Peng Lim, Zhiwei Liu, and Tianxiang Zhao. 2022. Explanation guided contrastive learning for sequential recommendation. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 2017--2027.Google ScholarDigital Library
- Jiapeng Wu, Yishi Xu, Yingxue Zhang, Chen Ma, Mark Coates, and Jackie Chi Kit Cheung. 2021. Tie: A framework for embedding-based incremental temporal knowledge graph completion. In Proc. of SIGIR.Google ScholarDigital Library
- Chengjin Xu, Yung-Yu Chen, Mojtaba Nayyeri, and Jens Lehmann. 2021. Temporal knowledge graph completion using a linear temporal regularizer and multivector embeddings. In Proc. of NAACL.Google ScholarCross Ref
- Chenjin Xu, Mojtaba Nayyeri, Fouad Alkhoury, Hamed Yazdi, and Jens Lehmann. 2020. Temporal knowledge graph completion based on time series gaussian embedding. In Proc. of ISWC.Google ScholarDigital Library
- Fuwei Zhang, Zhao Zhang, Xiang Ao, Fuzhen Zhuang, Yongjun Xu, and Qing He. 2022. Along the Time: Timeline-traced Embedding for Temporal Knowledge Graph Completion. In Proc. of CIKM.Google ScholarDigital Library
- Mingda Zhang, Keren Ye, Rebecca Hwa, and Adriana Kovashka. 2020. Story completion with explicit modeling of commonsense knowledge. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. 376--377.Google ScholarCross Ref
- Yingying Zhang, Xian Wu, Quan Fang, Shengsheng Qian, and Changsheng Xu. 2023. Knowledge-enhanced attributed multi-task learning for medicine recommendation. ACM Transactions on Information Systems, Vol. 41, 1 (2023), 1--24.Google ScholarDigital Library
- Shan Zhao, Minghao Hu, Zhiping Cai, and Fang Liu. 2020. Modeling Dense Cross-Modal Interactions for Joint Entity-Relation Extraction. In Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence. 4032--4038.Google ScholarCross Ref
- Cunchao Zhu, Muhao Chen, Changjun Fan, Guangquan Cheng, and Yan Zhang. 2021. Learning from history: Modeling temporal knowledge graphs with sequential copy-generation networks. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35. 4732--4740.Google ScholarCross Ref
Index Terms
- Learn from Relational Correlations and Periodic Events for Temporal Knowledge Graph Reasoning
Recommendations
An effective Time-Aware Encoder for Temporal Knowledge Graph Reasoning
MLNLP '22: Proceedings of the 2022 5th International Conference on Machine Learning and Natural Language ProcessingThere are many studies on static knowledge graph (KG) reasoning that predicts missing facts for its completeness. As the facts in real world usually are time-dependent, temporal knowledge graph (TKG) has received great attention lately. Entities and ...
Multi-hop temporal knowledge graph reasoning with temporal path rules guidance
AbstractTemporal Knowledge graph (TKG) is a key component of artificial intelligence. In recent years, many large-scale temporal knowledge graphs have been produced and put into practical applications. At present, researchers have proposed many methods ...
Reasoning over temporal knowledge graph with temporal consistency constraints
Knowledge graph reasoning or completion aims at inferring missing facts by reasoning about the information already present in the knowledge graph. In this work, we explore the problem of temporal knowledge graph reasoning that performs inference on the ...
Comments