Abstract
The existing link prediction researches of information networks mainly focus on the dynamic homogeneous network or the static heterogeneous network. It has always been a challenge to predict future relationships between nodes while learning both continuous-time and heterogeneous information simultaneously. In this paper, we propose a Heterogeneous and Continuous-Time Model Based on Self-Attention (HTAT) to complete the link prediction task by learning temporal evolution and heterogeneity jointly. The HTAT model consists of the base layer and the heterogeneous layer. The base layer incorporates a functional time encoding with self-attention mechanism to capture continuous-time evolution. And the heterogeneous layer consists of multi-view attention to learn heterogeneous information. Experimental results show that HTAT is significantly competitive compared with four state-of-the-art baselines on three real-world datasets.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Cai, H., Zheng, V.W., Chang, K.C.C.: A comprehensive survey of graph embedding: problems, techniques, and applications. IEEE Trans. Knowl. Data Eng. 30(9), 1616–1637 (2018)
Cen, Y., Zou, X., Zhang, J., Yang, H., Zhou, J., Tang, J.: Representation learning for attributed multiplex heterogeneous network. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 1358–1368 (2019)
Chen, J., Zhang, J., Xu, X., Fu, C., Zhang, D., Zhang, Q., Xuan, Q.: E-LSTM-D: a deep learning framework for dynamic network link prediction. IEEE Trans. Syst. Man Cybern.: Syst. (2019)
Dong, Y., Chawla, N.V., Swami, A.: metapath2vec: scalable representation learning for heterogeneous networks. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 135–144 (2017)
Gai, K., Qiu, M., Zhao, H., Sun, X.: Resource management in sustainable cyber-physical systems using heterogeneous cloud computing. IEEE Trans. Sustain. Comput. 3(2), 60–72 (2017)
Grover, A., Leskovec, J.: node2vec: scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 855–864 (2016)
Lee, D.D., Pham, P., Largman, Y., Ng, A.: Advances in neural information processing systems 22. Technical report (2009)
Li, T., Zhang, J., Philip, S.Y., Zhang, Y., Yan, Y.: Deep dynamic network embedding for link prediction. IEEE Access 6, 29219–29230 (2018)
Lü, L., Zhou, T.: Link prediction in complex networks: a survey. Phys. A 390(6), 1150–1170 (2011)
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., Dean, J.: Distributed representations of words and phrases and their compositionality. arXiv preprint arXiv:1310.4546 (2013)
Pareja, A., et al.: EvolveGCN: evolving graph convolutional networks for dynamic graphs. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 5363–5370 (2020)
Vaswani, A., et al.: Attention is all you need. arXiv preprint arXiv:1706.03762 (2017)
Veličković, P., Cucurull, G., Casanova, A., Romero, A., Lio, P., Bengio, Y.: Graph attention networks. arXiv preprint arXiv:1710.10903 (2017)
Wang, X., et al.: Heterogeneous graph attention network. In: The World Wide Web Conference, pp. 2022–2032 (2019)
Xu, D., Ruan, C., Korpeoglu, E., Kumar, S., Achan, K.: Inductive representation learning on temporal graphs. arXiv preprint arXiv:2002.07962 (2020)
Xue, H., Yang, L., Jiang, W., Wei, Y., Hu, Y., Lin, Y.: Modeling dynamic heterogeneous network for link prediction using hierarchical attention with temporal RNN. arXiv preprint arXiv:2004.01024 (2020)
Yin, Y., Ji, L.X., Zhang, J.P., Pei, Y.L.: DHNE: network representation learning method for dynamic heterogeneous networks. IEEE Access 7, 134782–134792 (2019)
Zhang, L., Li, J., Zhang, Q., Meng, F., Teng, W.: Domain knowledge-based link prediction in customer-product bipartite graph for product recommendation. Int. J. Inf. Technol. Decis. Making 18(01), 311–338 (2019)
Zhou, L., Yang, Y., Ren, X., Wu, F., Zhuang, Y.: Dynamic network embedding by modeling triadic closure process. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32 (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Ruan, B., Zhu, C. (2021). An Efficient Link Prediction Model in Dynamic Heterogeneous Information Networks Based on Multiple Self-attention. In: Qiu, H., Zhang, C., Fei, Z., Qiu, M., Kung, SY. (eds) Knowledge Science, Engineering and Management. KSEM 2021. Lecture Notes in Computer Science(), vol 12817. Springer, Cham. https://doi.org/10.1007/978-3-030-82153-1_6
Download citation
DOI: https://doi.org/10.1007/978-3-030-82153-1_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-82152-4
Online ISBN: 978-3-030-82153-1
eBook Packages: Computer ScienceComputer Science (R0)