Abstract
Deep learning has been successfully used in heterogeneous network embedding. Although it shows excellent performance on preserving the structure and semantic characteristics of network while a large scale of training data is provided, it is still challenging to model complex structured representations that effectively perform on diverse network tasks. In this work, a new heterogeneous network embedding learning method is presented based on cloud model and variational inference, called HNECV. The model uses meta-path random walks to obtain structural information of original network which can capture abundant semantics of networks from different views. In addition, a novel framework is put forward to build an excellent embedding. We employ the forward cloud transformation algorithm to improve the sampling method of the variational autoencoder in its hidden space, and then a self-supervised learning module is constructed to guide the cluster of node vectors in the hidden space of variational autoencoder. Experimental results indicate that the proposed model can achieve better performance than those of state-of-the-art algorithms. Furthermore, HNECV shows better robustness and steadiness on different network tasks when different ratio of edges are disconnected at training.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Grover, A., Leskovec, J.: node2vec: scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 855–864. ACM, New York (2016)
Cui, P., Wang, X., Pei, J., Zhu, W.: A survey on network embedding. IEEE Trans. Knowl. Data Eng. 31(5), 833–852 (2018)
Kipf, T.N., Welling, M.: Variational graph auto-encoders. arXiv preprint arXiv:1611.07308 (2016)
Perozzi, B., Al-Rfou, R., Skiena, S.: DeepWalk: online learning of social representations. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 701–710. ACM, New York (2014)
Ribeiro, L.F., Saverese, P.H., Figueiredo, D.R.: struc2vec: learning node representations from structural identity. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 385–394. ACM, New York (2017)
Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907 (2016)
Wang, C., Pan, S., Hu, R., Long, G., Jiang, J., Zhang, C.: Attributed graph clustering: a deep attentional embedding approach. arXiv preprint arXiv:1906.06532 (2019)
Fan, S., Wang, X., Shi, C., Lu, E., Lin, K., Wang, B.: One2multi graph autoencoder for multi-view graph clustering. In: Proceedings of The Web Conference 2020, pp. 3070–3076. ACM, New York (2020)
Bo, D., Wang, X., Shi, C., Zhu, M., Lu, E., Cui, P.: Structural deep clustering network. In: Proceedings of The Web Conference 2020, pp. 1400–1410. ACM, New York (2020)
Dong, Y., Chawla, N.V., Swami, A.: metapath2vec: scalable representation learning for heterogeneous networks. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 135–144. ACM, New York (2017)
Fu, T.Y., Lee, W.C., Lei, Z.: Hin2vec: explore meta-paths in heterogeneous information networks for representation learning. In: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, pp. 1797–1806. ACM, New York (2017)
Shi, C., Hu, B., Zhao, W.X., Philip, S.Y.: Heterogeneous information network embedding for recommendation. IEEE Trans. Knowl. Data Eng. 31(2), 357–370 (2018)
Tang, J., Qu, M., Mei, Q.: PTE: predictive text embedding through large-scale heterogeneous text networks. In: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1165–1174. ACM, New York (2015)
Xu, L., Wei, X., Cao, J., Yu, P.S.: Embedding of embedding (EOE) joint embedding for coupled heterogeneous networks. In: Proceedings of the Tenth ACM International Conference on Web Search and Data Mining, pp. 741–749. ACM, New York (2017)
Wang, H., Zhang, F., Hou, M., Xie, X., Guo, M., Liu, Q.: SHINE: signed heterogeneous information network embedding for sentiment link prediction. In: Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, pp. 592–600. ACM, New York (2018)
Hu, B., Shi, C., Zhao, W.X., Yu, P.S.: Leveraging meta-path based context for top-n recommendation with a neural co-attention model. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 1531–1540. ACM, New York (2018)
Wang, X., Ji, H., Shi, C., Wang, B., Ye, Y., Cui, P., Yu, P.S.: Heterogeneous graph attention network. In: The World Wide Web Conference, pp. 2022–2032. ACM, New York (2019)
Hu, B., Fang, Y., Shi, C.: Adversarial learning on heterogeneous information networks. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 120–129. ACM, New York (2019)
Shi, C., Lu, Y., Hu, L., Liu, Z., Ma, H.: RHINE: relation structure-aware heterogeneous information network embedding. IEEE Trans. Knowl. Data Eng. 99(1), 1–15 (2020)
Cen, Y., Zou, X., Zhang, J., Yang, H., Zhou, J., Tang, J.: Representation learning for attributed multiplex heterogeneous network. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 1358–1368. ACM, New York (2019)
Zhang, C., Song, D., Huang, C., Swami, A., Chawla, N.V.: Heterogeneous graph neural network. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 793–803. ACM, New York (2019)
Hu, B., Zhang, Z., Shi, C., Zhou, J., Li, X., Qi, Y.: Cash-out user detection based on attributed heterogeneous information network with a hierarchical attention mechanism. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 946–953. AAAI, Palo Alto (2019)
Li, J., et al.: Higher-order attribute-enhancing heterogeneous graph neural networks. arXiv preprint arXiv:2104.07892 (2021)
Wu, L., et al.: Learning the implicit semantic representation on graph-structured data. arXiv preprint arXiv:2101.06471 (2021)
Li, X., Wen, L., Qian, C., Wang, J.: GAHNE: graph-aggregated heterogeneous network embedding. In: 2020 IEEE 32nd International Conference on Tools with Artificial Intelligence, pp. 1012–1019. IEEE, Baltimore (2020)
Shi, C., Li, Y., Zhang, J., Sun, Y., Philip, S.Y.: A survey of heterogeneous information network analysis. IEEE Trans. Knowl. Data Eng. 29(1), 17–37 (2016)
Sun, Y., Han, J., Yan, X., Yu, P.S., Wu, T.: PathSim: meta path-based top-k similarity search in heterogeneous information networks. Proc. VLDB Endow. 4(11), 992–1003 (2011)
Kingma, D.P., Welling, M.: Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114 (2013)
Li, D., Han, J., Shi, X., Chan, M.C.: Knowledge representation and discovery based on linguistic atoms. Knowl.-Based Syst. 10(7), 431–440 (1998)
Wang, G., Xu, C., Li, D.: Generic normal cloud model. Inf. Sci. 280, 1–15 (2014)
Xie, J., Girshick, R., Farhadi, A.: Unsupervised deep embedding for clustering analysis. In: International Conference on Machine Learning, pp. 478–487. PMLR, ACM, New York (2016)
Nigam, K., Ghani, R.: Analyzing the effectiveness and applicability of co-training. In: Proceedings of the Ninth International Conference on Information and Knowledge Management, pp. 86–93. ACM, New York (2000)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Yuan, M., Liu, Q., Wang, G., Guo, Y. (2021). HNECV: Heterogeneous Network Embedding via Cloud Model and Variational Inference. In: Fang, L., Chen, Y., Zhai, G., Wang, J., Wang, R., Dong, W. (eds) Artificial Intelligence. CICAI 2021. Lecture Notes in Computer Science(), vol 13069. Springer, Cham. https://doi.org/10.1007/978-3-030-93046-2_63
Download citation
DOI: https://doi.org/10.1007/978-3-030-93046-2_63
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-93045-5
Online ISBN: 978-3-030-93046-2
eBook Packages: Computer ScienceComputer Science (R0)