Abstract
Network embedding in heterogeneous network has recently attracted much attention due to its effectiveness in capturing the structure and inherent properties of networks. Most existing models focus on node proximity of networks. Nevertheless, in heterogeneous network, it contains different types (domains) of nodes and edges. The same types of nodes exhibit global patterns widely known as communities, and a community is intuitively identified as a group of nodes with more connections between its internal nodes compared with the external ones. Similarly, we assume that there is also an intermediate structure in the different types of nodes, which we call it as organization, and nodes in an organization interact more frequently than external ones. Thus, nodes within the same community and organization should have similar node embeddings. Inspired by this, we take the structural characteristics in heterogeneous network into consideration and propose a novel structure-aware Attributed Heterogeneous Network Embedding model (SAHNE). Specifically, we first introduce a random walk strategy based upon node degree to sample node sequences, which can better explore the community and organization information in heterogeneous network. Next, we design a structure-aware attributed heterogeneous network embedding model to simultaneously detect community and organization distribution of each node and learn embeddings of nodes, communities and organizations. Extensive experiments on three real-world heterogeneous networks demonstrate that SAHNE outperforms the state-of-the-art methods in terms of various datamining tasks.






Similar content being viewed by others
References
Zhang Y, Xiong Y, Kong X, Li S, Mi J, Zhu Y (2018) Deep collective classification in heterogeneous information networks. In: Proceedings of the 2018 world wide web conference, pp 399–408
Wang X, Cui P, Wang J, Pei J, Zhu W, Yang S (2017) Community preserving network embedding. In: Proceedings of the AAAI conference on artificial intelligence, 31
Kipf TN, Welling M (2016) Variational graph auto-encoders. arXiv preprint arXiv:1611.07308
Tu C, Wang H, Zeng X, Liu Z, Sun M (2016) Community-enhanced network representation learning for network analysis. arXiv preprint arXiv:1611.06645
Hussein R, Yang D, Cudré-Mauroux P (2018) Are meta-paths necessary? Revisiting heterogeneous graph embeddings. In: Proceedings of the 27th ACM international conference on information and knowledge management, pp 437–446
Shang J, Qu M, Liu J et al (2016) Meta-path guided embedding for similarity search in large-scale heterogeneous information networks. https://doi.org/10.48550/arXiv.1610.09769
Dong Y, Chawla NV, Swami A (2017) metapath2vec: scalable representation learning for heterogeneous networks. In: Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining, pp 135–144
Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781
Fu Ty, Lee WC, Lei Z (2017) Hin2vec: Explore meta-paths in heterogeneous information networks for representation learning. In: Proceedings of the 2017 ACM on conference on information and knowledge management, pp 1797–1806
Zhou S. Bu J, Wang X, Chen J, Wang C (2019) Hahe: hierarchical attentive heterogeneous information network embedding. arXiv preprint arXiv:1902.01475
Wang X, Ji H, Shi C, Wang B, Ye Y, Cui P, Yu PS (2019) Heterogeneous graph attention network. In: The world wide web conference, pp 2022–2032
Zhang C, Song D, Huang C, Swami A, Chawla NV (2019) Heterogeneous graph neural network. In: Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining, pp 793–803
Hu Z, Dong Y, Wang K, Sun Y (2020) Heterogeneous graph transformer. In: Proceedings of the web conference 2020, pp 2704–2710
Fu X, Zhang J, Meng Z, King I (2020) Magnn: metapath aggregated graph neural network for heterogeneous graph embedding. In: Proceedings of the web conference 2020, pp 2331–2341
Zhao J, Wang X, Shi C, Liu Z, Ye Y (2020) Network schema preserved heterogeneous information network embedding. In: 29th International joint conference on artificial intelligence (IJCAI)
Lu, Y., Shi, C., Hu, L., Liu, Z.: Relation structure-aware heterogeneous information network embedding. In: Proceedings of the AAAI conference on artificial intelligence, vol 33, pp 4456–4463 (2019)
Jin, D., Huo, C., Liang, C., Yang, L.: Heterogeneous graph neural network via attribute completion. In: WWW’21: the web conference 2021 (2021)
Jianan Z, Xiao W, Chuan, S, Binbin, H (2021) Heterogeneous graph structure learning for graph neural networks. In: Proceedings of the AAAI conference on artificial intelligence
Jiang X et al (2021) Pre-training on large-scale heterogeneous graph. In: Proceedings of the 27th ACM SIGKDD conference on knowledge discovery & data mining
Wang X, Liu N, Han H, Shi C (2021) Self-supervised heterogeneous graph neural network with co-contrastive learning. In: Proceedings of the 27th ACM SIGKDD conference on knowledge discovery & data mining, pp 1726–1736
Yang Y, Guan Z, Li J, Zhao W, Cui J, Wang Q (2021) Interpretable and efficient heterogeneous graph convolutional network. IEEE Trans Knowl Data Eng 29:1818–1822
Chang Y, Chen C, Hu W, Zheng Z, Zhou X, Chen S (2022) Megnn: meta-path extracted graph neural network for heterogeneous graph representation learning. Knowl-Based Syst 235:107611
Fei W, Tao L, Xin W, Shenghuo Z, Ding C (2011) Community discovery using nonnegative matrix factorization. Data Min Knowl Discov 22:493–521
Wasserman S, Faust K (1994) Social network analysis: methods and applications, vol 8. Cambridge University Press, Cambridge
Perozzi B, Al-Rfou R, Skiena S (2014) Deepwalk: Online learning of social representations. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 701–710
Yun S, Jeong M, Kim R, Kang J, Kim HJ (2019) Graph transformer networks. In: Advances in neural information processing systems, pp. 11983-11993
Shi C, Kong X, Huang Y, Philip SY, Wu B (2014) Hetesim: a general framework for relevance measure in heterogeneous networks. IEEE Trans Knowl Data Eng 26(10):2479–2492
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Wei, H., Xiong, G., Wei, Q. et al. Structure-aware attributed heterogeneous network embedding. Knowl Inf Syst 65, 1769–1785 (2023). https://doi.org/10.1007/s10115-022-01810-5
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10115-022-01810-5