Abstract
Attributed network embedding enables to generate low-dimensional representations of network objects by leveraging both network structure and attribute data. However, how to properly combine two different information to achieve better vector representations remains still unclear. While some methods learn the embeddings from graph structure and attribute data separately, and then joint them, some existing methods use attribute data as an auxiliary information. However, the problem of integrating attribute data into an embedding process is an open problem due to the sparsity of attribute space. Especially in social networks such as Twitter and Flickr, the contexts may be short and the number of attributes defining objects may be very few, which cause that the contextual proximity among objects are not discovered properly. To address these issues, in this work, we present an enhanced attributed network embedding method via enriched attribute representations (ANEA) which generates low-dimensional representations of the network objects. ANEA incorporates attribute data into the embedding process by mapping the data to two different graph structures. To deal with the sparsity problem, our method provides to capture high-order semantic relations between attributes by performing random walks on these graphs. ANEA learns the embeddings through a joint space composed of the network structure and attributes. Therefore, it allows to discover latent attribute representations of the objects, which is helpful to explain what the common contextual interests are effective in modelling the proximity among nodes. Experiments on real-world networks confirm that ANEA outperforms the state-of-the-art methods.






Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Change history
10 August 2021
A Correction to this paper has been published: https://doi.org/10.1007/s10489-021-02706-7
References
Bandyopadhyay S, Kara H, Kannan A, Murty MN (2018) Fscnmf: Fusing structure and content via non-negative matrix factorization for embedding information networks. arXiv preprint arXiv:1804.05313
Blei DM, Ng AY, Jordan MI (2003) Latent dirichlet allocation. J Mach Learn Res 3(Jan):993–1022
Cao S, Lu W, Xu Q (2015) Grarep: Learning graph representations with global structural information. In: Proceedings of the 24th ACM international on conference on information and knowledge management, pp. 891–900
Cataltepe Z, Sonmez A, Senliol B (2014) Feature enrichment and selection for transductive classification on networked data. Pattern Recogn Lett 37:41–53
Dai AM, Olah C, Le QV (2015) Document embedding with paragraph vectors. arXiv preprint arXiv:1507.07998
Fan RE, Chang KW, Hsieh CJ, Wang XR, Lin CJ (2008) Liblinear: a library for large linear classification. J Mach Learn Res 9(Aug):1871–1874
Feng S, Zhang H, Cao J, Yao Y (2019) Merging user social network into the random walk model for better group recommendation. Appl Intell 49(6):2046–2058
Gao H, Huang H (2018) Deep attributed network embedding. In: IJCAI 18:3364–3370
Grover A, Leskovec J (2016) node2vec: Scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 855–864
Huang X, Li J, Hu X (2017) Accelerated attributed network embedding. In: Proceedings of the 2017 SIAM international conference on data mining, pp. 633–641. SIAM
Huang X, Song Q, Li Y, Hu X (2019) Graph recurrent networks with attributed random walks. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 732–740
Kakisim AG, Sogukpinar I (2019) Unsupervised binary feature construction method for networked data. Expert Syst Appl 121:256–265
Kaya H, Alpaslan FN (2010) Using social networks to solve data sparsity problem in one-class collaborative filtering. In: 2010 Seventh International Conference on Information Technology: New Generations, pp. 249–252. IEEE
Luo J, Pan X, Wang S, Huang Y (2019) Identifying target audience on enterprise social network. Ind Manag Data Syst 119:111–128
Marsden PV, Friedkin NE (1993) Network studies of social influence. Sociol Methods Res 22(1):127–151
Meng Z, Liang S, Bao H, Zhang X (2019) Co-embedding attributed networks. In: Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, pp. 393–401
Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781
Pan S, Wu J, Zhu X, Zhang C, Wang Y (2016) Tri-party deep network representation. Network 11(9):12
Perozzi B, Al-Rfou R, Skiena S (2014) Deepwalk: Online learning of social representations. In: Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 701–710. ACM
Sajjad HP, Docherty A, Tyshetskiy Y (2019) Efficient representation learning using random walks for dynamic graphs. arXiv preprint arXiv:1901.01346
Sheikh N, Kefato Z, Montresor A (2019) gat2vec: representation learning for attributed graphs. Computing 101(3):187–209
Shen E, Cao Z, Zou C, Wang J (2018) Flexible attributed network embedding. arXiv preprint arXiv:1811.10789
Shi M, Tang Y, Zhu X, Liu J, He H (2019) Topical network embedding. Data Mining and Knowledge Discovery pp. 1–26
Tang J, Liu J, Zhang M, Mei Q (2016) Visualizing large-scale and high-dimensional data. In: Proceedings of the 25th international conference on world wide web, pp. 287–297
Tang J, Qu M, Wang M, Zhang M, Yan J, Mei Q (2015) Line: Large-scale information network embedding. In: Proceedings of the 24th international conference on world wide web, pp. 1067–1077
Wang D, Cui P, Zhu W (2016) Structural deep network embedding. In: Proceedings of the 22nd ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 1225–1234
Wu W, Li B, Chen L, Zhang C (2018) Efficient attributed network embedding via recursive randomized hashing. In: IJCAI 18:2861–2867
Yang C, Liu Z, Zhao D, Sun M, Chang E (2015) Network representation learning with rich text information. In: Twenty-Fourth International Joint Conference on Artificial Intelligence
Yang C, Sun M, Liu Z, Tu C (2017) Fast network embedding enhancement via high order proximity approximation. In: IJCAI, pp. 3894–3900
Yang H, Pan S, Zhang P, Chen L, Lian D, Zhang C (2018) Binarized attributed network embedding. In: 2018 IEEE International Conference on Data Mining (ICDM), pp. 1476–1481. IEEE
Yang S, Yang B (2018) Enhanced network embedding with text information. In: 2018 24th International Conference on Pattern Recognition (ICPR), pp. 326–331. IEEE
Yu B, Li Y, Zhang C, Pan K, Xie Y (2019) Enhancing attributed network embedding via similarity measure. IEEE Access 7(166):235–166,245
Acknowledgments
The author would like to thank Dr. Yakup Genc for his support to the author of this paper while at Gebze Technical University.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The original online version of this article was revised: columns/rows of table 2 are out of order.
Rights and permissions
About this article
Cite this article
Kakisim, A.G. Enhancing attributed network embedding via enriched attribute representations. Appl Intell 52, 1566–1580 (2022). https://doi.org/10.1007/s10489-021-02498-w
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-021-02498-w