Skip to main content
Log in

Enhancing attributed network embedding via enriched attribute representations

  • Published:
Applied Intelligence Aims and scope Submit manuscript

A Publisher Correction to this article was published on 10 August 2021

This article has been updated

Abstract

Attributed network embedding enables to generate low-dimensional representations of network objects by leveraging both network structure and attribute data. However, how to properly combine two different information to achieve better vector representations remains still unclear. While some methods learn the embeddings from graph structure and attribute data separately, and then joint them, some existing methods use attribute data as an auxiliary information. However, the problem of integrating attribute data into an embedding process is an open problem due to the sparsity of attribute space. Especially in social networks such as Twitter and Flickr, the contexts may be short and the number of attributes defining objects may be very few, which cause that the contextual proximity among objects are not discovered properly. To address these issues, in this work, we present an enhanced attributed network embedding method via enriched attribute representations (ANEA) which generates low-dimensional representations of the network objects. ANEA incorporates attribute data into the embedding process by mapping the data to two different graph structures. To deal with the sparsity problem, our method provides to capture high-order semantic relations between attributes by performing random walks on these graphs. ANEA learns the embeddings through a joint space composed of the network structure and attributes. Therefore, it allows to discover latent attribute representations of the objects, which is helpful to explain what the common contextual interests are effective in modelling the proximity among nodes. Experiments on real-world networks confirm that ANEA outperforms the state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Change history

References

  1. Bandyopadhyay S, Kara H, Kannan A, Murty MN (2018) Fscnmf: Fusing structure and content via non-negative matrix factorization for embedding information networks. arXiv preprint arXiv:1804.05313

  2. Blei DM, Ng AY, Jordan MI (2003) Latent dirichlet allocation. J Mach Learn Res 3(Jan):993–1022

    MATH  Google Scholar 

  3. Cao S, Lu W, Xu Q (2015) Grarep: Learning graph representations with global structural information. In: Proceedings of the 24th ACM international on conference on information and knowledge management, pp. 891–900

  4. Cataltepe Z, Sonmez A, Senliol B (2014) Feature enrichment and selection for transductive classification on networked data. Pattern Recogn Lett 37:41–53

    Article  Google Scholar 

  5. Dai AM, Olah C, Le QV (2015) Document embedding with paragraph vectors. arXiv preprint arXiv:1507.07998

  6. Fan RE, Chang KW, Hsieh CJ, Wang XR, Lin CJ (2008) Liblinear: a library for large linear classification. J Mach Learn Res 9(Aug):1871–1874

    MATH  Google Scholar 

  7. Feng S, Zhang H, Cao J, Yao Y (2019) Merging user social network into the random walk model for better group recommendation. Appl Intell 49(6):2046–2058

    Article  Google Scholar 

  8. Gao H, Huang H (2018) Deep attributed network embedding. In: IJCAI 18:3364–3370

    Google Scholar 

  9. Grover A, Leskovec J (2016) node2vec: Scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 855–864

  10. Huang X, Li J, Hu X (2017) Accelerated attributed network embedding. In: Proceedings of the 2017 SIAM international conference on data mining, pp. 633–641. SIAM

  11. Huang X, Song Q, Li Y, Hu X (2019) Graph recurrent networks with attributed random walks. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 732–740

  12. Kakisim AG, Sogukpinar I (2019) Unsupervised binary feature construction method for networked data. Expert Syst Appl 121:256–265

    Article  Google Scholar 

  13. Kaya H, Alpaslan FN (2010) Using social networks to solve data sparsity problem in one-class collaborative filtering. In: 2010 Seventh International Conference on Information Technology: New Generations, pp. 249–252. IEEE

  14. Luo J, Pan X, Wang S, Huang Y (2019) Identifying target audience on enterprise social network. Ind Manag Data Syst 119:111–128

    Article  Google Scholar 

  15. Marsden PV, Friedkin NE (1993) Network studies of social influence. Sociol Methods Res 22(1):127–151

    Article  Google Scholar 

  16. Meng Z, Liang S, Bao H, Zhang X (2019) Co-embedding attributed networks. In: Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, pp. 393–401

  17. Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781

  18. Pan S, Wu J, Zhu X, Zhang C, Wang Y (2016) Tri-party deep network representation. Network 11(9):12

    Google Scholar 

  19. Perozzi B, Al-Rfou R, Skiena S (2014) Deepwalk: Online learning of social representations. In: Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 701–710. ACM

  20. Sajjad HP, Docherty A, Tyshetskiy Y (2019) Efficient representation learning using random walks for dynamic graphs. arXiv preprint arXiv:1901.01346

  21. Sheikh N, Kefato Z, Montresor A (2019) gat2vec: representation learning for attributed graphs. Computing 101(3):187–209

    Article  MathSciNet  Google Scholar 

  22. Shen E, Cao Z, Zou C, Wang J (2018) Flexible attributed network embedding. arXiv preprint arXiv:1811.10789

  23. Shi M, Tang Y, Zhu X, Liu J, He H (2019) Topical network embedding. Data Mining and Knowledge Discovery pp. 1–26

  24. Tang J, Liu J, Zhang M, Mei Q (2016) Visualizing large-scale and high-dimensional data. In: Proceedings of the 25th international conference on world wide web, pp. 287–297

  25. Tang J, Qu M, Wang M, Zhang M, Yan J, Mei Q (2015) Line: Large-scale information network embedding. In: Proceedings of the 24th international conference on world wide web, pp. 1067–1077

  26. Wang D, Cui P, Zhu W (2016) Structural deep network embedding. In: Proceedings of the 22nd ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 1225–1234

  27. Wu W, Li B, Chen L, Zhang C (2018) Efficient attributed network embedding via recursive randomized hashing. In: IJCAI 18:2861–2867

    Google Scholar 

  28. Yang C, Liu Z, Zhao D, Sun M, Chang E (2015) Network representation learning with rich text information. In: Twenty-Fourth International Joint Conference on Artificial Intelligence

  29. Yang C, Sun M, Liu Z, Tu C (2017) Fast network embedding enhancement via high order proximity approximation. In: IJCAI, pp. 3894–3900

  30. Yang H, Pan S, Zhang P, Chen L, Lian D, Zhang C (2018) Binarized attributed network embedding. In: 2018 IEEE International Conference on Data Mining (ICDM), pp. 1476–1481. IEEE

  31. Yang S, Yang B (2018) Enhanced network embedding with text information. In: 2018 24th International Conference on Pattern Recognition (ICPR), pp. 326–331. IEEE

  32. Yu B, Li Y, Zhang C, Pan K, Xie Y (2019) Enhancing attributed network embedding via similarity measure. IEEE Access 7(166):235–166,245

    Google Scholar 

Download references

Acknowledgments

The author would like to thank Dr. Yakup Genc for his support to the author of this paper while at Gebze Technical University.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Arzu Gorgulu Kakisim.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

The original online version of this article was revised: columns/rows of table 2 are out of order.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kakisim, A.G. Enhancing attributed network embedding via enriched attribute representations. Appl Intell 52, 1566–1580 (2022). https://doi.org/10.1007/s10489-021-02498-w

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-021-02498-w

Keywords

Navigation