Skip to main content
SpringerLink
Log in

FLGAI: a unified network embedding framework integrating multi-scale network structures and node attribute information

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Network embedding is an effective method aiming to learn the low-dimensional vector representation of nodes in networks, which has been widely used in various network analytic tasks such as node classification, node clustering, and link prediction. The objective of network embedding is to capture the structural information and inherent characteristics of the network as much as possible in the low-dimensional vector representation. However, the majority of the existing network embedding methods merely exploited the microscopic proximity of the network structure to learn the node representation, which tend to generate sub-optimal network representation. In this paper, we propose a novel nonnegative matrix factorization (NMF) based network representation learning framework called FLGAI, which jointly integrates the local network structure, global network structure, and attribute information to learn the network representation. First, we employ the first-order proximity and second-order proximity jointly to preserve the local network structure. Then, the community structure is introduced to preserve the global network structure. Third, we exploit the node attribute information to capture the node characteristics. To preserve the structural information and the network node attributes simultaneously, we formulate their consensus relationships and optimize them jointly in a unified NMF framework to derive the final network representation. To evaluate the effectiveness of our model, we conduct extensive experiments on six real-world datasets and the empirical results demonstrate the superior performance of the proposed method over the state-of-the-art approaches in both node classification and node clustering tasks.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Cao J, Bu Z, Wang Y, Yang H, Jiang J, Li H-J (2019) Detecting prosumer-community groups in smart grids from the multiagent perspective. IEEE Trans Syst Man Cybern Syst 49(8):1652–1664. https://doi.org/10.1109/TSMC.2019.2899366

    Article  Google Scholar 

  2. Li H-J, Bu Z, Wang Z, Cao J (2020) Dynamical clustering in electronic commerce systems via optimization and leadership expansion. IEEE Trans Ind Informatics 16(8):5327–5334. https://doi.org/10.1109/TII.2019.2960835

    Article  Google Scholar 

  3. C NC, Mohan A (2019) A social recommender system using deep architecture and network embedding. Appl Intell 49(5):1937–1953. https://doi.org/10.1007/s10489-018-1359-z

  4. Tang J, Aggarwal C, Liu H (2016) Node classification in signed social networks. In: proceedings of the 2016 SIAM international conference on data mining. Proceedings. Society for Industrial and Applied Mathematics :54-62. https://doi.org/10.1137/1.9781611974348.710.1137/1.9781611974348.7

  5. Wang T, Liu L, Liu N, Zhang H, Zhang L, Feng S (2020) A multi-label text classification method via dynamic semantic representation model and deep neural network. Appl Intell. https://doi.org/10.1007/s10489-020-01680-w

  6. Gao S, Denoyer L, Gallinari P (2011) Temporal link prediction by integrating content and structure information. https://doi.org/10.1145/2063576.2063744

  7. Singh AP, Gordon GJ (2008) Relational learning via collective matrix factorization. In: Proceedings of the 14th ACM SIGKDD international conference on knowledge discovery and data mining. Las Vegas, Nevada, USA, pp 650–658

    Google Scholar 

  8. Tang J, Liu J, Zhang M, Mei Q (2016) Visualizing large-scale and high-dimensional data. In: Proceedings of the 25th International Conference on World Wide Web, WWW 2016, Montreal, Canada, April 11–15, 2016, pp. 287–297. https://doi.org/10.1145/2872427.2883041

  9. Li Y, Sha C, Huang X, Zhang Y (2018) Community detection in attributed graphs: an embedding approach. In: Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, (AAAI-18), New Orleans, Louisiana, USA, 2018, pp. 338–345

  10. Li HJ, Daniels JJ (2015) Social significance of community structure: statistical view. Phys Rev E 91(1):012801

    MathSciNet  Google Scholar 

  11. Perozzi B, Al-Rfou R, Skiena S (2014) DeepWalk: online learning of social representations. Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, In, pp 701–710. https://doi.org/10.1145/2623330.2623732

    Book  Google Scholar 

  12. Tang J, Qu M, Wang M, Zhang M, Yan J, Mei Q (2015) LINE: large-scale information network embedding. In: Proceedings of the 24th international conference on world wide web, WWW 2015, Florence, Italy, pp. 1067–1077. https://doi.org/10.1145/2736277.2741093

  13. Grover A, Leskovec J (2016) node2vec: scalable feature learning for networks, In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, San Francisco, CA, USA , pp. 855–864 .doi:https://doi.org/10.1145/2939672.2939754

  14. Wang X, Cui P, Wang J, Pei J, Zhu W, Yang S (2017) Community preserving network embedding. In: Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, February 4–9, 2017, San Francisco, California, USA, pp. 203–209

  15. McPherson M, Smith-Lovin L, Cook J (2001) Birds of a feather: homophily in social networks. Annu Rev Sociol 27(1):415–444. https://doi.org/10.1146/annurev.soc.27.1.415

    Article  Google Scholar 

  16. Zhang D, Yin J, Zhu X, Zhang C (2016) Homophily, structure, and content augmented network representation learning. In: Proceedings of the IEEE 16th international conference on data mining, ICDM2016, Barcelona, Spain, pp. 609–618

  17. Yang D, Wang S, Li C, Zhang X, Li Z (2017) From properties to links: deep network embedding on incomplete graphs. In: Proceedings of the 2017 ACM on conference on information and knowledge management, CIKM 2017, Singapore, pp 367–376

  18. Belkin M, Niyogi P (2001) Laplacian eigenmaps and spectral techniques for embedding and clustering. In: Proceedings of the 14th international conference on neural information processing systems: natural and synthetic, Vancouver, British Columbia, Canada, pp. 585–591

  19. Roweis, Sam, T., Saul, Lawrence, K. (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326

  20. Cao S, Lu W, Xu Q (2015) GraRep: learning graph representations with global structural information. In: Proceedings of the 24th ACM international on conference on information and knowledge management, Melbourne, Australia, pp. 891–900

  21. Ou M, Cui P, Pei J, Zhang Z, Zhu W (2016) Asymmetric transitivity preserving graph embedding. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, San Francisco, California, USA, pp. 1105–1114

  22. Wang D, Cui P, Zhu W (2016) Structural deep network embedding. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, San Francisco, California, USA, pp. 1225–1234

  23. Cao S, Lu W, Xu Q (2016) Deep neural networks for learning graph representations. In: Proceedings of the thirtieth AAAI conference on artificial intelligence, Phoenix, Arizona, USA, pp. 1145–1152

  24. Feng R, Yang Y, Hu W, Wu F, Zhuang Y (2017) Representation learning for scale-free networks. In: Proceedings of the thirty-second AAAI conference on artificial intelligence , New Orleans, Louisiana, USA, pp. 282–289

  25. Chen H, Perozzi B, Hu Y, Skiena S (2018) HARP: hierarchical representation learning for networks. In: Proceedings of the thirty-second AAAI conference on artificial intelligence, New Orleans, Louisiana, USA, pp. 2127–2134

  26. Shi W, Huang L, Wang C-D, Li J-H, Tang Y, Fu C (2019) Network embedding via community based variational autoencoder. IEEE Access 7:25323–25333. https://doi.org/10.1109/ACCESS.2019.2900662

    Article  Google Scholar 

  27. Du L, Lu Z, Wang Y, Song G, Wang Y, Chen W (2018) Galaxy network embedding: a hierarchical community structure preserving approach. In: Proceedings of the twenty-seventh international joint conference on artificial intelligence, IJCAI 2018, Stockholm, Sweden, pp. 2079–2085

  28. Yang C, Liu Z, Zhao D, Sun M, Chang EY (2015) Network representation learning with rich text information. In: Proceedings of the twenty-fourth international joint conference on artificial intelligence, IJCAI 2015, Buenos Aires, Argentina, pp. 2111–2117

  29. Zhang D, Yin J, Zhu X, Zhang C (2016) Collective classification via discriminative matrix factorization on sparsely labeled networks. In: Proceedings of the 25th ACM international on conference on information and knowledge management, Indianapolis, Indiana, USA, pp. 1563–1572

  30. Pan S, Wu J, Zhu X, Zhang C, Wang Y (2016) tri-party deep network representation. In: Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, New York, New York, USA, pp. 1895–1901

  31. Huang X, Li J, Hu X (2017) Label informed attributed network embedding. In: Proceedings of the tenth ACM international conference on web search and data mining, Cambridge, United Kingdom, pp. 731–739

  32. Huang X, Li J, Hu X (2017) Accelerated attributed network embedding. In: Proceedings of the 2017 SIAM international conference on data mining, Houston, Texas, USA, pp. 633–641

  33. Liao L, He X, Zhang H, Chua T (2018) Attributed social network embedding. IEEE Trans Knowl Data Eng 30(12):2257–2270. https://doi.org/10.1109/TKDE.2018.2819980

    Article  Google Scholar 

  34. Gao H, Huang H (2018) Deep attributed network embedding. In: Proceedings of the twenty-seventh international joint conference on artificial intelligence, Stockholm, Sweden, pp. 3364–3370

  35. Zheng C, Pan L, Wu P (2020) Multimodal deep network embedding with integrated structure and attribute information. IEEE Transactions on Neural Networks and Learning Systems 31(5):1437–1449. https://doi.org/10.1109/TNNLS.2019.2920267

    Article  Google Scholar 

  36. Jin D, Ge M, Yang L, He D, Wang L, Zhang W (2018) Integrative network embedding via deep joint reconstruction. In: Proceedings of the twenty-seventh international joint conference on artificial intelligence, Stockholm, Sweden, pp. 3407–3413

  37. Girvan M, Newman M (2001) Community structure in social and biological networks. Proc Natl Acad Sci 99(12):7821–7826. https://doi.org/10.1073/pnas.122653799

    Article  MathSciNet  MATH  Google Scholar 

  38. Newman M (2006) Finding community structure in networks using the eigenvectors of matrices. Phys Rev E 74:036104. https://doi.org/10.1103/PhysRevE.74.036104

    Article  MathSciNet  Google Scholar 

  39. M. E. J. Newman, “Modularity and community structure in networks,” Proceedings of the National Academy of Sciences, vol. 103, no. 23, pp. 8577–8582, 2006. Newman MEJ (2006) Modularity and community structure in networks. Proc. Natl. Acad. Sci 103(23):8577. https://doi.org/10.1073/pnas.0601602103

  40. Brandes U, Delling D, Gaertler M, Goerke R, Hoefer M, Nikoloski Z, Wagner D (2006) Maximizing modularity is hard. Physics

    Google Scholar 

  41. Lee DD, Seung HS (1999) Learning the parts of objects by non-negative matrix factorization. Nature 401(6755):788–791. https://doi.org/10.1038/44565

    Article  MATH  Google Scholar 

  42. Akata Z, Thurau C, Bauckhage C (2011) Non-negative matrix factorization in multimodality data for segmentation and label prediction. In: proceedings of the 16th computer vision winter workshop, Mitterberg, Austria

Download references

Author information

Authors and Affiliations

  1. Institute of Command and Control Engineering, Army Engineering University, Nanjing, 210007, China

    Yu Pan, Guyu Hu, Yanyan Zhang, Shuaihui Wang, Dongsheng Shao & Zhisong Pan

  2. School of Information Technology, Deakin University, Geelong, Victoria, 3216, Australia

    Junyang Qiu

Authors
  1. Yu Pan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Guyu Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Junyang Qiu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yanyan Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Shuaihui Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Dongsheng Shao
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Zhisong Pan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhisong Pan.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pan, Y., Hu, G., Qiu, J. et al. FLGAI: a unified network embedding framework integrating multi-scale network structures and node attribute information. Appl Intell 50, 3976–3989 (2020). https://doi.org/10.1007/s10489-020-01780-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-020-01780-7

Keywords

Search

Navigation