Cited By
View all- Nahali SSafari LKhanteymoori AHuang J(2024)StructmRNA a BERT based model with dual level and conditional masking for mRNA representationScientific Reports10.1038/s41598-024-77172-514:1Online publication date: 29-Oct-2024
A Survey of Complex Network Representation Learning Methods
Pages 160 - 168
Abstract
Network representation learning is a technique that embeds the nodes in a network into a low-dimensional vector space, providing strong support for network analysis tasks such as node classification, link prediction, and community detection. This paper provides a summary of the research in the field of network representation learning in recent years. Firstly, the definition of network representation learning is introduced. Then, traditional network representation learning methods are presented, including matrix factorization-based methods, random walk-based methods, and neural network-based methods. However, traditional network representation learning methods can only be applicable to the traditional networks abstracted as the graphs and not applicable to the hypernetworks abstracted as the hypergraphs. Therefore, this paper also introduces hypernetwork representation learning methods, including homogeneous hypernetwork representation learning and heterogeneous hypernetwork representation learning. Finally, this paper summarizes future research directions in network representation learning.
References
[1]
Zhu Y, Ye Z L, Zhao H X, Zhang K. Text-enhanced network representation learning [J]. Frontiers of Computer Science, 2020, 14(6): 146322.
[2]
Halevy N, Kalish Y. Broadening versus deepening: gender and brokering in social networks [J]. Social Psychological and Personality Science, 2022, 13(2): 618-625.
[3]
Toth I, Lazar Z I, Varga L, Jarai-Szabo F, Papp I, Florian R V, Ercsey-Ravasz M. Mitigating ageing bias in article level metrics using citation network analysis [J]. Journal of Informetrics, 2021, 15(1): 101105.
[4]
Zarbakhshnia N, Soleimani H, Goh M, Razavi S S. A novel multi-objective model for green forward and reverse logistics network design [J]. Journal of Cleaner Production, 2019, 208: 1304-1316.
[5]
Somolinos FJ, León C, Guerrero-Aspizua S. Drug repurposing using biological networks [J]. Processes, 2021, 9(6):1057.
[6]
Hong X B, Zhang T, Cui Z, Yang J. Variational gridded graph convolution network for node classification [J]. IEEE/CAA Journal of Automatica Sinica, 2021, 8(10): 1697-1708.
[7]
Wang J, Liu J, Zhao G S. Dynamic link prediction method of task and user in mobile crowd sensing [J]. Computer Communications, 2022, 189: 110-119.
[8]
Liu Z G, Yuan G X, Luo X. Symmetry and nonnegativity-constrained matrix factorization for community detection [J]. IEEE/CAA Journal of Automatica Sinica, 2022, 9(9):1691-1693.
[9]
Cen Y K, Zou X, Zhang J W, Yang H X, Zhou J R, Tang J. Representation learning for attributed multiplex heterogeneous network [C]. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2019, 1358-1368.
[10]
Mikolov T, Sutskever I, Chen K, Corrado G, Dean J. Distributed representations of words and phrases and their compositionality [C]. In Proceedings of the 26th International Conference on Neural Information Processing Systems, 2013, 3111-3119.
[11]
Perozzi B, Alrfou R, Skiena S. Deepwalk: online learning of social representations [C]. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2014, 701-710.
[12]
Tang J, Qu M, Wang M Z, Zhang M, Yan J, Mei Q Z. Line: large-scale information network embedding [C]. In Proceedings of the 24th International World Wide Web Conference, 2015, 1067-1077.
[13]
Grover A, Leskovec J. Node2vec: scalable feature learning for networks [C]. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2016, 855-864.
[14]
Yang C, Liu Z Y, Zhao D L, Sun M S, Chang E Y. Network representation learning with rich text information [C]. In Proceedings of the 24th International Joint Conference on Artificial Intelligence, 2015, 2111-2117.
[15]
Tu C C, Zeng X K, Wang H, Zhang Z Y, Liu Z Y, Sun M S, Zhang B, Lin L Y. A unified framework for community detection and network representation learning [J]. IEEE Transactions on Knowledge and Data Engineering, 2019, 31(6): 1051-1065.
[16]
Pan S R, Wu J, Zhu X Q, Zhang C Q, Wang Y. Tri-party deep network representation [C]. In Proceedings of the 25th International Joint Conference on Artificial Intelligence, 2016, 1895-1901.
[17]
Gao H C, Huang H. Deep attributed network embedding [C]. In Proceedings of the 27th International Joint Conference on Artificial Intelligence, 2018, 3364-3370.
[18]
Tang J, Qu M, Mei Q Z. PTE: predictive text embedding through large-scale heterogeneous text networks [C]. In Proceedings of the 21st ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2015, 1165-1174.
[19]
Dong Y X, Chawla N V, Swami A. Metapath2vec: scalable representation learning for heterogeneous networks [C]. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2017, 135-144.
[20]
Shi C, Hu B B, Zhao W X, Yu P S. Heterogeneous information network embedding for recommendation [J]. IEEE Transactions on Knowledge and Data Engineering, 2019, 31(2): 357-370.
[21]
Chang S Y, Han W, Tang J L, Qi G J, Aggarwal C C, Huang T S. Heterogeneous network embedding via deep architectures [C]. In Proceedings of the 21st ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2015, 119-128.
[22]
Liu W Y, Chen P Y, Yeung S, Suzumura T, Chen L L. Principled multilayer network embedding [C]. In Proceedings of the 17th IEEE International Conference on Data Mining, 2017, 134-141.
[23]
Qu M, Tang J, Shang J B, Ren X, Zhang M, Han J W. An attention-based collaboration framework for multi-view network representation learning [C]. In Proceedings of the 26th ACM International Conference on Information and Knowledge Management, 2017, 1767-1776.
[24]
Shi Y, Han F Q, He X W, Yang C, Luo J, Han J W. Mvn2vec: preservation and collaboration in multi-view network embedding [EB/OL] [2018-1-19]. https://doi.org/10.48550/arXiv.1801.06597.
[25]
Symeonidis P. Matrix and tensor decomposition in recommender systems [C]. In Proceedings of the 10th ACM Conference on Recommender Systems, 2016, 429-430.
[26]
Zhou D Y, Huang J Y, Schölkopf B. Learning with hypergraphs: clustering, classification and embedding[C]. In Proceedings of the 19th International Conference on Neural Information Processing Systems, 2006, 1601-1608.
[27]
Yadati N, Nimishakavi M, Yadav P, Nitin V, Louis A, Talukdar P. HyperGCN: a new method of training graph convolutional networks on hypergraphs [C]. In Proceedings of the 32nd International Conference on Neural Information Processing Systems, 2019.
[28]
Bai S, Zhang F H, Torr P H S. Hypergraph convolution and hypergraph attention [J]. Pattern Recognition, 2021, 110(1):107637-107667.
[29]
Jiang J W, Wei Y X, Feng Y F, Cao J X, Gao Y. Dynamic hypergraph neural networks [C]. In Proceedings of the 28th International Joint Conference on Artificial Intelligence, 2019, 2635-2641.
[30]
Feng Y F, You H X, Zhang Z Z, Ji R R, Gao Y. Hypergraph neural networks [C]. In Proceedings of the 33rd AAAI Conference on Artificial Intelligence, 2019, 3558-3565.
[31]
Krishna K, Murty M N. Genetic k-means algorithm [J]. IEEE Transactions on Systems Man and Cybernetics, 1999, 29(3): 433-439.
[32]
Gui H, Liu J L, Tao F B, Jiang M, Norick B Han J W. Large-scale embedding learning in heterogeneous event data [C]. In Proceedings of the 16th IEEE International Conference on Data Mining, 2016, 907-912.
[33]
Baytas I M, Xiao C, Wang F, Jain A K, Zhou J Y. Heterogeneous hyper-network embedding [C]. In Proceedings of the 18th IEEE International Conference on Data Mining, 2018, 875-880.
[34]
Tu K, Cui P, Wang X, Wang F, Zhu W W. Structural deep embedding for hyper-networks [C]. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence, 2018, 426-433.
[35]
Zhang R C, Zou Y S, Ma J. Hyper-SAGNN: a self-attention based graph neural network for hypergraphs. [EB/OL]. [2019-11-6]. https://doi.org/10.48550/arXiv.1911.02613.
[36]
Huang J, Liu X, Song Y Q. Hyper-path-based representation learning for hyper-networks [C]. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management, 2019, 449-458.
Index terms have been assigned to the content through auto-classification.
Recommendations
A survey on heterogeneous network representation learning
Highlights- We put forward a novel taxonomy of existing heterogeneous network representation learning algorithms, including path based algorithms, semantic unit based ...
AbstractHeterogeneous information networks usually contain different kinds of nodes and distinguishing types of relations, which can preserve more information than homogeneous information networks. Heterogeneous network representation learning ...
Deep Inductive Network Representation Learning
WWW '18: Companion Proceedings of the The Web Conference 2018This paper presents a general inductive graph representation learning framework called DeepGL for learning deep node and edge features that generalize across-networks. In particular, DeepGL begins by deriving a set of base features from the graph (e.g., ...
A survey of structural representation learning for social networks
Highlights- Structural similarity metrics and learning techniques are introduced.
- A method for classifying algorithms by network structure is proposed.
- General applications and research directions of network embedding are promoted.
AbstractSocial networks have a plethora of applications, and analysis of these applications has been gaining much interest from the research community. The high dimensionality of social network data poses a significant obstacle in its analysis, leading ...
Comments
Information & Contributors
Information
Published In
June 2023
354 pages
ISBN:9781450399883
DOI:10.1145/3606043
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 16 November 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- the National Natural Science Foundation of China
- the grant of Tsinghua University
- the Natural Science Foundation of Qinghai Province
- the Open Project of State Key Laboratory of Plateau Ecology and Agriculture, Qinghai University
Conference
HP3C 2023
HP3C 2023: 2023 7th International Conference on High Performance Compilation, Computing and Communications
June 17 - 19, 2023
Jinan, China
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 54Total Downloads
- Downloads (Last 12 months)41
- Downloads (Last 6 weeks)5
Reflects downloads up to 03 Mar 2025
Other Metrics
Citations
Cited By
View all- Nahali SSafari LKhanteymoori AHuang J(2024)StructmRNA a BERT based model with dual level and conditional masking for mRNA representationScientific Reports10.1038/s41598-024-77172-514:1Online publication date: 29-Oct-2024
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format