Abstract
Graph representation learning (GRL) has recently gained attention and becoming popular in research community. GRL has been proven to be extremely handy for transforming large and complex network data onto a low-dimensional vector space. It opens the door to many vector-based algorithms such as link prediction, recommendation, and classification to be effectively applied to the network data. Though many GRL algorithms exist for homogeneous (one-mode) graphs, however only a few methods exist for bipartite (two-mode) graphs. Most of the existing methods for bipartite graph representation learning mainly focus on graph topology and ignore the information available in the attributes of the nodes. In this paper, we propose a novel “Attributed and Structural Bipartite Network Embedding” (ASBiNE) method. The ASBiNE incorporates both the graph topological information concerning inter-partition and intra-partition links and attributes information by generating proximity between nodes having attribute similarities. Intermediate embeddings are generated by modeling the intra-partition links in homogeneous structural and attribute networks separately, which in the end are combined through a joint optimization framework, and final embeddings are generated. The attribute and structural information share is controlled before the joint optimization step. The proposed method is evaluated on a real-life dataset through extensive experiments. The results show that the proposed method is effective and outperforms state-of-the-art baseline embedding methods.
Similar content being viewed by others
Availability of data and material
All datasets used in this study are publicly available.
References
Jia, Y., Gu, Z., Jiang, Z., Gao, C., Yang, J.: Persistent graph stream summarization for real-time graph analytics. World Wide Web 1–21 (2023)
Arsov, N., Mirceva, G.: Network embedding: an overview. Preprint at http://arxiv.org/abs/1911.11726 (2019)
Wang, Y., Yao, Y., Tong, H., Feng, X., Jian, L.: A brief review of network embedding. Big Data Min. Anal. 2(1), 35–47 (2019)
Perozzi, B., Al-Rfou, R., Skiena, S.: Deepwalk: online learning of social representations. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD ’14, New York, NY, USA, pp 701–710. Association for Computing Machinery (2014)
Grover, A., Leskovec, J.: Node2vec: scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD ’16, New York, NY, USA, pp 855–864. Association for Computing Machinery (2016)
Tang, J., Qu, M., Wang, M., Zhang, M., Yan, J., Mei, Q.: Line: large-scale information network embedding. In: Proceedings of the 24th International Conference on World Wide Web, WWW ’15, Republic and Canton of Geneva, CHE, pp 1067–1077. International World Wide Web Conferences Steering Committee (2015)
Spanurattana, S., Murata T.: Visual analysis of bipartite networks. In: 2013 IEEE 13th International Conference on Data Mining Workshops, Los Alamitos, CA, USA, pp. 833–838. IEEE Computer Society (2011)
Xue, H., Yang., L., Rajan, V., Jiang, W., Wei, Y., Lin, Y.: Multiplex bipartite network embedding using dual hypergraph convolutional networks. In: Proceedings of the Web Conference 2021, WWW ’21, New York, NY, USA, pp 1649–1660. Association for Computing Machinery (2021)
Cao, J., Lin, X., Guo, S., Liu, L., Liu, T., Wang, B.: Bipartite graph embedding via mutual information maximization. In: Proceedings of the 14th ACM International Conference on Web Search and Data Mining, New York, NY, USA, pp 635–643. Association for Computing Machinery (2021)
Gao, M., Chen, L., He, X., Zhou, A.: Bine: Bipartite network embedding. In: The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, SIGIR ’18, New York, NY, USA, pp 715–724. Association for Computing Machinery (2018)
Huang, W., Li, Y., Fang, Y., Fan, J., Yang, H.: Biane: Bipartite attributed network embedding. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR ’20, New York, NY, USA, pp 149–158. Association for Computing Machinery (2020)
Na, S., Luo, Y., Yang, Z., Wang, Z., Kolar, M.: Semiparametric nonlinear Bipartite graph representation learning with provable guarantees. Preprint at http://arxiv.org/abs/2003.01013 (2020)
Li, R., Zhang, S., Wan, B., He, X.: Bipartite graph network with adaptive message passing for unbiased scene graph generation. In: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Los Alamitos, CA, USA, pp 11104–11114. IEEE Computer Society (2021)
Li, C., Jia, K., Shen, D., Richard Shi, C.J., Yang, H.: Hierarchical representation learning for bipartite graphs. In: Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, IJCAI-19, pp 2873–2879. International Joint Conferences on Artificial Intelligence Organization (2019)
Ahmed, H., Ali, S.: Research on bipartite network embedding with auxiliary information. In: 2019 IEEE 10th International Conference on Software Engineering and Service Science (ICSESS), Beijing, China, pp. 1–6. IEEE (2019)
Gao, M., He, X., Chen, L., Liu, T., Zhang, J., Zhou, A.: Learning vertex representations for bipartite networks. IEEE Trans. Knowl. Data Eng. 34(1), 379–393 (2022)
Kaya, B.: Hotel recommendation system by bipartite networks and link prediction. J. Inf. Sci. 46, 016555151882457 (2019)
Sheikh, N., Kefato, Z., Montresor, A.: gat2vec: representation learning for attributed graphs. Computing 101(3), 187–209 (2019)
Shen, Y., Traganitis, P.A., Giannakis, G.B.: Nonlinear dimensionality reduction on graphs. CoRR, abs/1801.09390 (2018)
Chen, H., Perozzi, B., Al-Rfou, R., Skiena, S.: A tutorial on network embeddings. CoRR, abs/1808.02590 (2018)
Cao, S., Lu, W., Xu, Q.: Grarep: Learning graph representations with global structural information. In: Proceedings of the 24th ACM International on Conference on Information and Knowledge Management, CIKM ’15, New York, NY, USA, pp 891–900. Association for Computing Machinery (2015)
Ou, M., Cui, P., Pei, J., Zhang, Z., Zhu, W.: Asymmetric transitivity preserving graph embedding. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD ’16, New York, NY, USA, pp 1105–1114. Association for Computing Machinery (2016)
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Proceedings of the 26th International Conference on Neural Information Processing Systems - Volume 2, NIPS’13, Red Hook, NY, USA, pp 3111–3119. Curran Associates Inc (2013)
Dong, Y., Chawla, N.V., Swami, A.: Metapath2vec: scalable representation learning for heterogeneous networks. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD ’17, New York, NY, USA, pp. 135–144. Association for Computing Machinery (2017)
Fu, T-Y., Lee, W-C., Lei, Z.: Hin2vec: explore meta-paths in heterogeneous information networks for representation learning. In: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, CIKM ’17, New York, NY, USA, pp 1797–1806. Association for Computing Machinery (2017)
Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks (2017)
Kipf, T.N., Welling, M.: Variational graph auto-encoders. Preprint at https://arxiv.org/abs/1611.07308 (2016)
Hamilton, W.L., Ying, R., Leskovec, J.: Inductive representation learning on large graphs. In: Proceedings of the 31st International Conference on Neural Information Processing Systems, NIPS’17, Red Hook, NY, USA, pp. 1025–1035. Curran Associates Inc (2017)
Ying, R., He, R., Chen, K., Eksombatchai, P., Hamilton, W.L., Leskovec, J.: Graph convolutional neural networks for web-scale recommender systems. CoRR, abs/1806.01973 (2018)
Wang, D., Cui, P., Zhu, W.: Structural deep network embedding. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD ’16, New York, NY, USA, pp. 1225–1234. Association for Computing Machinery (2016)
Jia, Y., Lin, M., Wang, Y., Li, J., Chen, K., Siebert, J., Zhang, G.Z., Liao, Q.: Extrapolation over temporal knowledge graph via hyperbolic embedding. CAAI Transactions on Intelligence Technology n/a(n/a)
Song, X., Li, J., Cai, T., Yang, S., Yang, T., Liu, C.: A survey on deep learning based knowledge tracing. Knowledge-Based Systems 258:110036
Chang, S., Han, W., Tang, J., Qi, G.-J., Aggarwal, C.C., Huang, T.S.: Heterogeneous network embedding via deep architectures. In: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD ’15, New York, NY, USA, pp. 119–128. Association for Computing Machinery (2015)
Lu, Y., Shi, C., Hu, L., Liu, Z.: Relation structure-aware heterogeneous information network embedding. CoRR, abs/1905.08027 (2019)
Chen, X., Yu, G., Wang, J., Domeniconi, C., Li, Z., Zhang, X.: ActiveHNE: active heterogeneous network embedding. In: Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, IJCAI-19, pp 2123–2129. International Joint Conferences on Artificial Intelligence Organization (2019)
Xu, L., Wei, X., Cao, J., Yu, P.S.: Embedding of embedding (EOE): Joint embedding for coupled heterogeneous networks. In: Proceedings of the Tenth ACM International Conference on Web Search and Data Mining, WSDM ’17, New York, NY, USA, pp 741–749. Association for Computing Machinery (2017)
Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. Preprint at http://arxiv.org/abs/1301.3781 (2013)
Yoon, Y., Hong, J., Kim, W.: Item recommendation by predicting bipartite network embedding of user preference. Expert Syst. Appl. 151, 113339 (2020)
Cai, X., Zhao, W., Zhao, J., Guan, Z., Song, X., Li, J.: Uncertainty-aware multiview deep learning for internet of things applications. IEEE Trans. Industr. Inf. 19(2), 1456–1466 (2023)
Xu, C., Guan, Z., Zhao, W., Wu, H., Niu, Y., Ling, B.: Adversarial incomplete multi-view clustering. In: Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, IJCAI-19, pp. 3933–3939. International Joint Conferences on Artificial Intelligence Organization (2019)
Xie, Y., Gong, M., Gao, Y., Qin, A.K., Fan, X.: A multi-task representation learning architecture for enhanced graph classification. Front. Neurosci. 13 (2020)
Hancock, J.T., Khoshgoftaar, T.M.: Survey on categorical data for neural networks. J. Big Data 7, 1–41 (2020)
Chen, W., Liu, T.-Y., Lan, Y., Ma, Z., Li, H.: Ranking measures and loss functions in learning to rank. In: Proceedings of the 22nd International Conference on Neural Information Processing Systems, NIPS’09, pp. 315–323. Red Hook, NY, USA. Curran Associates Inc (2009)
Hou, C., He, S., Tang, K.: Attributed network embedding for incomplete structure information. CoRR, abs/1811.11728 (2018)
Funding
Zafar Saeed was funded by the project FAIR - Future AI Research (PE00000013), Spoke 6 - Symbiotic AI, under the NRRP MUR program funded by NextGenerationEU.
Author information
Authors and Affiliations
Contributions
Sajjad Athar performed experimental analysis and design, Rabeeh Ayaz Abbasi led the experiment. Zafar Saeed and Anwar Said assisted in writing and experiments. Imran Razzak and Flora Salim assisted in methodology and writing.
Corresponding author
Ethics declarations
Ethical approval
This research does not involve both human and/ or animal studies.
Conflict of interest
The authors declare no known potential conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This article belongs to the Topical Collection: Special Issue on Fairness-driven User Behavioral Modelling and Analysis for Online Recommendation
Guest Editors: Jianxin Li, Guandong Xu, Xiang Ren, and Qing Li.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Athar, S., Abbasi, R.A., Saeed, Z. et al. ASBiNE: Dynamic Bipartite Network Embedding for incorporating structural and attribute information. World Wide Web 26, 3463–3481 (2023). https://doi.org/10.1007/s11280-023-01189-5
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11280-023-01189-5