Abstract
This paper addresses attributed network embedding which maps the structural information and multi-modal attribute data into a latent space. Most existing network embedding algorithms concentrate on either node-oriented modeling or edge-oriented modeling, resulting in unilaterally capturing information from nodes or edges. However, there is no effective method to bilaterally extract node attributes cooperated with edge attributes, which delineates the outline and detail of social network. To this end, we propose a novel Node-Edge Bilateral Attributed Network Embedding method named NEBANE. Regarding each edge as a specific node, we construct a pioneering node-edge-node triangular structure for bilateral information modeling on both nodes and edges. Furthermore, we envisage a pairwise loss which maximizes the likelihood of connected node pairs and of connected node-edge pairs to measure the node-node and node-edge similarity. Empirically, experiments on two real-world datasets, including link prediction and node classification, are conducted in this paper. Our method achieves substantial performance gains compared with state-of-the-art baselines (e.g., 4.21%–13.65% lift by AUC scores for link prediction).
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Grover, A., Leskovec, J.: node2vec: scalable feature learning for networks. In: ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2016)
Bordes, A., Usunier, N., Garcia-Duran, A., Weston, J., Yakhnenko, O.: Translating embeddings for modeling multi-relational data. In: Advances in Neural Information Processing Systems, pp. 2787–2795 (2013)
Cao, B., Liu, N.N., Yang, Q.: Transfer learning for collective link prediction in multiple heterogenous domains. In: International Conference on International Conference on Machine Learning (2010)
Cao, S.: Deep neural network for learning graph representations. In: Thirtieth AAAI Conference on Artificial Intelligence (2016)
Cheng, Y., Zhao, D., Zhao, D., Chang, E.Y., Chang, E.Y.: Network representation learning with rich text information. In: International Conference on Artificial Intelligence (2015)
Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift. In: International Conference on Machine Learning, pp. 448–456 (2015)
Jie, T., Jing, Z., Yao, L., Li, J., Zhong, S.: ArnetMiner: extraction and mining of academic social networks. In: ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2008)
Kingma, D., Ba, J.: Adam: a method for stochastic optimization. Computer Science (2014)
Le, Q., Mikolov, T.: Distributed representations of sentences and documents. In: International Conference on Machine Learning, pp. 1188–1196 (2014)
Li, J., Dani, H., Hu, X., Liu, H.: Radar: residual analysis for anomaly detection in attributed networks. In: IJCAI 2017 (2017)
Liao, L., He, X., Zhang, H., Chua, T.S.: Attributed social network embedding. IEEE Trans. Knowl. Data Eng. 30(12), 2257–2270 (2017)
Lin, Y., Liu, Z., Sun, M., Liu, Y., Zhu, X.: Learning entity and relation embeddings for knowledge graph completion. In: Twenty-ninth AAAI Conference on Artificial Intelligence (2015)
Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. Computer Science (2013)
Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Advances in Neural Information Processing Systems, pp. 3111–3119 (2013)
Pan, S., Wu, J., Zhu, X., Zhang, C., Wang, Y.: Tri-party deep network representation. In: International Joint Conference on Artificial Intelligence (2016)
Perozzi, B., Al-Rfou, R., Skiena, S.: DeepWalk: online learning of social representations. In: ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2014)
Tang, J., Qu, M., Wang, M., Zhang, M., Yan, J., Mei, Q.: LINE: large-scale information network embedding. In: Proceedings of the 24th International Conference on World Wide Web, pp. 1067–1077. International World Wide Web Conferences Steering Committee (2015)
Tang, J., Aggarwal, C., Liu, H.: Node classification in signed social networks. In: Proceedings of the 2016 SIAM International Conference on Data Mining, pp. 54–62. SIAM (2016)
Tu, C., Zhang, Z., Liu, Z., Sun, M.: TransNet: translation-based network representation learning for social relation extraction. In: International Joint Conference on Artificial Intelligence (2017)
Vinh, N.X., Epps, J., Bailey, J.: Information theoretic measures for clusterings comparison: variants, properties, normalization and correction for chance. J. Mach. Learn. Res. 11(1), 2837–2854 (2010)
Wang, D., Peng, C., Zhu, W.: Structural deep network embedding. In: ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2016)
Wang, Z., Zhang, J., Feng, J., Chen, Z.: Knowledge graph embedding by translating on hyperplanes. In: AAAI, vol. 14, pp. 1112–1119 (2014)
Xiao, H., Li, J., Xia, H.: Label informed attributed network embedding. In: Tenth ACM International Conference on Web Search and Data Mining (2017)
Yao, Z., Yun, X., Kong, X., Zhu, Y.: Learning node embeddings in interaction graphs. In: ACM on Conference on Information and Knowledge Management (2017)
Acknowledgements
This work is supported by the National Natural Science Foundation of China (No. U163620068).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Mo, J., Gao, N., Xiang, J., Zha, D. (2019). Node-Edge Bilateral Attributed Network Embedding. In: Gedeon, T., Wong, K., Lee, M. (eds) Neural Information Processing. ICONIP 2019. Communications in Computer and Information Science, vol 1143. Springer, Cham. https://doi.org/10.1007/978-3-030-36802-9_51
Download citation
DOI: https://doi.org/10.1007/978-3-030-36802-9_51
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-36801-2
Online ISBN: 978-3-030-36802-9
eBook Packages: Computer ScienceComputer Science (R0)