Abstract
A novel model-based machine-learning approach is presented for the unsupervised and exploratory analysis of node affiliations to overlapping communities with roles in networks. At the heart of our approach is a new Bayesian probabilistic generative model of directed networks, that treats roles as abstract behavioral classes explaining node linking behavior. A generalized weighted instance of directed affiliation modeling rules the strength of node participation in communities with whichever role through Gamma priors. Moreover, link establishment between nodes is governed by a Poisson distribution. The latter is parameterized so that, the stronger the affiliations of two nodes to common communities with respective roles, the more likely it is the formation of a connection. A coordinate-ascent algorithm is designed to implement mean-field variational inference for affiliation analysis and link prediction. A comparative experimentation on real-world networks demonstrates the superiority of our approach in community compactness, link prediction and scalability.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bishop, C.M.: Pattern Recognition and Machine Learning. Springer, New York (2006)
Blei, D., Kucukelbir, A., McAuliffe, J.: Variational inference: a review forstatisticians. arXiv:1601.00670 (2016)
Chatterjee, N., Sinha, S.: Understanding the mind of a worm: hierarchical network structure underlying nervous system function in C. elegans. In: Banerjee, R., Chakrabarti, B.K. (eds) Progress in Brain Research, pp. 145–153. Elsevier (2008)
Costa, G., Ortale, R.: A bayesian hierarchical approach for exploratory analysis of communities and roles in social networks. In: Proceedings of the IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, pp. 194–201 (2012)
Costa, G., Ortale, R.: Probabilistic analysis of communities and inner roles in networks: Bayesian generative models and approximate inference. Soc. Netw. Anal. Min. 3(4), 1015–1038 (2013)
Costa, G., Ortale, R.: A unified generative bayesian model for communitydiscovery and role assignment based upon latent interaction factors. In: IEEE/ACMASONAM, pp. 93–100 (2014)
Costa, G., Ortale, R.: Model-based collaborative personalized recommendation on signed social rating networks. ACM Trans. Int. Technol. 16(3), 20:1–20:21 (2016)
Creamer, G., Rowe, R., Hershkop, S., Stolfo, S.J.: Segmentation and automated social hierarchy detection through email network analysis. In: Zhang, H., Spiliopoulou, M., Mobasher, B., Giles, C.L., McCallum, A., Nasraoui, O., Srivastava, J., Yen, J. (eds.) SNAKDD/WebKDD -2007. LNCS (LNAI), vol. 5439, pp. 40–58. Springer, Heidelberg (2009). doi:10.1007/978-3-642-00528-2_3
Gopalan, P., Hofman, J., Blei, D.: Scalable recommendation with hierarchical Poisson factorization. In: UAI, pp. 326–335 (2015)
Henderson, K., Eliassi-Rad, T., Papadimitriou, S., Faloutsos, C.: HCDF: a hybrid community discovery framework. In: Proceedings of SIAM International Conference on Data Mining, pp. 754–765 (2010)
Henderson, K., Eliassi Rad, T.: Applying latent dirichlet allocation to group discovery in large graphs. In: Proceedings of ACM Symposium on Applied Computing, pp. 1456–1461 (2009)
Lattanzi, S., Sivakumar, D.: Affiliation networks. In: ACM STOC, pp. 427–434 (2009)
McAuley, J., Leskovec, J.: Learning to discover social circles in ego networks. In: NIPS, pp. 548–556 (2012)
Pathak, N., Delong, C., Banerjee, A., Erickson, K.: Social topic models for community extraction. In: Proceedings of KDD Workshop on Social Network Mining and Analysis (2008)
Sohn, Y., Choi, M.-K., Ahn, Y.-Y., Lee, J., Jeong, J.: Topological cluster analysis reveals the systemic organization of the caenorhabditis elegans connectome. PLoS Comput. Biol. 7(5), e1001139 (2011)
Watts, D.J., Strogatz, S.H.: Collective dynamics of small-world networks. Nature 393(6684), 440–442 (1998)
White, J.G., Southgate, E., Thompson, J.N., Brenner, S.: The structure of the nervous system of the nematode caenorhabditis elegans. Philos. Trans. Royal Soc. B Biol. Sci. 314(1165), 1–340 (1986)
Yang, J., Leskovec, J.: Structure, overlaps of ground-truth communities in networks. ACM Trans. Intell. Syst. Technol. 5(2), 26:1–26:35 (2014)
Yang, J., McAuley, J., Leskovec, J.: Detecting cohesive and 2-mode communities in directed and undirected networks. In: WSDM, pp. 323–332 (2014)
Zhang, H., Qiu, B., Giles, C.L., Foley, H.C., Yen, J.: An LDA-based community structure discovery approach for large-scale social networks. In: IEEE ISI, pp. 200–207 (2007)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing AG
About this paper
Cite this paper
Costa, G., Ortale, R. (2016). A Mean-Field Variational Bayesian Approach to Detecting Overlapping Communities with Inner Roles Using Poisson Link Generation. In: Boström, H., Knobbe, A., Soares, C., Papapetrou, P. (eds) Advances in Intelligent Data Analysis XV. IDA 2016. Lecture Notes in Computer Science(), vol 9897. Springer, Cham. https://doi.org/10.1007/978-3-319-46349-0_10
Download citation
DOI: https://doi.org/10.1007/978-3-319-46349-0_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-46348-3
Online ISBN: 978-3-319-46349-0
eBook Packages: Computer ScienceComputer Science (R0)