Skip to main content
Log in

Block diagonal dominance-based dynamic programming for detecting community

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Clustering or partition is a fundamental work for graph or network. Detecting communities is a typical clustering, which divides a network into several parts according to the modularity. Community detection is a critical challenge for designing scalable, adaptive and survivable trust management protocol for a community of interest-based social IoT system. Most of the existed methods on community detection suffer from a common issue that the number of communities should be prior decided. This urges us to estimate the number of communities from the data by some way. This paper concurrently considers eliminating the number of communities and detecting communities based on block diagonal dominace adjacency matrix. To construct a block diagonal dominance adjacency matrix for the input network, it first reorders the node number by the breadth-first search algorithm. For the block diagonal dominance adjacency matrix, this paper shows that the numbers of nodes in a community should be continuous adjacent. And thus, it only needs insert some breakpoints in node number sequence to decide the number of communities and the nodes in every community. In addition, a dynamic programming algorithm is designed to achieve an optimal community detection result. Experimental results on a number of real-world networks show the effectiveness of the dynamic programming approach on the community detection problem.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Atzori L, Iera A, Morabito G (2010) The internet of things: a survey. Comput Netw 54(15):2787–2805

    Article  Google Scholar 

  2. Atzori L, Iera A, Morabito G (2011) SIoT: giving a social structure to the internet of things. IEEE Commun Lett 15(11):1193–1195

    Article  Google Scholar 

  3. Blondel VD, Guillaume J-L, Lambiotte R, Lefebvre E (2008) Fast unfolding of communities in large networks. J Stat Mech: Theory Exp 10:P10008

    Article  Google Scholar 

  4. Bruna J, Li X (2017) Community detection with graph neural networks. arXiv preprint, arXiv:1705.08415

  5. Chen T, Singh P, Bassler KE (2018) Network community detection using modularity density measures. J Stat Mech Theory Exp 053406

  6. Chen Z, Li L, Bruna J (2019) Supervised community detection with hierarchical graph neural networks. In International Conference on Learning Representations (ICLR)

  7. Chen C-M, Xiang B, Liu Y, Wang K-H (2019) A secure authentication protocol for internet of vehicles. IEEE Access 7(1):12047–12057

    Article  Google Scholar 

  8. Come E, Latouche P (2015) Model selection and clustering in stochastic block models based on the exact integrated complete data likelihood. Stat Model 15:564–589

    Article  MathSciNet  Google Scholar 

  9. Daudin JJ, Picard F, Robin S (2008) A mixture model for random graphs. Stat Comput 18:173–183

    Article  MathSciNet  Google Scholar 

  10. Fortunato S (2010) Community detection in graphs. Phys Rep 486:75–174

    Article  MathSciNet  Google Scholar 

  11. Fortunato S, Hric D (2016) Community detection in networks: a user guide. Phys Rep 659:1–44

    Article  MathSciNet  Google Scholar 

  12. Girvan M, Newman MEJ (2002) Community structure in social and biological networks. Proc Natl Acad Sci USA 99:7821–7826

    Article  MathSciNet  Google Scholar 

  13. Guo K, Guo W, Chen Y, Qiu Q, Zhang Q (2015) Community discovery by propagating local and global information based on the MapReduce model. Inf Sci 323:73–93

    Article  MathSciNet  Google Scholar 

  14. Guimera R, Sales-Pardo M (2009) Missing and spurious interactions and the reconstruction of complex networks. Proc Natl Acad Sci USA 106:22073–22078

    Article  Google Scholar 

  15. Handcock MS, Raftery AE, Tantrum JM (2007) Model-based clustering for social networks. J R Stat Soc A 170:301–354

    Article  MathSciNet  Google Scholar 

  16. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. Comput Vis Pattern Recogn, pp 770–778

  17. Karrer B, Newman MEJ (2011) Stochastic block models and community structure in networks. Phys Rev E 83:016107

    Article  MathSciNet  Google Scholar 

  18. Krzakala F, Moore C, Mossel E, Neeman J, Sly A, Zdeborov L, Zhang P (2013) Spectral redemption in clustering sparse networks. Proc Nat Acad Sci 110(52):20935–20940

    Article  MathSciNet  Google Scholar 

  19. Latouche P, Birmel’e E, Ambroise C (2009) Bayesian methods for graph clustering. In Advances in Data Analysis, Data Handling, and Business Intelligence. Springer, Berlin, pp 229–239

  20. Latouche P, Birmele E, Ambroise C (2012) Variational Bayesian inference and complexity control for stochastic block models. Stat Model 12:93–115

    Article  MathSciNet  Google Scholar 

  21. Luo F, Guo W, Yu Y, Chen G (2016) A multi-label classification algorithm based on kernel extreme learning machine. Neurocomputing 260:313–320

    Article  Google Scholar 

  22. Massouli’e L (2014) Community detection thresholds and the weak Ramanujan property. In Proceedings of the 46th Annual ACM Symposium on the Theory of Computing, pp 694–703, Association of Computing Machinery, New York

  23. McDaid AF, Murphy TB, Friel N, Hurley N (2013) Improved Bayesian inference for the stochastic block model with application to large networks. Comput Stat Data Anal 60:12–31

    Article  MathSciNet  Google Scholar 

  24. Newman MEJ, Reinert G (2016) Estimating the number of communities in a network. Phys Rev Lett 117:078301

    Article  Google Scholar 

  25. Newman M E J (2016) Community detection in networks: Modularity optimization and maximum likelihood are equivalent. arXiv preprint arXiv:1606.02319

  26. Pan J-S, Lee C-Y, Sghaier A, Zeghid M, Xie J (2019) Novel systolization of subquadratic space complexity multipliers based on toeplitz matrix-vector product approach. IEEE Trans Very Large Scale Int Syst 27(7):1614–1622

    Article  Google Scholar 

  27. Peixoto TP (2014) Hierarchical block structures and high-resolution model selection in large networks. Phys Rev X 4:011047

    Google Scholar 

  28. Peixoto TP (2017) Nonparametric Bayesian inference of the microcanonical stochastic block model. Phys Rev E 95:012317

    Article  Google Scholar 

  29. Riolo M A, Cantwell G T, Reinert G, Newman M E J (2017) Efficient method for estimating the number of communities in a network. arXiv:1706.02324v1

  30. Sukhbaatar S, Szlam A, Fergus R (2016) Learning multiagent communication with backpropagation. Adv Neural Inf Process Syst, pp 2244–2252

  31. Tai K, Socher R, Manning C (2015) Improved semantic representations from tree-structured long short-term memory networks. Association for Computational Linguistics (ACL), pp 1556–1566

  32. Wang S, Guo W (2017) Sparse multi-graph embedding for multimodal feature representation. IEEE Trans Multimedia 19(7):1454–1466

    Article  Google Scholar 

  33. Wu T-Y, Chen C-M, Wang K-H, Meng C, Wang EK (2019) A provably secure certificateless public key encryption with keyword search. J Chinese Inst Eng 42(1):20–28

    Article  Google Scholar 

  34. Yan X (2016) Bayesian model selection of stochastic block models. In Proceedings of the 2016 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, pp 323–328

  35. Yang J, Leskovec J (2015) Defining and evaluating network communities based on ground-truth. Knowl Inf Syst 42:181–213

    Article  Google Scholar 

  36. Yang Y, Liu X, Zheng X, Rong C, Guo W (2018) Efficient traceable authorization search system for secure cloud storage. IEEE Trans Cloud Comput. https://doi.org/10.1109/TCC.2018.2820714

    Article  Google Scholar 

  37. Ye F, Chen C, Wen Z, Zheng Z, Chen W, Zhou Y (2019) Homophily preserving community detection. IEEE Trans Neural Netw Learn Syst. https://doi.org/10.1109/TNNLS.2019.2933850

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported in part by the National Natural Science Foundation of China (NSFC) under Grants (No. 61907024), and the Starting Research Fund from Minnan Normal University (No. KJ18009), and the Open Fund of Key Laboratory of Urban Land Resources Monitoring and Simulation, Ministry of Land and Resources (No. KF201803065).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xingquan Li.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, X., Cao, C. & Zhang, T. Block diagonal dominance-based dynamic programming for detecting community. J Supercomput 76, 8627–8640 (2020). https://doi.org/10.1007/s11227-020-03151-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-020-03151-y

Keywords

Navigation