skip to main content
10.1145/1871437.1871469acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
research-article

SHRINK: a structural clustering algorithm for detecting hierarchical communities in networks

Published: 26 October 2010 Publication History

Abstract

Community detection is an important task for mining the structure and function of complex networks. Generally, there are several different kinds of nodes in a network which are cluster nodes densely connected within communities, as well as some special nodes like hubs bridging multiple communities and outliers marginally connected with a community. In addition, it has been shown that there is a hierarchical structure in complex networks with communities embedded within other communities. Therefore, a good algorithm is desirable to be able to not only detect hierarchical communities, but also identify hubs and outliers. In this paper, we propose a parameter-free hierarchical network clustering algorithm SHRINK by combining the advantages of density-based clustering and modularity optimization methods. Based on the structural connectivity information, the proposed algorithm can effectively reveal the embedded hierarchical community structure with multiresolution in large-scale weighted undirected networks, and identify hubs and outliers as well. Moreover, it overcomes the sensitive threshold problem of density-based clustering algorithms and the resolution limit possessed by other modularity-based methods. To illustrate our methodology, we conduct experiments with both real-world and synthetic datasets for community detection, and compare with many other baseline methods. Experimental results demonstrate that SHRINK achieves the best performance with consistent improvements.

References

[1]
M. Ankerst, M. M. Breunig, H.-P. Kriegel, and J. Sander. Optics: Ordering points to identify the clustering structure. In SIGMOD, pages 49--60, 1999.
[2]
A. Arenas, A. Fernandez, and S. Gomez. Analysis of the structure of complex networks at different resolution levels. New Journal of Physics, 10(5):053039, 2008.
[3]
V. D. Blondel, J.-L. Guillaume, R. Lambiotte, and E. Lefebvre. Fast unfolding of communities in large networks. Journal of Statistical Mechanics: Theory and Experiment, 2008(10):P10008+, October 2008.
[4]
D. Bortner and J. Han. Progressive clustering of networks using structure-connected order of traversal. In Proc. of ICDE'10, pages 653--656, 2010.
[5]
D. Chakrabarti, Y. Wang, C. Wang, J. Leskovec, and C. Faloutsos. Epidemic thresholds in real networks. ACM Transactions on Information and System Security, 10(4):1--26, 2008.
[6]
A. Clauset, M. E. J. Newman, and C. Moore. Finding community structure in very large networks. Phys. Rev. E, 70(6):066111, Dec 2004.
[7]
P. Domingos and M. Richardson. Mining the network value of customers. In Proc. of KDD'01, pages 57--66, New York, NY, USA, 2001. ACM.
[8]
M. Ester, H. Kriegel, J. Sander, and X. Xu. A density-based algorithm for discovering clusters in large spatial databases with noise. In KDD'99.
[9]
Z. Feng, X. Xu, N. Yuruk, and T. A. J. Schweiger. A novel similarity-based modularity function for graph partitioning. In DaWak'07, pages 385--396, 2007.
[10]
S. Fortunato and M. Barthélemy. Resolution limit in community detection. PNAS, 104(1):36, 2007.
[11]
M. Girvan and M. E. J. Newman. Community structure in social and biological networks. PNAS, 99(12):7821--7826, 2002.
[12]
R. Guimerà and L. A. Nunes Amaral. Functional cartography of complex metabolic networks. Nature, 433(7028):895--900, February 2005.
[13]
B. W. Kernighan and S. Lin. An efficient heuristic procedure for partitioning graphs. The Bell System Technical Journal, 49(1):291--307, 1970.
[14]
J. Kleinberg. Authoritative sources in a hyperlinked environment. In SODA, pages 668--677, 1998.
[15]
A. Lancichinetti and S. Fortunato. Community detection algorithms: A comparative analysis. Phys. Rev. E, 80(5):056117, Nov 2009.
[16]
A. Lancichinetti, S. Fortunato, and J. Kertesz. Detecting the overlapping and hierarchical community structure in complex networks. New Journal of Physics, 11(3):033015+, Mar 2009.
[17]
A. Lancichinetti, S. Fortunato, and F. Radicchi. Benchmark graphs for testing community detection algorithms. Phys. Rev. E, 78(4):046110, Apr 2008.
[18]
T. Nepusz, A. Petróczi, L. Négyessy, and F. Bazsó. Fuzzy communities and the concept of bridgeness in complex networks. Phys. Rev. E, 77(1):016107, 2008.
[19]
M. E. J. Newman. Fast algorithm for detecting community structure in networks. Phys. Rev. E, 69(6):066133, Jun 2004.
[20]
M. E. J. Newman and M. Girvan. Finding and evaluating community structure in networks. Phys. Rev. E, 69(2):026113, Feb 2004.
[21]
G. Palla, I. Derenyi, I. Farkas, and T. Vicsek. Uncovering the overlapping community structure of complex networks in nature and society. Nature, 435(7043):814--818, June 2005.
[22]
P. Ronhovde and Z. Nussinov. Multiresolution community detection for megascale networks by information-based replica correlations. Phys. Rev. E, 80(1):016109, Jul 2009.
[23]
M. Sales-Pardo, R. Guimera, A. A. Moreira, and L. A. N. Amaral. Extracting the hierarchical organization of complex systems. PNAS, 104(39):15224--15229, 2007.
[24]
J. Shi and J. Malik. Normalized cuts and image segmentation. IEEE TPAMI, 22(8):888--905, 2000.
[25]
S. White and P. Smyth. A spectral clustering approach to finding communities in graph. In Proc. of SDM'05, 2005.
[26]
X. Xu, N. Yuruk, Z. Feng, and T. Schweiger. SCAN: a structural clustering algorithm for networks. In KDD'07, pages 824--833. ACM, 2007.
[27]
W. W. Zachary. An information flow model for conflict and fission in small groups. Journal of Anthropological Research, 33:452--473, 1977.

Cited By

View all
  • (2024)Structural Graph Clustering on Signed Graphs: An Index-based ApproachInformation Sciences10.1016/j.ins.2024.121766(121766)Online publication date: Dec-2024
  • (2024)Community detection for networks based on Monte Carlo type algorithmsJournal of the Korean Statistical Society10.1007/s42952-024-00287-y54:1(44-62)Online publication date: 26-Aug-2024
  • (2024)SCS: A Structural Similarity Measure for Graph Clustering Based on Cycles and PathsWeb and Big Data10.1007/978-981-97-2303-4_22(331-345)Online publication date: 29-May-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CIKM '10: Proceedings of the 19th ACM international conference on Information and knowledge management
October 2010
2036 pages
ISBN:9781450300995
DOI:10.1145/1871437
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 October 2010

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. graph clustering
  2. hierarchical community discovery
  3. hubs and outliers

Qualifiers

  • Research-article

Conference

CIKM '10

Acceptance Rates

Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

CIKM '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)31
  • Downloads (Last 6 weeks)1
Reflects downloads up to 02 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Structural Graph Clustering on Signed Graphs: An Index-based ApproachInformation Sciences10.1016/j.ins.2024.121766(121766)Online publication date: Dec-2024
  • (2024)Community detection for networks based on Monte Carlo type algorithmsJournal of the Korean Statistical Society10.1007/s42952-024-00287-y54:1(44-62)Online publication date: 26-Aug-2024
  • (2024)SCS: A Structural Similarity Measure for Graph Clustering Based on Cycles and PathsWeb and Big Data10.1007/978-981-97-2303-4_22(331-345)Online publication date: 29-May-2024
  • (2023)An Efficient Algorithm for Distance-based Structural Graph ClusteringProceedings of the ACM on Management of Data10.1145/35887251:1(1-25)Online publication date: 30-May-2023
  • (2021)Parallel Index-Based Structural Graph Clustering and Its ApproximationProceedings of the 2021 International Conference on Management of Data10.1145/3448016.3457278(1851-1864)Online publication date: 9-Jun-2021
  • (2021)Soft Overlapping Community Detection in Large-Scale Networks via Fast Fuzzy Modularity MaximizationIEEE Transactions on Fuzzy Systems10.1109/TFUZZ.2020.298050229:6(1533-1543)Online publication date: Jun-2021
  • (2020)Detecting Overlapping Communities in Modularity Optimization by Reweighting VerticesEntropy10.3390/e2208081922:8(819)Online publication date: 27-Jul-2020
  • (2020)A Critical Survey of the Multilevel Method in Complex NetworksACM Computing Surveys10.1145/337934753:2(1-35)Online publication date: 17-Apr-2020
  • (2020)GraphLib: A Parallel Graph Mining Library for Joint Cloud Computing2020 IEEE International Conference on Joint Cloud Computing10.1109/JCC49151.2020.00010(9-12)Online publication date: Aug-2020
  • (2020)Research on the Community Number Evolution Model of Public Opinion Based on Stochastic Competitive LearningIEEE Access10.1109/ACCESS.2020.29785228(46267-46277)Online publication date: 2020
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media