Skip to main content
Springer Nature Link
Log in

A local mean-based distance measure for spectral clustering

  • Theoretical advances
  • Published:
Pattern Analysis and Applications Aims and scope Submit manuscript

Abstract

Spectral clustering has become very popular in recent years, due to the simplicity of its implementation and good performance in clustering non-convex data. Constructing a similarity graph based on an appropriate distance measure for modeling the local neighborhood relations among data samples is crucial for achieving an acceptable performance in spectral clustering. In this paper, we propose a fuzzy spectral clustering algorithm for poorly separated data with arbitrary shapes. Distinguishing poorly separated clusters is a challenging issue since a border point of a cluster may be more similar to the border points of the adjacent cluster than to the points in its own cluster. We propose a local mean-based distance measure which helps in separating points in cluster borders. The distance between a pair of points, in the proposed distance measure, is defined as the distance between the mean of their k nearest neighbors. We also propose a new transitive-based method for computing the membership degrees of points to clusters. Our evaluation results on both artificial and real data show that both the proposed local mean-based distance measure and the proposed membership computation method have significant impacts in obtaining performance improvement over the existing methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Ertoz L, Steinbach MS, Kumar V (2003) Finding clusters of different sizes, shapes, and densities in noisy, high dimensional data, Proceedings of the Third SIAM International Conference on Data Mining. San Francisco, CA, USA, pp. 47–58

  2. MacQueen James B (1965) Some methods for classification and analysis of multivariate observations. In Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, Berkeley, CA, USA, pp. 281–297

  3. Von Luxburg U (2007) A tutorial on spectral clustering. Stat Comput 17(4):395–416

    Article  MathSciNet  Google Scholar 

  4. Wang Bangjun, Zhang Li, Caili Wu, Li Fanzhang, Zhang Zhao (2017) Spectral clustering based on similarity and dissimilarity criterion. Pattern Anal Appl 20(2):495–506

    Article  MathSciNet  Google Scholar 

  5. Li Xiang, Wang Zhijian, Ronglin Hu, Zhu Quanyin, Wang Liuyang (2019) Recommendation algorithm based on improved spectral clustering and transfer learning. Pattern Anal Appl 22(2):633–647

    Article  MathSciNet  Google Scholar 

  6. Kong Wanzeng, Sanqing Hu, Zhang Jianhai, Dai Guojun (2013) Robust and smart spectral clustering from normalized cut. Neural Comput. Appl. 23(5):1503–1512

    Article  Google Scholar 

  7. Newman M (2006) Finding community structure in networks using the eigenvectors of matrices. Phys Rev E 74:36–104

    Article  MathSciNet  Google Scholar 

  8. Ding Shifei, Jia Hongjie, Zhang Liwen, Jin Fengxiang (2014) Research of semi-supervised spectral clustering algorithm based on pairwise constraints. Neural Comput. Appl. 24(1):211–219

    Article  Google Scholar 

  9. Shi J, Malik J (2000) Normalized cuts and image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 22(8):888–905. https://doi.org/10.1109/34.868688

    Article  Google Scholar 

  10. Tan M, Zhang S, Wu L (2020) Mutual Knn based spectral clustering. Neural Comput Appl 32:6435–6442

    Article  Google Scholar 

  11. Cominetti O, Matzavinos A, Samarasinghe S, Kulasiri D, Liu S, Maini PK, Erban R (2010) DifFUZZY: A fuzzy spectral clustering algorithm for complex data sets. Int J Comput Intell Bioinf Syst Biol 1(4):402–417

    Google Scholar 

  12. Shi T, Belkin M, Yu B (2009) Data spectroscopy: Eigenspaces of convolution operators and clustering. Annals Stat 37(6B):3960–3984. https://doi.org/10.1214/09-AOS700

    Article  MathSciNet  MATH  Google Scholar 

  13. Jia H, Ding S, Xu X, Nie R (2014) The latest research progress on spectral clustering. Neural Comput Appl 24:1477–1486

    Article  Google Scholar 

  14. Liu H, Zhang Q, Zhao F (2018) Interval fuzzy spectral clustering ensemble algorithm for color image segmentation. J Intell Fuzzy Syst 35(5):5467–5476

    Article  Google Scholar 

  15. Zeng S, Tong X, Sang N (2014) Study on multi-center fuzzy C-means algorithm based on transitive closure and spectral clustering. Appl Soft Comput 16:89–101. https://doi.org/10.1016/j.asoc.2013.11.020

    Article  Google Scholar 

  16. Huang T, Wang S, Zhu W (2020) An adaptive kernelized rank-order distance for clustering non-spherical data with high noise. Int J Mach Learn Cyber. https://doi.org/10.1007/s13042-020-01068-9

    Article  Google Scholar 

  17. Tasdemir K, Yalcin B, Yildirim I (2015) Approximate spectral clustering with utilized similarity information using geodesic based hybrid distance measures. Pattern Recogn 48(4):1465–1477

    Article  Google Scholar 

  18. Su MC, Chou CH (2001) A modified version of the K-means algorithm with a distance based on cluster symmetry. IEEE Trans Pattern Anal Mach Intell 23(6):674–680

    Article  Google Scholar 

  19. Ng AY, Jordan MI, Weiss Y (2001) On spectral clustering: Analysis and an algorithm, NIPS’01: Proceedings of the 14th International Conference on Neural Information Processing Systems: Natural and Synthetic, 849–856

  20. Verma D, Meila M (2003) A comparison of spectral methods, Technical Report UWCSE-03-05-01. University of Washington, Department of Computer Science and Engineering

  21. Meila M, Shi J (2001) A Random Walks View of Spectral Segmentation, AISTATS (Proceedings of the Eighth International Workshop on Artificial Intelligence and Statistics, AISTATS 2001. Key West, Florida, USA

  22. Kannan R, Vempala S, Vetta A (2004) On clusterings: Good, bad and spectral. J ACM 51(3):497–515. https://doi.org/10.1145/990308.990313

    Article  MathSciNet  MATH  Google Scholar 

  23. Wang Xiaoyu, Ding Shifei, Jia Weikuan (2020) Active constraint spectral clustering based on Hessian matrix. Soft Comput 24(3):2381–2390

    Article  Google Scholar 

  24. Saade A, Krzakala F (2014) Spectral clustering of graphs with the Bethe Hessian. Int Conf Neural Inf Process Syst, 406–414

  25. Nataliani Y, Yang MS (2019) Powered Gaussian kernel spectral clustering. Neural Comput Appl 31:557–572

    Article  Google Scholar 

  26. Bezdek JC (1981) Pattern Recognition with Fuzzy Objective Function Algorithms. Plenum, New York

    Book  Google Scholar 

  27. Krishnapuram R, Kim J (1999) A note on the Gustafson-Kessel and adaptive fuzzy clustering algorithms. IEEE Trans Fuzzy Syst 7(4):453–461

    Article  Google Scholar 

  28. Zhao F, Liu H, Jiao L (2011) Spectral clustering with fuzzy similarity measure. Digital Signal Process 21:701–709

    Article  Google Scholar 

  29. Zeyu L, Shiwei T, Jing X, Jun J (2001) Modified FCM clustering based on kernel mapping. Proc Internat Soc Optical Eng 4554:241–245

    Google Scholar 

  30. Memon KH, Lee DH (2018) Generalised kernel weighted fuzzy C-means clustering algorithm with local information. Fuzzy Sets Syst 340:91–108

    Article  MathSciNet  Google Scholar 

  31. Zhang DQ, Chen SC (2003) Clustering incomplete data using kernel-based fuzzy c-means algorithm. Neural Process Lett 18:155–162

    Article  Google Scholar 

  32. Zhang DQ, Chen SC (2004) A novel kernelized fuzzy C-means algorithm with application in medical image segmentation. Artif Intell Med 32:37–50

    Article  Google Scholar 

  33. Graves D, Pedrycz W (2007) Fuzzy C-Means, Gustafson-Kessel FCM, and Kernel-Based FCM: A Comparative Study. Anal Design Intell Syst Using Soft Comput Tech, 140–149

  34. Jimenez R (2008) Fuzzy spectral clustering for identification of rock discontinuity sets. Rock Mech Rock Eng 41:929–939

    Article  Google Scholar 

  35. Liu H, Zhao F, Jiao L (2012) Fuzzy spectral clustering with robust spatial information for image segmentation. Appl Soft Comput 12(11):3636–3647

    Article  Google Scholar 

  36. Wang Y, Duan X, Liu X, Wang C (2018) A spectral clustering method with semantic interpretation based on axiomatic fuzzy set theory. Appl Soft Comput 64:59–74

    Article  Google Scholar 

  37. Celikyilmaz A (2009) Soft-link spectral clustering for information extraction. Proc IEEE Int Conf Commun, 434–441

  38. Stewart GW, Sun J (1990) Matrix Perturbation Theory, Computer Science and Scientific Computing. Academic Press, Cambridge

    Google Scholar 

  39. Zelnik-Manor L, Perona P (2004) Self-tuning spectral clustering, Neural Information Processing Systems (NIPS 2004) Vancouver, British Columbia. Canada 1601–1608

  40. Zhang X, Li J, Yu H (2011) Local density adaptive similarity measurement for spectral clustering. Pattern Recogn Letts 32:352–358

    Article  Google Scholar 

  41. Halkidi M, Batistakis Y, Vazirgiannis M (2002) Cluster Validity Methods: Part I. SIGMOD Rec 31(2):40–45

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical and Computer Engineering, Graduate University of Advanced Technology, Kerman, Iran

    Hassan Motallebi

  2. Department of Applied Mathematics, Graduate University of Advanced Technology, Kerman, Iran

    Rabeeh Nasihatkon & Mina Jamshidi

Authors
  1. Hassan Motallebi
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Rabeeh Nasihatkon
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Mina Jamshidi
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Hassan Motallebi.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Motallebi, H., Nasihatkon, R. & Jamshidi, M. A local mean-based distance measure for spectral clustering. Pattern Anal Applic 25, 351–359 (2022). https://doi.org/10.1007/s10044-021-01040-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10044-021-01040-5

Keywords