Abstract
Sparse Subspace Clustering (SSC) methods based on variant norms have attracted significant attention due to their empirical success. However, SSC methods presume that data points are embedded in a linear space and use the linear structure to find the sparse representation of data. Unfortunately, real-world datasets usually reside on a special manifold where linear geometry reduces the efficiency of clustering methods. This paper extends Sparse Subspace Clustering with \(l_1\)-norm and Entropy norm to cluster data points that lie in submanifolds of an unknown manifold. The key idea is to provide a novel feature space by conformal mapping the original intrinsic manifolds with unknown structures to n-spheres such that angles and sparse similarities of the original manifold data are preserved. The proposed method finds an appropriate distance instead of the Euclidean distance for the Kernel SSC algorithm and the SSC algorithm with Entropy norm. Finally, we provide the experimental analysis to compare the efficiency of stereographic sparse subspace clustering with \(l_1\)-norm, Entropy norm, and kernel on several data sets.
Similar content being viewed by others
Data Availability
The link of data is presented in the paper
Notes
References
Aggarwal CC, Reddy CK (2014) Data clustering. Algorithms and applications. Chapman & Hall CRC Data mining and Knowledge Discovery series, Londra
Baek S, Yoon G, Song J, Yoon SM (2021) Deep self-representative subspace clustering network. Pattern Recogn 118:108041
Bai L, Liang J (2020) Sparse subspace clustering with entropy-norm. In: International Conference on Machine Learning. PMLR, pp 561–568
Belkin M, Niyogi P (2002) Laplacian eigenmaps and spectral techniques for embedding and clustering. Adv Neural Inform Process Syst 14:585–591
Carmo MP (1992) Riemannian Geom. Birkhäuser
Casselman B (2014) Stereographic projection, Feature column
Chen Y, Li G, Gu Y (2017) Active orthogonal matching pursuit for sparse subspace clustering. IEEE Signal Process Lett 25(2):164–8
Choi GP, Ho KT, Lui LM (2016) Spherical conformal parameterization of genus-0 point clouds for meshing. SIAM J Imag Sci 9(4):1582–618
Donoho D (2003) Hessian eigenmaps: new tools for nonlinear dimensionality reduction. Proc Natl Acad Sci 100:5591–5596
Dyer EL, Sankaranarayanan AC, Baraniuk RG (2013) Greedy feature selection for subspace clustering. J Mach Learn Res 14(1):2487–517
Elhamifar E, Vidal R (2013) Sparse subspace clustering: Algorithm, theory, and applications. IEEE Trans Pattern Anal Mach Intell 35(11):2765–81
Favaro P, Vidal R, Ravichandran A (2011) A closed form solution to robust subspace estimation and clustering. In CVPR. IEEE, pp. 1801–1807
Goh A, Vidal R (2008) Clustering and dimensionality reduction on Riemannian manifolds. In 2008 IEEE Conference on Computer Vision and Pattern Recognition, pp 1–7
Jia H, Wang L, Song H, Mao Q, Ding S (2021) An efficient Nyström spectral clustering algorithm using incomplete Cholesky decomposition. Expert Syst Appl 186:115813
Jing L, Ng MK, Xu J, Huang JZ (2005) Subspace clustering of text documents with feature weighting k-means algorithm. Pacific-Asia conference on knowledge discovery and data mining. Springer, Berlin, Heidelberg, pp 802–812
Kanatani KI (2001) Motion segmentation by subspace separation and model selection. In Proceedings Eighth IEEE International Conference on computer Vision, pp. 586–591
Kang Z, Lin Z, Zhu X, Xu W (2021) Structured graph learning for scalable subspace clustering: from single view to multiview. IEEE Transact Cybern
Kang Z, Pan H, Hoi SC, Xu Z (2019) Robust graph learning from noisy data. IEEE Transact Cybern 50(5):1833–43
Lee KC, Ho J, Kriegman DJ (2005) Acquiring linear subspaces for face recognition under variable lighting. IEEE Trans Pattern Anal Mach Intell 27(5):684–98
Li P, Wang Q, Zuo W, Zhang L (2013) Log-Euclidean kernels for sparse representation and dictionary learning. In Proceedings of the IEEE international conference on computer vision, pp. 1601–1608
Liu G, Lin Z, Yan S, Sun J, Yu Y, Ma Y (2012) Robust recovery of subspace structures by low-rank representation. IEEE Trans Pattern Anal Mach Intell 35(1):171–84
Nguyen H, Yang W, Shen F, Sun C (2015) Kernel low-rank representation for face recognition. Neurocomputing 155:32–42
Patel VM, Vidal R (2014) Kernel sparse subspace clustering. In 2014 ieee international conference on image processing (icip), pp. 2849–2853
Pourkamali-Anaraki F, Folberth J, Becker S (2020) Efficient solvers for sparse subspace clustering. Signal Process 172:107548
Qin Y, Zhang X, Shen L, Feng G (2022) Maximum Block Energy Guided Robust Subspace Clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence
Ratcliffe JG, Axler S, Ribet KA (2006) Foundations of hyperbolic manifolds. Springer, New York
Rao S, Tron R, Vidal R, Ma Y (2009) Motion segmentation in the presence of outlying, incomplete, or corrupted trajectories. IEEE Trans Pattern Anal Mach Intell 32(10):1832–45
Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326
Toponogov VA (2006) Differential geometry of curves and surfaces. Birkhũser-Verlag, Basel
Tu LW (2011) An introduction to manifolds. Springer, New York
Vidal R (2011) Subspace clustering. IEEE Signal Process Mag 28(2):52–68
Wang YX, Xu H (2013) Noisy sparse subspace clustering. In International Conference on Machine Learning. PMLR, pp. 89–97
Yang AY, Wright J, Ma Y, Sastry SS (2008) Unsupervised segmentation of natural images via lossy data compression. Comput Vis Image Underst 110(2):212–25
Yin M, Guo Y, Gao J (2016) Kernel sparse subspace clustering on symmetric positive definite manifolds. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 5157–5164
You C, Robinson D, Vidal R (2016) Scalable sparse subspace clustering by orthogonal matching pursuit. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3918–3927
Zhang T, Szlam A, Lerman G (2009) Median k-flats for hybrid linear modeling with many outliers. In 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops. IEEE, pp 234–241
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Eybpoosh, K., Rezghi, M. & Heydari, A. A novel conformal deformation based sparse subspace clustering. Int. J. Mach. Learn. & Cyber. 14, 1579–1590 (2023). https://doi.org/10.1007/s13042-022-01712-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13042-022-01712-6