Abstract
Graph-based manifold learning plays an important role in clustering and classification tasks. Regarding the unsupervised case, the local structure of each sample is vital to the quality of clustering results. Many state-of-the-art methods seek the low-dimensional projection matrix for graph embedding, ignoring the contortion of original local structure in the projected space, which impairs the quality of clustering. To remedy this shortcoming, we propose an iterative leaning approach in this paper, aiming at preserving the original locality in each iteration. During iterative steps, adjacency weights of each currently projected sample are optimally defined by quadratic programming with equality constraints, and in return the upcoming projection matrix that attempts to keep the original locality is flexibly determined based on the current weights. Such iteration proceeds until the objective function value converges. In particular, the proposed approach requires very few parameters, leading to simple operation in experiments. Further, local distances of projected samples could be directly obtained from their inner products, with no explicit calculation of projection matrix in each iteration. We repeat k-means clustering many times w.r.t these samples after convergence, and experimental results reveal the obvious better clustering quality of the proposed approach on average, compared to the state-of the-art ones.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Chong, Y., Ding, Y., Yan, Q., et al.: Graph-based semi-supervised learning: a review. Neurocomputing 408(30), 216–230 (2020)
Yan, S., Xu, D., Zhang, B., et al.: Graph embedding and extensions: a general framework for dimensionality reduction. IEEE Trans. Pattern Anal. Mach. Intell. 29(1), 40–51 (2007)
Jolliffe, I.T.: Principal Component Analysis. Springer-Verlag (2005)
Turk, M.A., Pentland, A.P.: Face recognition using eigenfaces. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 586–591 (1991)
Belkin, M., Niyogi, P.: Laplacian eigenmaps and spectral techniques for embedding and clustering. Adv. Neural Inf. Process. Syst. 14, 585–591 (2001)
He, X., Yan, S., Hu, Y., et al.: Face recognition using laplacian faces. IEEE Trans. Pattern Anal. Mach. Intell. 27(3), 328–340 (2005)
Roweis, S., Saul, L.: Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500), 2323–2326 (2000)
He, X., Deng, C., Yan, S., et al.: Neighborhood preserving embedding. In: Tenth IEEE International Conference on Computer Vision (2005)
Ng, A.Y., Jordan, M.I., Weiss, Y.: On spectral clustering: analysis and an algorithm. In: Advances in Neural Information Processing System, p. 849–856 (2001)
Dornaika, F., Traboulsi, Y.E.: Learning flexible graph-based semi-supervised embedding. IEEE Trans. Cybernet. 46(1), 206–218 (2016)
Dornaika, F., Traboulsi, Y.E., Assoum, A.: Inductive and flexible feature extraction for semi-supervised pattern categorization. Pattern Recogn. 60, 275–285 (2016)
Nie, F., Xu, D., Tsang, W.H., et al.: Flexible manifold embedding: a framework for semi-supervised and unsupervised dimension reduction. IEEE Trans. Image Process. 19(7), 1921–1932 (2010)
Wang, W., Yan, Y., Nie, F., et al.: Flexible manifold learning with optimal graph for image and video representation. IEEE Trans. Image Process. 27(6), 2664–2675 (2018)
Lecun, Y., Bottou, L., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)
Xin, C., Jian, W., Wei, L., et al.: Deep manifold learning combined with convolutional neural networks for action recognition. IEEE Trans. Neural Netw. Learn. Syst. 29(9), 3938–3952 (2018)
Liu, B., Meng, W., Hong, R., et al.: Joint learning of labels and distance metric. IEEE Trans. Syst. Man Cybernet. Part B Cybernet. 40(3), 973–978 (2010)
Boyd, S., Vandenberghe, L.: Convex Optimization. Cambridge University Press (2004)
Strehl, A., Ghosh, J.: Cluster ensembles – a knowledge reuse framework for combining multiple partitions. J. Mach. Learn. Res. 3(3), 583–617 (2002)
Lyons, M.J., Kamachi, M., Gyoba, J.: The Japanese Female Facial Expression (JAFFE) Database. In: IEEE International Conference on Face and Gesture Recognition, pp.14–16, (1998)
Leibe, B., Schiele, B.: Analyzing appearance and contour based methods for object categorization. In: International Conference on Computer Vision and Pattern Recognition (2003)
Leibe, B.: The ETH-80 Image Set. http://www.mis.informatik.tu-darmstadt.de/Research/Projects/categorization/eth80-db.html
Acknowledgements
This work was supported by the International Science and Technology Cooperation Project of Jiangsu Province under grant BZ2020069, Research Foundation for Advanced Talents and Incubation Foundation of Jingling Institute of Technology under grant JIT-B-201717, JIT-B-201617, JIT-FHXM-201808, and JIT-FHXM-201911.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Tao, Y., Zhao, H., Zhang, Y. (2021). Flexible Projection Search Using Optimal Re-weighted Adjacency for Unsupervised Manifold Learning. In: Ma, H., et al. Pattern Recognition and Computer Vision. PRCV 2021. Lecture Notes in Computer Science(), vol 13022. Springer, Cham. https://doi.org/10.1007/978-3-030-88013-2_19
Download citation
DOI: https://doi.org/10.1007/978-3-030-88013-2_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-88012-5
Online ISBN: 978-3-030-88013-2
eBook Packages: Computer ScienceComputer Science (R0)