Abstract
Low-rank-based methods are frequently employed for dimensionality reduction and feature extraction in machine learning. To capture local structures, these methods often incorporate graph embedding, which requires constructing a zero-one weighted neighborhood graph to extract local information from the original data. However, these methods are incapable of learning an adaptive graph that reveals intricate relationships among distinct samples within noisy data. To address this issue, we propose a novel unsupervised feature extraction method called Robust Subspace Learning with Double Graph Embedding (RSL_DGE). RSL_DGE incorporates a low-rank graph into the graph embedding process to preserve more discriminative information and remove noise simultaneously. Additionally, the \(l_{2,1}\)-norm constraint is also imposed on the projection matrix, making RSL_DGE more flexible in selecting feature dimensions. Several experiments demonstrate that RSL_DGE achieves competitive performance compared to other state-of-the-art methods.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abdi, H., Williams, L.J.: Principal component analysis. Wiley Interdisc. Rev. Comput. Stat. 2(4), 433–459 (2010)
Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J., et al.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends® Mach. Learn. 3(1), 1–122 (2011)
Cai, D., He, X.: Orthogonal locality preserving indexing. In: Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 3–10 (2005)
Candès, E.J., Li, X., Ma, Y., Wright, J.: Robust principal component analysis? J. ACM (JACM) 58(3), 1–37 (2011)
Chen, J., Yang, J.: Robust subspace segmentation via low-rank representation. IEEE Trans. Cybern. 44(8), 1432–1445 (2013)
Chen, M.S., Wang, C.D., Lai, J.H.: Low-rank tensor based proximity learning for multi-view clustering. IEEE Trans. Knowl. Data Eng. 35, 5076–5090 (2022)
Du, S., Liu, B., Shan, G., Shi, Y., Wang, W.: Enhanced tensor low-rank representation for clustering and denoising. Knowl.-Based Syst. 243, 108468 (2022)
Georghiades, A.S., Belhumeur, P.N., Kriegman, D.J.: From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Anal. Mach. Intell. 23(6), 643–660 (2001)
He, X., Cai, D., Yan, S., Zhang, H.J.: Neighborhood preserving embedding. In: Tenth IEEE International Conference on Computer Vision (ICCV 2005), vol. 2, pp. 1208–1213. IEEE (2005)
He, X., Niyogi, P.: Locality preserving projections. Adv. Neural Inf. Process. Syst. 16, 1–8 (2003)
Huang, G.B., Mattar, M., Berg, T., Learned-Miller, E.: Labeled faces in the wild: a database for studying face recognition in unconstrained environments. In: Workshop on faces in ‘Real-Life’ Images: Detection, Alignment, and Recognition (2008)
Huang, Z., Zhao, S., Fei, L., Wu, J.: Weighted graph embedded low-rank projection learning for feature extraction. In: ICASSP 2022–2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1501–1505. IEEE (2022)
Khan, G.A., Hu, J., Li, T., Diallo, B., Zhao, Y.: Multi-view low rank sparse representation method for three-way clustering. Int. J. Mach. Learn. Cybern. 13, 233–253 (2022)
Liu, G., Lin, Z., Yan, S., Sun, J., Yu, Y., Ma, Y.: Robust recovery of subspace structures by low-rank representation. IEEE Trans. Pattern Anal. Mach. Intell. 35(1), 171–184 (2012)
Liu, G., Yan, S.: Latent low-rank representation for subspace segmentation and feature extraction. In: 2011 International Conference on Computer Vision, pp. 1615–1622. IEEE (2011)
Lu, J., Wang, H., Zhou, J., Chen, Y., Lai, Z., Hu, Q.: Low-rank adaptive graph embedding for unsupervised feature extraction. Pattern Recogn. 113, 107758 (2021)
Lu, Y., Lai, Z., Xu, Y., Li, X., Zhang, D., Yuan, C.: Low-rank preserving projections. IEEE Trans. Cybern. 46(8), 1900–1913 (2015)
Nene, S.A., Nayar, S.K., Murase, H., et al.: Columbia object image library (coil-20) (1996)
Qiao, L., Chen, S., Tan, X.: Sparsity preserving projections with applications to face recognition. Pattern Recogn. 43(1), 331–341 (2010)
Tang, C.: Feature selective projection with low-rank embedding and dual laplacian regularization. IEEE Trans. Knowl. Data Eng. 32(9), 1747–1760 (2019)
Wang, M., Wang, Q., Hong, D., Roy, S.K., Chanussot, J.: Learning tensor low-rank representation for hyperspectral anomaly detection. IEEE Trans. Cybern. 53(1), 679–691 (2022)
Wang, S., Xiao, S., Zhu, W., Guo, Y.: Multi-view fuzzy clustering of deep random walk and sparse low-rank embedding. Inf. Sci. 586, 224–238 (2022)
Wen, J., Han, N., Fang, X., Fei, L., Yan, K., Zhan, S.: Low-rank preserving projection via graph regularized reconstruction. IEEE Trans. Cybern. 49(4), 1279–1291 (2018)
Yan, S., Xu, D., Zhang, B., Zhang, H.J., Yang, Q., Lin, S.: Graph embedding and extensions: a general framework for dimensionality reduction. IEEE Trans. Pattern Anal. Mach. Intell. 29(1), 40–51 (2006)
Yang, W., Wang, Z., Sun, C.: A collaborative representation based projections method for feature extraction. Pattern Recogn. 48(1), 20–27 (2015)
Yin, M., Cai, S., Gao, J.: Robust face recognition via double low-rank matrix recovery for feature extraction. In: 2013 IEEE International Conference on Image Processing, pp. 3770–3774. IEEE (2013)
Zhang, G.Y., Huang, D., Wang, C.D.: Facilitated low-rank multi-view subspace clustering. Knowl.-Based Syst. 260, 110141 (2023)
Zhang, Y., Xiang, M., Yang, B.: Low-rank preserving embedding. Pattern Recogn. 70, 112–125 (2017)
Zhao, S., Wu, J., Zhang, B., Fei, L.: Low-rank inter-class sparsity based semi-flexible target least squares regression for feature representation. Pattern Recogn. 123, 108346 (2022)
Zhuang, L., Wang, J., Lin, Z., Yang, A.Y., Ma, Y., Yu, N.: Locality-preserving low-rank representation for graph construction from nonlinear manifolds. Neurocomputing 175, 715–722 (2016)
Acknowledgements
This work was supported in part by Huangpu International Sci &Tech Cooperation Fundation of Guangzhou, China (2021GH12) and Guangdong Basic and Applied Basic Research Foundation under Grant No. 2021B1515120010. It was also supported by the Natural Science Foundation of China under Grant 62106052.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Huang, Z., Zhao, S., Liang, Z., Wu, J. (2024). Robust Subspace Learning with Double Graph Embedding. In: Liu, Q., et al. Pattern Recognition and Computer Vision. PRCV 2023. Lecture Notes in Computer Science, vol 14431. Springer, Singapore. https://doi.org/10.1007/978-981-99-8540-1_11
Download citation
DOI: https://doi.org/10.1007/978-981-99-8540-1_11
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-8539-5
Online ISBN: 978-981-99-8540-1
eBook Packages: Computer ScienceComputer Science (R0)