Abstract
In this paper, we combine the random subspace and multi-view together and obtain a novel approach named semi-supervised multi-random subspace sparse representation (SSM-RSSR). In the proposed SSM-RSSR, firstly, we use subspace sparse representation to obtain the graph to characterize the distribution of samples in each subspace. Then, we fuse these graphs in the viewpoint of multi-view through an alternating optimization method and obtain the optimal coefficients of all random subspaces. Finally, we train a linear classifier under the framework of manifold regularization (MR) to obtain the final classified results. Through fusing the random subspaces, the proposed SSM-RSSR can obtain better and more stable results in a wider range of the dimension of random subspace and the number of random subspaces. Extensive experimental results on the several UCI datasets and face image datasets have demonstrated the effectiveness of the proposed SSM-RSSR.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs fisherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 711–720 (1997)
Li, B., Huang, D.S., Wang, C., Liu, K.H.: Feature extraction using constrained maximum variance mapping. Pattern Recognit. 41(11), 3287–3294 (2008)
Yang, W.K., Sun, C.Y., Zhang, L.: A multi-manifold discriminant analysis method for image feature extraction. Pattern Recognit. 44(8), 1649–1657 (2011)
Wold, S., Esbensen, K., Geladi, P.: Principal component analysis. Chemom. Intell. Lab. Syst. 2(1), 37–52 (1987)
Tenenbaum, J.B., Silva, V.D., Langform, J.C.: A global geometric framework for nonlinear dimensionality reduction. Science 290(5000), 2319–2323 (2000)
Roweis, S.T., Saul, L.K.: Nonlinear dimension reduction by locally linear embedding. Science 290(5), 2323–2326 (2000)
Belkin, M., Niyogi, P.: Laplacian eigenmaps for dimensionality reduction and data representation. Neurocomputing 15(6), 1373–1396 (2003)
He, X.F., Yan, S.C., Hu, Y.X., Niuogi, P., Zhang, H.J.: Face recognition using laplacian faces. IEEE Trans. Pattern Anal. Mach. Intell. 27(3), 328–340 (2005)
Ramirez, I., Sprechmann, P., Sapiro, G.: Classification and clustering via dictionary learning with structured incoherence and shared features. In: IEEE conference on computer vision and pattern recognition, pp. 3501–3508 (2010)
Ho, T.K.: The random subspace method for constructing decision forests. IEEE Trans. Pattern Anal. Mach. Intell. 20(8), 832–844 (1998)
Yu, G.X., Zhang, G., Domeniconi, C., Yu, Z.W., You, J.: Semi-supervised classification based on random subspace dimensionality reduction. Pattern Recognit. 45(3), 1119–1135 (2012)
Yu, G.X., Zhang, G., Yu, Z.W., Domeniconi, C., You, J., Han, G.Q.: Semi-supervised ensemble classification in subspaces. Appl. Soft Comput. 12(5), 1511–1522 (2012)
Yu, G.X., Zhang, G.J., Zhang, Z.L., Yu, Z.W., Lin, D.: Semi-supervised classification based on subspace sparse representation. Knowl. Inf. Syst. 43(1), 81–101 (2015)
Zhao, Z., Bai, L.F., Zhang, Y., Han, J.: Probabilistic semi-supervised random subspace sparse representation for classification. Multimed. Tools Appl. 77(18), 23245–23271 (2018)
Zhu, X.J., Ghahramani, Z.B., Lafferty, J.: Semi-supervised learning using gaussian fields and harmonic functions. In: International Conference on Machine Learning, pp. 912–919 (2003)
Cai, D., He, X.F., Han, J.W.: Semi-supervised discriminant analysis. In: IEEE International Conference on Computer Vision, pp. 1–7 (2007)
Belkin, M., Niyogi, P., Sindhwani, V.: Manifold regularization: a geometric framework for learning from labeled and unlabeled examples. J. Mach. Learn. Res. 7, 2399–2434 (2006)
Wu, F., Wang, W.H., Yang, Y., Zhuang, Y.T., Nie, F.P.: Classification by semi-supervised discriminative regularization. Neurocomputing 73(10), 1641–1651 (2010)
Fan, M.Y., Gu, N., Qiao, H., Zhang, B.: Sparse regularization for semi-supervised classification. Pattern Recognit. 44(8), 1777–1784 (2011)
Zhao, M.B., Zhan, C., Wu, Z., Tang, P.: Semi-supervised image classification based on local and global regression. IEEE Signal Process. Lett. 22(10), 1666–1670 (2015)
Figueiredo, M.A.T., Nowak, R.D., Wright, S.J.: Gradient projection for sparse reconstruction: application to compressed sensing and other inverse problems. IEEE J. Sel. Top. Signal Process. 1(4), 586–597 (2007)
Jenatton, R., Mairal, J., Obozinski, G., Bach, F.: Proximal methods for sparse hierarchical dictionary learning. In: International Conference on Machine Learning, pp. 487–494 (2010)
Bezdek, J.C., Hathaway, R.J.: Some notes on alternating optimization. In: AFSS International Conference on Fuzzy Systems (Springer, Berlin, 2002), pp. 288–300
Cevikalp, H., Verbeek, J., Jurie, F., Klaser, A.: Semi-supervised dimensionality reduction using pairwise equivalence constraints. Conf. Comput. Vision Imaging Comput. Graph. Theory Appl. 1, 489–496 (2008)
Acknowledgements
This work is supported by the National Natural Science Foundation of China (Grant No. 61727802, 61601225).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations
Rights and permissions
About this article
Cite this article
Zhao, Z., Bai, L., Zhang, Y. et al. Classification via semi-supervised multi-random subspace sparse representation. SIViP 13, 1387–1394 (2019). https://doi.org/10.1007/s11760-019-01467-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-019-01467-8