Zhao Zhang
ABSTRACT
This paper proposes an enhanced semi-supervised classification approach termed Nonnegative Sparse Neighborhood Propagation (SparseNP) that is an improvement to the existing neighborhood propagation due to the fact that the outputted soft labels of points cannot be ensured to be sufficiently sparse, discriminative, robust to noise and be probabilistic values. Note that the sparse property and strong discriminating ability of predicted labels is important, since ideally the soft label of each sample should have only one or few positive elements (that is, less unfavorable mixed signs are included) deciding its class assignment. To reduce the negative effects of unfavorable mixed signs on the learning performance, we regularize the l2,1-norm on the soft labels during optimization for enhancing the prediction results. The non-negativity and sum-to-one constraints are also included to ensure the outputted labels are probabilistic values. The proposed framework is solved in an alternative manner for delivering a more reliable solution so that the accuracy can be improved. Simulations show that satisfactory results can be obtained by the proposed SparseNP compared with other related approaches.
- O. Chapelle, B. Scholkopf, and A. Zien, "Semi-Supervised Learning," Cambridge: MIT Press, 2006. Google Scholar
Cross Ref
- X. Zhu, "Semi-supervised learning literature survey," Technical Report 1530, Univ. Wisconsin-Madison. 2005.Google Scholar
- D. Zhou, O. Bousquet, T. N. Lal, J. Weston, B. S cholkopf, "Learning with local and global consistency," In: Proc. Advances in Neural Information Processing Systems, 2004.Google Scholar
- X. Zhu, Z. Ghahramani, and J. D. Lafferty, "Semi-supervised learning using Gaussian fields and harmonic functions. In: Proceedings of the International Conference on Machine Learning, 2003.Google Scholar
- F. Wang, and C. S. Zhang, "Label propagation through linear Neighborhoods," IEEE Trans. on Knowledge and Data Engineering, vol. 20, no. 1, pp. 55--67, 2008. Google ScholarDigital Library
- Z. Zhang, M. B. Zhao, and T. W. S. Chow, "Graph based Constrained Semi-Supervised Learning Framework via Label Propagation over Adaptive Neighborhood," IEEE Trans. on Knowledge and Data Engineering, Dec 2013. DOI: 10.1109/ TKDE.2013.182.Google Scholar
- F. P. Nie, S. M. Xiang, Y. Liu, and C. S. Zhang, "A general graph-based semi-supervised learning with novel class discovery," Neural Computing Applications, vol. 19, no. 4, pp. 549--555, 2010. Google ScholarDigital Library
- J. Yang, A. F. Frangi, J.Y. Yang, D. Zhang, and J. Zhong, "KPCA plus LDA: a Complete Kernel Fisher Discriminant Framework for Feature Extraction and Recognition," IEEE Trans. on Pattern analysis and machine intelligence, vol. 27, no. 2, pp. 230--244, 2005. Google ScholarDigital Library
- M. Turk, A. Pentland, "Face recognition using eigenfaces," In: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, 1991.Google Scholar
- F. Zang, and J. S. Zhang, "Label propagation through sparse neighborhood and its applications, "Neurocomputing, vol. 97, pp. 267--277, 2012. Google ScholarDigital Library
- Y. Liu, F. P. Nie, J. G. Wu, and L. H. Chen, "Semi-supervised feature selection based on label propagation and subset selection," In: Proceedings of the International Conference on Computer and Information Application, 2010.Google ScholarCross Ref
- Z. Zhang, T. Chow, M. Zhao, "Trace Ratio Optimization based Semi-Supervised Nonlinear Dimensionality Reduction for Marginal Manifold Visualization," IEEE Transactions on Knowledge and Data Engineering, vol. 25, iss. 5, pp. 1148--1161, 2013. Google ScholarDigital Library
- H. Cheng, Z. Liu, and J. Yang, "Sparsity induced similarity measure for label propagation," In: Proceedings of the IEEE International Conference on Computer Vision, pp. 317--324, 2009.Google Scholar
- J. Wright, Y. Ma, J. Mairal, G. Sapiro, T. Huang, S. C. Yan, "Sparse Representation for Computer Vision and Pattern Recognition," Proceedings of the IEEE, vol. 98, no. 6, pp. 1031--1044, 2010.Google ScholarCross Ref
- T. Sim, S. Baker, M. Bsat, "The Carnegie Mellon University pose, illuminlation, and expression database," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 12, pp. 1615--1618, 2003. Google ScholarDigital Library
- Z. Zhang, M. B. Zhao, and T. W. S. Chow, "Binary- and Multi-Class Group Sparse Canonical Correlation Analysis for Feature Extraction and Classification," IEEE Transactions on Knowledge and Data Engineering, vol. 25, no. 10, pp. 2192--2205, October 2013. Google ScholarDigital Library
- C. P. Hou, F. P. Nie, D. Y. Yi, Yi Wu, "Feature Selection via Joint Embedding Learning and Sparse Regression," In: Proceedings of the International Joint Conferences on Artificial Intelligence, pp. 1324--1329, 2011. Google ScholarDigital Library
- L. S. Qiao, S. C. Chen, and X. Y. Tan, "Sparsity Preserving Projections with Applications to Face Recognition," Pattern Recognition, vol. 43, no. 1, pp. 331--341, 2010. Google ScholarDigital Library
- Z. Zhang, S. C. Yan, and M. B. Zhao, "Pairwise Sparsity Preserving Embedding for Unsupervised Subspace Learning and Classification," IEEE Transactions on Image Processing, vol. 22, iss. 12, pp. 4640--4651, 2013. Google ScholarDigital Library
- D. B. Graham, and N. M. Allinson, "Characterizing virtual eigensignatures for general 870 purpose face recognition in face recognition: from theory to application," NATO ASI Series F, Computer and Systems Sciences, Vol. 163; H. Wechsler, P. J. Phillips, V. Bruce, F. Fogelman-Soulie and T. S. Huang (eds), pp. 446--456, 1998.Google Scholar
- S. Roweis and L. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, no. 5500, pp. 2323--2326, 2000.Google ScholarCross Ref
- Y. Yang, H. T. Shen, Z. G. Ma, Z. Huang, and X. F. Zhou, "L2, 1-Norm Regularized Discriminative Feature Selection for Unsupervised Learning," In: Proceeding of the International Joint Conferences on Artificial Intelligence, 2011. Google ScholarDigital Library
- E. Kokiopoulou, J. Chen, and Y. Saad, "Trace optimization and eigenproblems in dimension reduction methods," Numerical Linear Algebra with Applications, vol. 18, no. 3, pp. 565--602, 2011.Google ScholarCross Ref
- F. Nie, H. Huang, X. Cai, and C. Ding, "Efficient and robust feature selection via joint l2,1-norms minimization," In: Proceeding of the Neural Information Processing Systems (NIPS), 2010.Google Scholar
- M. Culp, and G. Michailidis, "Graph-based semi-supervised learning," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 30, no. 1, pp. 174--179, 2008. Google ScholarDigital Library
- Z. Zhang, T. W. S. Chow, "Maximum Margin Multisurface Support Tensor Machines with Application to Image Classification and Segmentation," Expert Systems with Applications, vol. 39, iss. 1, pp. 850--861, 2012. Google ScholarDigital Library
- N. Dalal, and B. Triggs, "Histograms of Oriented Gradients for Human Detection," Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, pp. 886--893, 2005. Google ScholarDigital Library
- M. Belkin, and P. Niyogi, "Laplacian Eigenmaps for Dimensionality Reduction and Data Representation," Neural Computation, vol. 15, no. 6, pp. 1373--1396, 2003. Google ScholarDigital Library
- S. A. Nene, S. K. Nayar, and H. Murase, "Columbia Object Image Library (COIL-20)," Technical Report CUCS-005-96, 1996.Google Scholar
Index Terms
- Semi-Supervised Image Classification by Nonnegative Sparse Neighborhood Propagation
Recommendations
Semi-supervised partial label learning algorithm via reliable label propagation
AbstractPartial label learning (PLL) is a weakly supervised learning method that is able to predict one label as the correct answer from a given candidate label set. In PLL, when all possible candidate labels are as signed to real-world training examples, ...
Semi-supervised Bi-dictionary Learning Using Smooth Representation-Based Label Propagation
CYBERC '15: Proceedings of the 2015 International Conference on Cyber-Enabled Distributed Computing and Knowledge DiscoveryDue to heavy clutters and occlusions of complex background, natural images contain complex features in data structure which often cause errors in image classification. In this paper, we propose semi-supervised bi-dictionary learning for image ...
Robust and sparse label propagation for graph-based semi-supervised classification
AbstractTraditional graph-based semi-supervised classification algorithms are usually composed of two independent parts: graph construction and label propagation. However, the predefined graph may not be optimal for label propagation, and these methods ...
Comments