Abstract
In this paper, we propose a new tensor-based representation algorithm for image classification. The algorithm is realized by learning the parameter tensor for image tensors. One novelty is that the parameter tensor is learned according to the Tucker tensor decomposition as the multiplication of a core tensor with a group of matrices for each order, which endows that the algorithm preserved the spatial information of image. We further extend the proposed tensor algorithm to a semi-supervised framework, in order to utilize both labeled and unlabeled images. The objective function can be solved by using the alternative optimization method, where at each iteration, we solve the typical ridge regression problem to obtain the closed form solution of the parameter along the corresponding order. Experimental results of gray and color image datasets show that our method outperforms several classification approaches. In particular, we find that our method can implement a high-quality classification performance when only few labeled training samples are provided.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Notes
References
Hao, Z., He, L., Chen, B., Yang, X.: A linear support higher-order tensor machine for classification. IEEE Trans. Image Process. 22(7), 2911–2920 (2013)
Cao, X., Wei, X., Han, Y., Yang, Y., Lin, D.: Robust tensor clustering with non-greedy maximization. In: Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence(AAAI), pp. 1254–1259. AAAI Press (2013)
Guo, W., Kotsia, I., Patras, I.: Tensor learning for regression. IEEE Trans. Image Process.21(2), 816–827 (2012)
Han, Y., Yang, Y., Zhou, X.: Co-regularized ensemble for feature selection. In: Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence (AAAI), pp. 1380–1386. AAAI Press (2013)
Yang, Y., Song, J., Huang, Z., Ma, Z., Sebe, N., Hauptmann, A.G.: Multi-feature fusion via hierarchical regression for multimedia analysis. IEEE Trans. Multimed. 15(3), 572–581 (2013)
Zhang, L., Yang, Y., Zimmermann, R.: Discriminative cellets discovery for fine-grained image categories retrieval. In: Proceedings of the ACM ICMR (2014)
Shakhnarovich, G., Darrell, T., Indyk, P.: Nearest-Neighbor Methods in Learning and Vision: Theory and Practice, vol. 3. MIT press, Cambridge (2005)
Zhang, L., Han, Y., Yang, Y., Song, M., Yan, S., Tian, Q.: Discovering discrminative graphlets for aerial image categories recognition. IEEE Trans. Image Process. 22(12), 5071–5084 (2013)
Zhang, L., Song, M., Liu, X.., Bu, J., Chen, C..: Recognizing architecture styles by hierarchical sparse coding of blocklets. Inf. Sci. 254, 141–154 (2014)
Hoerl, A.E., Kennard, R.W.: Ridge regression: biased estimation for nonorthogonal problems. Technometrics 12(1), 55–67 (1970)
Vasilescu, M.A.O., Terzopoulos, D..: Multilinear subspace analysis of image ensembles. In: Proceedings of the Computer Vision and Pattern Recognition (CVPR), vol. 2, pp. 93–99. IEEE (2003)
Pang, Y., Li, X., Yuan, Y.: Robust tensor analysis with l1-norm. IEEE Trans. Circuits Syst. Video Technol. (T-CSVT) 20(2), 172–178 (2010)
Cai, D., He, X., Han, J.: Subspace learning based on tensor analysis. Department of Computer Science, Tech. Report No. 2572, Univ. of Illinois at Urbana-Champaign (UIUCDCS-R-2005-2572) (2005)
Yan, S., Xu, D., Yang, Q., Zhang, L., Tang, X., Zhang, H.-J.: Multilinear discriminant analysis for face recognition. IEEE Trans. Image Process. 16(1), 212–220 (2007)
Ma, Z., Yang, Y., Nie, F., Sebe, N.: Thinking of images as what they are: compound matrix regression for image classification. In: Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence (IJCAI) (2013)
Shashua, A., Levin, A.: Linear image coding for regression and classification using the tensor-rank principle. In: Proceedings of the Computer Vision and Pattern Recognition (CVPR), vol. 1, pp. 42–49. IEEE (2001)
Kolda, T.G., Bader, B.W.: Tensor decompositions and applications. SIAM Rev. 51(3), 455–500 (2009)
Cai, D., He, X., Han, J.: Learning with tensor representation. Technical Report UIUCDCS- R-2006-2716 (2006)
Tao, D., Li, X., Hu, W., Maybank, S., Wu, X.: Supervised tensor learning. In: Proceedings of the Fifth IEEE International Conference on Data Mining (ICDM), pp. 450–457. IEEE (2005)
Tichavsky, P., Phan, A.H., Koldovsky, Z.: Cramér-rao-induced bounds for candecomp/parafac tensor decomposition. IEEE Trans. Signal Process. 61(8), 1986–1997 (2013)
Haoquan, S., Yan, Y., Shicheng, X., Nicolas, B., Wenzhi, C.: Evaluation of semi-supervised learning method on action recognition. Multimed. Tools Appl. (2014). doi:10.1007/s11042-014-1936-z
Kotsia, I., Patras, I.: Support tucker machines. In: Proceedings of the Computer Vision and Pattern Recognition (CVPR), pp. 633–640. IEEE (2011)
Cai, D., He, X., Han, J.: Semi-supervised discriminant analysis. In: Proceedings of IEEE International Conference on Computer Vision (ICCV) (2007)
Yang, Y., Nie, F., Xu, D., Luo, J., Zhuang, Y., Pan, Y.: A multimedia retrieval framework based on semi-supervised ranking and relevance feedback. IEEE Trans. Pattern Anal. Mach. Intell. 34(4), 723–742 (2012)
Fung, G., Mangasarian, O.L.: Multicategory proximal support vector machine classifiers. Mach. Learn. 59(1–2), 77–97 (2005)
Nie, F., Dong, X., Tsang, I.W.H., Zhang, C.: Flexible manifold embedding: a framework for semi-supervised and unsupervised dimension reduction. IEEE Trans. Image Process. 19(7), 1921–1932 (2010)
Liu, W., He, J., Chang, S.-F.: Large graph construction for scalable semi-supervised learning. In: Proceedings of the 27th International Conference on Machine Learning (ICML-10), pp. 679–686 (2010)
Yu-Feng, L., Kwok J., T., Zhou, Z.-H.: Cost-sensitive semi-supervised support vector machine. In: Proceedings of the International Joint Conference on Artificial Intelligence(AAAI), pp. 500–505. AAAI Press (2010)
Acknowledgements
This work is partly supported by the NSFC (under Grant 61202166 and 61472276) and Doctoral Fund of Ministry of Education of China (under Grant 20120032120042).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhang, J., Han, Y. & Jiang, J. Semi-supervised tensor learning for image classification. Multimedia Systems 23, 63–73 (2017). https://doi.org/10.1007/s00530-014-0416-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00530-014-0416-7