Abstract
Recent studies have shown promising performance of graph-based semi-supervised learning. But one of major limitations of most graph-based semi-supervised learning approaches is that they did not explore the label dissimilarity knowledge. In this paper, we presented a novel graph-based label propagation framework that effectively incorporates similarity and dissimilarity information into semi-supervised classification. The class mass normalization is utilized to make the label decision rule match class priors. The function induction algorithm is also proposed to predict the labels of test data. In particular, by solving quadratic optimization, our approach can give rise to closed-form solution for classification functions of unlabeled data and out-of-sample data. The proposed framework has been extensively evaluated over three widely used datasets for image classification task. The experimental results in terms of classification accuracy demonstrate that the proposed method can achieve significant performance improvements with respect to the state-of-the-arts.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Zhu, X.: Semi-supervised learning literature survey. Technical Report 1530, Computer Sciences, University of Wisconsin-Madison (2005)
Joachims, T.: Transductive learning via spectral graph partitioning. In: Proceedings of the Twentieth International Conference on Machine Learning, pp. 290–297. AAAI Press (2003)
Sindhwani, V., Niyogi, P., Belkin, M.: Beyond the point cloud: from transductive to semi-supervised learning. In: Proceedings of the 22nd International Conference on Machine Learning, pp. 824–831. ACM, New York (2005)
Zhou, D., Bousquet, O., Lal, T.N., Weston, J., Schölkopf, B.: Learning with local and global consistency. In: Advances in Neural Information Processing Systems, vol. 16. MIT Press (2003)
Wang, F., Zhang, C.: Label propagation through linear neighborhoods. In: Proceedings of the 23rd International Conference on Machine Learning, pp. 985–992. ACM, New York (2006)
Mullen, T., Malouf, R.: A preliminary investigation into sentiment analysis of informal political discourse. In: AAAI 2006 Spring Symposium on Computational Approaches to Analysing Weblogs (2006)
Kulis, B., Basu, S., Dhillon, I., Mooney, R.: Semi-supervised graph clustering: a kernel approach. In: Proceedings of the 22nd International Conference on Machine Learning, pp. 457–464. ACM, New York (2005)
Zhu, X., Ghahramani, Z., Lafferty, J.: Semi-supervised learning using Gaussian fields and harmonic functions. In: Proceedings of the Twentieth International Conference on Machine Learning, pp. 912–919 (2003)
Zhou, D., Schölkopf, B., Hofmann, T.: Semi-supervised learning on directed graphs. In: Advances in Neural Information Processing Systems, vol. 17 (2004)
Herbster, M., Pontil, M., Wainer, L.: Online learning over graphs. In: Proceedings of the 22nd International Conference on Machine Learning, pp. 305–312. ACM, New York (2005)
Altun, Y., McAllester, D., Belkin, M.: Maximum margin semi–supervised learning for structured variables. In: Advances in Neural Information Processing Systems (2006)
Mika, S., Ratsch, G., Weston, J., Schölkopf, B., Mullers, K.R.: Fisher discriminant analysis with kernels, pp. 41–48 (1999)
Tong, W., Jin, R.: Semi-supervised learning by mixed label propagation. In: Proceedings of the 22nd National Conference on Artificial Intelligence, vol. 1, pp. 651–656. AAAI Press (2007)
Belkin, M., Niyogi, P.: Using Manifold Structure for Partially Labelled Classification. In: Advances in NIPS (2002)
Delalleau, O., Bengio, Y., Roux, N.L.: Nonparametric function induction in semi-supervised learning. In: Proc. Artificial Intelligence and Statistics (2005)
Fei-Fei, L., Fergus, R., Perona, P.: Learning generative visual models from few training examples: An incremental bayesian approach tested on 101 object categories. In: IEEE CVPR Workshop of Generative Model Based Vision (WGMBV) (2004)
Goldberg, A.B., Zhu, X., Wright, S.: Dissimilarity in graph-based semi-supervised classification. Journal of Machine Learning Research 2, 155–162 (2007)
Belkin, M., Niyogi, P., Sindhwani, V.: Manifold regularization: A geometric framework for learning from labeled and unlabeled examples. Journal of Machine Learning Research 7, 2399–2434 (2006)
Jiang, W., Chang, S.F., Jebara, T., Loui, A.C.: Semantic concept classification by joint semi-supervised learning of feature subspaces and support vector machines. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part IV. LNCS, vol. 5305, pp. 270–283. Springer, Heidelberg (2008)
Lazebnik, S., Schmid, C., Ponce, J.: Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In: Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 2169–2178. IEEE Computer Society, Washington, DC (2006)
Yang, J., Yu, K., Gong, Y., Huang, T.S.: Linear spatial pyramid matching using sparse coding for image classification. In: Computer Vision and Pattern Recognition, pp. 1794–1801 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer International Publishing Switzerland
About this paper
Cite this paper
Zheng, H., Ip, H.H.S. (2013). Graph-Based Label Propagation with Dissimilarity Regularization. In: Huet, B., Ngo, CW., Tang, J., Zhou, ZH., Hauptmann, A.G., Yan, S. (eds) Advances in Multimedia Information Processing – PCM 2013. PCM 2013. Lecture Notes in Computer Science, vol 8294. Springer, Cham. https://doi.org/10.1007/978-3-319-03731-8_5
Download citation
DOI: https://doi.org/10.1007/978-3-319-03731-8_5
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-03730-1
Online ISBN: 978-3-319-03731-8
eBook Packages: Computer ScienceComputer Science (R0)