Abstract
In this paper, an innovative batch mode active learning by combining discriminative and representative information for hyperspectral image classification with support vector machine is proposed. In the past years, the batch mode active learning mainly exploits different query functions, which are based on two criteria: uncertainty criterion and diversity criterion. Generally, the uncertainty criterion and diversity criterion are independent of each other, and they also could not make sure the queried samples identical and independent distribution. In the proposed method, the diversity criterion is focused. In the innovative diversity criterion, firstly, we derive a novel form of upper bound for true risk in the active learning setting, by minimizing this upper bound to measure the discriminative information, which is connected with the uncertainty. Secondly, for the representative information, the maximum mean discrepancy(MMD) which captures the representative information of the data structure is adopt to match the distribution of the labeled samples and query samples, to make sure the queried samples have a similar distribution to the labeled samples and guarantee the queried samples are diversified. Meanwhile, the number of new queried samples is adaptive, which depends on the distribution of the labeled samples. In the experiment, we employ two benchmark remote sensing images, Indian Pines and Washington DC. The experimental results demonstrate the effective of our proposed method compared with the state-of-the-art AL methods
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Settles, B., Craven, M.: An analysis of active learning strategies for sequence labeling tasks. In: Proc. Int. Conf. Emprical Methods in Natural Language Processing (EMNLP 2008), pp. 1070–1079 (2008)
Tong, S., Koller, D.: Support Vector Machine Active Learning with Applications to Text Classification. Journal of Machine Learning Research 2, 45–66 (2001)
Brinker, K.: Incorporating diversity in active learning with support vector machines. In: Proc. Int. Conf. Machine Learning Workshop, p. 59 (2003)
Xu, Z., Yu, K., Tresp, V., Xu, X., Wang, J.: Representative sampling for text classification using support vector machines. In: Sebastiani, F. (ed.) ECIR 2003. LNCS, vol. 2633, pp. 393–407. Springer, Heidelberg (2003)
Argamon-Engelson, S., Dagan, I.: Committee-based sample selection for probabilistic classifiers. arXiv preprint arXiv:1106.0220 (2011)
Melville, P., Mooney, R.J.: Diverse ensembles for active learning. In: Proc. Int. Conf. Machine Learning Workshop, p. 584 (2004)
Nigam, K., McCallum, A.K., Thrun, S., Mitchell, T.: Text classification from labeled and unlabeled documents using EM. Mach. Learn. 39, 103–134 (2000)
Luo, T., Kramer, K., Goldgof, D.B., Hall, L.O.: Active learning to recognize multiple types of plankton. In: Proc. 17th Int. Conf. Pattern Recognition, ICPR 2004, pp. 478–481 (2004)
Roy, N., McCallum, A.: Toward optimal active learning through monte carlo estimation of error reduction. In: ICML, Williamstown (2001)
Campbell, C., Cristianini, N., Smola, A.: Query learning with large margin classifiers. In: Proc. Int. Conf. Machine Learning Workshop, pp. 111–118 (2000)
Schohn, G., Cohn, D.: Less is more: Active learning with support vector machines. In: Proc. Int. Conf. Machine Learning Workshop, pp. 839–846 (2000)
Kanungo, T., Mount, D.M., Netanyahu, N.S.: An efficient k-means clustering algorithm: Analysis and implementation. IEEE Trans. Pattern Anal. Mach. Intell. 24, 881–892 (2002)
Shawe-Taylor, J., Cristianini, N.: Kernel methods for pattern analysis. Cambridge University Press (2004)
Dhillon, I.S., Guan, Y., Kulis, B.: Kernel k-means: spectral clustering and normalized cuts. In: Proc. 10th ACM SIGKDD Int. Conf. Knowledge Discovery and Data Mining, pp. 551–556 (2004)
Beygelzimer, A., Dasgupta, S., Langford, J.: Importance weighted active learning. In: Proceedings of the 26th International Conference on Machine Learning (ICML), pp. 49–56 (2009)
Nguyen, H.T., Smeulders, A.: Active learning using pre-clustering. In: Proceedings of the 21st International Conference on Machine Learning (ICML), New York, NY, USA, pp. 79–86 (2004)
Tuia, D., Ratle, F., Pacifici, F., Kanevski, M., Emery, W.J.: Active learning methods for remote sensing image classification. IEEE Trans. Geosci. Remote Sens. 47(7), 2218–2232 (2009)
Demir, B., Persello, C., Bruzzone, L.: Batch-mode active-learning methods for the interactive classification of remote sensing images. IEEE Trans. Geosci. Remote Sens. 49, 1014–1031 (2011)
Bezdek, J.C., Hathaway, R.J.: Convergence of alternating optimization. Neural, Parallel and Scientific Computations 11(4), 351–368 (2003)
Dasgupta, S.: Two faces of active learning. Theoretical Computer Science 41(19), 1767–1781 (2011)
Chang, C.C., Lin, C.J.: LIBSVM: a library for support vector machines. ACM T. Intell. Syst. Technol. (TIST) 2, 27 (2011)
Wenbin, C., Ya, Z., Jun, Z.: Maximizing expected model change for active learning in regression. In: Proc. 13th Intl. Conf. Data Mining (2013)
Chakrabarti, A., Zickler, T.: Statistics of real-world hyperspectral images. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 193–200 (2011)
Settles, B.: Active Learning. Morgan and Claypool (2012)
Chattopadhyay, R., Wang, Z., Fan, W., Davidson, I., Panchanathan, S., Ye, J.: Batch mode active sampling based on marginal probability distribution matching. In: Proc. 10th ACM SIGKDD Int. Conf. Knowledge Discovery and Data Mining (KDD), pp. 741–749 (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Wang, Z., Du, B., Zhang, L., Hu, W., Tao, D., Zhang, L. (2015). Batch Mode Active Learning for Geographical Image Classification. In: Cheng, R., Cui, B., Zhang, Z., Cai, R., Xu, J. (eds) Web Technologies and Applications. APWeb 2015. Lecture Notes in Computer Science(), vol 9313. Springer, Cham. https://doi.org/10.1007/978-3-319-25255-1_61
Download citation
DOI: https://doi.org/10.1007/978-3-319-25255-1_61
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-25254-4
Online ISBN: 978-3-319-25255-1
eBook Packages: Computer ScienceComputer Science (R0)