Skip to main content

Batch Mode Active Learning for Geographical Image Classification

  • Conference paper
  • First Online:
  • 2823 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9313))

Abstract

In this paper, an innovative batch mode active learning by combining discriminative and representative information for hyperspectral image classification with support vector machine is proposed. In the past years, the batch mode active learning mainly exploits different query functions, which are based on two criteria: uncertainty criterion and diversity criterion. Generally, the uncertainty criterion and diversity criterion are independent of each other, and they also could not make sure the queried samples identical and independent distribution. In the proposed method, the diversity criterion is focused. In the innovative diversity criterion, firstly, we derive a novel form of upper bound for true risk in the active learning setting, by minimizing this upper bound to measure the discriminative information, which is connected with the uncertainty. Secondly, for the representative information, the maximum mean discrepancy(MMD) which captures the representative information of the data structure is adopt to match the distribution of the labeled samples and query samples, to make sure the queried samples have a similar distribution to the labeled samples and guarantee the queried samples are diversified. Meanwhile, the number of new queried samples is adaptive, which depends on the distribution of the labeled samples. In the experiment, we employ two benchmark remote sensing images, Indian Pines and Washington DC. The experimental results demonstrate the effective of our proposed method compared with the state-of-the-art AL methods

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Settles, B., Craven, M.: An analysis of active learning strategies for sequence labeling tasks. In: Proc. Int. Conf. Emprical Methods in Natural Language Processing (EMNLP 2008), pp. 1070–1079 (2008)

    Google Scholar 

  2. Tong, S., Koller, D.: Support Vector Machine Active Learning with Applications to Text Classification. Journal of Machine Learning Research 2, 45–66 (2001)

    MATH  Google Scholar 

  3. Brinker, K.: Incorporating diversity in active learning with support vector machines. In: Proc. Int. Conf. Machine Learning Workshop, p. 59 (2003)

    Google Scholar 

  4. Xu, Z., Yu, K., Tresp, V., Xu, X., Wang, J.: Representative sampling for text classification using support vector machines. In: Sebastiani, F. (ed.) ECIR 2003. LNCS, vol. 2633, pp. 393–407. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  5. Argamon-Engelson, S., Dagan, I.: Committee-based sample selection for probabilistic classifiers. arXiv preprint arXiv:1106.0220 (2011)

    Google Scholar 

  6. Melville, P., Mooney, R.J.: Diverse ensembles for active learning. In: Proc. Int. Conf. Machine Learning Workshop, p. 584 (2004)

    Google Scholar 

  7. Nigam, K., McCallum, A.K., Thrun, S., Mitchell, T.: Text classification from labeled and unlabeled documents using EM. Mach. Learn. 39, 103–134 (2000)

    Article  MATH  Google Scholar 

  8. Luo, T., Kramer, K., Goldgof, D.B., Hall, L.O.: Active learning to recognize multiple types of plankton. In: Proc. 17th Int. Conf. Pattern Recognition, ICPR 2004, pp. 478–481 (2004)

    Google Scholar 

  9. Roy, N., McCallum, A.: Toward optimal active learning through monte carlo estimation of error reduction. In: ICML, Williamstown (2001)

    Google Scholar 

  10. Campbell, C., Cristianini, N., Smola, A.: Query learning with large margin classifiers. In: Proc. Int. Conf. Machine Learning Workshop, pp. 111–118 (2000)

    Google Scholar 

  11. Schohn, G., Cohn, D.: Less is more: Active learning with support vector machines. In: Proc. Int. Conf. Machine Learning Workshop, pp. 839–846 (2000)

    Google Scholar 

  12. Kanungo, T., Mount, D.M., Netanyahu, N.S.: An efficient k-means clustering algorithm: Analysis and implementation. IEEE Trans. Pattern Anal. Mach. Intell. 24, 881–892 (2002)

    Article  Google Scholar 

  13. Shawe-Taylor, J., Cristianini, N.: Kernel methods for pattern analysis. Cambridge University Press (2004)

    Google Scholar 

  14. Dhillon, I.S., Guan, Y., Kulis, B.: Kernel k-means: spectral clustering and normalized cuts. In: Proc. 10th ACM SIGKDD Int. Conf. Knowledge Discovery and Data Mining, pp. 551–556 (2004)

    Google Scholar 

  15. Beygelzimer, A., Dasgupta, S., Langford, J.: Importance weighted active learning. In: Proceedings of the 26th International Conference on Machine Learning (ICML), pp. 49–56 (2009)

    Google Scholar 

  16. Nguyen, H.T., Smeulders, A.: Active learning using pre-clustering. In: Proceedings of the 21st International Conference on Machine Learning (ICML), New York, NY, USA, pp. 79–86 (2004)

    Google Scholar 

  17. Tuia, D., Ratle, F., Pacifici, F., Kanevski, M., Emery, W.J.: Active learning methods for remote sensing image classification. IEEE Trans. Geosci. Remote Sens. 47(7), 2218–2232 (2009)

    Article  Google Scholar 

  18. Demir, B., Persello, C., Bruzzone, L.: Batch-mode active-learning methods for the interactive classification of remote sensing images. IEEE Trans. Geosci. Remote Sens. 49, 1014–1031 (2011)

    Article  Google Scholar 

  19. Bezdek, J.C., Hathaway, R.J.: Convergence of alternating optimization. Neural, Parallel and Scientific Computations 11(4), 351–368 (2003)

    MathSciNet  MATH  Google Scholar 

  20. Dasgupta, S.: Two faces of active learning. Theoretical Computer Science 41(19), 1767–1781 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  21. Chang, C.C., Lin, C.J.: LIBSVM: a library for support vector machines. ACM T. Intell. Syst. Technol. (TIST) 2, 27 (2011)

    Google Scholar 

  22. Wenbin, C., Ya, Z., Jun, Z.: Maximizing expected model change for active learning in regression. In: Proc. 13th Intl. Conf. Data Mining (2013)

    Google Scholar 

  23. Chakrabarti, A., Zickler, T.: Statistics of real-world hyperspectral images. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 193–200 (2011)

    Google Scholar 

  24. Settles, B.: Active Learning. Morgan and Claypool (2012)

    Google Scholar 

  25. Chattopadhyay, R., Wang, Z., Fan, W., Davidson, I., Panchanathan, S., Ye, J.: Batch mode active sampling based on marginal probability distribution matching. In: Proc. 10th ACM SIGKDD Int. Conf. Knowledge Discovery and Data Mining (KDD), pp. 741–749 (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zengmao Wang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Wang, Z., Du, B., Zhang, L., Hu, W., Tao, D., Zhang, L. (2015). Batch Mode Active Learning for Geographical Image Classification. In: Cheng, R., Cui, B., Zhang, Z., Cai, R., Xu, J. (eds) Web Technologies and Applications. APWeb 2015. Lecture Notes in Computer Science(), vol 9313. Springer, Cham. https://doi.org/10.1007/978-3-319-25255-1_61

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-25255-1_61

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-25254-4

  • Online ISBN: 978-3-319-25255-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics