Skip to main content

Advertisement

Springer Nature Link
Log in

A novel semisupervised SVM for pixel classification of remote sensing imagery

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

This article introduces a semisupervised support vector machine classification technique that exploits both labeled and unlabeled points for addressing the problem of pixel classification of remote sensing images. The proposed technique is based on applying the margin maximization principle to both labeled and unlabeled patterns. Semisupervised SVM progressively searches a reliable discriminant hyperplane in the high dimensional space through iterative method exploiting both labeled and unlabeled samples. In particular, the dynamic thresholding and successive filtering of the unlabeled set are exploited to find a reliable separating hyperplane. The proposed technique is first demonstrated for six labeled datasets described in terms of feature vectors and then identifying different land cover regions in remote sensing imagery and compared with the standard SVM. Experimental results confirm that employing this learning scheme removes unnecessary points to a great extent from the unlabeled set and increases the accuracy level on the other hand. Comparison is made in terms of accuracy, ROC, AUC and F-measure for the labeled data and quantitative cluster validity indices as well as classified image quality for the image data.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Plaza A, Benediktsson JA, Boardman JW, Brazile J, Bruzzone L, Cams-Valls G, Chanussort J, Fauvel M, Gamba P, Gualtieri A, Marconcini M, Tilton JC, Trianni G (2009) Recent advances in techniques for hyperspectral image processing. Remote Sens Environ 113:5110–5122

    Article  Google Scholar 

  2. Bandyopadhyay S, Pal SK (2001) Pixel classification using variable string genetic algorithms with chromosome differentiation. IEEE Trans Geosci Remote Sens 39(2):303–308

    Article  Google Scholar 

  3. Bandyopadhyay S, Maulik U, Mukhopadhyay A (2007) Multiobjective genetic clustering for pixel classification in remote sensing imagery. IEEE Trans Geosci Remote Sens 45(5):1506–1511

    Article  Google Scholar 

  4. Bandyopadhyay S, Maulik U (2002) Genetic clustering for automatic evolution of clusters and application to image classification. Pattern Recognit 35(2):1197–1208

    Article  MATH  Google Scholar 

  5. Baraldi A, Bruzzone L, Blonda P (2005) Quality assessment and cluster maps without ground truth knowledge. IEEE Trans Geosci Remote Sens 43(4):857–873

    Article  Google Scholar 

  6. Belkin M, Niyogi P, Sindhwani V (2004) Manifold regularization: a geometric framework for learning from examples. Technical Report TR 2004–06, University of Chicago

  7. Bennett KP, Demiriz A (1998) Semi-supervised support vector machines. In: Proc. Adv. Neural Inform. Process Syst., vol 10, pp 368–374

  8. Bezdek JC (1981) Pattern recognition with fuzzy objective function algorithms. Plenum, New York

    Book  MATH  Google Scholar 

  9. Bruzzone L, Chi M, Marconcini M (2006) A novel transductive SVM for semisupervised classification of remote-sensing images. IEEE Trans Geosci Remote Sens 44(11):3363–3373

    Article  Google Scholar 

  10. Burges CJC (1998) A tutorial on support vector machines for pattern recognition. Knowl Discov Data Min 2:121–167

    Article  Google Scholar 

  11. Camps-Valls G, Bandos T, Zhou D (2007) Semi-supervised graph-based hyperspectral image classification. IEEE Trans Geosci Remote Sens 45(10):3044–3054

    Article  Google Scholar 

  12. Chen Y, Wang G, Dong S (2003) Learning with progressive transductive support vector machine. Pattern Recognit Lett 34(12):1845–1855

    Article  Google Scholar 

  13. Chi M, Bruzzone L (2005) A semilabeled-sample driven bagging technique for ill-posed classification problem. IEEE Trans Geosci Remote Sens Lett 2(1):69–73

    Article  Google Scholar 

  14. Chi M, Bruzzone L (2007) Semi-supervised classification hyperspectral images by SVMs optimized in the primal. IEEE Trans Geosci Remote Sens Lett 45(6):1870–1880

    Article  Google Scholar 

  15. Cingolani AM, Renison D, Cabido MR (2004) Mapping vegetation in a heterogeneous mountain range land using landsat data: an alternative method to define and classify land-cover units. Remote Sens Environ 92:84–97

    Article  Google Scholar 

  16. Collobert R, Sinz F, Weston J, Bottou L (2006) Large scale transductive SVMs. J Mach Learn Res 7:1687–1712

    MathSciNet  MATH  Google Scholar 

  17. Dempster A, Laird N, Rubin D (1977) Maximum likelihood from incomplete data via the EM algorithm. J R Stat Soc B 39:1–38

    MathSciNet  MATH  Google Scholar 

  18. Hughes GF (1968) On the mean accuracy of statistical pattern recognition. IEEE Trans Inf Theory IT-14(1):55–63

    Article  Google Scholar 

  19. Joachims T (1999) Transductive inference for text classification using support vector machines. In: Proc. ICML, pp 200–209

  20. Liu Z, Wu Q, Zhang U, Philip Chen CL (2011) Adaptive least square support vector machines filter for hand tremor canceling in microsurgery. Int J Mach Learn Cybern 2:37–47

    Article  Google Scholar 

  21. Maulik U, Bandyopadhyay S (2002) Performance evaluation of some clustering algorithms and validity indices. IEEE Trans Pattern Anal Mach Intel 24(12):1650–1654

    Article  Google Scholar 

  22. Merz CJ, Murphy PM, Aha DW (1997) UCI repository of machine learning databases. Department of Information and Computer Science, University of California, Irvine, CA. http://www.ics.uci.edu/mlearn/∼MLRepository.html

  23. Nigam K, McCallum A, Thrun S, Mitchell TM (1998) Learning to classify text from labeled and unlabeled documents. In: AAAI/IAAI, 792

  24. Pontil M, Verri A (1998) Support vector machines for 3-D object recognition. IEEE Trans Pattern Anal Mach Intel 20:637–646

    Article  Google Scholar 

  25. van Rijsbergen CJ (1979) Information retireval. Butterworths, London

    Google Scholar 

  26. Scholkopf B, Kah-Kay C, Burges CJC, Girosi F, Niyogi P, Poggio T, Vapnik V (1997) Comparing support vector machines with gaussian kernels to radial basis fuction classifiers. IEEE Trans Signal Process 45:2758–2765

    Article  Google Scholar 

  27. Shahshahani BM, Landgrebe DA (1994) The effect of unlabeled samples in reducing the small sample size problem and mitigating the Hughes phenemenon. IEEE Trans Geosci Remote Sens 32(5):1087–1095

    Article  Google Scholar 

  28. Small K, Roth D (2010) Margin based active learning for structure predictions. Int J Mach Learn Cybern 1:3–25

    Article  Google Scholar 

  29. Tadjudin S, Landgrebe DA (2000) Robust parameter estimation for mixture model. IEEE Trans Geosci Remote Sens 38(1):439–445

    Article  Google Scholar 

  30. Vapnik V (1998) Statistical learning theory. Wiley, New York

    MATH  Google Scholar 

  31. Vapnik V (1999) The nature of statistical learning theory. 2nd edn. Springer-Verlag, Berlin

    Google Scholar 

  32. Wan V, Campbell WM (2000) Support vector machines for speaker verification and Identification. In: Proceedings IEEE Workshop Neural Networks for signal procesings, Sydney, Australia, pp 775–784

  33. Xie XL, Beni G (1991) A validity measure for fuzzy clustering. IEEE Trans Pattern Anal Mach Intel 13:841–847

    Article  Google Scholar 

  34. Zhang S, McCullagh P, Nugent C, Zheng H, Baumgarten M (2011) Optimal model for posture recognition in home-based healthcare. Int J Mach Learn Cybern 2:1–14

    Article  Google Scholar 

  35. Zhu X, Ghahramani Z, Lafferty J (2003) Semisupervised learning using Gaussian fields and harmonic functions. In: ICML-05, 20th International Conference on Machine Learning

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Jadavpur University, Calcutta, 700032, West Bengal, India

    Ujjwal Maulik

  2. Department of Electronics and Communication, Murshidabad College of Engineering and Technology, Berhampore, 742101, West Bengal, India

    Debasis Chakraborty

Authors
  1. Ujjwal Maulik
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Debasis Chakraborty
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Debasis Chakraborty.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Maulik, U., Chakraborty, D. A novel semisupervised SVM for pixel classification of remote sensing imagery. Int. J. Mach. Learn. & Cyber. 3, 247–258 (2012). https://doi.org/10.1007/s13042-011-0059-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-011-0059-3

Keywords

Search

Navigation