Skip to main content
SpringerLink
Log in

DeepSIC: a deep model

For satellite image classification

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Satellite Image Classification is the problem of classifying satellite images into their corresponding classes. Using supervised deep learning, we provide an efficient classification mechanism of earth observation imagery captured by satellite. Promising classification results were obtained through Convolution Neural Network. Two sets of experiments were carried out. In the first set, the traditional pre-deep learning era approach was followed: features were extracted first which were then given as input to Support Vector Machines (SVM). In the second set of experiments, the images were directly provided as input to Convolution Neural Networks and the output features were then used as input to the SVM. The proposed schemes were tested on satellite images datasets AID, UC-merced and WHU-RS, having varied classes and heterogeneous image dimensions. We show that our model, with Convolution Neural Network, achieves 92% accuracy on the AID dataset and outperforms the previously reported best accuracy of 89.64% (Xia et al. in CoRR, arXiv:1608.05167, 2016).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Accessed at: https://devblogs.nvidia.com/parallelforall/deep-learning-for-computer-vision-with-matlab-and-cudnn/ (2016)

  2. Bay, H., Tuytelaars, T., Van Gool, L.: Surf: speeded up robust features. In: European Conference on Computer Vision, pp. 404–417. Springer (2006)

  3. Bosch, A., Muñoz, X., Martí, R.: Which is the best way to organize/classify images by content? Image Vis. Comput. 25(6), 778–791 (2007)

    Article  Google Scholar 

  4. Boureau, Y.-L., Bach, F., LeCun, Y., Ponce, J.: Learning mid-level features for recognition. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2559–2566. IEEE (2010)

  5. Caffe, J.Y.: An open source convolutional architecture for fast feature embedding. In: ACM International Conference on Multimedia, ACM

  6. Chen, S., Tian, Y.L.: Pyramid of spatial relatons for scene-level land use classification. IEEE Trans. Geosci. Remote Sens. 53(4), 1947–1957 (2015)

    Article  Google Scholar 

  7. Cheriyadat, A.M.: Unsupervised feature learning for aerial scene classification. IEEE Trans. Geosci. Remote Sens. 52(1), 439–451 (2014)

    Article  Google Scholar 

  8. Coates, A., Lee, H., Ng, A.Y.: An analysis of single-layer networks in unsupervised feature learning. Ann Arbor 1001(48109), 2 (2010)

    Google Scholar 

  9. Donaldson, D., Storeygard, A.: The view from above: applications of satellite data in economics. J. Econ. Perspect. 30(4), 171–198 (2016)

    Article  Google Scholar 

  10. Gao, M.-L., Zhao, W.-J., Gong, Z.-N., Gong, H.-L., Chen, Z., Tang, X.-M.: Topographic correction of zy-3 satellite images and its effects on estimation of shrub leaf biomass in mountainous areas. Remote Sens. 6(4), 2745–2764 (2014)

    Article  Google Scholar 

  11. Guenther, N., Schonlau, M., et al.: Support vector machines. Stata J. 16(4), 917–937 (2016)

    Google Scholar 

  12. Guo, M., Yi, Y., Liu, J., Li, Y.: Scene text segmentation method based on mser and mlbp. In: China Academic Conference on Printing & Packaging and Media Technology, pp. 305–310. Springer (2016)

  13. Saxena, R., Mukherjee, S.: Application of remote sensing technology for land use/land cover change analysis. J. Indian Soc. Remote Sens. 27(2), 123–128 (1999)

    Article  Google Scholar 

  14. Ketkar, N.: Convolutional neural networks. In: Deep Learning with Python, pp. 61–76. Springer (2017)

  15. Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)

  16. Law, M.T., Thome, N., Cord, M.: Bag-of-words image representation: key ideas and further insight. In: Fusion in Computer Vision, pp. 29–52. Springer (2014)

  17. Lazebnik, S., Schmid, C., Ponce, J.: Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. In: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 2169–2178. IEEE (2006)

  18. LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)

    Article  Google Scholar 

  19. Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)

    Article  Google Scholar 

  20. Nguyen, A., Dosovitskiy, A., Yosinski, J., Brox, T., Clune, J.: Synthesizing the preferred inputs for neurons in neural networks via deep generator networks. In: Advances in Neural Information Processing Systems, pp. 3387–3395 (2016)

  21. Ren, J.S.J., Xu, L.: On vectorization of deep convolutional neural networks for vision tasks. arXiv preprint arXiv:1501.07338 (2015)

  22. Rogan, J., Chen, D.M.: Remote sensing technology for mapping and monitoring land-cover and land-use change. Prog. Plan. 61(4), 301–325 (2004)

    Article  Google Scholar 

  23. Schultz, L., Molthan, A., Burks, J.E., Bell, J., McGrath, K., Cole, T.: Applications of earth remote sensing for identifying tornado and severe weather damage (2016)

  24. Shao, W., Yang, W., Xia, G.-S.: Extreme value theory-based calibration for the fusion of multiple features in high-resolution satellite scene classification. Int. J. Remote Sens. 34(23), 8588–8602 (2013)

    Article  Google Scholar 

  25. Sheng, G., Yang, W., Tao, X., Sun, H.: High-resolution satellite scene classification using a sparse coding based multiple feature combination. Int. J. Remote Sens. 33(8), 2395–2412 (2012)

    Article  Google Scholar 

  26. Shin, H.-C., Roth, H.R., Gao, M., Lu, L., Xu, Z., Nogues, I., Yao, J., Mollura, D., Summers, R.M.: Deep convolutional neural networks for computer-aided detection: Cnn architectures, dataset characteristics and transfer learning. IEEE Trans. Med. Imaging 35(5), 1285–1298 (2016)

    Article  Google Scholar 

  27. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)

  28. Sivic, J., Zisserman, A., et al.: Video google: a text retrieval approach to object matching in videos. In: iccv vol. 2, 1470–1477 (2003)

  29. Vaudour, E., Gilliot, J.-M., Bel, L., Brechet, L., Hamiache, J., Hadjar, D., Lemonnier, Y.: Uncertainty of soil reflectance retrieval from spot and rapideye multispectral satellite images using a per-pixel bootstrapped empirical line atmospheric correction over an agricultural region. Int. J. Appl. Earth Obs. Geoinf. 26, 217–234 (2014)

    Article  Google Scholar 

  30. Xia, G.-S., Hu, J., Hu, F., Shi, B., Bai, X., Zhong, Y., Zhang, L.: AID: a benchmark dataset for performance evaluation of aerial scene classification. CoRR (2016). arXiv:1608.05167

  31. Xia, G.-S., Yang, W., Delon, J., Gousseau, Y., Sun, H., Maître, H.: Structural high-resolution satellite image indexing. In: ISPRS TC VII Symposium-100 Years ISPRS, vol. 38, pp. 298–303 (2010)

  32. Yong, X.U., Bo, H.U.A.N.G.: Spatial and temporal classification of synthetic satellite imagery: land cover mapping and accuracy validation. Geo-spat. Inf. Sci. 17(1), 1–7 (2014)

    Article  Google Scholar 

  33. Yang, W., Yin, X., Xia, G.-S.: Learning high-level features for satellite image classification with limited labeled samples. IEEE Trans. Geosci. Remote Sens. 53(8), 4472–4482 (2015)

    Article  Google Scholar 

  34. Yang, Y., Newsam, S.: Bag-of-visual-words and spatial extensions for land-use classification. In: Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems, pp. 270–279. ACM (2010)

  35. Yang, Y., Newsam, S.: Spatial pyramid co-occurrence for image classification. In: 2011 IEEE International Conference on Computer Vision (ICCV)

  36. Yeom, J.-M., Hwang, J., Jung, J.-H., Lee, K.-H., Lee, C.-S.: Initial radiometric characteristics of kompsat-3a multispectral imagery using the 6s radiative transfer model, well-known radiometric tarps, and mfrsr measurements. Remote Sens. 9(2), 130 (2017)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. National University of Computer & Emerging Sciences, Islamabad, Pakistan

    Muhammad Amin, Shakirullah Shah & Muhammad Abdullah

  2. Institute of Management Sciences, Peshawar, Pakistan

    Tamleek Ali Tanveer

  3. Faculty of Computer and Information Systems, Islamic University in Madinah, Medina, Saudi Arabia

    Muhammad Shafi

Authors
  1. Muhammad Amin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tamleek Ali Tanveer
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shakirullah Shah
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Muhammad Abdullah
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Muhammad Shafi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Muhammad Amin.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Amin, M., Tanveer, T.A., Shah, S. et al. DeepSIC: a deep model. Cluster Comput 21, 741–754 (2018). https://doi.org/10.1007/s10586-017-1010-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-017-1010-5

Keywords

Search

Navigation