Skip to main content
SpringerLink
Log in

A novel multi-class land use/land cover classification using deep kernel attention transformer for hyperspectral images

  • RESEARCH
  • Published:
Earth Science Informatics Aims and scope Submit manuscript

Abstract

Hyperspectral imaging is a prominent land use land cover (LULC)classification technology. However, due to fewer training samples, LULC classification using hyperspectral images remains complicated and labour-intensive. We have presented a Deep Kernel Attention Transformer (DKAT) to overcome these issues in classifying Land Use Land Cover classes. Before classifying the land cover, t-Distributed Stochastic Neighbouring Embedding (t-SNE) is exploited to extract the features from the LULC by applying the probability distribution function. To quantify the resemblance among the two points Kull Burk-Divergence (KL) is employed. Then, a searching-based band selection method is used to select the bands. The grey wolf optimization (GWO) technique is used in the searching-based band selection method to determine the informative bands. After choosing the informative bands from the hyperspectral data cube, we must classify the land cover. Experimental results are conducted by using five publicly available benchmark datasets. They are Indian Pines, Salinas, Pavia University, Botswana, and Kennedy Space Center. The classification accuracy is calculated using the overall accuracy, average accuracy, and kappa coefficient; we have achieved 99.19% overall accuracy, 99.32% average accuracy, and 99.14% kappa coefficient.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Algorithm
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

Data Availability

The datasets which are used in this study is openly available in GRUPO DE INTELIGENCIA COMPUTATIONAL (GIC) at https://www.ehu.eus/ccwintco/index.php/Hyperspectral_Remote_Sensing_Scenes, (Graña et al. n.d.).

References

  • Aberna P, Agilandeeswari L, Bansal A (2023) Vision transformer-based watermark generation for authentication and tamper detection using Schur decomposition and hybrid transforms. Int J Comput Inf Syst Ind Manag Appl 15:107–121

    Google Scholar 

  • Adam E, Mutanga O, Odindi J, Abdel-Rahman EM (2014) Land-use/cover classification in a heterogeneous coastal landscape using RapidEye imagery: evaluating the performance of random forest and support vector machines classifiers. Int J Remote Sens 35(10):3440–3458

    Google Scholar 

  • Agilandeeswari L, Meena SD (2023) SWIN transformer based contrastive self-supervised learning for animal detection and classification. Multimed Tools Appl 82(7):10445–10470

    Google Scholar 

  • Agilandeeswari L, Prabukumar M, Radhesyam V, Phaneendra KL, Farhan A (2022) Crop classification for agricultural applications in hyperspectral remote sensing images. Appl Sci 12(3):1670

    Google Scholar 

  • Bachmann CM, Ainsworth TL, Fusina RA (2005) Exploiting manifold geometry in hyperspectral imagery. IEEE Trans Geosci Remote Sens 43(3):441–454

    Google Scholar 

  • Bajwa SG, Bajcsy P, Groves P, Tian LF (2004) Hyperspectral image data mining for band selection in agricultural applications. Trans ASAE 47(3):895–907

    Google Scholar 

  • Bioucas-Dias JM, Plaza A, Camps-Valls G, Scheunders P, Nasrabadi N, Chanussot J (2013) Hyperspectral remote sensing data analysis and future challenges. IEEE Geosci Remote Sens Mag 1(2):6–36

    Google Scholar 

  • Cariou C, Chehdi K, Moan SL (2020) Improved nearest neighbor density-based clustering techniques with application to hyperspectral images. In: ICASSP. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp 2020–2020

    Google Scholar 

  • Chang C-I, Ren H (2000) An experiment-based quantitative and comparative analysis of target detection and image classification algorithms for hyperspectral imagery. IEEE Trans Geosci Remote Sens 38(2):1044–1063

    Google Scholar 

  • Chen C, Li W, Su H, Liu K (2014) Spectral-spatial classification of hyperspectral image based on kernel extreme learning machine. Remote Sens 6(6):5795–5814

    Google Scholar 

  • Chen H, Miao F, Chen Y, Xiong Y, Chen T (2021) A hyperspectral image classification method using multifeature vectors and optimized KELM. IEEE J Sel Top Appl Earth Obs Remote Sens 14:2781–2795

    Google Scholar 

  • Christovam LE, Pessoa GG, Shimabukuro MH, Galo ML (2019) Land use and land cover classification using hyperspectral imagery: evaluating the performance of spectral angle mapper, support vector machine and random forest. Int Arch Photogramm Remote Sens Spat Inf Sci 42:1841–1847

    Google Scholar 

  • Chutia D, Bhattacharyya DK, Sarma KK, Kalita R, Sudhakar S (2016) Hyperspectral remote sensing classifications: a perspective survey. Trans GIS 20(4):463–490

    Google Scholar 

  • Devassy BM, George S (2020) Dimensionality reduction and visualisation of hyperspectral ink data using t-SNE. Forensic Sci Int 311:110194

    Google Scholar 

  • Ettabaa KS, Salem MB (2018) Adaptive progressive band selection for dimensionality reduction in hyperspectral images. J Indian Soc Remote Sens 46:157–167

    Google Scholar 

  • Fauvel M, Chanussot J, Benediktsson JA (2009) Kernel principal component analysis for the classification of hyperspectral remote sensing data over urban areas. EURASIP J Adv Signal Process 2009:1–14

    Google Scholar 

  • Ghamisi P, Plaza J, Chen Y, Li J, Plaza AJ (2017) Advanced spectral classifiers for hyperspectral images: A review. IEEE Geosci Remote Sens Mag 5(1):8–32

    Google Scholar 

  • Graña M, Veganzons M, Ayerdi B (n.d.) Hyperspectral remote sensing scenes. (GRUPO DE INTELIGENCIA COMPUTATIONAL (GIC))

  • Haq MA (2022a) CDLSTM: A novel model for climate change forecasting. Comput Mater Contin 71(2)

  • Haq MA (2022b) CNN based automated weed detection system using UAV imagery. Comput Sys Sci Eng 42(2)

  • Haq MA (2022c) Planetscope nanosatellites image classification using machine learning. Comput Syst Sci Eng 42(3)

  • Haq MA, Baral P, Yaragal S, Rahaman G (2020) Assessment of trends of land surface vegetation distribution, snow cover and temperature over entire Himachal Pradesh using MODIS datasets. Nat Resour Model 33(2):e12262

    Google Scholar 

  • Haq MA, Alshehri M, Rahaman G, Ghosh A, Baral P, Shekhar C (2021a) Snow and glacial feature identification using Hyperion dataset and machine learning algorithms. Arab J Geosci 14:1–21

    Google Scholar 

  • Haq MA, Baral P, Yaragal S, Pradhan B (2021b) Bulk processing of multi-temporal modis data, statistical analyses and machine learning algorithms to understand climate variables in the Indian Himalayan region. Sensors 21(21):7416

    Google Scholar 

  • Haq MA, Rahaman G, Baral P, Ghosh A (2021c) Deep learning based supervised image classification using UAV images for forest areas classification. J Indian Soc Remote Sens 49:601–606

    Google Scholar 

  • Haq MA, Ahmed A, Khan I, Gyani J, Mohamed A, Attia E-A, Pandi D (2022) Analysis of environmental factors using AI and ML methods. Sci Rep 12(1):13267

    Google Scholar 

  • Haq MA, Ahsan A, Gyani J (2023) Implementation of CNN for plant identification using UAV imagery. Int J Adv Comput Sci Appl 14(4)

  • He X, Chen Y, Lin Z (2021) Spatial-spectral transformer for hyperspectral image classification. Remote Sens 13(3):498

    Google Scholar 

  • Hong D, Gao L, Yao J, Zhang B, Plaza A, Chanussot J (2020) Graph convolutional networks for hyperspectral image classification. IEEE Trans Geosci Remote Sens 59(7):5966–5978

    Google Scholar 

  • Hotelling H (1933) Analysis of a complex of statistical variables into principal components. J Educ Psychol 24(6):417

    Google Scholar 

  • Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks. Proc IEEE Conf Comput Vis Pattern Recognit:7132–7141

  • Jia S, Wang Y (2022) Multiscale convolutional transformer with center mask pretraining for hyperspectral image classification. arXiv preprint arXiv:2203.04771

  • Kambhatla N, Leen T (1993) Fast non-linear dimension reduction. Adv Neural Inf Proces Syst 6

  • Kavzoglu T, Colkesen I (2009) A kernel functions analysis for support vector machines for land cover classification. Int J Appl Earth Obs Geoinf 11(5):352–359

    Google Scholar 

  • Lee H, Kwon H (2017) Going deeper with contextual CNN for hyperspectral image classification. IEEE Trans Image Process 26(10):4843–4855

    Google Scholar 

  • Li W, Wu G, Zhang F, Du Q (2016) Hyperspectral image classification using deep pixel-pair features. IEEE Trans Geosci Remote Sens 55(2):844–853

    Google Scholar 

  • Lunga D, Ersoy O (2012) Spherical stochastic neighbor embedding of hyperspectral data. IEEE Trans Geosci Remote Sens 51(2):857–871

    Google Scholar 

  • Lv W, Wang X (2020) Overview of hyperspectral image classification. J Sens 2020

  • Ma X, Wang H, Wang J (2016) Semisupervised classification for hyperspectral image based on multi-decision labeling and deep feature learning. ISPRS J Photogramm Remote Sens 120:99–107

    Google Scholar 

  • Manandhar R, Odeh IO, Ancev T (2009) Improving the accuracy of land use and land cover classification of Landsat data using post-classification enhancement. Remote Sens 1(3):330–344

    Google Scholar 

  • Mangan P, Pandi D, Haq MA, Sinha A, Nagarajan R, Dasani T, Alshehri M (2022) Analytic hierarchy process based land suitability for organic farming in the arid region. Sustainability 14(8):4542

    Google Scholar 

  • Mas J-F (1999) Monitoring land-cover changes: a comparison of change detection techniques. Int J Remote Sens 20(1):139–152

    Google Scholar 

  • Maxwell AE, Warner TA, Fang F (2018) Implementation of machine-learning classification in remote sensing: an applied review. Int J Remote Sens 39(9):2784–2817

    Google Scholar 

  • Mishra G, Sethi N, Agilandeeswari L, Hu Y-C (2023) Intelligent abstractive text summarization using hybrid Word2Vec and Swin transformer for long documents. Int J Comput Inf Syst Ind Manag Appl. 15:212–226

    Google Scholar 

  • MohanRajan SN, Loganathan A (2021) Modelling spatial drivers for LU/LC change prediction using hybrid machine learning methods in Javadi Hills, Tamil Nadu, India. J Indian Soc Remote Sens 49:913–934

    Google Scholar 

  • Mohanrajan SN, Loganathan A (2022) Novel vision transformer–based bi-LSTM model for LU/LC prediction—Javadi Hills, India. Appl Sci 12(13):6387

    Google Scholar 

  • MohanRajan SN, Loganathan A (2023) A novel fuzzy Harris hawks optimization-based supervised vegetation and bare soil prediction system for Javadi Hills, India. Arab J Geosci 16(8):478

    Google Scholar 

  • MohanRajan SN, Loganathan A, Manoharan P (2020) Survey on land use/land cover (LU/LC) change analysis in remote sensing and GIS environment: techniques and challenges. Environ Sci Pollut Res 27:29900–29926

    Google Scholar 

  • Navin MS, Agilandeeswari L (2020a) Comprehensive review on land use/land cover change classification in remote sensing. Journal of spectral. Imaging 9

  • Navin MS, Agilandeeswari L (2020b) Multispectral and hyperspectral images based land use/land cover change prediction analysis: an extensive review. Multimed Tools Appl 79(39–40):29751–29774

    Google Scholar 

  • Otter DW, Medina JR, Kalita JK (2020) A survey of the usages of deep learning for natural language processing. IEEE Trans Neural Netw Learn Syst 32(2):604–624

    Google Scholar 

  • Palani A, Loganathan A (2023a) Multi-image feature map-based watermarking techniques using transformer. Int J Electr Electron Res 11:339–344

    Google Scholar 

  • Palani A, Loganathan A (2023b) Semi-blind watermarking using convolutional attention-based turtle shell matrix for tamper detection and recovery of medical image. Expert Syst Appl 121903

  • Petitjean F, Kurtz C, Passat N, Gançarski P (2012) Spatio-temporal reasoning for the classification of satellite image time series. Pattern Recogn Lett 33(13):1805–1815

    Google Scholar 

  • Puletti N, Camarretta N, Corona P (2016) Evaluating EO1-hyperion capability for mapping conifer and broadleaved forests. Eur J Remote Sens 49(1):157–169

    Google Scholar 

  • Roy SK, Krishna G, Dubey SR, Chaudhuri BB (2019) HybridSN: exploring 3-D–2-D CNN feature hierarchy for hyperspectral image classification. IEEE Geosci Remote Sens Lett 17(2):277–281

    Google Scholar 

  • Saqui D, Saito JH, Lucio AD, Ferreira EJ, Lima DC, Herrera JP (2016) Methodology for band selection of hyperspectral images using genetic algorithms and gaussian maximum likelihood classifier. In: 2016 international conference on Computational science and Computational intelligence (CSCI), IEEE

  • Sawant SS, Prabukumar M, Samiappan S (2019) A band selection method for hyperspectral image classification based on cuckoo search algorithm with correlation based initialization. In: 2019 10th workshop on hyperspectral imaging and signal processing: evolution in remote sensing (WHISPERS). IEEE

    Google Scholar 

  • Segl K, Roessner S, Heiden U, Kaufmann H (2003) Fusion of spectral and shape features for identification of urban surface cover types using reflective and thermal hyperspectral data. ISPRS J Photogramm Remote Sens 58(1–2):99–112

    Google Scholar 

  • Su H, Yong B, Du Q (2015) Hyperspectral band selection using improved firefly algorithm. IEEE Geosci Remote Sens Lett 13(1):68–72

    Google Scholar 

  • Su H, Tian S, Cai Y, Sheng Y, Chen C, Najafian M (2017) Optimized extreme learning machine for urban land cover classification using hyperspectral imagery. Front Earth Sci 11:765–773

    Google Scholar 

  • Teng W, Zhao J, Bai X (2022) Improved graph-based Semisupervised hyperspectral band selection. In: IGARSS. IEEE International Geoscience and Remote Sensing Symposium, IEEE, pp 2022–2022

    Google Scholar 

  • Wang L, Peng J, Sun W (2019) Spatial–spectral squeeze-and-excitation residual network for hyperspectral image classification. Remote Sens 11(7):884

    Google Scholar 

  • Wang M, Liu W, Chen M, Huang X, Han W (2021) A band selection approach based on a modified gray wolf optimizer and weight updating of bands for hyperspectral image. Appl Soft Comput 112:107805

    Google Scholar 

  • Wang Y, Zhu Q, Ma H, Yu H (2022) A hybrid gray wolf optimizer for hyperspectral image band selection. IEEE Trans Geosci Remote Sens 60:1–13

    Google Scholar 

  • Yadav CS, Pradhan MK, Gangadharan SM, Chaudhary JK, Singh J, Khan AA, Haq MA (2022) Multi-class pixel certainty active learning model for classification of land cover classes using hyperspectral imagery. Electronics 11(17):2799

    Google Scholar 

  • Yang R, Zhou Q, Fan B, Wang Y (2022) Land cover classification from hyperspectral images via local nearest neighbor collaborative representation with Tikhonov regularization. Land 11(5):702

    Google Scholar 

  • Zhang T, Tao D, Li X, Yang J (2008) Patch alignment for dimensionality reduction. IEEE Trans Knowl Data Eng 21(9):1299–1313

    Google Scholar 

  • Zhang L, Zhang L, Tao D, Huang X (2013) A modified stochastic neighbor embedding for multi-feature dimension reduction of remote sensing images. ISPRS J Photogramm Remote Sens 83:30–39

    Google Scholar 

  • Zhang M, Ma J, Gong M (2017) Unsupervised hyperspectral band selection by fuzzy clustering with particle swarm optimization. IEEE Geosci Remote Sens Lett 14(5):773–777

    Google Scholar 

  • Zhang A, Ma P, Liu S, Sun G, Huang H, Zabalza J, Lin C (2019) Hyperspectral band selection using crossover-based gravitational search algorithm. IET Image Process 13(2):280–286

    Google Scholar 

  • Zhang Z, Ma Q, Zhou H, Gong N (2022) Nested transformers for hyperspectral image classification. Journal of Sensors

  • Zhu J, Fang L, Ghamisi P (2018) Deformable convolutional neural networks for hyperspectral image classification. IEEE Geosci Remote Sens Lett 15(8):1254–1258

    Google Scholar 

Download references

Funding

The authors did not receive support from any organization for the submitted work.

Author information

Authors and Affiliations

  1. School of Information Technology and Engineering, Vellore Institute of Technology, Vellore, 632014, Tamil Nadu, India

    Ganji Tejasree & Agilandeeswari L

Authors
  1. Ganji Tejasree
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Agilandeeswari L
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors contributed to the study conception and design. Material preparation, data collection and analysis were performed by [Ganji Tejasree], and [L. Agilandeeswari]. The first draft of the manuscript was written by [Ganji Tejasree] and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Agilandeeswari L.

Ethics declarations

Competing interests

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tejasree, G., L, A. A novel multi-class land use/land cover classification using deep kernel attention transformer for hyperspectral images. Earth Sci Inform 17, 593–616 (2024). https://doi.org/10.1007/s12145-023-01109-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12145-023-01109-1

Keywords

Search

Navigation