Abstract
The aim of this research is to perform remote sensing scene classification, because it supports numerous strategic research fields like land use and land cover monitoring. However, classifying an enormous amount of remote sensing data is a challenging task in scene classification. In this research work, a new model is introduced to improve the feature extraction ability for better scene classification. A multiscale Retinex technique is employed for color restoration, and contrast enhancement in the aerial images that are collected from UC Merced, aerial image dataset, and RESISC45. Further, the feature extraction is carried out using steerable pyramid transform, gray level co-occurrence matrix features, and local ternary pattern. The feature extraction mechanism reduces overfitting risks, improves training process, and data visualization ability. Generally, the extracted features are high dimension, so an unsupervised feature selection based on multi subspace randomization and collaboration with state transition algorithm is proposed for selecting active features for better multiclass classification. The selected features are fed to long short term memory network for scene type classification. The experimental results showed that the proposed model achieved 99.14 %, 98.09%, and 99.25% of overall classification accuracy on UC Merced, RESISC45 and aerial image dataset. The proposed model showed a minimum of 0.03 % and maximum of 18.6 % improvement in classification accuracy compared to the existing models like self-attention based deep feature fusion, multitask learning system with convolutional neural network, multilayer feature fusion Wasserstein generative adversarial networks, and transfer learning model on UC Merced, RESISC45 and aerial dataset, respectively.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Nogueira K, Penatti OA, Dos Santos JA (2017) Towards better exploiting convolutional neural networks for remote sensing scene classification. Pattern Recognit 61:539–556. doi:https://doi.org/10.1016/j.patcog.2016.07.001
Pires de Lima R, Marfurt K (2020) Convolutional neural network for remote-sensing scene classification: Transfer learning analysis. Remote Sens 12:86. doi:https://doi.org/10.3390/rs12010086
Huang XL, Ma X, Hu F (2018) Machine learning and intelligent communications. Mobile Netw Appl 23(1):68–70
Wang S, Guan Y, Shao L (2020) Multi-granularity canonical appearance pooling for remote sensing scene classification. IEEE Trans Image Process 29:5396–5407. doi:https://doi.org/10.1109/tip.2020.2983560
Zhang J, Lu C, Wang J, Yue XG, Lim SJ, Al-Makhadmeh Z, Tolba A (2020) Training convolutional neural networks with multi-size images and triplet loss for remote sensing scene classification. Sensors 20:1188. https://doi.org/10.3390/s20041188
Xue W, Dai X, Liu L (2020) Remote sensing scene classification based on multi-structure deep features fusion. IEEE Access 8:28746–28755. doi:https://doi.org/10.1109/access.2020.2968771
Dong R, Xu D, Jiao L, Zhao J, An J (2020) A Fast Deep Perception Network for Remote Sensing Scene Classification. Remote Sens 12:729. doi:https://doi.org/10.3390/rs12040729
Zhang J, Liu J, Pan B, Shi Z (2020) Domain adaptation based on correlation subspace dynamic distribution alignment for remote sensing image scene classification. IEEE Trans Geosci Remote Sens 58:7920–7930. doi:https://doi.org/10.1109/tgrs.2020.2985072
Li L, Liang P, Ma J, Jiao L, Guo X, Liu F, Sun C (2020) A Multiscale Self-Adaptive Attention Network for Remote Sensing Scene Classification. Remote Sens 12:2209. doi:https://doi.org/10.3390/rs12142209
Zhao X, Zhang J, Tian J, Zhuo L, Zhang J (2020) Residual dense network based on channel-spatial attention for the scene classification of a high-resolution remote sensing image. Remote Sens 12:1887. doi:https://doi.org/10.3390/rs12111887
Amiri K, Farah M, Leloglu UM (2020) BoVSG: bag of visual SubGraphs for remote sensing scene classification. Int J Remote Sens 41:1986–2003. doi:https://doi.org/10.1080/01431161.2019.1681602
Yu D, Xu Q, Guo H, Zhao C, Lin Y, Li D (2020) An efficient and lightweight convolutional neural network for remote sensing image scene classification. Sensors 20: 1999
Yuan Z, Huang W, Li L, Luo X (2020) Few-Shot Scene Classification with Multi-Attention DeepEMD Network in Remote Sensing. IEEE Access. doi:https://doi.org/10.1109/ACCESS.2017
Kumar A, Abhishek K, Singh AK, Nerurkar P, Chandane M, Bhirud S, Patel D, Busnel Y (2020) Multilabel classification of remote sensed satellite imagery. Trans Emerg Telecommun Technol e3988. doi:https://doi.org/10.1002/ett.3988
Zou Q, Ni L, Zhang T, Wang Q (2015) Deep learning based feature selection for remote sensing scene classification. IEEE Geosci Remote Sens Lett 12:2321–2325. doi:https://doi.org/10.1109/lgrs.2015.2475299
Lu X, Zheng X, Yuan Y (2017) Remote sensing scene classification by unsupervised representation learning. IEEE Trans Geosci Remote Sens 55:5148–5157. doi:https://doi.org/10.1109/tgrs.2017.2702596
Chaib S, Liu H, Gu Y, Yao H (2017) Deep feature fusion for VHR remote sensing scene classification. IEEE Trans Geosci Remote Sens 55:4775–4784. doi:https://doi.org/10.1109/tgrs.2017.2700322
Tong W, Chen W, Han W, Li X, Wang L (2020) Channel-attention-based DenseNet network for remote sensing image scene classification. IEEE J Sel Top Appl Earth Obs Remote Sens 13:4121–4132. doi:https://doi.org/10.1109/jstars.2020.3009352
Cao R, Fang L, Lu T, He N (2020) Self-attention-based deep feature fusion for remote sensing scene classification. IEEE Geosci Remote Sens Lett 18:43–47. doi:https://doi.org/10.1109/lgrs.2020.2968550
Liu X, Zhou Y, Zhao J, Yao R, Liu B, Ma D, Zheng Y (2020) Multiobjective ResNet pruning by means of EMOAs for remote sensing scene classification. Neurocomputing 381:298–305. doi:https://doi.org/10.1016/j.neucom.2019.11.097
Shawky OA, Hagag A, El-Dahshan ESA, Ismail MA (2020) Remote sensing image scene classification using CNN-MLP with data augmentation. Optik 221:165356. doi:https://doi.org/10.1016/j.ijleo.2020.165356
Hung SC, Wu HC, Tseng MH (2020) Remote sensing scene classification and explanation using RSSCNet and LIME. Appl Sci 10:6151. doi:https://doi.org/10.3390/app10186151
Zhao Z, Luo Z, Li J, Chen C, Piao Y (2020) When Self-Supervised Learning Meets Scene Classification: Remote Sensing Scene Classification Based on a Multitask Learning Framework. Remote Sens 12:3276. doi:https://doi.org/10.3390/rs12203276
Wei Y, Luo X, Hu L, Peng Y, Feng J (2020) An improved unsupervised representation learning generative adversarial network for remote sensing image scene classification. Remote Sens Lett 11:598–607. https://doi.org/10.1080/2150704X.2020.1746854
Yan P, He F, Yang Y, Hu F (2020) Semi-supervised representation learning for remote sensing image classification based on generative adversarial networks. IEEE Access 8:54135–54144. doi:https://doi.org/10.1109/access.2020.2981358
Ma A, Wan Y, Zhong Y, Wang J, Zhang L (2021) SceneNet: Remote sensing scene classification deep learning network using multi-objective neural evolution architecture search. ISPRS J Photogrammet Remote Sens 172:171–188
Gao Y, Shi J, Li J, Wang R (2021) Remote sensing scene classification based on high-order graph convolutional network. European Journal of Remote Sensing 54(sup1):141–155
Bi Q, Zhang H, Qin K (2021) Multi-scale stacking attention pooling for remote sensing scene classification, 436. Neurocomputing, pp 147–161
Akodad S, Bombrun L, Xia J, Berthoumieu Y, Germain C (2020) Ensemble learning approaches based on covariance pooling of CNN features for high resolution remote sensing scene classification. Remote Sens, 12(20), p.3292
Yang Y, Newsam S (2010) Bag-of-visual-words and spatial extensions for land-use classification. SIGSPATIAL international conference on advances in geographic information systems 270–279. doi:https://doi.org/10.1145/1869790.1869829
Xia GS, Hu J, Hu F, Shi B, Bai X, Zhong Y, Zhang L, Lu X (2017) AID: A benchmark data set for performance evaluation of aerial scene classification. IEEE Trans Geosci Remote Sens 55:3965–3981. doi:https://doi.org/10.1109/tgrs.2017.2685945
Zheng X, Yuan Y, Lu X (2019) A deep scene representation for aerial scene classification. IEEE Trans Geosci Remote Sens 57:4799–4809. doi:https://doi.org/10.1109/tgrs.2019.2893115
Cheng G, Han J, Lu X (2017) Remote sensing image scene classification: Benchmark and state of the art. Proceedings of the IEEE 105:1865–1883. doi:https://doi.org/10.1109/jproc.2017.2675998
Mahmood Z, Muhammad N, Bibi N, Malik YM, Ahmed N (2018) Human visual enhancement using Multi Scale Retinex. Inf Med Unlocked 13:9–20. doi:https://doi.org/10.1016/j.imu.2018.09.001
Zotin A (2018) Fast algorithm of image enhancement based on multi-scale Retinex. Procedia Comput Sci 131:6–14
El Margae S, Kerroum MA, Fakhri Y (2017) Robust color traffic sign recognition algorithm based on steerable pyramid transform and extreme learning machine. Int J Tomograp Simulation™ 30:77–95
Mahmood MT, Ali U, Choi YK (2020) Single image defocus blur segmentation using Local Ternary Pattern. ICT Express 6:113–116
Fadl S, Megahed A, Han Q, Qiong L (2020) Frame duplication and shuffling forgery detection technique in surveillance videos based on temporal average and gray level co-occurrence matrix. Multimedia Tools Appl. 1–25. doi:https://doi.org/10.1007/s11042-019-08603-z
Sherstinsky A (2020) Fundamentals of recurrent neural network (RNN) and long short-term memory (LSTM) network. Physica D 404:132306. doi:https://doi.org/10.1016/j.physd.2019.132306
Funding
This study was not funded by any organization.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Kumar, S., Setty, S.L.N. UFS-LSTM: unsupervised feature selection with long short-term memory network for remote sensing scene classification. Evol. Intel. 16, 299–315 (2023). https://doi.org/10.1007/s12065-021-00660-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12065-021-00660-4