Yingluo Song
ABSTRACT
Hyperspectral images(HSIs) have rich spatial and spectral information, which provide a strong basis for distinguishing different landcover objects. The HSI classification methods based on deep learning have achieved good performance. Recently, several Neural Architecture Search (NAS) algorithms have been proposed for HSI to further improve the accuracy to a new level. In this paper, the neural structure search method based onmultiple attention mechanism search space is proposed for hyperspectral images. In the search process, the network selects attention mechanism operation at an appropriate layer, which can help the network focus on useful features and discard useless features. In our experiments, we have verified the superiority of this method on two hyperspectral datasets.
- Yordanka Karayaneva and Diana Hintea, "Object Recognition in Python and MNIST Dataset Modification and Recognition with Five Machine Learning Classifiers," Journal of Image and Graphics, Vol. 6, No. 1, pp. 10-20 June 2018. doi: 10.18178/joig.6.1.10-20Google Scholar
Cross Ref
- Edisanter Lo, "Target Detection Algorithms in Hyperspectral Imaging Based on Discriminant Analysis," Journal of Image and Graphics, Vol. 7, No. 4, pp. 140-144, December 2019. doi: 10.18178/joig.7.4.140-144Google ScholarCross Ref
- J. Peng and Q. Du, “Robust joint sparse representation based on maximum correntropy criterion for hyperspectral image classification,”IEEE Trans. Geosci. Remote Sens., vol. 55, no. 12, pp. 7152–7164,Dec. 2017.Google ScholarCross Ref
- Nguyen Minh Trieu and Nguyen Truong Thinh, "A Study of Combining KNN and ANN for Classifying Dragon Fruits Automatically," Journal of Image and Graphics, Vol. 10, No. 1, pp. 28-35, March 2022.Google ScholarCross Ref
- L. Fang, S. Li, X. Kang and J. A. Benediktsson, "Spectral–Spatial Hyperspectral Image Classification via Multiscale Adaptive Sparse Representation," in IEEE Transactions on Geoscience and Remote Sensing, vol. 52, no. 12, pp. 7738-7749, Dec. 2014, doi: 10.1109/TGRS.2014.2318058.Google ScholarCross Ref
- Y . Zhang, X. Wang, X. Jiang, and Y . Zhou, “Marginalized graph selfrepresentation for unsupervised hyperspectral band selection,” IEEE Trans. Geosci. Remote Sens., early access, Oct. 21, 2021, doi:10.1109/TGRS.2021.3121671.Google ScholarCross Ref
- J. Jiang, J. Ma, C. Chen, Z. Wang, Z. Cai, and L. Wang, “SuperPCA: A superpixelwise PCA approach for unsupervised feature extraction of hyperspectral imagery,” IEEE Trans. Geosci. Remote Sens., vol. 56,no. 8, pp. 4581–4593, Aug. 2018Google ScholarCross Ref
- J. Y ue, W. Zhao, S. Mao, and H. Liu, “Spectral–spatial classification of hyperspectral images using deep convolutional neural networks,” Remote Sensing Letters, vol. 6, no. 6, pp. 468–477, 2015.Google ScholarCross Ref
- Z. Ge, G. Cao, X. Li, and P. Fu, “Hyperspectral image classification method based on 2D–3D CNN and multibranch feature fusion,” IEEEJ. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 13, pp. 5776–5788,Google ScholarCross Ref
- A. B. Hamida, A. Benoit, P. Lambert, and C. B. Amar, “3-D deeplearning approach for remote sensing image classification,” IEEE Trans.Geosci. Remote Sens., vol. 56, no. 8, pp. 4420–4434, Aug. 2018.Google ScholarCross Ref
- H. Liu, K. Simonyan, and Y . Y ang, “DARTS: Differentiable architecture search,” in Proc. Int. Conf. Learn. Represent., 2019, pp. 1–13.Google Scholar
- Y . Chen, K. Zhu, L. Zhu, X. He, P . Ghamisi, and J. A. Benediktsson“Automatic design of convolutional neural network for hyperspectral image classification,” IEEE Transactions on Geoscience and Remote Sensing, vol. 57, no. 9, pp. 7048–7066, 2019.Google ScholarCross Ref
- H. Zhang, C. Gong, Y . Bai, Z. Bai, and Y . Li, “3d-anas: 3d asymmetric neural architecture search for fast hyperspectral image classification,” arXiv preprint arXiv:2101.04287, 2021.[Online]. Available: https://arxiv.org/abs/2101.04287Google Scholar
- Hu J, Shen L, Albanie S, Squeeze-and-Excitation Networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020, 42(8): 2011-2023.Google ScholarDigital Library
- Park J, Woo S, Lee J Y, BAM: Bottleneck Attention Module[C]. British Machine Vision Conference, Newcastle, England, 2018.Google Scholar
- Woo S, Park J, Lee J Y, CBAM: Convolutional Block Attention Module[C]. European Conference on Computer Vision, Munich, Germany, 2018.Google ScholarDigital Library
- Misra D, Nalamada T, Arasanipalai A U, Rotate to Attend: Convolutional Triplet Attention Module[C]. IEEE Winter Conference on Applications of Computer Vision, Virtual, 2021: 3138-3147.Google Scholar
- Qibin Hou, Daquan Zhou, et al. Coordinate Attention for Efficient Mobile Network Design. [J], Computer Vision and Pattern Recognition, 4 Mar 2021. [Online]. Available: [2103.02907] Coordinate Attention for Efficient Mobile Network Design (arxiv.org)Google ScholarCross Ref
- Chen Xuemin. Design of multi angle face recognition system based on SE ResNet model [J]. Journal of Guiyang University (Natural Science Edition), 2020,15 (04): 10-13. DOI: 10.16856/j.cnki.52-1142/n.2020.04.003Google ScholarCross Ref
- F. Melgani and L. Bruzzone, "Classification of hyperspectral remote sensing images with support vector machines," in IEEE Transactions on Geoscience and Remote Sensing, vol. 42, no. 8, pp. 1778-1790, Aug. 2004, doi: 10.1109/TGRS.2004.831865.Google ScholarCross Ref
- Z. Zhong, J. Li, Z. Luo and M. Chapman, "Spectral–Spatial Residual Network for Hyperspectral Image Classification: A 3-D Deep Learning Framework," in IEEE Transactions on Geoscience and Remote Sensing, vol. 56, no. 2, pp. 847-858, Feb. 2018, doi: 10.1109/TGRS.2017.2755542.Google ScholarCross Ref
- X. Liu, Y. Meng and M. Fu, "Classification Research Based on Residual Network for Hyperspectral Image," 2019 IEEE 4th International Conference on Signal and Image Processing (ICSIP), 2019, pp. 911-915.Google Scholar
- He, Xin, and Yushi Chen. 2021. "Modifications of the Multi-Layer Perceptron for Hyperspectral Image Classification" Remote Sensing 13, no. 17,pp. 3547,July.2021, https://doi.org/10.3390/rs13173547.Google ScholarCross Ref
Index Terms
- Multiple Attention-Guided Neural Architecture Search for Hyperspectral Image Classification
Recommendations
NasmamSR: a fast image super-resolution network based on neural architecture search and multiple attention mechanism
AbstractAlthough the current super-resolution model based on deep learning has achieved excellent reconstruction results, the increasing depth of the model results in huge parameters, limiting the further application of the super-resolution deep model. To ...
Hyperspectral image classification using multiobjective optimization
AbstractHyperspectral images constitute a substantial amount of data in the form of spectral bands. This information is used for land cover analysis, specifically in classifying a hyperspectral pixel, which is a popular domain in remote sensing. This ...
Spectral-wise Attention-based Residual Network for Hyperspectral Image Classification
ICMLC '21: Proceedings of the 2021 13th International Conference on Machine Learning and ComputingHyperspectral images (HSI) have abundant bands and can capture more useful information, having been widely used in military and civil applications. Traditional HSI classification algorithms failed to take full consideration of the relationship between ...
Comments