Abstract
Deep learning methods have outclassed traditional methods in hyperspectral image classification (HIC). However, due to the limited size of input 3D cube, most HIC networks are shallow in depth, resulting in effectiveness constrained. Multi-scale convolution operation has arisen to alleviate this issue by expanding width of neural networks. Though multi-scale CNN is able to enhance the classification capacity in some extent, there are still some inherent disadvantages, such as heavy computation burden and inadequate multi-scale features extraction. To address these, this paper proposes a multi-scale dense network based on multilevel wavelet decomposition for HIC. The proposed approach characterizes multi-scale features by establishing multiple branches with 2D discrete wavelet transform rather than multi-scale convolution and pooling. Various features are joined with others from adjacent branches by level-wise short cut for supporting classification decision. Otherwise, the dense block is modified to fuse multi-frequency features and fetch underlying scale information with dense connections. The experimental results on Pavia University and University of Houston datasets demonstrate that proposed approach acquires competitive performance with the state-of-the-arts and only requires less computation and time consumptions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Liang, L., et al.: Estimation of crop LAI using hyperspectral vegetation indices and a hybrid inversion method. Remote Sens. Environ. 165, 123–134 (2015). https://doi.org/10.1016/j.rse.2015.04.032
Aslett, Z., Taranik, J.V., Riley, D.N.: Mapping rock forming minerals at Boundary Canyon, Death Valey National Park, California, using aerial SEBASS thermal infrared hyperspectral image data. Int. J. Appl. Earth Obs. Geoinf. 64, 326–339 (2018)
Agilandeeswari, L., Prabukumar, M., et al.: Crop classification for agricultural applications in hyperspectral remote sensing images. Appl. Sci. 12(3), 1670 (2022)
Cariou, C., Chehdi, K.: Unsupervised nearest neighbors clustering with application to hyperspectral Images. IEEE J. Sel. Top. Signal Process. 9(6), 1105–1116 (2015)
Melgani, F., Bruzzone, L.: Classification of hyperspectral remote sensing images with support vector machines. IEEE Trans. Geosci. Remote Sens. 42(8), 1778–1790 (2004)
Benediktsson, J.A., et al.: Classification of hyperspectral data from urban areas based on extended morphological profiles. IEEE Trans. Geosci. Remote Sens. 43(3), 480–491 (2005)
Li, J., Bioucas-Dias, J.M., Plaza, A.: Spectral-spatial hyperspectral image segmentation using subspace multinomial logistic regression and Markov random fields. IEEE Trans. Geosci. Remote Sens. 50(3), 809–823 (2012)
Zhong, Z., Li, J., Luo, Z., Chapman, M.: Spectral-spatial residual network for hyperspectral image classification: A 3-D deep learning framework. IEEE Trans. Geosci. Remote Sens. 56(2), 847–858 (2018)
Zhao, W., Du, S.: Spectral-spatial feature extraction for hyperspectral image classification: a dimension reduction and deep learning approach. IEEE Trans. Geosci. Remote Sens. 54(8), 4544–4554 (2016)
Szegedy, C., Liu, W., Jia, Y., et al.: Going deeper with convolutions. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1–9. IEEE (2015)
He, M., Li, B., Chen, H.: Multi-scale 3D deep convolutional neural network for hyperspectral image classification. In: 2017 IEEE International Conference on Image Processing (ICIP), pp. 3904–3908. IEEE (2017)
Xiao, Y., Xu, Q., Wang, D., Tang, J., Luo, B.: Multi-scale densely 3D CNN for hyperspectral image classification. In: Lin, Z., et al. (eds.) PRCV 2019. LNCS, vol. 11858, pp. 596–606. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-31723-2_51
Mallat, S.G.: A theory for multiresolution signal decomposition: the wavelet representation. IEEE Trans. Pattern Anal. Mach. Intell. 11(7), 674–693 (1989)
Lewis, A.S., Knowles, G.: Image compression using the 2-D wavelet transform. IEEE Trans. Image Process. 1(2), 244–250 (1992)
Chen, G., Qian, S.-E.: Denoising of hyperspectral imagery using principal component analysis and wavelet shrinkage. IEEE Trans. Geosci. Remote Sens. 49(3), 973–980 (2011)
Rasti, B., Sveinsson, J.R., Ulfarsson, M.O.: Wavelet-based sparse reduced-rank regression for hyperspectral image restoration. IEEE Trans. Geosci. Remote Sens. 52(10), 6688–6698 (2014)
Williams, T., Li, R.: Advanced image classification using wavelets and convolutional neural networks. In: Proceedings - 2016 15th IEEE International Conference Machine Learning Applications ICMLA 2016, pp. 233–239 (2017)
Prabhakar, T.V.N., et al.: Two-dimensional empirical wavelet transform based supervised hyperspectral image classification. ISPRS J. Photogramm. Remote Sens. 133, 37–45 (2017)
Huang, G., Liu, Z., Van Der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2261–2269. IEEE (2017)
Chollet, F.: Xception: deep learning with depthwise separable convolutions. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1800–1807. IEEE (2017)
Lin, M., Chen, Q., Yan, S.: Network in network. In: 2nd International Conference Learning Representation ICLR 2014 - Conference Track Proceedings, pp. 1–10 (2013)
Roy, S.K., Krishna, G., Dubey, S.R., Chaudhuri, B.B.: HybridSN: exploring 3-D–2-D CNN feature hierarchy for hyperspectral image classification. IEEE Geosci. Remote Sens. Lett. 17(2), 277–281 (2020)
Wang, X.: Moving window-based double haar wavelet transform for image processing. IEEE Trans. Image Process. 15(9), 2771–2779 (2006)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Yang, C., Song, D., Wang, B., Tang, Y. (2022). A Multi-scale Convolutional Neural Network Based on Multilevel Wavelet Decomposition for Hyperspectral Image Classification. In: Yu, S., et al. Pattern Recognition and Computer Vision. PRCV 2022. Lecture Notes in Computer Science, vol 13536. Springer, Cham. https://doi.org/10.1007/978-3-031-18913-5_38
Download citation
DOI: https://doi.org/10.1007/978-3-031-18913-5_38
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-18912-8
Online ISBN: 978-3-031-18913-5
eBook Packages: Computer ScienceComputer Science (R0)