Skip to main content

A GPU Accelerated Hyperspectral 3D Convolutional Neural Network Classification at the Edge with Principal Component Analysis Preprocessing

  • Conference paper
  • First Online:
Parallel Processing and Applied Mathematics (PPAM 2022)

Abstract

The Edge Computing paradigm promises to transfer decision-making processes based on artificial intelligence algorithms to the edge of the network without the need to query servers far from the data collection point. Hyperspectral image classification is one of the application fields that can benefit most from the close relationship between Edge Computing and Artificial Intelligence. It consists of a framework of techniques and methodologies for collecting and processing images related to objects or scenes on the Earth’s surface, employing cameras or other sensors mounted on Unmanned Aerial Vehicles. However, the computing performance of the edge devices is not comparable with those of high-end servers, so specific approaches are required to consider the influence of the computing environment on the algorithm development methodology. In the present work, we propose a hybrid technique to make the Hyperspectral Image classification through Convolutional Neural Network affordable on low-power and high-performance sensor devices. We first use the Principal Component Analysis to filter insignificant wavelengths to reduce the dataset dimension; then, we use a process acceleration strategy to improve the performance by introducing a GPU-based form of parallelism.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Source code: https://github.com/gigernau/PCAHyperspectralClassifier.

References

  1. Ai, Y., Peng, M., Zhang, K.: Edge cloud computing technologies for internet of things: a primer. Digit. Commun. Netw. 4, 77–86 (2017)

    Article  Google Scholar 

  2. Andrecut, M.: Parallel GPU implementation of iterative PCA algorithms. J. Comput. Biol. 16(11), 1593–1599 (2009)

    Article  MathSciNet  Google Scholar 

  3. Armbrust, M., et al.: A view of cloud computing. Commun. ACM 53(4), 50–58 (2010)

    Article  Google Scholar 

  4. Audebert, N.: Deephyperx. https://github.com/nshaud/DeepHyperX

  5. Audebert, N., Le Saux, B., Lefèvre, S.: Deep learning for classification of hyperspectral data: a comparative review. IEEE Geosci. Remote Sens. Mag. 7(2), 159–173 (2019)

    Article  Google Scholar 

  6. Audebert, N., Le Saux, B., Lefèvre, S.: Semantic segmentation of earth observation data using multimodal and multi-scale deep networks. In: Lai, S.-H., Lepetit, V., Nishino, K., Sato, Y. (eds.) ACCV 2016. LNCS, vol. 10111, pp. 180–196. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-54181-5_12

    Chapter  Google Scholar 

  7. Ben Hamida, A., Benoit, A., Lambert, P., Ben Amar, C.: 3-D deep learning approach for remote sensing image classification. IEEE Trans. Geosci. Remote Sens. 56(8), 4420–4434 (2018)

    Article  Google Scholar 

  8. Chang, C.I.: Hyperspectral Imaging: Techniques for Spectral Detection and Classification, vol. 1. Springer, Cham (2003)

    Book  Google Scholar 

  9. Chen, Y., Jiang, H., Li, C., Jia, X., Ghamisi, P.: Deep feature extraction and classification of hyperspectral images based on convolutional neural networks. IEEE Trans. Geosci. Remote Sens. 54(10), 6232–6251 (2016)

    Article  Google Scholar 

  10. De Lucia, G., Lapegna, M., Romano, D.: Towards explainable AI for hyperspectral image classification in edge computing environments. Comput. Electr. Eng. 103, 108381 (2022)

    Article  Google Scholar 

  11. Ding, N., Wagner, D., Chen, X., Pathak, A., Hu, Y.C., Rice, A.: Characterizing and modeling the impact of wireless signal strength on smartphone battery drain. ACM SIGMETRICS Perform. Eval. Rev. 41(1), 29–40 (2013)

    Article  Google Scholar 

  12. Grahn, H., Geladi, P.: Techniques and Applications of Hyperspectral Image Analysis. John Wiley, Hoboken (2007)

    Book  Google Scholar 

  13. Greenberg, A., Hamilton, J., Maltz, D.A., Patel, P.: The cost of a cloud: research problems in data center networks. SIGCOMM Comput. Commun. Rev. 39(1), 68–73 (2009)

    Article  Google Scholar 

  14. Grupo de Inteligencia Computacional (GIC): Hyperspectral dataset. http://www.ehu.eus/ccwintco/index.php/Hyperspectral_Remote_Sensing_Scenes

  15. Ha, K., Chen, Z., Hu, W., Richter, W., Pillai, P., Satyanarayanan, M.: Towards wearable cognitive assistance. In: Proceedings of the 12th Annual International Conference on Mobile Systems, Applications, and Services, MobiSys 2014, pp. 68–81. Association for Computing Machinery, New York (2014)

    Google Scholar 

  16. He, M., Li, B., Chen, H.: Multi-scale 3D deep convolutional neural network for hyperspectral image classification. In: 2017 IEEE International Conference on Image Processing (ICIP), pp. 3904–3908 (2017)

    Google Scholar 

  17. Lapegna, M., Balzano, W., Meyer, N., Romano, D.: Clustering algorithms on low-power and high-performance devices for edge computing environments. Sensors 21(16), 5395 (2021)

    Article  Google Scholar 

  18. Lee, H., Kwon, H.: Going deeper with contextual CNN for hyperspectral image classification. IEEE Trans. Image Process. 26(10), 4843–4855 (2017)

    Article  MathSciNet  Google Scholar 

  19. Li, J., Cui, R., Li, B., Li, Y., Mei, S., Du, Q.: Dual 1d–2d spatial-spectral CNN for hyperspectral image super-resolution. In: IGARSS 2019–2019 IEEE International Geoscience and Remote Sensing Symposium, pp. 3113–3116 (2019)

    Google Scholar 

  20. Li, Y., Zhang, H., Shen, Q.: Spectral-spatial classification of hyperspectral imagery with 3D convolutional neural network. Remote Sens. 9(1), 67 (2017)

    Article  Google Scholar 

  21. Li, Y., Zhang, H., Shen, Q.: Spectral-spatial classification of hyperspectral imagery with 3D convolutional neural network. Remote Sens. 9(1) (2017)

    Google Scholar 

  22. Luo, Y., Zou, J., Yao, C., Zhao, X., Li, T., Bai, G.: HSI-CNN: a novel convolution neural network for hyperspectral image. In: 2018 International Conference on Audio, Language and Image Processing (ICALIP), pp. 464–469 (2018)

    Google Scholar 

  23. Makantasis, K., Karantzalos, K., Doulamis, A., Doulamis, N.: Deep supervised learning for hyperspectral data classification through convolutional neural networks. In: 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), pp. 4959–4962. IEEE (2015)

    Google Scholar 

  24. Marcellino, L., et al.: Using GPGPU accelerated interpolation algorithms for marine bathymetry processing with on-premises and cloud based computational resources. In: Wyrzykowski, R., Dongarra, J., Deelman, E., Karczewski, K. (eds.) PPAM 2017. LNCS, vol. 10778, pp. 14–24. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-78054-2_2

    Chapter  Google Scholar 

  25. Marmanis, D., Wegner, J.D., Galliani, S., Schindler, K., Datcu, M., Stilla, U.: Semantic segmentation of aerial images with an ensemble of CNSS. ISPRS Ann. Photogrammetry Remote Sens. Spat. Inf. Sci. 2016(3), 473–480 (2016)

    Article  Google Scholar 

  26. Montella, R., Giunta, G., Laccetti, G.: Virtualizing high-end GPGPUS on arm clusters for the next generation of high performance cloud computing. Cluster Comput. 17(1), 139–152 (2014)

    Article  Google Scholar 

  27. Raychaudhuri, D., Nagaraja, K., Venkataramani, A.: Mobilityfirst: a robust and trustworthy mobility-centric architecture for the future internet. ACM SIGMOBILE Mob. Comput. Commun. Rev. 16(3), 2–13 (2012)

    Article  Google Scholar 

  28. Rodarmel, C., Shan, J.: Principal component analysis for hyperspectral image classification. Surv. Land Inf. Syst. 62(2), 115–123 (2002)

    Google Scholar 

  29. Romano, D., Lapegna, M.: A GPU-parallel image coregistration algorithm for InSar processing at the edge. Sensors 21(17), 5916 (2021)

    Article  Google Scholar 

  30. Sabins, F.F.: Remote sensing for mineral exploration. Ore Geol. Rev. 14(3–4), 157–183 (1999)

    Article  Google Scholar 

  31. Slavkovikj, V., Verstockt, S., De Neve, W., Van Hoecke, S., Van de Walle, R.: Hyperspectral image classification with convolutional neural networks. In: Proceedings of the 23rd ACM International Conference on Multimedia, pp. 1159–1162 (2015)

    Google Scholar 

  32. Tharwat, A.: Principal component analysis-a tutorial. Int. J. Appl. Pattern Recognit. 3(3), 197–240 (2016)

    Article  Google Scholar 

  33. Volpi, M., Tuia, D.: Dense semantic labeling of subdecimeter resolution images with convolutional neural networks. IEEE Trans. Geosci. Remote Sens. 55(2), 881–893 (2016)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Gianluca De Lucia .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

De Lucia, G., Lapegna, M., Romano, D. (2023). A GPU Accelerated Hyperspectral 3D Convolutional Neural Network Classification at the Edge with Principal Component Analysis Preprocessing. In: Wyrzykowski, R., Dongarra, J., Deelman, E., Karczewski, K. (eds) Parallel Processing and Applied Mathematics. PPAM 2022. Lecture Notes in Computer Science, vol 13827. Springer, Cham. https://doi.org/10.1007/978-3-031-30445-3_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-30445-3_11

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-30444-6

  • Online ISBN: 978-3-031-30445-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics