Abstract
Cloud detection plays a significant role in various practices, such as weather forecasting, climate studies, etc. This paper presents an integrated approach called cloud-WAVECAP for ground-based cloud detection using a combination of wavelet and capsule networks. The proposed approach utilizes the wavelet’s multiscale analysis capability to detect significant cloud features at different resolutions. Meanwhile, the inherent capability of dynamic routing by the capsule network increases the model’s ability to capture hierarchical structures and spatial relationships within the clouds. The cloud-WAVECAP model applies two-level wavelet decomposition, followed by convolutional layers and the capsule network. This architecture integrates preprocessing, wavelet layers, and capsule layers to capture both low- and high-level features for accurate cloud classification. It excels in identifying different cloud types, which is vital for meteorological analysis. Cloud-WAVECAP is assessed using several metrics and outperforms Inception V3, VGGNet, Resnet50, EfficientNet-B7, achieving 98.42% precision, 98.48% recall, and 99.12% accuracy. Additionally, the model’s efficiency, measured by Floating Point Operations (FLOPs), is competitive, resulting in 1.5426 GIGA FLOPS compared to other methods.












Similar content being viewed by others
Data availability
The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.
References
Marina Astitha and Efthimios Nikolopoulos (2023) Chapter 1 - Overview of extreme weather events, impacts and forecasting techniques. Elsevier, Extreme Weather Forecasting, pp 1–86
Gawlikowski J, Ebel P, Schmitt M, Zhu XX (2022) Explaining the effects of clouds on remote sensing scene classification. IEEE J Sel Top Appl Earth Obs Remote Sens 15:9976–9986
Ri X et al (2022) Cloud, atmospheric radiation and renewal energy application (CARE) version 1.0 cloud top property product from Himawari-8/AHI: algorithm development and preliminary validation. IEEE Trans Geosci Remote Sens 60:1–11
Zheng X et al (2018) Detecting comma-shaped clouds for severe weather forecasting using shape and motion. IEEE Trans Geosci Remote Sens 57:3788–3801. https://doi.org/10.1109/TGRS.2018.2887206
World Meteorological Organization (WMO)(2007) International Organizations. Cloud Atlas. https://cloudatlas.wmo.int/ Accessed on WorldMetDay2017
World Weather Research Programme (WWRP)(2012) Recommended Methods for Evaluating Cloud and Related Parameters. Report of World Weather Research Programme. Accessed 2012
Saketh PS, Rohit R, Suneetha B (2023) Weather Forecasting using Machine Learning. In: Proceedings of the 2023 International Conference on Inventive Computation Technologies (ICICT), Lalitpur, Nepal, pp. 13-18. https://doi.org/10.1109/ICICT57646.2023.10134218
Rehman A, Tariq S, Farrakh A, Ahmad M, Javeid MS (2023) A Systematic Review of Machine Learning and Artificial Intelligence Methods to Tackle Climate Change Impacts. In: Proceedings of the 2023 International Conference on Business Analytics for Technology and Security (ICBATS), Dubai, United Arab Emirates, pp. 1-7
de Graaff T, Ribeiro de Menezes A (2022) Capsule Networks for Hierarchical Novelty Detection in Object Classification. In: Proceedings of the 2022 IEEE Intelligent Vehicles Symposium (IV), Aachen, Germany,pp. 1795-1800
Xu K, Chen J, Ning Y, Tang W (2023) Deep Learning in Image Classification: An Overview. In: Proceedings of the 2023 4th International Conference on Computer Vision, Image and Deep Learning (CVIDL), Zhuhai, China, pp. 81-93
Jaseena KU, Kovoor Binsu C (2022) Deterministic weather forecasting models based on intelligent predictors: a survey. J King Saud Univ Comput Inform Sci 34:3393–3412
Shi M, Xie F, Zi Y, Yin J (2016) Cloud detection of remote sensing images by deep learning. In: Proceedings of the 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Beijing, China, 2016, pp. 701-704. https://doi.org/10.1109/IGARSS.2016.7729176
Zhang J, Liu P, Zhang F, Song Q (2018) CloudNet: ground-based cloud classification with deep convolutional neural network. Geophys Res Lett 45:8665–8672. https://doi.org/10.1029/2018GL077787
Jeppesen Jacob Høxbroe, Jacobsen Rune Hylsberg, Inceoglu Fadil, Toftegaard Thomas Skjødeberg (2019) A cloud detection algorithm for satellite imagery based on deep learning. Remote Sens Environ 229:247–259
Zhao M, Chang CH, Xie W, Xie Z, Hu J (2020) Cloud shape classification system based on multi-channel CNN and improved FDM. IEEE Access 8:44111–44124. https://doi.org/10.1109/ACCESS.2020.2978090
Li L, Li X, Jiang L et al (2021) A review on deep learning techniques for cloud detection methodologies and challenges. Signal. Image Video Process (SIViP) 15:1527–1535
Bai C, Zhao D, Zhang M, Zhang J (2022) Multimodal information fusion for weather systems and clouds identification from satellite images. IEEE J Sel Top Appl Earth Obs Remote Sens 15:7333–7345. https://doi.org/10.1109/JSTARS.2022.3202246
Mürüvvet Kalkan, Erkan Bostancı Gazi, Serdar Güzel Mehmet, Buğrahan Kalkan, Soysal Şifa Özsarı Ömürhan, Köse Güven (2022) Cloudy/clear weather classification using deep learning techniques with cloud images. Comput Electr Eng 102:108271. https://doi.org/10.1016/j.compeleceng.2022.108271
Liu C, Yang S, Di D et al (2022) A machine learning-based cloud detection algorithm for the Himawari-8 spectral image. Adv Atmospheric Sci 39:1994–2007. https://doi.org/10.1007/s00376-021-0366-x
Zhu W, Chen T, Hou B, Bian C, Yu A, Chen L, Tang M, Zhu Y (2022) Classification of ground-based cloud images by improved combined convolutional network. Appl Sci 12:1570
Zhu Xizhi (2009) The Application of Wavelet Transform in Digital Image Processing. In: Proceedings of the 2008 International Conference on MultiMedia and Information Technology, Three Gorges, China, 2009, pp. 326-329. https://doi.org/10.1109/MMIT.2008.134
Alzubaidi L, Zhang J, Humaidi AJ et al (2021) Review of deep learning: concepts, CNN architectures, challenges, applications, future directions. J Big Data 8:53. https://doi.org/10.1186/s40537-021-00444-8
Aggarwal S, Sahoo AK, Bansal C, Sarangi PK (2023) Image Classification using Deep Learning: A Comparative Study of VGG-16, Inception V3 and EfficientNet B7 Models. In: Proceedings of the 2023 3rd International Conference on Advance Computing and Innovative Technologies in Engineering (ICACITE), Greater Noida, India, pp. 1728-1732. https://doi.org/10.1109/ICACITE57410.2023.10183255.
Kwabena Patrick M, Felix Adekoya A, Abra Mighty A, Edward BY (2022) Capsule networks - a survey. J King Saud Univ Comput Inform Sci 34(1):1295–1310
Pawan SJ, Rajan Jeny (2022) Capsule networks for image classification: a review. Neurocomputing 509:102–120
Segal-Rozenhaimer M, Li A, Das K, Chirayath V (2020) Cloud detection algorithm for multi-modal satellite imagery using convolutional neural networks (CNN). Remote Sens Environ 237:111446
Padilla R, Netto SL, da Silva EAB (2020) A Survey on Performance Metrics for Object-Detection Algorithms. In: Proceedings of the 2020 International Conference on Systems, Signals and Image Processing (IWSSIP), Niteroi, Brazil, pp. 237-242. https://doi.org/10.1109/IWSSIP48289.2020.9145130.
Liu S, Duan L, Zhang Z, Cao X, Durrani TS (2022) Ground-based remote sensing cloud classification via context graph attention network. IEEE Trans Geosci Remote Sens 60:5602711
Bradley AP (1997) The use of the area under the ROC curve in the evaluation of machine learning algorithms. Pattern Recognit 30(7):1145–1159
Nababan AA, Zarlis Sutarman M, Nababan EB (2022) Air Quality Prediction Based on Air Pollution Emissions in the City Environment Using XGBoost with SMOTE. In: Proceedings of the 2022 IEEE International Conference of Computer Science and Information Technology (ICOSNIKOM), Laguboti, North Sumatra, Indonesia, pp. 1-6
Li J, Wu Z, Sheng Q, Wang B, Hu Z, Zheng S, Camps-Valls G, Molinier M (2022) A hybrid generative adversarial network for weakly-supervised cloud detection in multispectral images. Remote Sens Environ 280:113197
Wang J, Wang Y, Wang W, Shi L, Si H (2022) Transfer-learning-based cloud detection for Zhuhai-1 satellite hyperspectral imagery. Front Environ Sci 10:1039249. https://doi.org/10.3389/fenvs.2022.1039249
Mateo-García G, Laparra V, López-Puigdollers D, Gómez-Chova L (2020) Transferring deep learning models for cloud detection between Landsat-8 and Proba-V. ISPRS J Photogramm Remote Sens 160:1–17
Wang M, Yang P, Zhang Y (2023) Capsule networks embedded with prior known support information for image reconstruction. High Confid Comput 3(4):100125
Shang Z, Feng Z, Li W et al (2024) Capsule network based on double-layer attention mechanism and multi-scale feature extraction for remaining life prediction. Neural Process Lett 56:195
Li X, Qiu B, Cao G, Wu C, Zhang L (2022) A novel method for ground-based cloud image classification using transformer. Remote Sens 14(16):3978. https://doi.org/10.3390/rs14163978
Gyasi EK, Swarnalatha P (2023) Cloud-MobiNet: an abridged Mobile-Net convolutional neural network model for ground-based cloud classification. Atmosphere 14(2):28
Guzel M, Kalkan M, Bostanci E, Acici K, Asuroglu T (2024) Cloud type classification using deep learning with cloud images. PeerJ Comput Sci 10:e1779. https://doi.org/10.7717/peerj-cs.1779
Cong P, Yang C (2023) Number of FLOPs of Training DNNs for Learning Precoding. In: 2023 IEEE 97th Vehicular Technology Conference (VTC2023-Spring), Florence, Italy, pp. 1-6. https://doi.org/10.1109/VTC2023-Spring57618.2023.10200945
Eko Prasetyo, Nanik Suciati, Chastine Fatichah (2022) Multi-level residual network VGGNet for fish species classification. J King Saud Univ Comput Inform Sci 34:5286–5295
Author information
Authors and Affiliations
Contributions
Sanjukta Mishra helped in conceptualization, methodology, formal analysis, writing—original draft, investigation. Samarjit Kar was involved in resources, formal analysis, project administration, supervision, writing—review & editing. Parag Kumar Guhathakurta helped in software, validation, supervision, data curation, writing—review & editing
Corresponding author
Ethics declarations
Ethical approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Informed consent
Informed consent was obtained from all participants included in the study.
Conflict of interest
All authors of this research paper declare that they have no Conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Mishra, S., Kar, S. & Guhathakurta, P.K. Cloud-WAVECAP: Ground-based cloud types detection with an efficient wavelet-capsule approach. J Supercomput 81, 424 (2025). https://doi.org/10.1007/s11227-025-06941-4
Accepted:
Published:
DOI: https://doi.org/10.1007/s11227-025-06941-4