Skip to main content

Advertisement

Attention mechanism fusion neural network for typhoon path prediction

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Timely and accurately predicting typhoon movement paths is essential to prevent typhoon disasters and reduce property losses. However, the existing typhoon path prediction models have weak spatiotemporal correlation feature extraction capabilities and insufficient consideration of the importance of different dimensional features, resulting in low prediction accuracy. In this paper, we propose an attention mechanism-based fusion neural network prediction model for typhoon paths to address this issue. This model first uses a Temporal Convolutional Network (TCN) with residual units (R-TCN) to extract time-dependent features from typhoon trajectory data. Then, we propose a fusion self-attention-based ResNeXt-50 model (AT-ResNeXt-50) to obtain position attention between atmospheric data image channels, thus having better spatiotemporal feature extraction capabilities. Finally, we use attention aggregation to automatically weigh and fuse the two data features, achieving high-precision typhoon path prediction based on multidimensional feature data. The experimental results show that our model has higher accuracy and is significantly superior to the several existing data-driven typhoon path prediction methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data Availability

The data sets generated and analyzed during the current study are available at: https://github.com/wangyu13142/FusionNet-work-For-Typhoon

References

  1. Yu H, Chen G, Zhou C, Wong WK, Yang M, Xu Y, Chen P, Wan R, Hu X (2021) Are we reaching the limit of tropical cyclone track predictability in the western north pacific? Bulletin American Meteorological Soc:1–46

  2. Heming JT, Prates F, Bender MA, Bowyer R, Cangialosi J, Caroff P, Coleman T, Doyle JD, Dube A, Faure G et al (2019) Review of recent progress in tropical cyclone track forecasting and expression of uncertainties. Tropical Cyclone Res Rev 8(4):181–218

    Article  Google Scholar 

  3. Liang M, Yuan X, Wang W (2023) Improving the forecasts of surface latent heat fluxes and surface air temperature in the grapes global forecast system. Atmosphere 14(8):1241

    Article  MATH  Google Scholar 

  4. Surgi N, Gopalkrishnan Q, Tuleya R, O’Connor W (2006) The hurricane wrf (hwrf): Addressing our nation’s next generation hurricane forecast problems. In: 27th Conference on hurricanes and tropical cyclone meteorology

  5. Doyle JD, Hodur RM, Chen S, Jin Y, Moskaitis JR, Wang S, Hendricks EA, Jin H, Smith TA (2014) Tropical cyclone prediction using coamps-tc. Oceanography 27(3):104–115

    Article  Google Scholar 

  6. Cangialosi JP, Franklin J (2012) National hurricane center forecast verification report. NOAA/National Hurricane Center 79

  7. Xu G, Xian D, Fournier-Viger P, Li X, Ye Y, Hu X (2022) Am-convgru: a spatio-temporal model for typhoon path prediction. Neural Comput Appl 34(8):5905–5921

    Article  Google Scholar 

  8. Qin W, Tang J, Lu C, Lao S (2022) A typhoon trajectory prediction model based on multimodal and multitask learning. Appl Soft Comput 122:108804

    Article  MATH  Google Scholar 

  9. Neumann CJ, Lawrence MB (1975) An operational experiment in the statistical-dynamical prediction of tropical cyclone motion. Mon Weather Rev 103(8):665–673

    Article  MATH  Google Scholar 

  10. Bai S, Kolter JZ, Koltun V (2018) An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv:1803.01271

  11. Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, Polosukhin I (2017) Attention is all you need. In: Proceedings of the 31st international conference on neural information processing systems, pp 6000–6010. Curran Associates Inc., Red Hook, NY, USA

  12. Li X, Wang W, Hu X, Yang J (2019) Selective kernel networks. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 510–519

  13. Weber HC (2003) Hurricane track prediction using a statistical ensemble of numerical models. Mon Weather Rev 131(5):749–770

    Article  MATH  Google Scholar 

  14. Song H-J, Huh S-H, Kim J-H, Ho C-H, Park S-K (2005) Typhoon track prediction by a support vector machine using data reduction methods. In: Computational Intelligence and Security: International Conference, CIS 2005, Xi’an, China, December 15-19, 2005, Proceedings Part I, Springer, pp 503–511. https://doi.org/10.1007/11596448_74

  15. Tamamadin M, Lee C, Kee S, Yee J (2022) Regional Typhoon Track Prediction Using Ensemble k-Nearest Neighbor Machine Learning in the GIS Environment. Remote Sens. 2022, 14, 5292. s Note: MDPI stays neutral with regard to jurisdictional claims in published … https://doi.org/10.3390/rs14215292

  16. Lam R, Sanchez-Gonzalez A, Willson M, Wirnsberger P, Fortunato M, Pritzel A, Ravuri S, Ewalds T, Alet F, Eaton-Rosen Z et al (2022) Graphcast: learning skillful medium-range global weather forecasting. arXiv:2212.12794

  17. Wang Y, Zhang W, Fu W (2011) Back propogation (bp)-neural network for tropical cyclone track forecast. In: 2011 19th International conference on geoinformatics, IEEE, pp 1–4

  18. Alemany S, Beltran J, Perez A, Ganzfried S (2019) Predicting hurricane trajectories using a recurrent neural network. In: Proceedings of the AAAI conference on artificial intelligence, vol 33, pp 468–475

  19. Zhang Y, Chandra R, Gao J (2018) Cyclone track prediction with matrix neural networks. In: 2018 International Joint Conference on Neural Networks (IJCNN), IEEE, pp 1–8

  20. Li H, Gao S, Liu G, Guo D, Grecos C, Ren P (2019) Visual prediction of typhoon clouds with hierarchical generative adversarial networks. IEEE Geosci Remote Sens Lett 17(9):1478–1482

    Article  MATH  Google Scholar 

  21. Rüttgers M, Jeon S, Lee S, You D (2022) Prediction of typhoon track and intensity using a generative adversarial network with observational and meteorological data. IEEE Access 10:48434–48446

    Article  Google Scholar 

  22. Kim S, Kim H, Lee J, Yoon S, Kahou SE, Kashinath K, Prabhat M (2019) Deep-hurricane-tracker: Tracking and forecasting extreme climate events. In: 2019 IEEE Winter Conference on Applications of Computer Vision (WACV), IEEE, pp 1761–1769

  23. Giffard-Roisin S, Yang M, Charpiat G, Kumler Bonfanti C, Kégl B, Monteleoni C (2020) Tropical cyclone track forecasting using fused deep learning from aligned reanalysis data. Front Big Data 1

  24. Sun Y, Song Y, Qiao B, Li B (2021) Distributed typhoon track prediction based on complex features and multitask learning. Complexity 2021:1–12

    Article  MATH  Google Scholar 

  25. Dong P, Lian J, Yu H, Pan J, Zhang Y, Chen G (2022) Tropical cyclone track prediction with an encoding-to-forecasting deep learning model. Weather Forecast 37(6):971–987

    Article  MATH  Google Scholar 

  26. Bai S, Kolter JZ, Koltun V (2018) An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv:1803.01271

  27. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778. https://doi.org/10.1109/CVPR.2016.90

  28. Xie S, Girshick R, Dollár P, Tu Z, He K (2017) Aggregated residual transformations for deep neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1492–1500. https://doi.org/10.1109/CVPR.2017.634

  29. Dee DP, Uppala SM, Simmons AJ, Berrisford P, Poli P, Kobayashi S, Andrae U, Balmaseda M, Balsamo G, Bauer dP et al (2011) The era-interim reanalysis: Configuration and performance of the data assimilation system. Quarterly J Royal Meteorological Soc 137(656):553–597

  30. Knapp KR, Kruk MC, Levinson DH, Diamond HJ, Neumann CJ (2010) The international best track archive for climate stewardship (ibtracs) unifying tropical cyclone data. Bull Am Meteor Soc 91(3):363–376

    Article  Google Scholar 

  31. Salimans T, Kingma DP (2016) Weight normalization: a simple reparameterization to accelerate training of deep neural networks. Advances Neural Inform Process Syst 29

  32. Loshchilov I, Hutter F (2017) Fixing weight decay regularization in adam. arXiv:1711.05101

  33. Szegedy C, Ioffe S, Vanhoucke V, Alemi A (2017) Inception-v4, inception-resnet and the impact of residual connections on learning. In: Proceedings of the AAAI conference on artificial intelligence, vol 31. arXiv:1602.07261

  34. Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7132–7141. https://doi.org/10.1109/TPAMI.2019.2913372

  35. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1–9. https://doi.org/10.1109/CVPR.2015.7298594

  36. Shi X, Chen Z, Wang H, Yeung D, Wong W, Woo W (2015) Convolutional LSTM network: a machine learning approach for precipitation nowcasting. pp 802–810

  37. Wang Y, Long M, Wang J, Gao Z, Yu PS (2017) Predrnn: Recurrent neural networks for predictive learning using spatiotemporal lstms. pp 879–888

  38. Li H, Gao S, Liu G, Guo D, Grecos C, Ren P (2019) Visual prediction of typhoon clouds with hierarchical generative adversarial networks. IEEE Geosci Remote Sens Lett 17(9):1478–1482

    Article  MATH  Google Scholar 

  39. Lu P, Xu M, Chen M, Wang Z, Zheng Z, Yin Y (2023) Multi-step prediction of typhoon tracks combining reanalysis image fusion using laplacian pyramid and discrete wavelet transform with convlstm. Axioms 12(9). https://doi.org/10.3390/axioms12090874

  40. Huang C, Bai C, Chan S, Zhang J, Wu Y (2023) Mgtcf: Multi-generator tropical cyclone forecasting with heterogeneous meteorological data. In: The Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI-23), pp 5096–5104. https://doi.org/10.1609/AAAI.V37I4.25638

  41. Yamaguchi M, Sakai R, Kyoda M, Komori T, Kadowaki T (2009) Typhoon ensemble prediction system developed at the japan meteorological agency. Mon Weather Rev 137(8):2592–2604

    Article  Google Scholar 

  42. Hwang J, Cho H-O, Lim Y, Son S-W, Kim E-J, Lim J-O, Boo K-O (2020) Extratropical prediction skill of kma gdaps in january 2019. Atmosphere 30(2):115–124

    MATH  Google Scholar 

  43. Tan Y, Zhang X, Xu X, Huang W (2022) Improvements in the grapes-tcm and the forecast performance analysis in 2019. Front Earth Sci 16(1):144–157

    Article  MATH  Google Scholar 

  44. Chen G, Li T, Yang M, Zhang X (2023) Evaluation of western north pacific typhoon track forecasts in global and regional models during the 2021 typhoon season. Atmosphere 14(3). https://doi.org/10.3390/atmos14030499

  45. Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7132–7141

  46. Li H, Yang X, Liu L, Li T (2023) An improved unet for retinal vessel segmentation using semantic fusion, attention mechanism and multi-scale features. SSRN Electronic J

  47. Tayal AR, Tayal MA (2021) Darnn: discourse analysis for natural languages using rnn and lstm. Int J of Next-Generation Comput 12(5)

  48. Yu Y, Si X, Hu C, Zhang J (2019) A review of recurrent neural networks: Lstm cells and network architectures. Neural Comput 31(7):1235–1270

    Article  MathSciNet  MATH  Google Scholar 

  49. Dey R, Salem FM (2017) Gate-variants of gated recurrent unit (gru) neural networks. In: 2017 IEEE 60th International Midwest Symposium on Circuits and Systems (MWSCAS), IEEE, pp 1597–1600

  50. Siami-Namini S, Tavakoli N, Namin AS (2019) The performance of lstm and bilstm in forecasting time series. In: 2019 IEEE International Conference on Big Data (Big Data), IEEE, pp 3285–3292

Download references

Acknowledgements

This work was supported by the National Key Technologies Research and Development Program of China (No.2016YFC1401900) and the National Natural Science Foundation of China (No. 61872072).

Author information

Authors and Affiliations

Authors

Contributions

Conceptualization: B.Q. and Y.W.; methodology: B.Q., Y.W., and G.L.; validation: Y.W., and G.L.; formal analysis: B.Q., Y.W., G.L., G.W.; data curation: D.H. and G.W.; Writing - original draft preparation: B.Q., Y.W, and G.L.; writing - review and editing: B.Q. Y.W., G.W., and D.H.; visualization: Y.W., G.L., and D.H.; All authors read and approved the manuscript.

Corresponding author

Correspondence to Baiyou Qiao.

Ethics declarations

Conflict of interest

The authors have no conflicts of interest to declare that are relevant to the content of this article.

Ethical approval

This article does not contain any studies with human participants performed by any of the authors.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Qiao, B., Wang, Y., Yao, L. et al. Attention mechanism fusion neural network for typhoon path prediction. Appl Intell 55, 244 (2025). https://doi.org/10.1007/s10489-024-06196-1

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10489-024-06196-1

Keywords