Abstract
In recent years, how to discover causality rather than correlation among climate variables and how to use causality to help in time-series tasks have received great concern. However, the high dimensionality and nonlinearity of climate variables are the main issues for causal inference based on historical large-scale climate time series. Therefore, a method based on neural Granger causality inference is proposed to study the interactions of climate variables, with focus on the variables commonly used in the energy field, especially in photovoltaics. Firstly, for each climate variable, the time-varying causality and global causality are, respectively, obtained on each time window and on the whole series by neural Granger causality inference. Secondly, the global causality is used as a feature selection map of the input variables in the prediction task. Finally, compared with some existing feature selection methods, the experiments determine that the proposed method not only reveals the appropriate causality rather than the correlation among climate variables, but also efficiently reduces the input dimensionality and improves the performance and interpretability of the predicting model.
Similar content being viewed by others
Data availability
All data generated or analyzed during this study are included in this published article (and its supplementary information files).
References
Jung J, Han S, Kim B (2019) Digital numerical map-oriented estimation of solar energy potential for site selection of photovoltaic solar panels on national highway slopes. Appl Energy 242:57–68
Gong H-F, Chen Z-S, Zhu Q-X, He Y-L (2017) A monte carlo and pso based virtual sample generation method for enhancing the energy prediction and energy optimization on small data problem: an empirical study of petrochemical industries. Appl Energy 197:405–415
Zhang Z, Qin H, Liu Y, Wang Y, Yao L, Li Q, Li J, Pei S (2019) Long short-term memory network based on neighborhood gates for processing complex causality in wind speed prediction. Energy Convers Manag 192:37–51
Zhou J, Wu Y, Wu C, Deng Z, Xu C, Hu Y (2019) A hybrid fuzzy multi-criteria decision-making approach for performance analysis and evaluation of park-level integrated energy system. Energy Convers Manag 201:112134
Sánchez-Oro J, Duarte A, Salcedo-Sanz S (2016) Robust total energy demand estimation with a hybrid variable neighborhood search-extreme learning machine algorithm. Energy Convers Manag 123:445–452
Fan J, Wang X, Wu L, Zhou H, Zhang F, Yu X, Lu X, Xiang Y (2018) Comparison of support vector machine and extreme gradient boosting for predicting daily global solar radiation using temperature and precipitation in humid subtropical climates: a case study in china. Energy Convers Manag 164:102–111
Runge J, Bathiany S, Bollt E, Camps-Valls G, Coumou D, Deyle E, Glymour C, Kretschmer M, Mahecha MD, Muñoz-Marí J et al (2019) Inferring causation from time series in earth system sciences. Nat Commun 10(1):1–13
Behar O, Khellaf A, Mohammedi K (2015) Comparison of solar radiation models and their validation under algerian climate-the case of direct irradiance. Energy Convers Manag 98:236–251
Soukissian TH, Karathanasi FE, Zaragkas DK (2021) Exploiting offshore wind and solar resources in the mediterranean using era5 reanalysis data. Energy Convers Manag 237:114092
Kinney JB, Atwal GS (2014) Equitability, mutual information, and the maximal information coefficient. Proc Nat Acad Sci 111(9):3354–3359
Verbois H, Rusydi A, Thiery A (2018) Probabilistic forecasting of day-ahead solar irradiance using quantile gradient boosting. Sol Energy 173:313–327
Hannart A, Naveau P (2018) Probabilities of causation of climate changes. J Clim 31(14):5507–5524
Gómez-Chova L, Muñoz-Marí J, Laparra V, Malo-López J, Camps-Valls G (2011) A review of kernel methods in remote sensing data analysis. Opt Remote Sens, 1171–206
Jiang H, Dong Y (2017) Forecast of hourly global horizontal irradiance based on structured kernel support vector machine: a case study of tibet area in china. Energy Convers Manag 142:307–321
Lago J, De Brabandere K, De Ridder F, De Schutter B (2018) Short-term forecasting of solar irradiance without local telemetry: A generalized model using satellite data. Sol Energy 173:566–577
Wang H, Lei Z, Zhang X, Zhou B, Peng J (2019) A review of deep learning for renewable energy forecasting. Energy Convers Manag 198:111799
Zhu T, Huang Y, Wei H (2019) Estimating climate feedbacks using a neural network. J Geophys Res Atmos 124(6):3246–3258
Angelov P, Soares E (2020) Towards explainable deep neural networks (xdnn). Neural Netw 130:185–194
Reichstein M, Camps-Valls G, Stevens B, Jung M, Denzler J, Carvalhais N et al (2019) Deep learning and process understanding for data-driven earth system science. Nature 566(7743):195–204
Chen J, Zeng G-Q, Zhou W, Du W, Lu K-D (2018) Wind speed forecasting using nonlinear-learning ensemble of deep learning time series prediction and extremal optimization. Energy Convers Manag 165:681–695
Mooij JM, Magliacane S, Claassen T (2020) Joint causal inference from multiple contexts
Hofer-Szabó G, Rédei M, Szabó LE (1999) On reichenbach’s common cause principle and reichenbach’s notion of common cause. Br J Philos Sci 50(3):377–399
Moraffah R, Karami M, Guo R, Raglin A, Liu H (2020) Causal interpretability for machine learning-problems, methods and evaluation. ACM SIGKDD Explor Newsl 22(1):18–33
Freeman JR (1983) Granger causality and the times series analysis of political relationships. Am J Political Sci, 327–358
Breitung J, Candelon B (2006) Testing for short-and long-run causality: a frequency-domain approach. J Econom 132(2):363–378
McGraw MC, Barnes EA (2018) Memory matters: a case for granger causality in climate variability studies. J Clim 31(8):3289–3300
Zhang H, Cai G, Yang D (2020) The impact of oil price shocks on clean energy stocks: fresh evidence from multi-scale perspective. Energy 196:117099
Elsner JB (2007) Granger causality and atlantic hurricanes. Tellus A Dyn Meteorol Oceanogr 59(4):476–485
Stips A, Macias D, Coughlan C, Garcia-Gorriz E, San Liang X (2016) On the causal structure between co 2 and global temperature. Sci Rep 6:21691
Tiao GC, Box GE (1981) Modeling multiple time series with applications. J Am Stat Assoc 76(376):802–816
Contreras-Reyes JE, Hernández-Santoro C (2020) Assessing granger-causality in the southern humboldt current ecosystem using cross-spectral methods. Entropy 22(10):1071
Triacca U (2005) Is granger causality analysis appropriate to investigate the relationship between atmospheric concentration of carbon dioxide and global surface air temperature? Theoret Appl Climatol 81(3):133–135
Tank A, Covert I, Foti N, Shojaie A, Fox EB (2021) Neural granger causality. IEEE Trans Pattern Anal Mach Intell
Doelling DR, Loeb NG, Keyes DF, Nordeen ML, Morstad D, Nguyen C, Wielicki BA, Young DF, Sun M (2013) Geostationary enhanced temporal interpolation for ceres flux products. J Atmos Oceanic Tech 30(6):1072–1090
Cheng BS, Lai TW (1997) An investigation of co-integration and causality between energy consumption and economic activity in Taiwan. Energy econom 19(4):435–444
Lozano AC, Abe N, Liu Y, Rosset S (2009) Grouped graphical granger modeling for gene expression regulatory networks discovery. Bioinformatics 25(12):110–118
Sindhwani V, Quang MH, Lozano AC (2012) Scalable matrix-valued kernel learning for high-dimensional nonlinear multivariate regression and granger causality. arXiv preprint arXiv:1210.4792
Verbesselt J, Umlauf N, Hirota M, Holmgren M, Van Nes EH, Herold M, Zeileis A, Scheffer M (2016) Remotely sensed resilience of tropical forests. Nat Clim Chang 6(11):1028–1031
Papagiannopoulou C, Gonzalez Miralles D, Decubber S, Demuzere M, Verhoest N, Dorigo WA, Waegeman W (2017) A non-linear granger-causality framework to investigate climate-vegetation dynamics. Geosci Model Dev 10(5):1945–1960
Van Nes EH, Scheffer M, Brovkin V, Lenton TM, Ye H, Deyle E, Sugihara G (2015) Causal feedbacks in climate change. Nat Clim Chang 5(5):445–448
Runge J (2018) Causal network reconstruction from time series: from theoretical assumptions to practical estimation. Chaos Interdiscip J Nonlinear Sci 28(7):075310
Perez-Suay A, Camps-Valls G (2018) Causal inference in geoscience and remote sensing from observational data. IEEE Trans Geosci Remote Sens 57(3):1502–1513
Nesme-Ribes E, Ferreira E, Sadourny R, Le Treut H, Li Z (1993) Solar dynamics and its impact on solar irradiance and the terrestrial climate. J Geophys Res Space Physics 98(A11):18923–18935
Masih I, Uhlenbrook S, Maskey S, Smakhtin V (2011) Streamflow trends and climate linkages in the Zagros mountains, Iran. Clim Change 104(2):317–338
Berman EE, Bolton DK, Coops NC, Mityok ZK, Stenhouse GB, Moore RD (2018) Daily estimates of landsat fractional snow cover driven by modis and dynamic time-warping. Remote Sens Environ 216:635–646
Scher S (2018) Toward data-driven weather and climate forecasting: approximating a simple general circulation model with deep learning. Geophys Res Lett 45(22):12–616
Hiemstra C, Jones JD (1994) Testing for linear and nonlinear granger causality in the stock price-volume relation. J Financ 49(5):1639–1664
Kumar DS, Yagli GM, Kashyap M, Srinivasan D (2020) Solar irradiance resource and forecasting: a comprehensive review. IET Renew Power Gener 14(10)
Yuan M, Lin Y (2006) Model selection and estimation in regression with grouped variables. J R Stat Soc Series B (Stat Methodol) 68(1):49–67
Gardner MW, Dorling S (1998) Artificial neural networks (the multilayer perceptron)-a review of applications in the atmospheric sciences. Atmos Environ 32(14–15):2627–2636
Nicholson WB, Wilms I, Bien J, Matteson DS (2020) High dimensional forecasting via interpretable vector autoregression. J Mach Learn Res 21(166):1–52
Suzuki T (2013) Dual averaging and proximal gradient descent for online alternating direction multiplier method. In: International Conference on Machine Learning, pp. 392–400. PMLR
Rappoport P, Reichlin L (1989) Segmented trends and non-stationary time series. Econ J 99(395):168–177
Cheung Y-W, Lai KS (1995) Lag order and critical values of the augmented dickey-fuller test. J Bus Econ Stat 13(3):277–280
Fox R, Taqqu MS (1986) Large-sample properties of parameter estimates for strongly dependent stationary gaussian time series. Annal Stat, 517–532
Wang Y, Zhang J, Zhu H, Long M, Wang J, Yu PS (2019) Memory in memory: apredictive neural network for learning higher-order non-stationarity from spatiotemporal dynamics. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 9154–9162
Santos L-D, Casado M, Prié F, Jossoud O, Kerstel E, Farradèche M, Kassi S, Fourré E, Landais A et al (2021) A dedicated robust instrument for water vapor generation at low humidity for use with a laser water isotope analyzer in cold and dry polar regions. Atmos Meas Tech 14(4):2907–2918
Townsend J, Chaton T, Monteiro JM (2019) Extracting relational explanations from deep neural networks: a survey from a neural-symbolic perspective. IEEE Trans Neural Netw Learn Syst 31(9):3456–3470
Acknowledgements
This work was supported by the National Key Research and Development Program of China (Grant No. 2018YFB1500800), the National Natural Science Foundation of China(Grant No. 61773118, Grant No. 61973083), Science and Technology Project of State Grid Corporation of China (Intelligent operation and maintenance technology of distributed photovoltaic system SGTJDK00DYJS2000148). Social Development Project of Science and Technology Innovation Action Plan of Shanghai (No. 20dz1207102).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no competing financial interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Shan, S., Wang, Y., Xie, X. et al. Analysis of regional climate variables by using neural Granger causality. Neural Comput & Applic 35, 16381–16402 (2023). https://doi.org/10.1007/s00521-023-08506-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-023-08506-z