Skip to main content

Advertisement

SpringerLink
Log in

Neuro-evolutionary for time series forecasting and its application in hourly energy consumption prediction

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

This paper proposed an ensemble methodology comprising neural networks, modified differential evolution algorithm and nonlinear autoregressive network with exogenous inputs (NARX) (called neuro-evolutionary NARX or NE-NARX model) for time series forecasting. In NE-NARX, the structure is designed by connecting the neural model and NARX model, and the weight value connection is optimized by a modified differential evolution algorithm. The effectiveness of the proposed NE-NARX model is tested on two well-known benchmark datasets, including the Canadian lynx and the Wolf sunspot. The proposed model is compared to other models, including the classical backpropagation algorithm, particle swarm optimization, differential evolution (DE) and DE variants. Additionally, an ARIMA model is employed as the benchmark for evaluating the capacity of the proposed model. And then, NE-NARX model is used for hourly energy consumption prediction through comparison with other machine learning models including gated recurrent units, convolutional neural networks (CNN), long short-term memory (LSTM), a hybrid CNN-LSTM and sequence-to-sequence learning. Results show convincingly the superiority of the proposed NE-NARX model over other models.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Data availability

The dataset used in this research is included in this paper.

Abbreviations

GRU:

Gated recurrent units

CNN:

Convolutional neural network

LSTM:

Long short-term memory

Seq2Seq:

Sequence-to-sequence

NARX:

Nonlinear autoregressive network with exogenous inputs

NE:

Neuro-evolutionary

ARIMA:

Autoregressive integrated moving average

DE:

Differential evolution

PSO:

Particle swarm optimization

MSE:

Mean square error

MAPE:

Mean absolute percent error

References

  1. Guo J, He H, Sun C (2019) ARIMA-based road gradient and vehicle velocity prediction for hybrid electric vehicle energy management. IEEE Trans Veh Technol 68(6):5309–5320

    Article  Google Scholar 

  2. Singh SN, Mohapatra A (2019) Repeated wavelet transform based ARIMA model for very short-term wind speed forecasting. Renew energy 136:758–768

    Article  Google Scholar 

  3. de Oliveira EM, Oliveira FLC (2018) Forecasting mid-long term electric energy consumption through bagging ARIMA and exponential smoothing methods. Energy 144:776–788

    Article  Google Scholar 

  4. Xu Y, Li F, Asgari A (2022) Prediction and optimization of heating and cooling loads in a residential building based on multi-layer perceptron neural network and different optimization algorithms. Energy 240:122692

    Article  Google Scholar 

  5. Lei R, Yin J (2022) Prediction method of energy consumption for high building based on LMBP neural network. Energy Rep 8:1236–1248

    Article  Google Scholar 

  6. Saâdaoui F (2017) A seasonal feedforward neural network to forecast electricity prices. Neural Comput Appl 28(4):835–847

    Article  Google Scholar 

  7. Hong Y-Y, Satriani TRA (2020) Day-ahead spatiotemporal wind speed forecasting using robust design-based deep learning neural network. Energy 209:118441

    Article  Google Scholar 

  8. Huang C et al (2020) Robust forecasting of river-flow based on convolutional neural network. IEEE Trans Sustain Comput 5(4):594–600

    Article  MathSciNet  Google Scholar 

  9. Bandara K, Bergmeir C, Smyl S (2020) Forecasting across time series databases using recurrent neural networks on groups of similar series: a clustering approach. Expert Syst Appl 140:112896

    Article  Google Scholar 

  10. Hewamalage H, Bergmeir C, Bandara K (2021) Recurrent neural networks for time series forecasting: current status and future directions. Int J Forecast 37(1):388–427

    Article  Google Scholar 

  11. Chen M-R, Zeng G-Q, Lu K-D, Weng J (2019) A two-layer nonlinear combination method for short-term wind speed prediction based on ELM, ENN, and LSTM. IEEE Internet Things J 6(4):6997–7010

    Article  Google Scholar 

  12. Zhang Z, Ding S, Sun Y (2020) A support vector regression model hybridized with chaotic krill herd algorithm and empirical mode decomposition for regression task. Neurocomputing 410:185–201

    Article  Google Scholar 

  13. Feng Z, Niu W (2021) Hybrid artificial neural network and cooperation search algorithm for nonlinear river flow time series forecasting in humid and semi-humid regions. Knowl Based Syst 211:106580

    Article  Google Scholar 

  14. Talaat M, Farahat MA, Mansour N, Hatata AY (2020) Load forecasting based on grasshopper optimization and a multilayer feed-forward neural network using regressive approach. Energy 196:117087

    Article  Google Scholar 

  15. Cai W, Yang J, Yu Y, Song Y, Zhou T, Qin J (2020) PSO-ELM: A hybrid learning model for short-term traffic flow forecasting. IEEE Access 8:6505–6514

    Article  Google Scholar 

  16. Kılıç F, Yılmaz İH, Kaya Ö (2021) Adaptive co-optimization of artificial neural networks using evolutionary algorithm for global radiation forecasting. Renew Energy 171:176–190

    Article  Google Scholar 

  17. Storn R, Price K (1995) Differential evolution-a simple and efficient adaptive scheme for global optimization over continuous spaces, vol 3. ICSI Berkeley

  18. Liang J et al (2020) Parameters estimation of solar photovoltaic models via a self-adaptive ensemble-based differential evolution. Sol Energy 207:336–346

    Article  Google Scholar 

  19. Song Y et al (2021) MPPCEDE: multi-population parallel co-evolutionary differential evolution for parameter optimization. Energy Convers Manag 228:113661

    Article  Google Scholar 

  20. Wang Y, Liu H, Long H, Zhang Z, Yang S (2017) Differential evolution with a new encoding mechanism for optimizing wind farm layout. IEEE Trans Ind Inform 14(3):1040–1054

    Article  Google Scholar 

  21. Wang L, Hu H, Ai X-Y, Liu H (2018) Effective electricity energy consumption forecasting using echo state network improved by differential evolution algorithm. Energy 153:801–815

    Article  Google Scholar 

  22. Peng L, Liu S, Liu R, Wang L (2018) Effective long short-term memory with differential evolution algorithm for electricity price prediction. Energy 162:1301–1314

    Article  Google Scholar 

  23. Deng W, Liu H, Xu J, Zhao H, Song Y (2020) An improved quantum-inspired differential evolution algorithm for deep belief network. IEEE Trans Instrum Meas 6:66

    Google Scholar 

  24. Zhang Q, Shen X, Zhao J, Xiao Q, Huang J, Wang Y (2020) Hysteresis modeling of piezoelectric actuator using particle swarm optimization-based neural network. Proc Inst Mech Eng Part C J Mech Eng Sci 234(23):4695–4707

    Article  Google Scholar 

  25. Van Kien C, Anh HPH, Son NN (2021) Adaptive inverse multilayer fuzzy control for uncertain nonlinear system optimizing with differential evolution algorithm. Appl Intell 51(1):527–548

    Article  Google Scholar 

  26. Jamali A, Mallipeddi R, Salehpour M, Bagheri A (2020) Multi-objective differential evolution algorithm with fuzzy inference-based adaptive mutation factor for Pareto optimum design of suspension system. Swarm Evol Comput 54:100666

    Article  Google Scholar 

  27. Zhang Z, Ding S, Jia W (2019) A hybrid optimization algorithm based on cuckoo search and differential evolution for solving constrained engineering problems. Eng Appl Artif Intell 85:254–268

    Article  Google Scholar 

  28. Liu M, Yao X, Li Y (2020) Hybrid whale optimization algorithm enhanced with Lévy flight and differential evolution for job shop scheduling problems. Appl Soft Comput 87:105954

    Article  Google Scholar 

  29. Li S, Gu Q, Gong W, Ning B (2020) An enhanced adaptive differential evolution algorithm for parameter extraction of photovoltaic models. Energy Convers Manag 205:112443

    Article  Google Scholar 

  30. Khan ZA et al (2022) Efficient short-term electricity load forecasting for effective energy management. Sustain Energy Technol Assess 53:102337

    Google Scholar 

  31. Kim T-Y, Cho S-B (2019) Predicting residential energy consumption using CNN-LSTM neural networks. Energy 182:72–81

    Article  Google Scholar 

  32. Marino DL, Amarasinghe K, Manic M (2016) Building energy load forecasting using deep neural networks. In: IECON 2016—42nd annual conference of the IEEE industrial electronics society, pp 7046–7051

  33. Han T, Muhammad K, Hussain T, Lloret J, Baik SW (2020) An efficient deep learning framework for intelligent energy management in IoT networks. IEEE Internet Things J 8(5):3170–3179

    Article  Google Scholar 

  34. Qin AK, Huang VL, Suganthan PN (2009) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evol Comput 13(2):398–417. https://doi.org/10.1109/TEVC.2008.927706

    Article  Google Scholar 

  35. Opara K, Arabas J (2018) Comparison of mutation strategies in differential evolution—a probabilistic perspective. Swarm Evol Comput 39:53–69

    Article  Google Scholar 

  36. Wu G, Mallipeddi R, Suganthan PN, Wang R, Chen H (2016) Differential evolution with multi-population based ensemble of mutation strategies. Inf Sci 329:329–345

    Article  Google Scholar 

  37. Gämperle R, Müller SD, Koumoutsakos P (2002) A parameter study for differential evolution. Adv Intell Syst fuzzy Syst Evol Comput 10:293–298

    Google Scholar 

  38. Liu J, Lampinen J (2005) A fuzzy adaptive differential evolution algorithm. Soft Comput 9(6):448–462

    Article  MATH  Google Scholar 

  39. Brest J, Bošković B, Greiner S, Žumer V, Maučec MS (2007) Performance comparison of self-adaptive and adaptive differential evolution algorithms. Soft Comput 11(7):617–629

    Article  MATH  Google Scholar 

  40. Zhang J, Sanderson AC (2009) JADE: adaptive differential evolution with optional external archive. IEEE Trans Evol Comput 13(5):945–958

    Article  Google Scholar 

  41. Wang Y, Cai Z, Zhang Q (2011) Differential evolution with composite trial vector generation strategies and control parameters. Evol Comput IEEE Trans 15(1):55–66

    Article  Google Scholar 

  42. Piotrowski AP (2014) Differential evolution algorithms applied to neural network training suffer from stagnation. Appl Soft Comput 21:382–406

    Article  Google Scholar 

  43. Peng Y, He S, Sun K (2022) Parameter identification for discrete memristive chaotic map using adaptive differential evolution algorithm. Nonlinear Dyn 107(1):1263–1275

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Electronics Technology, Industrial University of Ho Chi Minh City, Ho Chi Minh City, Viet Nam

    Nguyen Ngoc Son

  2. IUQ, Industrial University of Ho Chi Minh City, Ho Chi Minh City, Viet Nam

    Nguyen Van Cuong

Authors
  1. Nguyen Ngoc Son
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nguyen Van Cuong
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nguyen Ngoc Son.

Ethics declarations

Conflict of interest

The authors declare no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Son, N.N., Van Cuong, N. Neuro-evolutionary for time series forecasting and its application in hourly energy consumption prediction. Neural Comput & Applic 35, 21697–21707 (2023). https://doi.org/10.1007/s00521-023-08942-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-023-08942-x

Keywords

Search

Navigation