Skip to main content
Log in

Prediction of electricity consumption in cement production: a time-varying delay deep belief network prediction method

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

An important energy consumption index in cement production process is electricity consumption whose accurate prediction is of great significance to optimize production. However, it is difficult to establish an accurate electricity consumption forecasting model in cement production, for some problems such as the time delay, uncertainty and nonlinearity existing in the cement manufacturing process. To address the problems, we propose an electricity consumption prediction model based on time-varying delay deep belief network (TVD-DBN). In order to eliminate the influence of time-varying delay in the cement production process prediction, time series containing the time-varying delay is integrated into the input layer. In addition, we use the restricted Boltzmann machine (RBM) to capture the features, and after the pretraining of RBM, the gradient descent algorithm is used to fine-tuning the parameters of network. Through the above methods, the forecast of electricity consumption is realized in cement manufacturing process. Experiment results show that our approach TVD-DBN has higher accuracy, stronger robustness and better generalization ability in the prediction of cement electricity consumption compared with the least squares support vector machine and the deep belief network.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Zhao H, Zhang N, Wang HJ (2014) Power consumption prediction modeling of cement manufacturing based on the improved multiple non-linear regression algorithm. Appl Mech Mater 687–691:5185–5189

    Article  Google Scholar 

  2. Zhang X, Jing S (2015) The prediction of cement energy demand based on support vector machine. In: International conference on computer, mechatronics, control and electronic engineering, pp 1162–1167

  3. Peng P, Peng JH (2011) Research on the prediction of power load based on multiple linear regression model. J Saf Sci Technol 07(9):158–161

    Google Scholar 

  4. Dudek G (2016) Pattern-based local linear regression models for short-term load forecasting. Electr Power Syst Res 130:139–147

    Article  Google Scholar 

  5. Bianco V, Manca O, Nardini S (2009) Electricity consumption forecasting in Italy using linear regression models. Energy 34(9):1413–1421

    Article  Google Scholar 

  6. Luo WK, Shi SL, Run-Qiu LI (2010) Application of grey prediction model to energy consumption forecasting. China Saf Sci J 20(4):32–37

    Google Scholar 

  7. Xie Y, Li M (2009) Research on gray prediction modeling optimized by genetic algorithm for energy consumption demand. In: International conference on industrial mechatronics and automation. IEEE, pp 289–291

  8. Wu Z, Liu M, Wang X (2013) Prediction of electric power consumption based on the improved GM(1, 1). Telkomnika Indones J Electr Eng 11(8):4669–4675

    Google Scholar 

  9. Donate JP, Li X, Sánchez GG (2013) Time series forecasting by evolving artificial neural networks with genetic algorithms, differential evolution and estimation of distribution algorithm. Neural Comput Appl 22(1):11–20

    Article  Google Scholar 

  10. Sun W, Bai Y, (2011) Short-term load forecasting based on wavelet transform and BP neural network. In: Second international conference on mechanic automation and control engineering. IEEE, pp 656–659

  11. Yang X, Guo S, Yang HT (2008) The application of the multi-scale wavelet neutral network energy consumption forecast model in the steel corporation. In: IEEE international conference on automation and logistics. IEEE, pp 886–890

  12. Sun W, He Y, Chang H (2015) Forecasting fossil fuel energy consumption for power generation using QHSA-based LSSVM model. Energies 8(2):939–959

    Article  Google Scholar 

  13. Zeng Y, Wu Y (2011) Design of short term load forecasting model based on BP neural network and fuzzy rule. In: International conference on electric information and control engineering. IEEE, pp 5828–5830

  14. Bin H, Zu YX, Zhang C (2014) A forecasting method of short-term electric power load based on BP neural network. Appl Mech Mater 538:247–250

    Article  Google Scholar 

  15. Wang X (2014) Electricity consumption prediction based on non-stationary time series GM(1, 1) model and its application in power engineering. Lect Notes Electr Eng 237(2):933–940

    Article  Google Scholar 

  16. Zhang WQ, Xu C (2011) Time series forecasting method based on HUANG transform and BP neural network. In: Seventh international conference on computational intelligence and security. IEEE Computer Society, pp 497–502

  17. Hinton GE, Salakhutdinov RR (2006) Reducing the dimensionality of data with neural networks. Science 313:504–507

    Article  MathSciNet  Google Scholar 

  18. Kuremoto T, Kimura S, Kobayashi K (2014) Time series forecasting using a deep belief network with restricted Boltzmann machines. Neurocomputing 137(15):47–56

    Article  Google Scholar 

  19. Jiang M, Liang Y, Feng X (2016) Text classification based on deep belief network and softmax regression. Neural Comput Appl 29:61–70

    Article  Google Scholar 

  20. Zhao Z, Jiao L, Zhao J (2017) Discriminant deep belief network for high-resolution SAR image classification. Pattern Recogn 61:686–701

    Article  Google Scholar 

  21. Khatami A, Khosravi A, Nguyen T (2017) Medical image analysis using wavelet transform and deep belief networks. Expert Syst Appl 86:190

    Article  Google Scholar 

  22. Diao W, Sun X, Dou F (2015) Object recognition in remote sensing images using sparse deep belief networks. Remote Sens Lett 6(10):745–754

    Article  Google Scholar 

  23. Wang Y, Yang J, Lu J (2015) Hierarchical deep belief networks based point process model for keywords spotting in continuous speech. Int J Commun Syst 28(3):483–496

    Article  Google Scholar 

  24. Mohamed AR, Dahl GE, Hinton G (2011) Acoustic modeling using deep belief networks. IEEE Trans Audio Speech Lang Process 20(1):14–22

    Article  Google Scholar 

  25. Li X, Yang Y, Pang Z (2015) A comparative study on selecting acoustic modeling units in deep neural networks based large vocabulary Chinese speech recognition. Neurocomputing 170(C):251–256

    Article  Google Scholar 

  26. Elleuch M, Tagougui N, Kherallah M (2017) Optimization of DBN using regularization methods applied for recognizing arabic handwritten script. Proc Comput Sci 108:2292–2297

    Article  Google Scholar 

  27. Zhou S, Chen Q, Wang X (2015) Deep networks for online handwriting Chinese character recognition. Icic Express Lett 9(6):1783–1789

    Google Scholar 

  28. Sukhbaatar S, Makino T, Aihara K (2011) Robust generation of dynamical patterns in human motion by a deep belief nets. J Mach Learn Res 20:231–246

    Google Scholar 

  29. Taylor GW, Hinton GE (2009) Factored conditional restricted Boltzmann machines for modeling motion style. In: Proceedings of the 26th annual international conference on machine learning, pp 1025–1032

  30. Zhang H, Li J, Ji Y (2017) Understanding subtitles by character-level sequence-to-sequence learning. IEEE Trans Ind Inf 13(2):616–624

    Article  Google Scholar 

  31. Zhang H, Cao X (2017) Object-level video advertising: an optimization framework. IEEE Trans Ind Inf 13(2):520–531

    Article  Google Scholar 

  32. Dedinec A, Filiposka S, Dedinec A (2016) Deep belief network based electricity load forecasting: an analysis of Macedonian case. Energy 115:1688–1700

    Article  Google Scholar 

  33. Hu J, Zhang L, Tian W (2017) DBN based failure prognosis method considering the response of protective layers for the complex industrial systems. Eng Fail Anal 79:504–519

    Article  Google Scholar 

  34. He J, Yang S, Gan C (2017) Unsupervised fault diagnosis of a gear transmission chain using a deep belief network. Sensors 17(7):1564

    Article  Google Scholar 

  35. Hinton GE (2012) A practical guide to training restricted Boltzmann machines. Momentum 9(1):599–619

    Google Scholar 

  36. Aljarah I, Faris H, Mirjalili S (2016) Training radial basis function networks using biogeography-based optimizer. Neural Comput Appl 29:529–553

    Article  Google Scholar 

  37. Rubio JDJ, Elias I, Cruz DR (2016) Uniform stable radial basis function neural network for the prediction in two mechatronic processes. Neurocomputing 227:122–130

    Article  Google Scholar 

  38. Liu Q, Yin J, Leung VCM (2016) Applying a new localized generalization error model to design neural networks trained with extreme learning machine. Neural Comput Appl 27(1):1–8

    Article  Google Scholar 

  39. Rubio JDJ (2016) Interpolation neural network model of a manufactured wind turbine. Neural Comput Appl 28(8):1–12

    MathSciNet  Google Scholar 

  40. Nan Z, Xia ZQ, Hong J (2010) Prediction of runoff based on the multiple quantity index of SVM. J Hydraul Eng 41(11):1318–1324

    Google Scholar 

  41. Rong L, Han H, Yanmei C (2008) Application of support vector machine combined with K-nearest neighbors in solar flare and proton events forecast. Adv Space Res 36(9):2165

    Google Scholar 

Download references

Acknowledgements

The authors would like to thank the reviewers for their constructive comments on the manuscript. This work is supported by the National Natural Science Foundation of China (Grant No. 61403336), the Natural Science Foundation of Hebei province of China (Grant Nos. F2015203342 and F2015203291) and the Independent Research Project Topics for Young Teacher of Yanshan University (Grant No. 15LGB007).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xiaochen Hao.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hao, X., Wang, Z., Shan, Z. et al. Prediction of electricity consumption in cement production: a time-varying delay deep belief network prediction method. Neural Comput & Applic 31, 7165–7179 (2019). https://doi.org/10.1007/s00521-018-3540-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-018-3540-z

Keywords