Abstract
An important energy consumption index in cement production process is electricity consumption whose accurate prediction is of great significance to optimize production. However, it is difficult to establish an accurate electricity consumption forecasting model in cement production, for some problems such as the time delay, uncertainty and nonlinearity existing in the cement manufacturing process. To address the problems, we propose an electricity consumption prediction model based on time-varying delay deep belief network (TVD-DBN). In order to eliminate the influence of time-varying delay in the cement production process prediction, time series containing the time-varying delay is integrated into the input layer. In addition, we use the restricted Boltzmann machine (RBM) to capture the features, and after the pretraining of RBM, the gradient descent algorithm is used to fine-tuning the parameters of network. Through the above methods, the forecast of electricity consumption is realized in cement manufacturing process. Experiment results show that our approach TVD-DBN has higher accuracy, stronger robustness and better generalization ability in the prediction of cement electricity consumption compared with the least squares support vector machine and the deep belief network.










Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Zhao H, Zhang N, Wang HJ (2014) Power consumption prediction modeling of cement manufacturing based on the improved multiple non-linear regression algorithm. Appl Mech Mater 687–691:5185–5189
Zhang X, Jing S (2015) The prediction of cement energy demand based on support vector machine. In: International conference on computer, mechatronics, control and electronic engineering, pp 1162–1167
Peng P, Peng JH (2011) Research on the prediction of power load based on multiple linear regression model. J Saf Sci Technol 07(9):158–161
Dudek G (2016) Pattern-based local linear regression models for short-term load forecasting. Electr Power Syst Res 130:139–147
Bianco V, Manca O, Nardini S (2009) Electricity consumption forecasting in Italy using linear regression models. Energy 34(9):1413–1421
Luo WK, Shi SL, Run-Qiu LI (2010) Application of grey prediction model to energy consumption forecasting. China Saf Sci J 20(4):32–37
Xie Y, Li M (2009) Research on gray prediction modeling optimized by genetic algorithm for energy consumption demand. In: International conference on industrial mechatronics and automation. IEEE, pp 289–291
Wu Z, Liu M, Wang X (2013) Prediction of electric power consumption based on the improved GM(1, 1). Telkomnika Indones J Electr Eng 11(8):4669–4675
Donate JP, Li X, Sánchez GG (2013) Time series forecasting by evolving artificial neural networks with genetic algorithms, differential evolution and estimation of distribution algorithm. Neural Comput Appl 22(1):11–20
Sun W, Bai Y, (2011) Short-term load forecasting based on wavelet transform and BP neural network. In: Second international conference on mechanic automation and control engineering. IEEE, pp 656–659
Yang X, Guo S, Yang HT (2008) The application of the multi-scale wavelet neutral network energy consumption forecast model in the steel corporation. In: IEEE international conference on automation and logistics. IEEE, pp 886–890
Sun W, He Y, Chang H (2015) Forecasting fossil fuel energy consumption for power generation using QHSA-based LSSVM model. Energies 8(2):939–959
Zeng Y, Wu Y (2011) Design of short term load forecasting model based on BP neural network and fuzzy rule. In: International conference on electric information and control engineering. IEEE, pp 5828–5830
Bin H, Zu YX, Zhang C (2014) A forecasting method of short-term electric power load based on BP neural network. Appl Mech Mater 538:247–250
Wang X (2014) Electricity consumption prediction based on non-stationary time series GM(1, 1) model and its application in power engineering. Lect Notes Electr Eng 237(2):933–940
Zhang WQ, Xu C (2011) Time series forecasting method based on HUANG transform and BP neural network. In: Seventh international conference on computational intelligence and security. IEEE Computer Society, pp 497–502
Hinton GE, Salakhutdinov RR (2006) Reducing the dimensionality of data with neural networks. Science 313:504–507
Kuremoto T, Kimura S, Kobayashi K (2014) Time series forecasting using a deep belief network with restricted Boltzmann machines. Neurocomputing 137(15):47–56
Jiang M, Liang Y, Feng X (2016) Text classification based on deep belief network and softmax regression. Neural Comput Appl 29:61–70
Zhao Z, Jiao L, Zhao J (2017) Discriminant deep belief network for high-resolution SAR image classification. Pattern Recogn 61:686–701
Khatami A, Khosravi A, Nguyen T (2017) Medical image analysis using wavelet transform and deep belief networks. Expert Syst Appl 86:190
Diao W, Sun X, Dou F (2015) Object recognition in remote sensing images using sparse deep belief networks. Remote Sens Lett 6(10):745–754
Wang Y, Yang J, Lu J (2015) Hierarchical deep belief networks based point process model for keywords spotting in continuous speech. Int J Commun Syst 28(3):483–496
Mohamed AR, Dahl GE, Hinton G (2011) Acoustic modeling using deep belief networks. IEEE Trans Audio Speech Lang Process 20(1):14–22
Li X, Yang Y, Pang Z (2015) A comparative study on selecting acoustic modeling units in deep neural networks based large vocabulary Chinese speech recognition. Neurocomputing 170(C):251–256
Elleuch M, Tagougui N, Kherallah M (2017) Optimization of DBN using regularization methods applied for recognizing arabic handwritten script. Proc Comput Sci 108:2292–2297
Zhou S, Chen Q, Wang X (2015) Deep networks for online handwriting Chinese character recognition. Icic Express Lett 9(6):1783–1789
Sukhbaatar S, Makino T, Aihara K (2011) Robust generation of dynamical patterns in human motion by a deep belief nets. J Mach Learn Res 20:231–246
Taylor GW, Hinton GE (2009) Factored conditional restricted Boltzmann machines for modeling motion style. In: Proceedings of the 26th annual international conference on machine learning, pp 1025–1032
Zhang H, Li J, Ji Y (2017) Understanding subtitles by character-level sequence-to-sequence learning. IEEE Trans Ind Inf 13(2):616–624
Zhang H, Cao X (2017) Object-level video advertising: an optimization framework. IEEE Trans Ind Inf 13(2):520–531
Dedinec A, Filiposka S, Dedinec A (2016) Deep belief network based electricity load forecasting: an analysis of Macedonian case. Energy 115:1688–1700
Hu J, Zhang L, Tian W (2017) DBN based failure prognosis method considering the response of protective layers for the complex industrial systems. Eng Fail Anal 79:504–519
He J, Yang S, Gan C (2017) Unsupervised fault diagnosis of a gear transmission chain using a deep belief network. Sensors 17(7):1564
Hinton GE (2012) A practical guide to training restricted Boltzmann machines. Momentum 9(1):599–619
Aljarah I, Faris H, Mirjalili S (2016) Training radial basis function networks using biogeography-based optimizer. Neural Comput Appl 29:529–553
Rubio JDJ, Elias I, Cruz DR (2016) Uniform stable radial basis function neural network for the prediction in two mechatronic processes. Neurocomputing 227:122–130
Liu Q, Yin J, Leung VCM (2016) Applying a new localized generalization error model to design neural networks trained with extreme learning machine. Neural Comput Appl 27(1):1–8
Rubio JDJ (2016) Interpolation neural network model of a manufactured wind turbine. Neural Comput Appl 28(8):1–12
Nan Z, Xia ZQ, Hong J (2010) Prediction of runoff based on the multiple quantity index of SVM. J Hydraul Eng 41(11):1318–1324
Rong L, Han H, Yanmei C (2008) Application of support vector machine combined with K-nearest neighbors in solar flare and proton events forecast. Adv Space Res 36(9):2165
Acknowledgements
The authors would like to thank the reviewers for their constructive comments on the manuscript. This work is supported by the National Natural Science Foundation of China (Grant No. 61403336), the Natural Science Foundation of Hebei province of China (Grant Nos. F2015203342 and F2015203291) and the Independent Research Project Topics for Young Teacher of Yanshan University (Grant No. 15LGB007).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Rights and permissions
About this article
Cite this article
Hao, X., Wang, Z., Shan, Z. et al. Prediction of electricity consumption in cement production: a time-varying delay deep belief network prediction method. Neural Comput & Applic 31, 7165–7179 (2019). https://doi.org/10.1007/s00521-018-3540-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-018-3540-z