Abstract
Electricity Price forecast is a major task in smart grid operation. There is a massive amount of data flowing in the power system including the data collection by control systems, sensors, etc. In addition, there are many data points which are not captured and processed by the energy market operators and electricity network operators including gross domestic product, the price of fuel, government policy and incentives for renewable and green energy sectors as well as impacts on new technologies such as battery technology advancement and electric vehicles. In this study, data points from 2001 to 2017 were collected and 78 data points are considered for analyses to select the highly-correlated features which could potentially affect the electricity price. In the first step, a comprehensive correlation method using Pearson Correlation Coefficient is applied to find the points which are correlated with the electricity price. In the next step, the correlated data is fed to the machine learning algorithm for price forecast. The algorithm results were tested in the historical data in California and the outcomes were satisfactory for the three years forecast. The combination of featured selection and machine learning is giving superior outcomes than the traditional methods.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Agrawal, R.K., Muchahary, F., Tripathi, M.M.: Long term load forecasting with hourly predictions based on long-short-term-memory networks. In: 2018 IEEE Texas Power and Energy Conference (TPEC), pp. 1–6 (2018)
Helseth, A., Haugen, M., Jaehnert, S., Mo, B., Farahmand, H., Naversen, C.: Multi-market price forecasting in hydro-thermal power systems. In: 15th International Conference on the European Energy Market (EEM), pp. 1–5 (2018)
Jiang, L. Hu, G.: Day-ahead price forecasting for electricity market using long-short term memory recurrent neural network. In: 15th International Conference on Control, Automation, Robotics and Vision (ICARCV), pp. 949–954 (2018)
Varshney, H., Sharma, A., Kumar, R.: A hybrid approach to price forecasting incorporating exogenous variables for a day ahead electricity Market. In: 2016 IEEE 1st International Conference on Power Electronics, Intelligent Control and Energy Systems (ICPEICES), pp. 1–6 (2016)
Rafiei, M., Niknam, T., Khooban, M.: Probabilistic forecasting of hourly electricity price by generalization of ELM for usage in improved wavelet neural network. IEEE Trans. Industr. Inf. 13(1), 71–79 (2017)
Kobayashi, K.: Optimal real-time pricing of electricity based on switched markov chain models and welfare maximization. In: IEEE 4th International Conference on Cyber-Physical Systems, Networks, and Applications (CPSNA), pp. 35–39 (2016)
Mosbah, H., El-hawary, M.: Hourly electricity price forecasting for the next month using multilayer neural network. Can. J. Electr. Comput. Eng. 39(4), 283–291 (2016)
Ozozen, A., Kayakutlu, G., Ketterer, M., Kayalica, O.: A combined seasonal ARIMA and ANN model for improved results in electricity spot price forecasting: Case study in Turkey. In: 2016 Portland International Conference on Management of Engineering and Technology (PICMET), pp. 2681–2690 (2016)
Zhi-Wei, Q.: Mutivariable mutual information based feature selection for electricity price forecasting. In: 2012 International Conference on Machine Learning and Cybernetics, vol. 1, pp. 168–173 (2012)
Abedinia, O., Amjady, N., Zareipour, H.: A new feature selection technique for load and price forecast of electrical power systems. IEEE Trans. Power Syst. 32(1), 62–74 (2017)
Hehui, Q., Zhiwei, Q.: Feature selection using C4.5 algorithm for electricity price prediction. In: 2014 International Conference on Machine Learning and Cybernetics, vol. 1, pp. 175–180 (2014)
Wang, K., et al.: A survey on energy internet: architecture, approach, and emerging technologies. IEEE Syst. J. 12(3), 2403–2416 (2018)
Jiang, H., Wang, K., Wang, Y., Gao, M., Zhang, Y.: Energy big data: a survey. IEEE Access 4, 3844–3861 (2016)
California Government Open Data Portal (2017). https://data.ca.gov/
Python Data Analysis Library (2017)
Brownlee, J.: Autoregression Models for Time Series Forecasting With Python – Machine Learning Mastery (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Yousefi, A., Ameri Sianaki, O., Jan, T. (2019). Big Data Analytics for Electricity Price Forecast. In: Barolli, L., Takizawa, M., Xhafa, F., Enokido, T. (eds) Web, Artificial Intelligence and Network Applications. WAINA 2019. Advances in Intelligent Systems and Computing, vol 927. Springer, Cham. https://doi.org/10.1007/978-3-030-15035-8_90
Download citation
DOI: https://doi.org/10.1007/978-3-030-15035-8_90
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-15034-1
Online ISBN: 978-3-030-15035-8
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)