Skip to main content
Log in

Enhanced neighborhood node graph neural networks for load forecasting in smart grid

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

Deep learning technology creates the condition for the optimization of the smart grid, and the big data analytical technique has the most efficient way to analyze and share the power load spatio-temporal data in the smart grid. Utilizing the graph-based method to learn the structure of load date distribution and load prediction has become hot-spot research. This paper proposes EnGAT-BiLSTM, an enhanced graph neural networks framework to realize short-term load prediction. The EnGAT-BiLSTM model aims to improve the prediction accuracy of the load and solve the sampled data sparsity in the short-term prediction. In this model, the Box-Cox transformation technology is used to denoise and obtain the effective load sampled data set; a dynamic load knowledge graph (DLKG) is designed to map the internal attribute of the various electrical load and the correlation of the external influencing factors; the graphic attention mechanism is introduced in the local network structure of graph neural network (GNN) to extract the high-quality load spatio-temporal features; the deep bi-directional long short-term memory (BiLSTM) framework is used for the lifelong learning of the load prediction. The extensive load-sampled datasets in the real world are employed to evaluate our method. The experimental results indicate that EnGAT-BiLSTM improves significantly in load prediction accuracy and has good robustness. The model will provide a valuable theoretical basis and guidance for the smart grid IoT system.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Tang FX, Fadlullah ZM, Mao BM, Kato N (2019) An Intelligent Traffic Load Prediction-Based Adaptive Channel Assignment Algorithm in SDN-IoT: A Deep Learning Approach. IEEE Internet Things J 5(6):5141–5154. https://doi.org/10.1109/JIOT.2018.2838574

    Article  Google Scholar 

  2. Rabie AH, Saleh AI, Ali HA (2021) Smart electrical grids based on cloud. IoT, and big data technologies: state of the art, ournal of ambient intelligence and humanized computing. 12(10):9449–9480. https://doi.org/10.1007/s12652-020-02685-6

    Article  Google Scholar 

  3. Maity I, Misra S, Mandal C (2021) CORE: Prediction-Based Control Plane Load Reduction in Software-Defined IoT Networks. IEEE Trans Commun 69(3):1835–1844. https://doi.org/10.1109/TCOMM.2020.3043760

    Article  Google Scholar 

  4. Bedi G, Venayagamoorthy GK, Singh R (2020) Development of an IoT-Driven Building Environment for Prediction of Electric Energy Consumption. IEEE Internet Things J 7(6):4912–4921. https://doi.org/10.1109/JIOT.2020.2975847

    Article  Google Scholar 

  5. Randall L, Agrawal P, Mohapatra A (2022) IoT Based Load Forecasting for Reliable Integration of Renewable Energy Sources. JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY. https://doi.org/10.1007/s11265-022-01785-0

    Article  Google Scholar 

  6. Bui V, Le NT, Nguyen VH, Kim J, Jang YM (2022) Multi-Behavior with Bottleneck Features LSTM for Load Forecasting in Building Energy Management System. Electronics 10(9):209–236. https://doi.org/10.3390/electronics10091026

    Article  Google Scholar 

  7. Zhang CG, Chen ZC, Wu LJ, Cheng, SY, Lin PJ (2019) A NB-IoT based intelligent combiner box for PV arrays integrated with short-term power prediction using extreme learning machine and similar days, IOP Conference Series-Earth and Environmental Science. Paper presented at 4th International Conference on Energy Engineering and Environmental Protection (EEEP), 2021, Xiamen, PEOPLES R CHINA. 467. (2019). https://doi.org/10.1088/1755-1315/467/1/012081

  8. Zhang XY, Cordoba-Pachon JR, Guo PQ, Watkins C, Kuenzel S (2022) Privacy-Preserving Federated Learning for Value-Added Service Model in Advanced Metering Infrastructure. IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS. https://doi.org/10.1109/TCSS.2022.3204361

    Article  Google Scholar 

  9. Liang F, Yu, A, Hatcher WG, Yu W, Lu C (2019) Deep Learning-Based Power Usage Forecast Modeling and Evaluation, Procedia Computer Science. Paper presented at 9th International Conference of Information and Communication Technology [ICICT], Nanning, PEOPLES R CHINA. https://doi.org/10.1016/j.procs.2019.06.016

  10. Xiao LY, Shao W, Yu MX, Ma J, Jin CJ (2017) Research and application of a hybrid wavelet neural network model with the improved cuckoo search algorithm for electrical power system forecasting. Appl Energy 198(9):203–222. https://doi.org/10.1016/j.apenergy.2017.04.039

    Article  Google Scholar 

  11. Chandrarathna Kasun, Edalati Arman, Tabar Ahmad Reza Fourozan (2020) Forecasting Short-term load using Econometrics time series model with T-student Distribution. Preprint at https://arxiv.org/Statistical Finance

  12. Ozturk Ali, Tosun Salih, Celik Hasan (2016) Forecasting Short-term load using Econometrics time series model with T-student Distribution. International Symposium Innovative Technologies Engineering and Science

  13. Wu F, Cattani C, Song W, Zio E (2020) Fractional ARIMA with an improved cuckoo search optimization for the efficient Short-term power load forecasting. Academie PressAEJ - Alexandria Engineering Journal. 59(5). https://doi.org/10.1016/j.aej.2020.06.049

  14. Wang Huiping, Wang Yi (2022) Forecasting solar energy consumption using a fractional discrete grey model with time power term. Clean Technologies and Environmental Policy. Preprint at https://doi.org/10.1007/s10098-022-02320-2

  15. Zhu Fuyun, Wu Guoqing (2021) Load Forecasting of the Power System: An Investigation Based on the Method of Random Forest Regression. Energy Engineering. Preprint at https://doi.org/10.32604/EE.2021.015602

  16. Aasim Singh SN, Mohapatra A (2021) Data driven day-ahead electrical load forecasting through repeated wavelet transform assisted SVM model. Applied Soft Computing. 111(16):107730. https://doi.org/10.1016/j.asoc.2021.107730

  17. Lv Da, Xue Jianjie, Zhang Yan, Tang Mengcong, Chen Qian (2020) Research on Power User Intelligent Load Forecasting Method Based on Data State Drive. Journal of Physics Conference Series. 1449:012073. https://doi.org/10.1088/1742-6596/1449/1/012073

  18. Ma H, Tang JM (2020) Short-Term Load Forecasting of Microgrid Based on Chaotic Particle Swarm Optimization. Procedia Computer Science. 166:546–550. https://doi.org/10.1016/j.procs.2020.02.026

    Article  Google Scholar 

  19. Fan GF, Yu M, Dong SQ, Yeh YH, Hong WC (2021) Forecasting short-term electricity load using hybrid support vector regression with grey catastrophe and random forest modeling. Utilities Policy. 73(2):173–196. https://doi.org/10.1016/j.jup.2021.101294

    Article  Google Scholar 

  20. Hafeez G, Khan I, Usman M, Aurangzeb K, Ullah A (2020) Fast and Accurate Hybrid Electric Load Forecasting with Novel Feature Engineering and Optimization Framework in Smart Grid. Paper presented at the 6th Conference on Data Science and Machine Learning Applications (CDMA), Riyadh, Saudi Arabia. https://doi.org/10.1016/j.jup.2021.101294

  21. Carcangiu S, Fanni A, Pegoraro PA, Sias G, Sulis S (2020) Forecasting-Aided Monitoring for the Distribution System State Estimation. Complexity 2020(4281219):4281219. https://doi.org/10.1155/2020/4281219

    Article  Google Scholar 

  22. Peng H, Li J, Song Y, Yang R, He L (2021) Streaming Social Event Detection and Evolution Discovery in Heterogeneous Information Networks, ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA. 15. https://doi.org/10.1145/3447585

  23. Peng Hao, Li Jianxin, Gong Qiran, Ning Yuanxin, He Lifang (2020) Motif-Matching Based Subgraph-Level Attentional Convolutional Network for Graph Classification. Paper presented at 34th AAAI Conference on Artificial Intelligence / 32nd Innovative Applications of Artificial Intelligence Conference / 10th AAAI Symposium on Educational Advances in Artificial Intelligence, New York, NY. 34:5387-5394

  24. Silva Mad, Abreu T, CR Santos-Júnior, Minussi CR (2021) Load forecasting for smart grid based on continuous-learning neural network. Electric Power Systems Research. 201(4281219):107545-107545. https://doi.org/10.1016/j.epsr.2021.107545

  25. Soares LD, Franco, Emc (2021) BiGRU-CNN neural network applied to short-term electric load forecasting. Electric Power Systems Research. 32. https://doi.org/10.1590/0103-6513.20210087

  26. Miao Kai, Hua Qiang, Shi Huifeng (2021) Short-Term Load Forecasting Based on CNN-BiLSTM with Bayesian Optimization and Attention Mechanism. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE 32. https://doi.org/10.1002/cpe.6676

  27. Zhao H, Yao Q, Weiwei TU (2021) Search to aggregate neighborhood for graph neural network, IEEE International Conference on Data Engineering. Paper presented at 2021 IEEE 37TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2021), ELECTR NETWORKc. https://doi.org/10.1109/ICDE51399.2021.00054

  28. Dudek G, Peka P, Smyl S (2020) A Hybrid Residual Dilated LSTM end Exponential Smoothing Model for Mid-Term Electric Load Forecasting. Preprint at https://arxiv.org/2004.00508

  29. Xiao Y, Zheng KH, Zheng ZJ, Qian B, Li S, Ma QL (2021) Multi-scale skip deep long short-term memory network for short-term multivariate load forecasting. Journal of Computer Applications. 41(1):231–236

    Google Scholar 

  30. Fu L (2020) Time Series-oriented Load Prediction Using Deep Peephole LSTM. Paper presented at 12th International Conference on Advanced Computational Intelligence (ICACI), Dali, PEOPLES R CHINA

  31. Xu XZ, Meng ZR (2020) A hybrid transfer learning model for short-term electric load forecasting. Electr Eng 10(3):1371–1381. https://doi.org/10.1007/s00202-020-00930-x

    Article  Google Scholar 

  32. Lu YK, Tian Z, Zhou RY, Liu WJ (2020) Multi-step-ahead prediction of thermal load in regional energy system using deep learning method. ENERGY AND BUILDINGS. 233:110658. https://doi.org/10.1016/j.enbuild.2020.110658

    Article  Google Scholar 

  33. Wang B, Zhang LM, Ma HR, Wang HX, Wan SH (2019) Parallel LSTM-Based Regional Integrated Energy System Multienergy Source-Load Information Interactive Energy Prediction. Complexity 2019:7414318. https://doi.org/10.1155/2019/7414318

    Article  Google Scholar 

  34. Wang B, Zhang LM, Ma HR, Wang HX, Wan SH (2020) Smart load prediction analysis for distributed power network of Holiday Cabins in Norwegian rural area. J Clean Prod 266:121423. https://doi.org/10.1016/j.jclepro.2020.121423

    Article  Google Scholar 

  35. Wang B, Zhang LM, Ma HR, Wang HX, Wan SH (2020) Edge sensing data-imaging conversion scheme of load forecasting in smart grid. SUSTAINABLE CITIES AND SOCIETY. 62:102363. https://doi.org/10.1016/j.scs.2020.102363

    Article  Google Scholar 

  36. Yong Zhao, Jiangxuehui Zhao (2020) Residual resistance prediction of sailing yacht based on random forest model, Journal of Huazhong University of Science and Technology. Nature Science. 10(1):6332. https://doi.org/10.1038/s41598-020-63331-x

    Article  Google Scholar 

  37. Fang L, Zhou ZY, Hong YP (2021) Symmetry Analysis of the Uncertain Alternative Box-Cox Regression Model. SYMMETRY-BASEL. 49(11):118–122

    Google Scholar 

  38. Zhao Z, Zhao YG, Li PP (2022) Efficient approach for dynamic reliability analysis based on uniform design method and Box-Cox transformation. MECHANICAL SYSTEMS AND SIGNAL PROCESSING. 172:108967. https://doi.org/10.1016/j.ymssp.2022.108967

    Article  Google Scholar 

  39. Zhu KD, Geng J, Wang K (2021) A hybrid prediction model based on pattern sequence-based matching method and extreme gradient boosting for holiday load forecasting. ELECTRIC POWER SYSTEMS RESEARCH. 190(106841). https://doi.org/10.1016/j.epsr.2020.106841

  40. Ge L, Li Y, Yan J, Wang Y, Zhang N (2021) Short-term Load Prediction of Integrated Energy System with Wavelet Neural Network Model Based on Improved Particle Swarm Optimization and Chaos Optimization Algorithm. JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY. 9(6):1490-1499. https://doi.org/10.35833/MPCE.2020.000647

  41. Chen Jinpeng, Hu Zhijian, Chen Weinan, Gao Mingxin, Du Yixing, Lin Mingrong (2021) Load Prediction of Integrated Energy System Based on Combination of Quadratic Modal Decomposition and Deep Bidirectional Long Short-term Memory and Multiple Linear Regression. Automation of Electric Power Systems. 45(1000-1026):85-94. https://doi.org/10.35833/MPCE.2020.000647

  42. Guo Wei, Zhang Kai, Wei Xinjie, Liu Mei (2021) Short-Term Load Forecasting Method Based on Deep Reinforcement Learning for Smart Grid. Hindawi Limited. 2021(8453896). https://doi.org/10.1155/2021/8453896

  43. Peng Hao, Zhang Ruitong, Li Shaoning, Cao Yuwei, Pan Shirui, Yu Philip (2022) Reinforced, Incremental and Cross-lingual Event Detection From Social Messages. IEEE transactions on pattern analysis and machine intelligence. PP. (2022). https://doi.org/10.1109/TPAMI.2022.3144993

  44. Liu Chao, Li Xinchuan, Zhao Dongyang, Guo Shaolong, Yao Hong (2020) A-GNN: Anchors-Aware Graph Neural Networks for Node Embedding, Lecture Notes of the Institute for Computer Sciences Social Informatics and Telecommunications Engineering. Paper presented at 15th EAI International Conference on Heterogeneous Networking for Quality, Reliability, Security and Robustness (QShine), Shenzhen, PEOPLES R CHINA. 300:141-153. https://doi.org/10.1007/978-3-030-38819-5_9

  45. Dai Jianhua, Chen Yuanmeng, Xiao Lin, Jia Lei, He Yongjun (2022) Design and Analysis of a Hybrid GNN-ZNN Model with a Fuzzy Adaptive Factor for Matrix Inversion. IEEE Trans Industr Inf 2434–2442(4):2434–2442. https://doi.org/10.1109/TII.2021.3093115

    Article  Google Scholar 

  46. Zhao Xusheng, Dai Qiong, Wu Jia, Peng Hao, Liu Mingsheng, Bai Xu, Tan Jianlong, Wang Senzhang, Yu Philip (2022) TinyGNN: Multi-view Tensor Graph Neural Networks Through Reinforced Aggregation, IEEE Transactions on Knowledge and Data Engineering

  47. Zhang Z, Leng J, Ma L, Miao Y, Guo M (2020) Architectural Implications of Graph Neural Networks. IEEE Comput Archit Lett 19(1):59–62. https://doi.org/10.1109/LCA.2020.2988991

    Article  Google Scholar 

  48. Peng H, Yang R, Wang Z, Li J, He L, Yu P, Zomaya A, Ranjan R (2022) LIME: Low-Cost Incremental Learning for Dynamic Heterogeneous Information Networks. IEEE Trans Comput 71(3):628–642. https://doi.org/10.1109/TC.2021.3057082

    Article  Google Scholar 

  49. Bai Youhui, Li Cheng, Lin Zhiqi, Wu Yufei, Xu Yinlong (2020) Efficient Data Loader for Fast Sampling-based GNN Training on Large Graphs. IEEE Trans Parallel Distrib Syst 32(10):2541–2556. https://doi.org/10.1109/TPDS.2021.3065737

    Article  Google Scholar 

  50. Guirado R, Jain A, Abadal S, Alarcón E (2019) Characterizing the Communication Requirements of GNN Accelerators: A Model-Based Approach, IEEE International Symposium on Circuits and Systems. Paper presented at2021 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), Daegu, SOUTH KOREA. https://doi.org/10.1109/ISCAS51556.2021.9401612

  51. Yin JB, Wang YY, Chen KY (2021) A Novel Graph Based Sequence Forecasting Model for Electric Load of Campus. Paper presented at 2nd International Conference on Artificial Intelligence and Information Systems (ICAIIS ), Chongqing, PEOPLES R CHINA, 28-30 MAY. https://doi.org/10.1155/2021/8453896

  52. Liao W, Bak-Jensen B, Pillai JR, Wang Y, Wang Y (2022) A Review of Graph Neural Networks and Their Applications in Power Systems. JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY. 10:345-360. https://doi.org/10.35833/MPCE.2021.000058

  53. Li HJ (2022) Short-Term Wind Power Prediction via Spatial Temporal Analysis and Deep Residual Networks. FRONTIERS IN ENERGY RESEARCH. 10(920407). https://doi.org/10.3389/fenrg.2022.920407

  54. Peng H, Du B, Liu M, Liu M, He L (2021) Dynamic Graph Convolutional Network for Long-Term Traffic Flow Prediction with Reinforcement Learning. Inf Sci 578:401–416. https://doi.org/10.1016/j.ins.2021.07.007

    Article  MathSciNet  Google Scholar 

  55. Peng H, Zhang R, Dou Y, Yang R, Yu PS (2022) Reinforced Neighborhood Selection Guided Multi-Relational Graph Neural Networks. ACM TRANSACTIONS ON INFORMATION SYSTEMS. 40(4):69. https://doi.org/10.1016/10.1145/3490181

    Article  Google Scholar 

  56. Zhao X, Wu J, Peng H, Beheshti A, Monaghan J, Mcalpine D, Hernandez-Perez H, Dras M, Dai Q, Li Y (2022) Deep Reinforcement Learning Guided Graph Neural Networks for Brain Network Analysis. Neural networks : the official journal of the International Neural Network Society. 154:56–67. https://doi.org/10.1016/j.neunet.2022.06.035

    Article  Google Scholar 

  57. Zhang Y, Xiong R, He H, Pecht M (2018) Lithium-ion battery remaining useful life prediction with Box-Cox transformation and Monte Carlo simulation. IEEE Trans Industr Electron 66:1585–1597. https://doi.org/10.1109/TIE.2018.2808918

    Article  Google Scholar 

  58. Johannesen NJ, Kolhe ML, Goodwin M (2020) Smart load prediction analysis for distributed power network of Holiday Cabins in Norwegian rural area-ScienceDirect. Journal of Cleaner Production. 266(121423). https://doi.org/10.1016/j.jclepro.2020.121423

  59. Jiang YM, Liu MS, Peng H, Bhuiyan MZA (2021) A reliable deep learning-based algorithm design for IoT load identification in smart grid. Ad Hoc Networks. 123:102643. https://doi.org/10.1016/j.adhoc.2021.102643

  60. Wang HX, Li YF, Li YF, Dang LM, Ko J, Han D, Moon H (2020) Smartphone-based bulky waste classification using convolutional neural networks, MULTIMEDIA TOOLS AND APPLICATIONS. 79(39-40):29411-29431. https://doi.org/29411-29431

  61. Unlu R, Kiris R (2020) Detection of damaged buildings after an earthquake with convolutional neural networks in conjunction with image segmentation. VISUAL COMPUTER. 38(2):685–694. https://doi.org/10.1007/s00371-020-02043-9

    Article  Google Scholar 

  62. Unlu R, Kiris R (2020) Neural Network Compression and Acceleration by Federated Pruning. Lecture Notes Artificial Intelligence 12453:173–183. https://doi.org/10.1007/978-3-030-60239-0_12

    Article  Google Scholar 

  63. Shan Lin, Hong Wang, Linhai Qi, Hanyu Feng, Su Ying (2021) Short-term Load Forecasting Based on Conditional Generative Adversarial Network. Automation of Electric Power Systems. 45(1000–1026):52–60

  64. Han Kai, Wang Yunhe, Guo Jianyun, Tang Yehui, Wu Enhua (2022) Vision GNN: An Image is Worth Graph of Nodes. arXiv preprint arXiv:2206.00272

  65. Zhang Ruitong, Peng Hao, Dou Yingtong, Wu Jia, Sun Qingyun, Zhang Jingyi, Yu Philip S (2022) Automating DBSCAN via Deep Reinforcement Learning. In Proceedings of The 31th ACM International Conference on Information and Knowledge Management, CIKM 2022, Atlanta, Georgia, USA, 17-22 Oct

  66. Peng Hao, Li Jianxin, Wang Zheng, Yang Renyu, Liu Mingsheng, Zhang Mingming, Yu Philip, He Lifang (2021) Lifelong Property Price Prediction: A Case Study for the Toronto Real Estate Market. IEEE Transactions on Knowledge and Data Engineering

  67. Hai W, Wang, Y.: Load Forecast of Gas Region Based on ARIMA Algorithm, Chinese Control and Decision Conference. 1960–1965. (2020) Paper presented at 32nd Chinese Control And Decision Conference (CCDC). PEOPLES R CHINA, Hefei, p 2020

  68. Dai XQ, Sheng KC, Shu FZ (2022) Ship power load forecasting based on PSO-SVM. MATHEMATICAL BIOSCIENCES AND ENGINEERING. 19:4547–4567. https://doi.org/10.3934/mbe.2022210

    Article  MathSciNet  Google Scholar 

  69. Yong Xiao, Kaihong Zheng, Zhenjing Zheng, Bin Qian, Sen Li, Qianli Ma (2021) Multi-scale skip deep long short-term memory network for short-term multivariate load forecasting. MATHEMATICAL BIOSCIENCES AND ENGINEERING. 41(1001–9081):231–236

    Google Scholar 

  70. Lin Shan, Wang Hong, Qi Linhai, Feng Hanyu, Su Ying (2021) Short-term Load Forecasting Based on Conditional Generative Adversarial Network. Automation of Electric Power Systems. 45(1000–1026):52–60

    Google Scholar 

  71. Liu RW, Liang MH, Nie JT, Yuan YL, Xiong ZH, Yu H, Guizani N (2022) STMGCN: Mobile Edge Computing-Empowered Vessel Trajectory Prediction Using Spatio-Temporal Multigraph Convolutional Network. Automation of Electric Power Systems. 18(11):7977-7987. https://doi.org/10.1109/TII.2022.3165886

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Liu Yaping.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yanmei, J., Mingsheng, L., Yangyang, L. et al. Enhanced neighborhood node graph neural networks for load forecasting in smart grid. Int. J. Mach. Learn. & Cyber. 15, 129–148 (2024). https://doi.org/10.1007/s13042-023-01796-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-023-01796-8

Keywords

Navigation