Skip to main content

Advertisement

Springer Nature Link
Log in

Federated learning for interpretable short-term residential load forecasting in edge computing network

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Short-term residential load forecasting is of great significance to smart grid applications. Deep learning techniques, especially recurrent neural networks, can greatly improve the performance of prediction models. However, deep neural networks usually have low interpretability, which creates obstacles for customers to deeply understand the prediction results and make quick responses. In addition, the existing deep learning prediction methods rely heavily on the centralized training of massive data. However, the transmission of data from the client to the server poses a threat to the data security of customers. In this work, we propose an interpretable deep learning framework with federated learning for short-term residential load forecasting. Specifically, we propose a new automatic relevance determination network for feature interpretation, combined with the encoder–decoder architecture to achieve interpretable multi-step load prediction. In the edge computing network, the training scheme based on federated learning does not share the original data, which can effectively protect data privacy. The introduction of iterative federated clustering algorithm can alleviate the problem of non-independent and identical distribution of data in different households. We use two real-world datasets to verify the feasibility and performance of the proposed method. Finally, we discuss in detail the feature interpretation of these two datasets.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data availability

Dataset 1 that supports the findings of this study is available in https://www.ausgrid.com.au/Industry/Our-Research/Data-to-share/Solar-home-electricity-data. Dataset 2 is not publicly available due to data privacy and is available from the corresponding author upon reasonable request.

References

  1. Tonkoski R (2012) Impact of high PV penetration on voltage profiles in residential neighborhoods. IEEE Trans Sustain Energy 3(3):518–527

    Article  Google Scholar 

  2. Li C, Liu C, Yu X, Deng K, Huang T, Liu L (2018) Integrating demand response and renewable energy in wholesale market. Proceedings of the twenty-seventh international joint conference on artificial intelligence (IJCAI) pp 382–388

  3. Wang S, Deng X, Chen H, Shi Q, Xu D (2021) A bottom-up short-term residential load forecasting approach based on appliance characteristic analysis and multi-task learning. Electr Power Sys Res 196:107233

    Article  Google Scholar 

  4. Wang Y, Gan D, Sun M, Zhang N, Lu Z, Kang C (2019) Probabilistic individual load forecasting using pinball loss guided LSTM. Appl Energy 235:10–20

    Article  Google Scholar 

  5. Schreck S, de La Comble IP, Thiem S, Niessen S (2020) A methodological framework to support load forecast error assessment in local energy markets. IEEE Trans Smart Grid 11(4):3212–3220

    Article  Google Scholar 

  6. Liu N, Yu X, Wang C, Li C, Ma L, Lei J (2017) Energy-sharing model with price-based demand response for microgrids of peer-to-peer prosumers. IEEE Trans Power Sys 32(5):3569–3583

    Article  Google Scholar 

  7. Zhang L, Zhang B (2019) Scenario forecasting of residential load profiles. IEEE J Select Areas Commun 38(1):84–95

    Article  Google Scholar 

  8. Razavi SE, Arefi A, Ledwich G, Nourbakhsh G, Smith DB, Minakshi M (2020) From load to net energy forecasting: Short-term residential forecasting for the blend of load and pv behind the meter. IEEE Access 8:224343–224353

    Article  Google Scholar 

  9. Garulli A, Paoletti S, Vicino A (2014) Models and techniques for electric load forecasting in the presence of demand response. IEEE Trans Cont Sys Technol 23(3):1087–1097

    Article  Google Scholar 

  10. Siano P (2014) Demand response and smart gridsła survey. Renew Sustain Energy Rev 30:461–478

    Article  Google Scholar 

  11. Tascikaraoglu A, Boynuegri A, Uzunoglu M (2014) A demand side management strategy based on forecasting of residential renewable sources: a smart home system in turkey. Energy Build 80:309–320

    Article  Google Scholar 

  12. Hor C-L, Watson SJ, Majithia S (2006) Daily load forecasting and maximum demand estimation using arima and garch, In: 2006 International conference on probabilistic methods applied to power systems, IEEE, pp.1–6

  13. Jain RK, Smith KM, Culligan PJ, Taylor JE (2014) Forecasting energy consumption of multi-family residential buildings using support vector regression: investigating the impact of temporal and spatial monitoring granularity on performance accuracy. Appl Energy 123:168–178

    Article  Google Scholar 

  14. Xie G, Chen X, Weng Y (2018) An integrated gaussian process modeling framework for residential load prediction. IEEE Trans Power Sys 33(6):7238–7248

    Article  Google Scholar 

  15. Elman JL (1991) Distributed representations, simple recurrent networks, and grammatical structure. Mach learn 7(2):195–225

    Article  Google Scholar 

  16. Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neur Comput 9(8):1735–1780

    Article  Google Scholar 

  17. K. Cho, B. van Merriënboer, Ç. Gu?lçehre, D. Bahdanau, F. Bougares, H. Schwenk, Y. Bengio, Learning phrase representations using rnn encoder–decoder for statistical machine translation, In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), 2014, pp. 1724–1734

  18. Kong W, Dong ZY, Jia Y, Hill DJ, Xu Y, Zhang Y (2019) Short-term residential load forecasting based on LSTM recurrent neural network. IEEE Trans Smart Grid 10(1):841–851

    Article  Google Scholar 

  19. Wen L, Zhou K, Yang S (2020) Load demand forecasting of residential buildings using a deep learning model. Electr Power Sys Res 179:106073

    Article  Google Scholar 

  20. Cai M, Pipattanasomporn M, Rahman S (2019) Day-ahead building-level load forecasts using deep learning vs. traditional time-series techniques. Appl Energy 236:1078–1088

    Article  Google Scholar 

  21. Deng Z, Wang B, Xu Y, Xu T, Liu C, Zhu Z (2019) Multi-scale convolutional neural network with time-cognition for multi-step short-term load forecasting. IEEE Access 7:88058–88071

    Article  Google Scholar 

  22. Rahman A, Srikumar V, Smith AD (2018) Predicting electricity consumption for commercial and residential buildings using deep recurrent neural networks. Appl Energy 212:372–385

    Article  Google Scholar 

  23. Sehovac L, Grolinger K (2020) Deep learning for load forecasting: sequence to sequence recurrent neural networks with attention. IEEE Access 8:36411–36426

    Article  Google Scholar 

  24. Sundararajan M, Taly A, Yan Q (2017) Axiomatic attribution for deep networks, In: Proceedings of the 34th international conference on machine learning-Volume 70, pp. 3319–3328

  25. Shrikumar A, Greenside P, Kundaje A (2017) Learning important features through propagating activation differences, in: International conference on machine learning, pp 3145–3153

  26. Ismail AA, Gunady M, Corrada Bravo H, Feizi S (2020) Benchmarking deep learning interpretability in time series predictions. Adv Neur Infor Process Sys 33:6441–6452

    Google Scholar 

  27. Lim B, Arık SÖ, Loeff N, Pfister T (2021) Temporal fusion transformers for interpretable multi-horizon time series forecasting. Int J Forecast 37(4):1748–1764

    Article  Google Scholar 

  28. Li L, Yan J, Yang X, Jin Y (2019) Learning interpretable deep state space model for probabilistic time series forecasting 2901C2908

  29. Briggs C, Fan Z, Andras P Federated learning for short-term residential energy demand forecasting, arXiv preprint arXiv:2105.13325

  30. Yang Q, Liu Y, Chen T, Tong Y (2019) Federated machine learning: concept and applications. ACM Trans Intell Sys Technol (TIST) 10(2):1–19

    Article  Google Scholar 

  31. Liu H, Zhang X, Shen X, Sun H A federated learning framework for smart grids: securing power traces in collaborative learning, arXiv preprint arXiv:2103.11870

  32. Zhang X, Fang F, Wang J (2020) Probabilistic solar irradiation forecasting based on variational bayesian inference with secure federated learning. IEEE Trans Ind Infor 17(11):7849–7859

    Article  Google Scholar 

  33. Taïk A, Cherkaoui S (2020) Electrical load forecasting using edge computing and federated learning, In: ICC 2020-2020 IEEE International conference on communications (ICC), IEEE, pp 1–6

  34. Ghosh A, Chung J, Yin D, Ramchandran K (2020) An efficient framework for clustered federated learning. Adv Neur Infor Process Sys 33:19586–19597

    Google Scholar 

  35. Zhou H, Zhang S, Peng J, Zhang S, Li J, Xiong H, Zhang W (2021) Informer: beyond efficient transformer for long sequence time-series forecasting, In: Proceedings of AAAI

  36. Martins A, Astudillo R (2016) From softmax to sparsemax: A sparse model of attention and multi-label classification, In: International conference on machine learning, PMLR, pp. 1614–1623

  37. Zhao R, Wang D, Yan R, Mao K, Shen F, Wang J (2017) Machine health monitoring using local feature-based gated recurrent unit networks. IEEE Trans Ind Electr 65(2):1539–1548

    Article  Google Scholar 

  38. Razavi SE, Arefi A, Ledwich G, Nourbakhsh G, Smith DB, Minakshi M (2020) From load to net energy forecasting: short-term residential forecasting for the blend of load and pv behind the meter. IEEE Access 8:224343–224353

    Article  Google Scholar 

  39. Paszke A, Gross S, Massa F, Lerer A, Bradbury J, Chanan G, Killeen T, Lin Z, Gimelshein N, Antiga L et al (2019) Pytorch: an imperative style, high-performance deep learning library. Adv Neur Infor Process Sys 32:8026–8037

    Google Scholar 

  40. Kingma DP, Ba J (2015) Adam: A method for stochastic optimization, In: 3rd International conference on learning representations (ICLR)

  41. Chen T, Guestrin C (2016) Xgboost: A scalable tree boosting system, In: Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining, pp. 785–794

  42. Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V et al (2011) Scikit-learn: machine learning in python. J Mach Learn Res 12:2825–2830

    MathSciNet  MATH  Google Scholar 

  43. Liaw A, Wiener M et al (2002) Classification and regression by randomforest. R News 2(3):18–22

    Google Scholar 

  44. Briggs C, Fan Z, Andras P (2020) Federated learning with hierarchical clustering of local updates to improve training on non-iid data, In: 2020 International joint conference on neural networks (IJCNN), IEEE, pp 1–9

  45. Breiman L (2001) Random forests. Mach Learn 45(1):5–32

    Article  MATH  Google Scholar 

Download references

Funding

This article was funded by National Natural Science Foundation of China under Grant No. (62073344).

Author information

Authors and Affiliations

  1. School of Automation, Central South University, Changsha, 410083, China

    Chongchong Xu, Guo Chen & Chaojie Li

Authors
  1. Chongchong Xu
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Guo Chen
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Chaojie Li
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Guo Chen.

Ethics declarations

Conflict of interest

The authors declare that they have no known potential conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xu, C., Chen, G. & Li, C. Federated learning for interpretable short-term residential load forecasting in edge computing network. Neural Comput & Applic 35, 8561–8574 (2023). https://doi.org/10.1007/s00521-022-08130-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-022-08130-3

Keywords