Skip to main content
SpringerLink
Log in

Multi-agent Reinforcement Learning Based User-Centric Demand Response with Non-intrusive Load Monitoring

  • Conference paper
  • First Online:
Artificial Intelligence Security and Privacy (AIS&P 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14509))

  • 191 Accesses

Abstract

This research proposes a multi-agent reinforcement learning framework as a home energy management algorithm that focuses on user needs and preferences as well. The proposed method aims to secure the smart grid from power outages due to overloading. The system predicts appliance-level load demand for the following day using non-intrusive load monitoring (NILM) and four neural network-based supervised learning methods to pick the more accurate forecasting method. The Python-based NILM toolkit is utilized to analyze disaggregation methods on the forecasted demand to obtain appliance-level energy consumption. The user feedback and time-based price values are employed to optimize appliance scheduling. The simulation results of each stage of the algorithm are presented. The results demonstrate a 15% reduction in the electricity cost.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Alfaverh, F., Denaï, M., Sun, Y.: Demand response strategy based on reinforcement learning and fuzzy reasoning for home energy management. IEEE Access 8, 39310–39321 (2020)

    Article  Google Scholar 

  2. Zhao, Z., Lee, W.C., Shin, Y., Song, K.-B.: An optimal power scheduling method for demand response in home energy management system. IEEE Trans. Smart Grid 4, 1391–1400 (2013)

    Article  Google Scholar 

  3. Zhou, K., Yang, S.: Understanding household energy consumption behavior: the contribution of energy big data analytics. Renew. Sustain. Energy Rev. 56, 810–819 (2016)

    Article  Google Scholar 

  4. Ogunjuyigbe, A.S.O., Ayodele, T.R., Akinola, O.A.: User satisfaction-induced demand side load management in residential buildings with user budget constraint. Appl. Energy 187, 352–366 (2017)

    Article  Google Scholar 

  5. Chen, S.-J., Chiu, W.-Y., Liu, W.-J.: User preference-based demand response for smart home energy management using multiobjective reinforcement learning. IEEE Access 9, 161627–161637 (2021)

    Article  Google Scholar 

  6. Zazo, J., Zazo, S., Macua, S.-V.: Robust worst-case analysis of demand-side management in smart grids. IEEE Trans. Smart Grid 8, 662–673 (2017)

    Google Scholar 

  7. Pipattanasomporn, M., Kuzlu, M., Rahman, S.: An algorithm for intelligent home energy management and demand response analysis. IEEE Trans. Smart Grid 3, 2166–2173 (2012)

    Article  Google Scholar 

  8. Abbas, F., Feng, D., Habib, S., Rahman, U., Rasool, A., Yan, Z.: Short term residential load forecasting: an improved optimal nonlinear auto regressive (NARX) method with exponential weight decay function. Electronics 7, 432 (2018)

    Article  Google Scholar 

  9. Sanjari, M.-J., Karami, H., Yatim, A.-H., Gharehpetian, G.-B.: Application of Hyper-Spherical Search algorithm for optimal energy resources dispatch in residential microgrids. Appl. Soft Comput. 37, 15–23 (2015)

    Article  Google Scholar 

  10. Marzband, M., Yousefnejad, E., Sumper, A., Domínguez-García, J.-L.: Real time experimental implementation of optimum energy management system in standalone Microgrid by using multi-layer ant colony optimization. Int. J. Electr. Power Energy Syst. 75, 265–274 (2016)

    Article  Google Scholar 

  11. Chenthur Pandian, S., Duraiswamy, K., Christober Asir Rajan, C., Kanagaraj, N.: Fuzzy approach for short term load forecasting. Electr. Power Syst. Res. 76(6–7), 541–548 (2006)

    Google Scholar 

  12. Xiao, L., Shao, W., Yu, M., Ma, J., Jin, C.: Research and application of a combined model based on multi-objective optimization for electrical load forecasting. Energy 119, 1057–1074 (2017)

    Article  Google Scholar 

  13. Chen, B.-J., Chang, M.-W., lin, C.-J.: Load forecasting using support vector Machines: a study on EUNITE competition 2001. IEEE Trans. Power Syst. 19(4), 1821–1830 (2004)

    Google Scholar 

  14. Kouhi, S., Keynia, F.: A new cascade NN based method to short-term load forecast in deregulated electricity market. Energy Convers. Manage. 71, 76–83 (2013)

    Article  Google Scholar 

  15. Masood, Z., Gantassi, R., Ardiansyah, Choi, Y.: A multi-step time-series clustering-based Seq2Seq LSTM learning for a single household electricity load forecasting. Energies 15(7), 2623 (2022)

    Google Scholar 

  16. Murray, D., et al.: A data management platform for personalised real-time energy feedback. In: Proceedings of the 8th International Conference on Energy Efficiency in Domestic Appliances and Lighting. IET (2015)

    Google Scholar 

  17. Yang, L., Chen, X., Zhang, J., Poor, H.-V.: Cost-effective and privacy-preserving energy management for smart meters. IEEE Trans. Smart Grid 6(1), 486–495 (2015)

    Article  Google Scholar 

  18. Beckel, C., Kleiminger, W., Cicchetti, R., Staake, T., Santini, S.: The ECO data set and the performance of non-intrusive load monitoring algorithms. In: Proceedings of the 1st ACM Conference on Embedded Systems for Energy-Efficient Buildings (BuildSys 2014), pp. 80–89. Association for Computing Machinery, New York (2014)

    Google Scholar 

  19. Zeifman, M., Roth, K.: Nonintrusive appliance load monitoring: review and outlook. IEEE Trans. Consum. Electron. 57(1), 76–84 (2011)

    Article  Google Scholar 

  20. Xin, W., Han, L., Wang, Z., Qi, B.: A nonintrusive fast residential load identification algorithm based on frequency-domain template filtering. IEEJ Trans. Electr. Electron. Eng. 12, S125–S133 (2017)

    Google Scholar 

  21. Iliaee, N., Liu, S., and Shi, W.: Non-intrusive load monitoring based demand prediction for smart meter attack detection. In: International Conference on Control, Automation and Information Sciences (ICCAIS), pp. 370–374, Xi’an, China (2021)

    Google Scholar 

  22. Batra, N., et al.: NILMTK: an open source toolkit for non-intrusive load monitoring. In: Proceedings of the 5th International Conference on Future Energy Systems (e-Energy 2014), pp. 265–276. Association for Computing Machinery, New York (2014)

    Google Scholar 

  23. Batra, N., et al.: Towards reproducible state-of-the-art energy disaggregation. In: Proceedings of the 6th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys 2019), pp. 193–202. Association for Computing Machinery, New York (2019)

    Google Scholar 

  24. RNN. https://www.educba.com/recurrent-neural-networks-rnn/

  25. Ding, Q.: Long-term load forecast using decision tree method. In: 2006 IEEE PES Power Systems Conference and Exposition, pp. 1541–1543, Atlanta, GA (2006)

    Google Scholar 

  26. LSTM. https://notesonai.com/LSTM

Download references

Author information

Authors and Affiliations

  1. Carleton University, Ottawa, Canada

    Mohammad Ashraf, Sima Hamedifar, Shichao Liu & Alanoud Alrasheedi

  2. Institute of Artificial Intelligence, Guangzhou University, Guangzhou, China

    Chunsheng Yang

Authors
  1. Mohammad Ashraf
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sima Hamedifar
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shichao Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Chunsheng Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Alanoud Alrasheedi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shichao Liu .

Editor information

Editors and Affiliations

  1. Rutgers University, Newark, NJ, USA

    Jaideep Vaidya

  2. Tampere University, Tampere, Finland

    Moncef Gabbouj

  3. Guangzhou University, Guangzhou, China

    Jin Li

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ashraf, M., Hamedifar, S., Liu, S., Yang, C., Alrasheedi, A. (2024). Multi-agent Reinforcement Learning Based User-Centric Demand Response with Non-intrusive Load Monitoring. In: Vaidya, J., Gabbouj, M., Li, J. (eds) Artificial Intelligence Security and Privacy. AIS&P 2023. Lecture Notes in Computer Science, vol 14509. Springer, Singapore. https://doi.org/10.1007/978-981-99-9785-5_30

Download citation

  • DOI: https://doi.org/10.1007/978-981-99-9785-5_30

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-99-9784-8

  • Online ISBN: 978-981-99-9785-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation