skip to main content
10.1145/3408308.3427611acmotherconferencesArticle/Chapter ViewAbstractPublication PagesbuildsysConference Proceedingsconference-collections
research-article

SolarTrader: Enabling Distributed Solar Energy Trading in Residential Virtual Power Plants

Published: 18 November 2020 Publication History

Abstract

Distributed solar energy resources (DSERs) in smart grid systems are rapidly increasing due to the steep decline in solar module prices. This DSER penetration has prompted utilities to balance the real-time supply and demand of electricity proactively. A direct consequence of this is virtual power plants (VPPs) that enable solar generated energy trading to mitigate the impact of the intermittent DSERs while also benefiting from distributed generation for more reliable and profitable grid management. However, existing energy trading approaches in residential VPPs do not actually allow DSER users to trade their surplus solar energy independently and concurrently to maximize benefit potential; they typically require a trusted third-party to play the role of an online middleman. Furthermore, due to a lack of fair trading algorithms, these approaches do not necessarily result in "fair" solar energy saving among all the VPP users in the long term.
We propose Sola/Trader, a new solar energy trading system that enables unsupervised, distributed, and long term fair solar energy trading in residential VPPs. In essence, SolarTrader leverages a new multi-agent deep reinforcement learning approach that enables peer-to-peer solar energy trading among different DSERs to ensure that both the DSER users and the VPPs maximize benefit. We implement SolarTrader and evaluate it using both synthetic and real smart meter data from 4 U.S. residential VPP communities that are comprised of ~229 residential DSERs in total. Our results show that SolarTrader can reduce the aggregated VPP energy consumption by 83.8% when compared against a non-trading approach. Furthermore, SolarTrader achieves a ~105% average saving in VPP residents' monthly electricity cost. We also find that SolarTrader-enabled VPPs can achieve a fairness of 0.05, as measured by the Gini Coefficient, a level equivalent to that achieved by the fairness-maximizing Round-Robin approach.

References

[1]
2018. Gini Coefficient. https://en.wikipedia.org/wiki/Gini_coefficient.
[2]
2020. Dominion Energy Green Power program. https://www.dominionenergy.com/home-and-small-business/renewable-energy-programs/solar-purchase-program/solar-purchase-program-faqs.
[3]
2020. How We Compensate You for Excess Power Generation. https://www.sdge.com/residential/savings-center/solar-power-renewable-energy/net-energy-metering/billing-information/excess-generation.
[4]
2020. PayPal. https://www.paypal.com/us/.
[5]
2020. Pecan Street Data: Circuit-level Electricity Use and Generation. https://www.pecanstreet.org/dataport/.
[6]
2020. Venmo. https://venmo.com/send-receive/start/.
[7]
Nurzhan Zhumabekuly Aitzhan and Davor Svetinovic. 2016. Security and privacy in decentralized energy trading through multi-signatures, blockchain and anonymous messaging streams. IEEE Transactions on Dependable and Secure Computing 15, 5 (2016), 840--852.
[8]
Muhammad Raisul Alam, Marc St-Hilaire, and Thomas Kunz. 2019. Peer-to-peer energy trading among smart homes. Applied energy 238 (2019), 1434--1443.
[9]
G. Barbose, S. Weaver, and N. Darghouth. 2014. Tracking the Sun VII: An Historical Summary of the Installed Price of Photovoltaics in the United States from 1998 to 2013. Technical Report. Lawrence Berkeley National Laboratory.
[10]
Riccardo Bonetto, Ilya Sychev, and Frank HP Fitzek. 2018. Power to the Future: Use Cases and Challenges for Mobile, Self Configuring, and Distributed Power Grids. In 2018 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm). IEEE, 1--6.
[11]
Gabriel Chan, Isaac Evans, Matthew Grimley, Ben Ihde, and Poulomi Mazumder. 2017. Design choices and equity implications of community shared solar. The Electricity Journal 30, 9 (2017), 37--41.
[12]
Dong Chen, Joseph Breda, and David Irwin. 2018. Staring at the sun: a physical black-box solar performance model. In Proceedings of the 5th Conference on Systems for Built Environments. ACM, 53--62.
[13]
Dong Chen and David Irwin. 2017. Black-box solar performance modeling: Comparing physical, machine learning, and hybrid approaches. ACM SIGMETRICS Performance Evaluation Review 45, 2 (2017), 79--84.
[14]
community 2012. A Guide to Community Shared Solar. https://www.nrel.gov/docs/fy12osti/54570.pdf.
[15]
Cuda 2020. An Even Easier Introduction to CUDA. https://devblogs.nvidia.com/even-easier-introduction-cuda/.
[16]
Egauge 2020. eGauge Energy Monitoring Solutions. http://www.egauge.net/.
[17]
electricity 2016. U.S. Energy Information Administration, Electricity Monthly Update. https://www.seia.org/solar-industry-research-data.
[18]
Jinwei He and Yun Wei Li. 2012. An enhanced microgrid load demand sharing strategy. IEEE Transactions on Power Electronics 27, 9 (2012), 3984--3995.
[19]
Robert H Lasseter and Paolo Paigi. 2004. Microgrid: A conceptual solution. In 2004 IEEE 35th Annual Power Electronics Specialists Conference (IEEE Cat. No. 04CH37551), Vol. 6. IEEE, 4285--4290.
[20]
Timothy P Lillicrap, Jonathan J Hunt, Alexander Pritzel, Nicolas Heess, Tom Erez, Yuval Tassa, David Silver, and Daan Wierstra. 2015. Continuous control with deep reinforcement learning. arXiv preprint arXiv:1509.02971 (2015).
[21]
Chao Long, Jianzhong Wu, Yue Zhou, and Nick Jenkins. 2018. Peer-to-peer energy sharing through a two-stage aggregated battery control in a community Microgrid. Applied energy 226 (2018), 261--276.
[22]
Alexandra Lüth, Jan Martin Zepter, Pedro Crespo del Granado, and Ruud Egging. 2018. Local electricity market designs for peer-to-peer trading: The role of battery flexibility. Applied energy 229 (2018), 1233--1243.
[23]
osbrain 2020. osBrain. https://osbrain.readthedocs.io/en/stable/.
[24]
Pandas 2020. Pandas. https://pandas.pydata.org/.
[25]
Aleksei Petrenko, Zhehui Huang, Tushar Kumar, Gaurav Sukhatme, and Vladlen Koltun. 2020. Sample Factory: Egocentric 3D Control from Pixels at 100000 FPS with Asynchronous Reinforcement Learning. preprint arXiv:2006.11751 (2020).
[26]
Manisa Pipattanasomporn, Murat Kuzlu, and Saifur Rahman. 2018. A Blockchain-based Platform for Exchange of Solar Energy: Laboratory-scale Implementation. In 2018 International Conference and Utility Exhibition on Green Energy for Sustainable Development (ICUE). IEEE, 1--9.
[27]
Danny Pudjianto, Charlotte Ramsay, and Goran Strbac. 2007. Virtual power plant and system integration of distributed energy resources. IET Renewable power generation 1, 1 (2007), 10--16.
[28]
Pycuda 2020. PyCUDA. https://mathema.tician.de/software/pycuda/.
[29]
Rlib 2020. RLib: Scalable Reinforcement Learning. https://docs.ray.io/en/master/rllib.html.
[30]
Eleonora Riva Sanseverino, Maria Luisa Di Silvestre, Pierluigi Gallo, Gaetano Zizzo, and Mariano Ippolito. 2017. The blockchain in microgrids for transacting energy and attributing losses. In 2017 IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData). IEEE, 925--930.
[31]
John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. 2020. Proximal policy optimization algorithms. preprint arXiv:1707.06347 (2020).
[32]
scikit 2020. Scikit-learn Machine Learning in Python. https://scikit-learn.org/stable/.
[33]
SolarTrader 2020. Solar, Trader. https://github.com/cyber-physical-systems/SolarTrader.
[34]
Wencong Su, Zhiyong Yuan, and Mo-Yuen Chow. 2010. Microgrid planning and operation: Solar energy and wind energy. In IEEE PES General Meeting. IEEE.
[35]
Richard S Sutton, David A McAllester, Satinder P Singh, and Yishay Mansour. 2000. Policy gradient methods for reinforcement learning with function approximation. In Advances in neural information processing systems. 1057--1063.
[36]
Luke D Watson and Jonathan W Kimball. 2011. Frequency regulation of a microgrid using solar power. In 2011 Twenty-Sixth Annual IEEE Applied Power Electronics Conference and Exposition (APEC). IEEE, 321--326.
[37]
Ting Zhu, Zhichuan Huang, Ankur Sharma, Jikui Su, David Irwin, Aditya Mishra, Daniel Menasche, and Prashant Shenoy. 2013. Sharing renewable energy in smart microgrids. In 2013 ACM/IEEE International Conference on Cyber-Physical Systems (ICCPS). IEEE, 219--228.
[38]
Ting Zhu, Sheng Xiao, Yi Ping, Don Towsley, and Weibo Gong. 2011. A secure energy routing mechanism for sharing renewable energy in smart microgrid. In 2011 IEEE International Conference on Smart Grid Communications (SmartGridComm). IEEE, 143--148.

Cited By

View all
  • (2024)Implementation of blockchain for sustainable solar energy trading: a systematic reviewSmart and Sustainable Built Environment10.1108/SASBE-12-2023-0404Online publication date: 5-Apr-2024
  • (2024)Graphical Model-Based Lasso for Weakly Dependent Time Series of TensorsMachine Learning and Knowledge Discovery in Databases. Research Track10.1007/978-3-031-70362-1_15(249-264)Online publication date: 22-Aug-2024
  • (2021)AutoShare: Virtual community solar and storage for energy sharingEnergy Informatics10.1186/s42162-021-00144-w4:1Online publication date: 12-Jul-2021

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
BuildSys '20: Proceedings of the 7th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation
November 2020
361 pages
ISBN:9781450380614
DOI:10.1145/3408308
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 November 2020

Permissions

Request permissions for this article.

Check for updates

Badges

  • Best Paper
  • Honorable Mention

Author Tags

  1. Deep Learning
  2. ML
  3. Reinforcement Learning
  4. Solar Energy Trading

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

BuildSys '20
Sponsor:

Acceptance Rates

BuildSys '20 Paper Acceptance Rate 38 of 139 submissions, 27%;
Overall Acceptance Rate 148 of 500 submissions, 30%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)69
  • Downloads (Last 6 weeks)13
Reflects downloads up to 15 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Implementation of blockchain for sustainable solar energy trading: a systematic reviewSmart and Sustainable Built Environment10.1108/SASBE-12-2023-0404Online publication date: 5-Apr-2024
  • (2024)Graphical Model-Based Lasso for Weakly Dependent Time Series of TensorsMachine Learning and Knowledge Discovery in Databases. Research Track10.1007/978-3-031-70362-1_15(249-264)Online publication date: 22-Aug-2024
  • (2021)AutoShare: Virtual community solar and storage for energy sharingEnergy Informatics10.1186/s42162-021-00144-w4:1Online publication date: 12-Jul-2021

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media