Skip to main content

Advertisement

SpringerLink
Log in

An interdisciplinary approach on efficient virtual microgrid to virtual microgrid energy balancing incorporating data preprocessing techniques

  • Regular Paper
  • Published:
Computing Aims and scope Submit manuscript

Abstract

A way to improve energy management is to perform balancing both at the Peer-to-peer (P2P) level and then at the Virtual Microgrid-to-Virtual Microgrid (VMG2VMG) level, while considering the intermittency of available Renewable Energy Source (RES). This paper proposes an interdisciplinary analytics-based approach for the formation of VMGs addressing energy balancing. Our approach incorporates Computer Science methods to address an Energy sector problem, utilizing data preprocessing techniques and Machine Learning concepts. It features P2P balancing, where each peer is a prosumer perceived as an individual entity, and Virtual Microgrids (VMGs) as clusters of peers. We conducted several simulations utilizing clustering and binning algorithms for preprocessing energy data. Our approach offers options for generating VMGs of prosumers, prior to using a customized Exhaustive brute-force Balancing Algorithm (EBA). EBA performs balancing at the cluster-to-cluster level, perceived as VMG2VMG balancing. To that end, the study simulates on data from 94 prosumers, and reports outcomes, biases, and prospects for scaling up and expanding this work. Finally, this paper outlines potential ideal usages for the approach, either standalone or integrated with other toolkits and technologies.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22

Similar content being viewed by others

Availability of data and material (data transparency)

Data partly available in the appendices due to confidentiality clauses for the ongoing eDREAM project.

Code availability (software application or custom code)

N/A due to confidentiality clauses for the ongoing eDREAM project.

Notes

  1. In the simulations, historical data are utilized to have a realistic measure of outcomes and balancing goals.

Abbreviations

DR:

Demand response

P2P:

Peer-to-peer

PV:

Photovoltaic

RES:

Renewable energy source

DSO:

Distribution system operator

DER:

Distributed energy resource

DR:

Demand response

MG:

Microgrid

VMG:

Virtual microgrid

VMG2VMG:

VMG to VMG

VPP:

Virtual power plants

EBA:

Exhaustive balancing algorithm

P2G:

Peer-to-Grid

SG:

Smart grid

AI:

Artificial intelligence

ML:

Machine learning

ToU:

Time of use

RTP:

Real time pricing

CPP:

Critical peak pricing

KPI:

Key performance indicator

nZEB:

Nearly zero energy building

TAE:

Total active energy

References

  1. Cagnano A, De Tuglie E, Mancarella P (2020) Microgrids: overview and guidelines for practical implementations and operation. Appl Energy 258:114039

    Article  Google Scholar 

  2. Tabatabaei NM, Kabalci E, Bizon N (eds) (2019) Microgrid architectures, control and protection methods. Springer, Berlin

    Google Scholar 

  3. Asmus P (2010) Microgrids, virtual power plants and our distributed energy future. Electr J 23(10):72–82

    Article  Google Scholar 

  4. Badami M, Fambri G, Mancò S, Martino M, Damousis IG, Agtzidis D, Tzovaras D (2020) A decision support system tool to manage the flexibility in renewable energy-based power systems. Energies 13(1):153

    Article  Google Scholar 

  5. Kafle YR, Mahmud K, Morsalin S, Town GE (2016, September). Towards an internet of energy. In: 2016 IEEE international conference on power system technology (POWERCON), IEEE, pp 1–6

  6. Tzovaras D, Damousis I, Papanikolaou A, Pitsiladis G, Barbagelata G (2019) DRIMPAC—unified demand response interoperability framework enabling market participation of active energy consumers. In: Multidisciplinary digital publishing institute proceedings, vol 20, No. 1, p 15

  7. Long C, Wu J, Zhou Y, Jenkins N (2018) Peer-to-peer energy sharing through a two-stage aggregated battery control in a community Microgrid. Appl Energy 226:261–276

    Article  Google Scholar 

  8. Hirsch A, Parag Y, Guerrero J (2018) Microgrids: a review of technologies, key drivers, and outstanding issues. Renew Sustain Energy Rev 90:402–411

    Article  Google Scholar 

  9. Paiva LT, Fontes FA (2018) Optimal electric power generation with underwater kite systems. Computing 100(11):1137–1153

    Article  MathSciNet  Google Scholar 

  10. Bintoudi AD, Zyglakis L, Apostolos T, Ioannidis D, Al-Agtash S, Martinez-Ramos JL et al. (2017, November). Novel hybrid design for microgrid control. In: 017 IEEE PES Asia-Pacific Power and Energy Engineering Conf. (APPEEC), IEEE, pp 1–6.

  11. Balijepalli VM, Pradhan V, Khaparde SA, Shereef, RM (2011, December). Review of demand response under smart grid paradigm. In ISGT2011-India, IEEE, pp 236–243

  12. Sioshansi FP (ed) (2019) Consumer, prosumer, prosumager: how service innovations will disrupt the utility business model. Academic Press, Cambridge

    Google Scholar 

  13. Charalambous A, Hadjidemetriou L, Zacharia L, Bintoudi AD, Tsolakis AC, Tzovaras D, Kyriakides E (2019) Phase balancing and reactive power support services for microgrids. Appl Sci 9(23):5067

    Article  Google Scholar 

  14. Ellahi M, Abbas G, Khan I, Koola PM, Nasir M, Raza A, Farooq U (2019) Recent approaches of forecasting and optimal economic dispatch to overcome intermittency of wind and photovoltaic (PV) systems: a review. Energies 12(22):4392

    Article  Google Scholar 

  15. Khuntia SR, Rueda JL, van der Meijden MA (2016) Forecasting the load of electrical power systems in mid-and long-term horizons: a review. IET Gener Transm Distrib 10(16):3971–3977

    Article  Google Scholar 

  16. Livingston D, Sivaram V, Freeman M, Fiege M (2018) Applying blockchain technology to electric power systems. Council on Foreign Relations.

  17. Nosratabadi SM, Hooshmand RA, Gholipour E (2017) A comprehensive review on microgrid and virtual power plant concepts employed for distributed energy resources scheduling in power systems. Renew Sustain Energy Rev 67:341–363

    Article  Google Scholar 

  18. Akbary P, Ghiasi M, Pourkheranjani MRR, Alipour H, Ghadimi N (2019) Extracting appropriate nodal marginal prices for all types of committed reserve. Comput Econ 53(1):1–26

    Article  Google Scholar 

  19. Liu N, Yu X, Wang C, Li C, Ma L, Lei J (2017) Energy-sharing model with price-based demand response for microgrids of peer-to-peer prosumers. IEEE Trans Power Syst 32(5):3569–3583

    Article  Google Scholar 

  20. Zhou Y, Wu J, Long C, Cheng M, Zhang C (2017) Performance evaluation of peer-to-peer energy sharing models. Energy Procedia 143:817–822

    Article  Google Scholar 

  21. Moura PS, de Almeida AT (2010) Multi-objective optimization of a mixed renewable system with demand-side management. Renew Sustain Energy Rev 14(5):1461–1468

    Article  Google Scholar 

  22. Blake ST, O’Sullivan DT (2018) Optimization of distributed energy resources in an industrial microgrid. Procedia CIRP 67:104–109

    Article  Google Scholar 

  23. Zhang Y, Gatsis N, Giannakis GB (2013) Robust energy management for microgrids with high-penetration renewables. IEEE Trans Sustain Energy 4(4):944–953

    Article  Google Scholar 

  24. Quiggin D, Cornell S, Tierney M, Buswell R (2012) A simulation and optimisation study: Towards a decentralised microgrid, using real world fluctuation data. Energy 41(1):549–559

    Article  Google Scholar 

  25. Ding YM, Hong SH, Li XH (2014) A demand response energy management scheme for industrial facilities in smart grid. IEEE Trans Industr Inf 10(4):2257–2269

    Article  Google Scholar 

  26. Hawkes AD, Leach MA (2009) Modelling high level system design and unit commitment for a microgrid. Appl Energy 86(7–8):1253–1265

    Article  Google Scholar 

  27. Zhang C, Wu J, Zhou Y, Cheng M, Long C (2018) Peer-to-Peer energy trading in a Microgrid. Appl Energy 220:1–12

    Article  Google Scholar 

  28. Anoh K, Maharjan S, Ikpehai A, Zhang Y, Adebisi B (2019) Energy peer-to-peer trading in virtual microgrids in smart grids: a game-theoretic approach. IEEE Trans Smart Grid 11:1264–1275

    Article  Google Scholar 

  29. Vergados DJ, Mamounakis I, Makris P, Varvarigos E (2016) Prosumer clustering into virtual microgrids for cost reduction in renewable energy trading markets. Sustain Energy Grids Netw 7:90–103

    Article  Google Scholar 

  30. Cioara T, Anghel I, Pop C, Bertoncini M, Croce V, Ioannidis D, D'Oriano L (2018, June). Enabling new technologies for demand response decentralized validation using blockchain. In: 2018 IEEE Int’l conf. on environment and electrical engineering and 2018 ieee industrial and commercial power systems europe (EEEIC/I&CPS Europe), IEEE, pp 1–4

  31. D’Oriano L, Mastandrea G, Rana G, Raveduto G, Croce V, Verber M, Bertoncini M (2018, November). Decentralized blockchain flexibility system for Smart Grids: Requirements engineering and use cases. In: 2018 Int’l IEEE conf. and workshop in obuda on electrical and power engineering (CANDO-EPE), IEEE, pp 39–44

  32. Pop C, Cioara T, Antal M, Anghel I, Salomie I, Bertoncini M (2018) Blockchain based decentralized management of demand response programs in smart energy grids. Sensors 18(1):162

    Article  Google Scholar 

  33. Petrican T, Vesa AV, Antal M, Pop C, Cioara T, Anghel I, Salomie I (2018, September). Evaluating forecasting techniques for integrating household energy prosumers into smart grids. In: 2018 IEEE 14th Int’l conf. on intelligent computer communication and processing (ICCP), IEEE, pp 79–85

  34. Stecchi U, Gomez J, Gallego L, Santori F, Rico J (2019). A multipurpose ICT platform for supporting energy transition: first results in flexibility profiling. In: 2019 1st Int’l Conf. Energy Transition in the Mediterranean Area (SyNERGY MED), IEEE, pp 1–6

  35. Bragatto T, Cresta M, Croce V, Paulucci M, Santori F, Ziu D (2019). A real-life experience on 2 nd life batteries services for Distribution System Operator. In: 2019 IEEE Int’l conf. environment and electrical engineering and 2019 ieee industrial and commercial power systems Europe (EEEIC/I&CPS Europe), IEEE, pp 1–6

  36. Pop C, Antal M, Cioara T, Anghel I, Sera D, Salomie I, Bertoncini M (2019) Blockchain-based scalable and tamper-evident solution for registering energy data. Sensors 19(14):3033

    Article  Google Scholar 

  37. Vesa AV, Cioara T, Anghel I, Antal M, Pop C, Iancu B, Salomie I (2020) Energy flexibility prediction for data center engagement in demand response programs. Sustainability 12(4):1417

    Article  Google Scholar 

  38. Pop C, Cioara T, Anghel I, Antal M, and Salomie I (2020) Blockchain based Decentralized Applications: Technology Review and Development Guidelines. arXiv preprint http://arxiv.org/abs/2003.07131.

  39. Kong X, Liu D, Wang C, Sun F, Li S (2020) Optimal operation strategy for interconnected microgrids in market environment considering uncertainty. Appl Energy 275:115336

    Article  Google Scholar 

  40. Liu W, Gu W, Wang J, Yu W, Xi X (2018) Game theoretic non-cooperative distributed coordination control for multi-microgrids. IEEE Trans Smart Grid 9(6):6986–6997

    Article  Google Scholar 

  41. Cardoso G, Brouhard T, DeForest N, Wang D, Heleno M, Kotzur L (2018) Battery aging in multi-energy microgrid design using mixed integer linear programming. Appl Energy 231:1059–1069

    Article  Google Scholar 

  42. Koukaras P, and Tjortjis C (2019) Social media analytics, types and methodology. In: Machine Learning Paradigms, Springer, Cham, pp 401–427

  43. Dikaiakos MD, Katsaros D, Mehra P, Pallis G, Vakali A (2009) Cloud computing: Distributed internet computing for IT and scientific research. IEEE Internet Comput 13(5):10–13

    Article  Google Scholar 

  44. Papazoglou MP, Georgakopoulos D (2003) Introduction: service-oriented computing. Commun ACM 46(10):24–28

    Article  Google Scholar 

  45. “Digital Innovation Hubs - Smart Specialisation Platform.”, http://s3platform.jrc.ec.europa.eu/digital-innovation-hubs-tool/-/dih/1521/view.

  46. Vafeiadis T, Zikos S, Stavropoulos G, Ioannidis D, Krinidis S, Tzovaras D, and Moustakas K (2017) Machine learning based occupancy detection via the use of smart meters. In: 2017 Int’l symposium on computer science and intelligent controls (ISCSIC), IEEE, pp 6–12

  47. Adamopoulou AA, Tryferidis AM, Tzovaras DK (2016) A context-aware method for building occupancy prediction. Energy Build 110:229–244

    Article  Google Scholar 

  48. McKinney W (2010). Data structures for statistical computing in python. In: Proceedings of the 9th python in science conference, vol 445, pp 51–56

  49. Arthur D, and Vassilvitskii S (2006) k-means++: The advantages of careful seeding. Stanford.

  50. Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Vanderplas J (2011) Scikit-learn: Machine learning in Python. J Mach Learn Res 12:2825–2830

    MathSciNet  MATH  Google Scholar 

  51. Rousseeuw PJ (1987) Silhouettes: a graphical aid to the interpretation and validation of cluster analysis. J Comput Appl Math 20:53–65

    Article  Google Scholar 

  52. Ketchen DJ, Shook CL (1996) The application of cluster analysis in strategic management research: an analysis and critique. Strateg Manag J 17(6):441–458

    Article  Google Scholar 

  53. Conejo AJ, Contreras J, Espínola R, Plazas MA (2005) Forecasting electricity prices for a day-ahead pool-based electric energy market. Int’l J Forecast 21(3):435–462

    Article  Google Scholar 

  54. Tsolakis AC, Moschos I, Votis K, Ioannidis D, Tzovaras D, Pandey P et al. (2018) A Secured and Trusted Demand Response system based on Blockchain technologies. In: 2018 Innovations in intelligent systems and applications (INISTA), IEEE, pp 1–6.

  55. Mendling J, Weber I, Aalst WVD, Brocke JV, Cabanillas C, Daniel F et al (2018) Blockchains for business process management-challenges and opportunities. ACM Trans Manag Inf Syst (TMIS) 9(1):1–16

    Article  Google Scholar 

Download references

Acknowledgments

This work has been conducted within the eDREAM project Grant number 774478, co-funded by the European Commission as part of the H2020 Framework Programme (H2020-LCE-2017-SGS).

Funding

The project eDREAM has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement N. 774478.

Author information

Authors and Affiliations

  1. Information Technologies Institute, Centre of Research & Technology – Hellas, 6th km Harilaou - Thermi, 57001, Thessaloniki, Greece

    Paraskevas Koukaras, Christos Tjortjis, Paschalis Gkaidatzis, Napoleon Bezas, Dimosthenis Ioannidis & Dimitrios Tzovaras

  2. School of Science and Technology, International Hellenic University, 14th km Thessaloniki – N. Moudania, Thermi, 57001, Thessaloniki, Greece

    Paraskevas Koukaras & Christos Tjortjis

Authors
  1. Paraskevas Koukaras
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Christos Tjortjis
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Paschalis Gkaidatzis
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Napoleon Bezas
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Dimosthenis Ioannidis
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Dimitrios Tzovaras
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Christos Tjortjis.

Ethics declarations

Conflict of interest

Researchers in Information Technologies Institute, Centre of Research & Technology or School of Science and Technology, International Hellenic University.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendices

Appendix 1: k-means clustering on raw data for different timestamps

On the following figures, different coloring is applied for marked entries that were positioned to different clusters.

figure a

Appendix 2: Clustering and balancing on a P2P level example

Each table refers to the figure on its right, while different coloring is applied for marked entries that were positioned to different clusters.

figure b
figure c
figure d
figure e

Appendix 3: Binning overview on raw data on a specific timestamp

CUT: #create Bins by pandas.cut (binning) [47] specifically define the bin value edges.

figure f

QCUT: create Bins by pandas.qcut (binning) [47] "Quantile-based discretization function" equally sized bins.

figure g

Appendix 4: CUT and QCUT methods for “sunlight” timestamps’ example

CUT method output is depicted on the left side figures, while QCUT method output is depicted on the right-side figures.

figure h
figure i

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Koukaras, P., Tjortjis, C., Gkaidatzis, P. et al. An interdisciplinary approach on efficient virtual microgrid to virtual microgrid energy balancing incorporating data preprocessing techniques. Computing 104, 209–250 (2022). https://doi.org/10.1007/s00607-021-00929-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00607-021-00929-7

Keywords

Mathematics Subject Classification

Search

Navigation