Skip to main content

Advertisement

SpringerLink
Log in

Real-time energy data compression strategy for reducing data traffic based on smart grid AMI networks

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

In the future, the Internet of things (IoT) may provide huge volumes of data. Smart grids are a class of IoT electricity distribution systems that can control bidirectional energy flows between consumers and service providers (Barman et al. “IOT Based Smart Energy Meter for Efficient Energy Utilization in Smart Grid”, 978-1-5386-4769-1 1831.00, 2018 IEEE). A typical smart grid features an advanced metering infrastructure (AMI), which automatically collects meter data from widely distributed sensors. A utility company that intends to use AMI must deploy smart meters, data concentrator units, and a meter data management system (MDMS). Concentrators collect ubiquitous messages from smart meters and transmit aggregated data to their MDMS. Although ubiquitous messages may enhance the efficiency of some electricity grids, any excessive volume of messages causes data congestion. This research considers the Reference Energy Disaggregation Data Set. Our proposed algorithm can compress meter data efficiently. Our contributions are as follows: First, thus far, numerous researchers have attempted to address smart grid problems with AMI systems, and here, we provide a relatively complete review of these attempts. Second, this paper presents a strategy to analyze this problem and propose a compression algorithm to compress meter data. This proposed algorithm combines several existing compression algorithms and operates from 2 to 10% more efficiently than previously published algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Alahakoon D, Yu X (2016) Smart electricity meter data intelligence for future energy systems: a survey. IEEE Trans Ind Inf 12(1):425–436. https://doi.org/10.1109/TII.2015.2414355

    Article  Google Scholar 

  2. Allalouf M, Gershinsky G, Lewin-Eytan L, Naor J (2014) Smart grid network optimization: data-quality-aware volume reduction. IEEE Syst J 8(2):450–460. https://doi.org/10.1109/JSYST.2013.2249331

    Article  Google Scholar 

  3. Ricci A, Faberi S, Brizard N, Bougnoux B, Degel M, Velte D, Garcia E (2012) The techno-scientific developments of smart grids and the related political, societal and economic implications in Europe. In: STOA - Science and Technology Options Assessment, PE 488.797

  4. Barman BK, Yadav SN, Kumar S, Gope S (2018) IOT based smart energy meter for efficient energy utilization in smart grid. In: 2018 2nd International Conference on Power, Energy and Environment: Towards Smart Technology (ICEPE), Shillong, India, pp 1–5. https://doi.org/10.1109/EPETSG.2018.8658501

  5. Barr KC, Asanović K (2006) Energy-aware lossless data compression. In: ACM Transactions on Computer Systems, pp 250–291. https://doi.org/10.1145/1151690.1151692

  6. The Association of Edison Illuminating Companies (2012) SmartGrid/AEIC AMI interoperability standard guidelines for ANSI C12.19 / IEEE 1377 / MC12.19 end device communications and supporting enterprise devices, Networks and Related Accessories, pp 1–85

  7. Choi K, Chae K (2014) Data aggregation using temporal and spatial correlations in Advanced Metering Infrastructure. In: The International Conference on Information Networking 2014 (ICOIN2014), Phuket, pp 541–544. https://doi.org/10.1109/ICOIN.2014.6799740

  8. Erol-Kantarci M, Mouftah HT (2015) Energy-efficient information and communication infrastructures in the smart grid: a survey on interactions and open issues. IEEE Commun Surv Tutor 17(1):179–197. https://doi.org/10.1109/COMST.2014.2341600

    Article  Google Scholar 

  9. Fadlulah ZMD, Fouda MM, Kato N, Takeuchi A, Kwasaki N, Nozaki Y (2011) Toward intelligent machine-to-machine communications in smart grid. IEEE Commun Mag 49(4):60–65. https://doi.org/10.1109/MCOM.2011.5741147

    Article  Google Scholar 

  10. Fang X, Misra S, Xue G, Yangand D (2012) Smart grid-the new and improved power grid: a survey. IEEE Commun Surv Tutor 14(4):944–980. https://doi.org/10.1109/SURV.2011.101911.00087

    Article  Google Scholar 

  11. Cagri Gungor V, Sahin D, Kocak T, Ergut S, Buccella C, Cecati C, Hancke GP (2013) A survey on smart grid potential applications and communication requirements. IEEE Trans Industr Inf 9(1):28–42. https://doi.org/10.1109/TII.2012.2218253

    Article  Google Scholar 

  12. Kaplan SM (2009) Electric power transmission: background and policy issues. In: Congressional Research Service, pp 1–42

  13. Karimi B, Namboodiri V, Jadliwala M (2015) Scalable meter data collection in smart grids through message concatenation. IEEE Trans Smart Grid Commun 6(4):1697–1706. https://doi.org/10.1109/TSG.2015.2426020

    Article  Google Scholar 

  14. Karimi B, Namboodiri V, Jadliwala M (2013) On the scalable collection of metering data in smart grids through message concatenation. In: 2013 IEEE International Conference on Smart Grid Communications (SmartGridComm), Vancouver, BC, pp 318–323. https://doi.org/10.1109/SmartGridComm.2013.6687977

  15. Kolter JZ, Johnson MJ (2011) REDD: a public data set for energy disaggregation research. In: Proceedings of the SustKDD workshop on Data Mining Applications in Sustainability

  16. Li H, Han Z, Lai L, Qiu R, Yang D (2011) Efficient and reliable multiple access for advanced metering in future smart grid. In: 2011 IEEE International Conference on Smart Grid Communications (SmartGridComm), Brussels, pp 440–444. https://doi.org/10.1109/SmartGridComm.2011.6102363

  17. Lo YL, Huang SC, Lu CN (2014) Transformational benefits of AMI data in transformer load modeling and management. IEEE Trans Power Delivery 29(2):742–750. https://doi.org/10.1109/TPWRD.2013.2280574

    Article  Google Scholar 

  18. Luan W, Sharp D, Landcashire S (2010) Smart grid communication network capacity planning for power utilities. In: IEEE PES T&D 2010, New Orleans, LA, pp 1–4. https://doi.org/10.1109/TDC.2010.5484223

  19. Ma R, Chen H-H, Huang Y-R, Meng W (2013) Smart grid communication: its challenges and opportunities. IEEE Trans Smart Grid 4(1):36–46. https://doi.org/10.1109/TSG.2012.2225851

    Article  Google Scholar 

  20. Prakash P (2013) Data concentrators: the core of energy and data management. In: Texas Instruments, pp 1–7

  21. Queen EE (2011) A discussion of smart meters and RF exposure issues. In: A Joint Project of the EEI and AEIC Meter Committee, pp 1–23

  22. Ringwelski M, Renner C, Reinhardt A, Weigel A, Turau V (2012) The Hitchhiker's guide to choosing the compression algorithm for your smart meter data. In: 2012 IEEE International Energy Conference and Exhibition (ENERGYCON), Florence, pp 935–940. https://doi.org/10.1109/EnergyCon.2012.6348285

  23. Tariq ZB, Arshad N, Nabeel M (2015) Enhanced LZMA and BZIP2 for improved energy data compression. In: 2015 International Conference on Smart Cities and Green ICT Systems (SMARTGREENS), Lisbon, pp 1–8

  24. Ye Y, Yi Q, Hamid S, David T (2018) A survey on smart grid communication infrastructures: motivations, requirements, and challenges. IEEE Commun Surv Tutor 15(1):5–20. https://doi.org/10.1109/SURV.2012.021312.00034

    Article  Google Scholar 

  25. Zhou J, Qingyang Hu R, Qian Y (2012) Scalable distributed communication architectures to support advanced metering infrastructure in smart grid. IEEE Trans Parallel Distrib Syst 23(9):1632–1642. https://doi.org/10.1109/TPDS.2012.53

    Article  Google Scholar 

  26. Zhou X, Ma Y, Gao Z, Wang H (2017) Summary of smart metering and smart grid communication. In: 2017 IEEE International Conference on Mechatronics and Automation (ICMA), Takamatsu, pp 300–304. https://doi.org/10.1109/ICMA.2017.8015832

Download references

Acknowledgements

The authors would like to thank Mr. Chin-Wei Hsu for his proof-reading and help in improving the quality of this paper.

Author information

Authors and Affiliations

  1. National Cheng Kung University, No. 1, University Road, Tainan 701, Taiwan, Republic of China

    Jie-Fu Huang, Geng-Hua Zhang & Sun-Yuan Hsieh

Authors
  1. Jie-Fu Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Geng-Hua Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sun-Yuan Hsieh
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sun-Yuan Hsieh.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Huang, JF., Zhang, GH. & Hsieh, SY. Real-time energy data compression strategy for reducing data traffic based on smart grid AMI networks. J Supercomput 77, 10097–10116 (2021). https://doi.org/10.1007/s11227-020-03557-8

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-020-03557-8

Keywords

Search

Navigation