Skip to main content

A Data Streams Analysis Strategy Based on Hadoop Scheduling Optimization for Smart Grid Application

  • Conference paper
  • First Online:
Frontiers in Algorithmics (FAW 2015)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 9130))

Included in the following conference series:

Abstract

The massive data streams analysis in the Smart Grids data processing system is very important, especially in the high-concurrent read and write environments where supporting the massive real-time streaming data storage and management. The computational and stored requirements for Smart Grids can be met by utilizing the Cloud computing. In order to support the robust, affordable and reliable power streaming data analysis and storage, in this paper, we propose a power data streams analysis strategy based on Hadoop scheduling optimization for smart grid monitoring application. The proposed strategy combined with the flexible resources and services shared in network, omnipresent access and parallel processing features of cloud computing. Finally, the simulation results show that proposed strategy can effectively improve the efficiency of computing resource utilization and achieve the massive information concurrent processing ability.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. McDaniel P., Smith S. W.: Outlook: cloud computing with a chance of security challenges and improvements. In: Proceeding of the IEEE Computer and Reliability Societies, pp. 77–80 (2010)

    Google Scholar 

  2. Wang, Y.Z., Lin, X., Pedram, M.: A stackelberg game-based optimization framework of the smart grid with distributed pv power generations and data centers. IEEE Trans. Energy Convers. 29(4), 978–987 (2014)

    Article  Google Scholar 

  3. Yigit, M., Gungor, V.C., Baktir, S.: Cloud compting for smart grid applications. Comput. Netw. 70, 312–329 (2014)

    Article  Google Scholar 

  4. Chang, S., Nagothu, K., Kelley, B.: A beamforming approach to smart grid systems based on cloud cognitive radio. IEEE Syst. J. 8(2), 461–470 (2014)

    Article  Google Scholar 

  5. Zhang S.B., Ran Y.Y. and Wu X.M. et al.: Electricity cost optimization for data centers in smart grid environment. In: IEEE International Conference on Control and Automation, Taichung, TaiWan, pp. 290–295 (2014)

    Google Scholar 

  6. Markovicn, D.S., Zivkovic, D., Branovic, I., et al.: Smart power grid and cloud computing. Renew. Sustain. Energy Rev. 24, 566–577 (2013)

    Article  Google Scholar 

  7. Fortino G., Guerrieri A. and Russo W.: Integration of agent-based and cloud computing for the smart objects-oriented IoT. In: IEEE International Conference on Computer Supported Cooperative Work in Design, Hsinchu, TaiWan, pp. 493–498 (2014)

    Google Scholar 

  8. Rahman, A., Liu, X., Kong, F.X.: A survey on geographic load balancing based data center power management in the smart grid environment. IEEE Commun. Surv. Tutorials 16(1), 214–233 (2014)

    Article  Google Scholar 

  9. Fang, X., Yang, D.J., Xue, G.L.: Evolving smart grid information management cloudward: a cloud optimization perspective. IEEE Trans. Smart Grid 4(1), 111–119 (2013)

    Article  Google Scholar 

  10. Bitzer B., Gebretsadik E. S.: Cloud computing framework for smart grid applications. In: 48th International Universities Power Engineering Conference, Dublin, Ireland, (2013)

    Google Scholar 

  11. Qi, K.Y., Zhao, Z.F., Fang, J., Ma, Q.: Real-time processing for high speed data stream over large scale data. Chin. J. Comput. 35(3), 477–490 (2012)

    Article  Google Scholar 

Download references

Acknowledgment

The research work was supported by the Fundamental Research Funds of the Central University under Grant no. N120323009, the Natural Science Foundation of Hebei Province under Grant No. F2014501055, the Program of Science and Technology Research of Hebei University No. ZD20132003, the Natural Science Foundation of Liaoning Province under Grant No.201202073, and the National Natural Science Foundation of China under Grant No.61403069, No.61473066 and No.61374097.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xin Song .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Zhou, F., Song, X., Han, Y., Gao, J. (2015). A Data Streams Analysis Strategy Based on Hadoop Scheduling Optimization for Smart Grid Application. In: Wang, J., Yap, C. (eds) Frontiers in Algorithmics. FAW 2015. Lecture Notes in Computer Science(), vol 9130. Springer, Cham. https://doi.org/10.1007/978-3-319-19647-3_30

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-19647-3_30

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-19646-6

  • Online ISBN: 978-3-319-19647-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics