Skip to main content

Datacentre Event Analysis for Knowledge Discovery in Large-Scale Cloud Environments

  • Chapter
  • First Online:
Cloud Computing

Part of the book series: Computer Communications and Networks ((CCN))

  • 7123 Accesses

Abstract

Cloud Computing paradigm is increasingly being adopted for various business needs, and improving the quality of Cloud services has naturally become essential for the providers to stay competitive. The characteristics of Cloud-based workloads are still not perfectly clear, and the extensive level of heterogeneity among both the Cloud workloads and the server resources imposes various levels of intrinsic and extrinsic complexities in achieving efficient datacentre management. To this end, this chapter conducts extensive analysis on a real-world datacentre execution trace, with the motivation of exhibiting the inherent knowledge among the workload behaviours and server usage patterns in a large-scale datacentre environment for the scope of decision making in Cloud datacentre management. The analysis presented in this chapter is conducted by subjecting the workload behaviours with various periodical effects. The sever usage patterns are analysed by dwelling into their usage frequencies for scheduling the incoming jobs. The analysis presented in this paper is believed to provide sufficient knowledge to the Cloud providers for achieving efficient datacentre management, and further the inferences obtained in this analysis find applications in workload behaviour modelling and prediction analytics in Cloud datacentres.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Alam M, Shakil KA, Sethi S (2015) Analysis and clustering of workloads in Google Cluster trace based on resource usage. Cornell University

    Google Scholar 

  2. Garraghan P, Moreno IS, Townend P, Xu J (2014) An analysis of failure-related energy waste in a large-scale cloud environment. IEEE Trans Emerg Top Comput 2:166–180

    Google Scholar 

  3. Garraghan P, Townend P, Xu J (2013) An analysis of the server characteristics and Resource utilization in Google cloud. In: International Conference on Cloud Engineering. IEEE, Redwood City

    Google Scholar 

  4. Google (2011) Google Cluster data V2 [Online]. Google. Available: https://github.com/google/clusterdata/blob/master/ClusterData2011_2.md

  5. Jing S-Y, Ali S, She K, Zhong Y (2013) State-of-the-art research study for green cloud computing. J Supercomput 65:445–468

    Article  Google Scholar 

  6. Khan A, Yan X, Tao S, Anerousis N (2012) Workload characterization and prediction in the cloud: a multiple time series approach. In: IEEE network operations and management symposium. IEEE, Maui

    Google Scholar 

  7. Liu Z, Cho S (2012) Characterizing machines and workloads on a Google cluster. In: 41st international conference on parallel processing workshops. IEEE, Pittsburgh

    Google Scholar 

  8. Mahambre S, Kulkarni P, Bellur U, Chafle G, Deshpande D (2012) Workload characterization for capacity planning and performance management in IaaS cloud. In: International conference on cloud computing in emerging markets (CCEM). IEEE, Bangalore

    Google Scholar 

  9. Moreno IS, Garraghan P, Townend P, Xu J (2013) An approach for characterizing workloads in Google cloud to derive realistic resource utilization models. In: 7th international symposium on service oriented system engineering (SOSE). IEEE, Redwood City

    Google Scholar 

  10. Moreno IS, Garraghan P, Townend P, Xu J (2014) Analysis Modelling and simulation of workload patterns in a large scale utility cloud. IEEE Trans Cloud Comput 2:208–221

    Article  Google Scholar 

  11. Panneerselvam J, Liu L, Antonopoulos N, Trovati M (2016) Latency-aware empirical analysis of the workloads for reducing excess energy consumptions at cloud datacentres. In: IEEE symposium on service-oriented system engineering (SOSE). IEEE, Oxford

    Google Scholar 

  12. Patel J, Jindal V, Yen I-L, Bastani F, Xu J, Garraghan P (2015) Workload estimation for improving resource management decisions in the cloud. In: Twelfth international symposium on autonomous decentralized systems. IEEE, Taichung

    Google Scholar 

  13. Reiss C, Tumanov A, Ganger GR, Katz RH, Kozuchi MA (2012) Towards understanding heterogeneous clouds at scale: Google trace analysis. Intel Science and Technology Center for Cloud Computing, Pittsburgh

    Google Scholar 

  14. Wang T, Wei J, Zhang W, Zhong H, Huang T (2014) Workload-aware anomaly detection for web applications. J Syst Softw 89:19–32

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to John Panneerselvam .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this chapter

Cite this chapter

Panneerselvam, J., Liu, L., Lu, Y. (2017). Datacentre Event Analysis for Knowledge Discovery in Large-Scale Cloud Environments. In: Antonopoulos, N., Gillam, L. (eds) Cloud Computing. Computer Communications and Networks. Springer, Cham. https://doi.org/10.1007/978-3-319-54645-2_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-54645-2_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-54644-5

  • Online ISBN: 978-3-319-54645-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics