skip to main content
research-article

Integrating I/Os in Cloudsim for Performance and Energy Estimation

Authors Info & Claims
Published:30 January 2017Publication History
Skip Abstract Section

Abstract

This article presents an extension of the IaaS Cloud simulator CloudSim. This extension takes into account the processing of i/o workload generated by virtual machines within a data center, and evaluates the overall performance and energy consumption. Indeed, according to state-of-the-art mstudies, storage systems energy consumption may account for as much as 40% in a data center. So, we modified the time computation model of CloudSim to consider i/o operations. Additionally, we designed several models of storage system devices including Hard Disk Drives and Solid-State Drives. We also modeled cpu utilization to compute the energy consumptions related to i/o request processing. This was achieved through machine learning techniques. Our storage system extensions have been evaluated using video encoding traces. The simulation results show that a significant amount of energy, around 25%, is consumed due to i/o workload execution. This corroborates the soundness of our CloudSim extensions.

References

  1. Aaron carroll: fio. http://linux.die.net/man/1/_o. Acces in Aug 2016.Google ScholarGoogle Scholar
  2. Hamza ouarnoughi: evaluation tools. https://github.com/Houarnoughi/sigops osr tools. Acces in Sep 2016.Google ScholarGoogle Scholar
  3. HTTP live streaming overview. https://developer.apple.com/library/mac/documentation/NetworkingInternet/Conceptual/StreamingMediaGuide/UsingHTTPLiveStreaming/ UsingHTTPLiveStreaming.html. Accessed in Apr 2016.Google ScholarGoogle Scholar
  4. Jason rudy: py-earth project. https://github.com/jcrudy/py-earth. Accessed in Aug 2016.Google ScholarGoogle Scholar
  5. Libreoffice calc: Linest function. https://help.libreo_ce.org/Calc/Array Functions/fr# Other LINEST Results:. Access in Aug 2016.Google ScholarGoogle Scholar
  6. Ms excel: Linest function. https://support.office.com/en-us/article/LINEST-function-84d7d0d9-6e50-4101-977a-fa7abf772b6d. Acces in Aug 2016.Google ScholarGoogle Scholar
  7. Scikit-learn. http://scikit-learn.org. Acces in Aug 2016.Google ScholarGoogle Scholar
  8. I. Apple Computer. Quicktime file format. Technical report, www.apple.com, 2001.Google ScholarGoogle Scholar
  9. A. Beloglazov, J. Abawajy, and R. Buyya. Energy-aware resource allocation heuristics for efficient management of data centers for cloud computing. Future Generation Computer System, 28, May 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. R. Bianchini and R. Rajamony. Power and energy management for server systems. Computer, 37, Nov. 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. R. N. Calheiros, R. Ranjan, A. Beloglazov, C. A. F. De Rose, and R. Buyya. Cloudsim: A toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Software: Practice & Experience, 41, Jan. 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. J. H. Friedman. Multivariate adaptive regression splines. The annals of statistics, pages 1{67, 1991.Google ScholarGoogle Scholar
  13. G. Gasior. Maxtor's diamondmax 10 hard drive. Technical report, Seagate, Accessed in Jan 2016.Google ScholarGoogle Scholar
  14. G. H. Golub, M. Heath, and G. Wahba. Generalized cross-validation as a method for choosing a good ridge parameter. Technometrics, 21(2):215{223, 1979.Google ScholarGoogle ScholarCross RefCross Ref
  15. N. Grozev and R. Buyya. Multi-cloud provisioning and load distribution for three-tier applications. ACM Transactions on Autonomous and Adaptive Systems, 9, Oct. 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. A. Gulati, C. Kumar, and I. Ahmad. Modeling workloads and devices for io load balancing in virtualized environments. SIGMETRICS Perform. Eval. Rev., 37, Jan. 2010.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. J. Hamilton. Cost of power in large-scale data centers. Technical report, perspectives.mvdirona.com, Accessed in Apr 2008.Google ScholarGoogle Scholar
  18. A. Irfan. Easy and efficient disk i/o workload characterization in vmware esx server. In IEEE 10th International Symposium on Workload Characterization, Sept 2007.Google ScholarGoogle Scholar
  19. A. Lebre, A. Legrand, F. Suter, and P. Veyre. Adding Storage Simulation Capacities to the SimGrid Toolkit: Concepts, Models, and API. In Proceedings of the 15th IEEE/ACM Symposium on Cluster, Cloud and Grid Computing, 2015. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Z. Li, K. M. Greenan, A. W. Leung, and E. Zadok. Power consumption in enterprise-scale backup storage systems. In Proceedings of the Tenth USENIX Conference on File and Storage Technologies, February 2012.Google ScholarGoogle Scholar
  21. S. Long and Y. Zhao. A toolkit for modeling and simulating cloud data storage: An extension to cloudsim. In International Conference on Control Engineering and Communication Technology, Liaoning, China, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. B. Louis, K. Mitra, S. Saguna, and C. Ahlund. Cloudsimdisk: Energy-aware storage simulation in cloudsim. In IEEE/ACM International Conference on Utility and Cloud Computing, 2015.Google ScholarGoogle ScholarCross RefCross Ref
  23. Z. A. Mann. Allocation of virtual machines in cloud data centers— a survey of problem models and optimization algorithms. ACM Computing Surveys, 48, Aug. 2015.Google ScholarGoogle Scholar
  24. M. Mesnier, G. R. Ganger, and E. Riedel. Object-based storage. IEEE Communications Magazine, 41, Aug. 2003.Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. H. Ouarnoughi, J. Boukhobza, F. Singho_, and S. Rubini. A multi-level I/O tracer for timing and performance storage systems in iaas cloud. In 3rd IEEE International Workshop on Real-time and distributed computing in emerging applications, 2014.Google ScholarGoogle Scholar
  26. H. Ouarnoughi, J. Boukhobza, F. Singho_, and S. Rubini. A cost model for virtual machine storage in cloud iaas context. In 24th Euromicro International Conference on Parallel, Distributed, and Network-Based Processing, 2016.Google ScholarGoogle ScholarCross RefCross Ref
  27. L. Rosasco, E. De Vito, A. Caponnetto, M. Piana, and A. Verri. Are loss functions all the same? Neural Computation, 16(5):1063{1076, 2004.Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. D. Ruiu. An overview of mpeg-2. Technical report, hewlett packard, 1997.Google ScholarGoogle Scholar
  29. Seagate. Barracuda st1000dm003. Technical report, http://www.seagate.com, Accessed in Mar 2016.Google ScholarGoogle Scholar
  30. T. Sturm, F. Jrad, and A. Streit. Storage cloudsim - A simulation environment for cloud object storage infrastructures. In Proceedings of the 4th International Conference on Cloud Computing and Services Science, 2014.Google ScholarGoogle Scholar

Index Terms

  1. Integrating I/Os in Cloudsim for Performance and Energy Estimation
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          Full Access

          • Published in

            cover image ACM SIGOPS Operating Systems Review
            ACM SIGOPS Operating Systems Review  Volume 50, Issue 2
            Special Topics
            December 2016
            45 pages
            ISSN:0163-5980
            DOI:10.1145/3041710
            Issue’s Table of Contents

            Copyright © 2017 Copyright is held by the owner/author(s)

            Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 30 January 2017

            Check for updates

            Qualifiers

            • research-article

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader