Skip to main content
SpringerLink
Log in

Evaluating Distributed Systems and Applications Through Accurate Models and Simulations

  • Chapter
  • First Online:
Modeling and Simulation in HPC and Cloud Systems

Part of the book series: Studies in Big Data ((SBD,volume 36))

  • 762 Accesses

Abstract

Evaluating the performance of distributed applications can be performed by in situ deployment on real-life platforms. However, this technique requires effort in terms of time allocated to configure both application and platform, execution time of tests, and analysis of results. Alternatively, users can evaluate their applications by running them on simulators on multiple scenarios. This provides a fast and reliable method for testing the application and platform on which it is executed. However, the accuracy of the results depend on the cross-layer models used by the simulators. In this chapter we investigate some of the existing models for representing both applications and the underlying distributed platform and infrastructure. We focus our presentation on the popular SimGrid simulator. We emphasize some best practices and conclude with few control questions and problems.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Full documentation available at: http://simgrid.gforge.inria.fr/simgrid/3.12/doc/platform.html.

References

  1. Martin, Q., et al.: Simgrid 101: Getting started to the simgrid project (Jan 2015). http://simgrid.gforge.inria.fr/tutorials/simgrid-101.pdf

  2. Simgrid Models. Getting started with simgrid models (2016). http://simgrid.gforge.inria.fr/tutorials/surf-101.pdf

  3. Casanova, H., Giersch, A., Legrand, A., Quinson, M., Suter, F.: Versatile, scalable, and accurate simulation of distributed applications and platforms. J. Parallel Distrib. Comput. 74(10), 2899–2917 (2014)

    Article  Google Scholar 

  4. Julien, G., et al.: Iaas simulation upon simgrid (2015). http://schiaas.gforge.inria.fr/

  5. NIST. Cloud computing (2016). https://www.nist.gov/itl/cloud-computing

  6. Calheiros, R.N., Ranjan, R., Beloglazov, A., De Rose, C.A.F., Buyya, R.: Cloudsim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw. Pract. Exper. 41(1), 23–50 (2011)

    Article  Google Scholar 

  7. Núñez, A., Vázquez-Poletti, J.L., Caminero, A.C., Castañé, G.G., Carretero, J., Llorente, I.M.: icancloud: a flexible and scalable cloud infrastructure simulator. J. Grid Comput. 10(1), 185–209 (2012)

    Article  Google Scholar 

  8. Gupta, H., Vahid Dastjerdi, A., Ghosh, S.K., Buyya, R.: ifogsim: a toolkit for modeling and simulation of resource management techniques in internet of things, edge and fog computing environments. CoRR, abs/1606.02007 (2016)

    Google Scholar 

  9. Ahmed, A., Sabyasachi, A.S.: Cloud computing simulators: a detailed survey and future direction (Feb 2014)

    Google Scholar 

  10. Sharkh, M.A., Kanso, A., Shami, A., Öhlén, P.: Building a cloud on earth: a study of cloud computing data center simulators. Comput. Netw. 108, 78–96 (2016)

    Article  Google Scholar 

  11. Wickremasinghe, B., Calheiros, R.N., Buyya, R.: Cloudanalyst: a cloudsim-based visual modeller for analysing cloud computing environments and applications. In: 2010 24th IEEE International Conference on Advanced Information Networking and Applications, pp. 446–452 (Apr 2010)

    Google Scholar 

  12. Samimi, P., Teimouri, Y., Mukhtar, M.: A combinatorial double auction resource allocation model in cloud computing. Inf. Sci. 357, 201–216 (2016)

    Article  Google Scholar 

  13. Sá, T.T., Calheiros, R.N., Gomes, D.G.: CloudReports: An Extensible Simulation Tool for Energy-Aware Cloud Computing Environments, pp. 127–142. Springer International Publishing, Cham (2014)

    Google Scholar 

  14. Simgrid Cloud. Virtualization/cloud abstractions in simgrid (2016). http://simgrid.gforge.inria.fr/contrib/clouds-sg-doc.php

  15. Frîncu, M.E., Genaud, S., Gossa, J.: Client-side resource management on the cloud: survey and future directions. IJCC 4(3), 234–257 (2015)

    Article  Google Scholar 

  16. Hunold, S., Casanova, H., Suter, F.: From simulation to experiment: a case study on multiprocessor task scheduling. In: 2011 IEEE International Symposium on Parallel and Distributed Processing Workshops and Phd Forum (IPDPSW), pp. 665–672 (2011)

    Google Scholar 

  17. Ghorbanzadeh, M., Abdelhadi, A., Clancy, C.: Delay-Based Backhaul Modeling, pp. 179–240 (2017)

    Google Scholar 

  18. Riley, G.F.: Large-scale network simulations with gtnets. In: Simulation Conference, 2003. Proceedings of the 2003 Winter, vol. 1, pp. 676–684 (2003)

    Google Scholar 

  19. ISI. The network simulator (Nov 2016). http://www.isi.edu/nsnam/ns/

  20. Hirofuchi, T., Lebre, A., Pouilloux, L.: Simgrid vm: virtual machine support for a simulation framework of distributed systems. IEEE Trans. Cloud Comput. (99):1–1 (2015)

    Google Scholar 

  21. Shah, S.A.R., Jaikar, A.H., Noh, S.Y.: A performance analysis of precopy, postcopy and hybrid live vm migration algorithms in scientific cloud computing environment. In: 2015 International Conference on High Performance Computing Simulation (HPCS), pp. 229–236 (2015)

    Google Scholar 

  22. Feitelson, D.G.: Workload Modeling for Computer Systems Performance Evaluation. Cambridge University Press, Cambridge (2015)

    Book  MATH  Google Scholar 

  23. Lo, V., Mache, J., Windisch, K.: A Comparative Study of Real Workload Traces and Synthetic Workload Models for Parallel Job Scheduling, pp. 25–46. Springer, Berlin (1998)

    Google Scholar 

  24. Urdaneta, G., Pierre, G., van Steen, M.: Wikipedia workload analysis for decentralized hosting. Elsevier Comput. Netw. 53(11), 1830–1845 (2009)

    Article  Google Scholar 

  25. Google. Google traces (2016). https://github.com/google/cluster-data

  26. Feitelson, D.: Parallel workload archive (2016). http://www.cs.huji.ac.il/labs/parallel/workload/

  27. Iosup, A., et al.: Grid workload archive (2016). http://gwa.ewi.tudelft.nl/

Download references

Acknowledgements

This chapter is based upon work from COST Action IC1406 High-Performance Modelling and Simulation for Big Data Applications (cHiPSet), supported by COST (European Cooperation in Science and Technology).

Additionally, the first author has been invited as a trainer to the cHiPSet training school “New trends in modeling and simulation in HPC system” held in Bucharest in September 21–23, 2016 and has been supported by the IC1406 Horizon 2020 grant. His work has also been partially funded by a grant of the Romanian National Authority for Scientific Research and Innovation, CNCS/CCCDI - UEFISCDI, project number PN-III-P3-3.6-H2020-2016-0005, within PNCDI III. The work of the second author has been partially funded by the EU H2020 VI-SEEM project under contract no. 675121. The work of the third and forth authors has been partially funded by the EU H2020 CloudLightning project under grant no. 643946.

Author information

Authors and Affiliations

  1. West University of Timisoara, Timisoara, Romania

    Marc Frincu, Bogdan Irimie & Anca Vulpe

  2. Austria Research Institute, Timisoara, Romania

    Teodora Selea & Adrian Spataru

Authors
  1. Marc Frincu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bogdan Irimie
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Teodora Selea
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Adrian Spataru
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Anca Vulpe
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Marc Frincu .

Editor information

Editors and Affiliations

  1. Institute of Computer Science, Cracow University of Technology, Cracow, Poland

    Joanna Kołodziej

  2. Department of Computer Science, University Politehnica of Bucharest, Bucharest, Romania

    Florin Pop

  3. Department of Computer Science, University Politehnica of Bucharest, Bucharest, Romania

    Ciprian Dobre

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Frincu, M., Irimie, B., Selea, T., Spataru, A., Vulpe, A. (2018). Evaluating Distributed Systems and Applications Through Accurate Models and Simulations. In: Kołodziej, J., Pop, F., Dobre, C. (eds) Modeling and Simulation in HPC and Cloud Systems. Studies in Big Data, vol 36. Springer, Cham. https://doi.org/10.1007/978-3-319-73767-6_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-73767-6_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-73766-9

  • Online ISBN: 978-3-319-73767-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation