Skip to main content
SpringerLink
Log in

A queuing theory model for cloud computing

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

The ability to deliver guaranteed QoS (Quality of Service) is crucial for the commercial success of cloud platforms. This paper presents a model based on queuing theory to study computer service QoS in cloud computing. Cloud platforms are modeled with an open Jackson network that can be used to determine and measure the QoS guarantees the cloud can offer regarding the response time. The analysis can be performed according to different parameters, such as the arrival rate of customer services and the number and service rate of processing servers, among others. Detailed results for the model are presented. When scaling the system and depending on the types of bottleneck in the system, we show how our model can provide us with the best option to guarantee QoS. The results obtained confirm the usefulness of the model presented for designing real cloud computing systems.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. Sage. http://www.sagemath.org.

  2. OpenStack. http://www.openstack.org.

  3. VirtualBox. https://www.virtualbox.org.

  4. Xen. http://www.xenproject.org.

  5. VMware. http://www.vmware.com.

  6. MySQL. http://www.mysql.com.

References

  1. Vaquero LM, Rodero-Merino L, Caceres J, Lindner M (2008) A break in the clouds: towards a cloud definition. ACM SIGCOMM Comput Commun Rev 39:50–55

    Article  Google Scholar 

  2. Xiong K, Perros H (2009) Service performance and analysis in cloud computing. In: Proceedings of IEEE World Conference Services, pp 693–700

  3. Varia J (2010) Architection for the cloud: best practices. Amazon Web Services

  4. Khazaei H, Misic J, Misic V (2012) Performance analysis of cloud computing centers using M/G/m/m+r.Queuing Systems. IEEE transactions on parallel and distributed systems, vol 23, no 5

  5. Armbrust M, Fox A, Griffith R, Joseph AD, Katz R, Konwinski A, Lee G, Patterson D, Rabkin A, Stoica I, Zaharia M (2010) A view of cloud computing. Commun ACM 53(4):50–58

    Article  Google Scholar 

  6. Martin J, Nilsson A (2002) On service level agreements for IP networks. In: Proceedings of the IEEE INFOCOM

  7. Jackson JR (1957) Networks of waiting lines. Oper Res 5:518–521

    Article  Google Scholar 

  8. Jackson JR (1963) Jobshop-like queueing systems. Manage Sci 10:131–142

    Article  Google Scholar 

  9. Martinello M, Kaâniche M, Kanoun K (2005) Web service availability: impact of error recovery and traffic model. J Reliab Eng Syst Saf 89(1):6–16

    Article  Google Scholar 

  10. Beloglazov A, Buyya R (2012) Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in Cloud data centers. Concurr Comput Pract Exp 24(13):1397–1420

    Article  Google Scholar 

  11. Iosup A, Yigitbasi N, Epema D (2011) On the performance variability of production cloud services. 11th IEEE/ACM international symposium on cluster, cloud and grid, computing (CCGrid’2011), pp 104–113

  12. Vishwanath KV, Nagappan N (2010) Characterizing cloud computing hardware reliability. In: Proceedings of the 1st ACM symposium on Cloud computing (SoCC ’10), pp 193–204

  13. Slothouber L (1996) A model of web server performance. In: Proceedings of the fifth international world wide web conference

  14. Yang B, Tan F, Dai Y, Guo S (2009) Performance Evaluation of cloud service considering fault recovery. In: Proceedings of the first international conference on cloud, computing (CloudCom’09), pp 571–576

  15. Ma N, Mark J (1998) Approximation of the mean queue length of an M/G/c queueing system. Oper Res 43:158–165

    Article  MathSciNet  Google Scholar 

  16. Karlapudi H, Martin J (2004) Web application performance prediction. In: Proceedings of the IASTED international conference on communication and computer networks, pp 281–286

  17. Mei RD, Meeuwissen HB (2005) Modelling end-to-end Quality-of-Service for transaction-based services in multidomain environement. In: Proceedings of the 19th international teletraffic congress (ITC19), pp 1109–1121

  18. Boxma OJ, Cohen JW, Huffel N (1979) Approximations of the Mean waiting time in an M=G=s queueing system. Oper Res 27:1115–1127

    Article  MATH  Google Scholar 

  19. Vilaplana J, Solsona F, Abella F, Filgueira R, Rius J (2013) The cloud paradigm applied to e-health. BMC Med Inf Decis Making 13:35

    Article  Google Scholar 

  20. Burke PJ (1956) The output of a queuing system. Oper Res 4:699–704

    Article  MathSciNet  Google Scholar 

  21. Mao M, Li J, Humphrey M (2010) Cloud auto-scaling with deadline and budget constraints. In: Proceedings of the 11th IEEE/ACM international conference on GRID, pp 41–48

  22. Nah F (2004) A study on tolerable waiting time: how long are Web users willing to wait? Behav Inf Technol 23(3):153–163

    Article  Google Scholar 

  23. Sai Sowjanya T, Praveen D, Satish K, Rahiman A (2011) The queueing theory in cloud computing to reduce the waiting time. IJCSET, vol 1, no 3, pp 110–112

  24. Kleinrock L (1975) Queueing systems: theory, vol 1. Wiley-Interscience, New York

    MATH  Google Scholar 

  25. Barbeau M, Kranakis E (2007) Principles of ad-hoc networking. Wiley, New York

    Book  Google Scholar 

  26. Apache JMeter website. http://jmeter.apache.org/. Accessed 10 March 2014

Download references

Acknowledgments

This work was supported by the MEyC under contract TIN2011-28689-C02-02. Some of the authors are members of the research group 2009 SGR145, funded by the Generalitat de Catalunya.

Author information

Authors and Affiliations

  1. Department of Computer Science, University of Lleida, Jaume II 69, 25001 , Lleida, Spain

    Jordi Vilaplana, Francesc Solsona, Ivan Teixidó & Jordi Mateo

  2. IRB Lleida, Avda Alcalde Rovira Roure 80, 25198 , Lleida, Spain

    Francesc Abella

  3. ICG Software, Pol. Industrial Torrefarrera. Mestral, s/n, Torrefarrera, 25123 , Lleida, Spain

    Josep Rius

Authors
  1. Jordi Vilaplana
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Francesc Solsona
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ivan Teixidó
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jordi Mateo
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Francesc Abella
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Josep Rius
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Francesc Solsona.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Vilaplana, J., Solsona, F., Teixidó, I. et al. A queuing theory model for cloud computing. J Supercomput 69, 492–507 (2014). https://doi.org/10.1007/s11227-014-1177-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-014-1177-y

Keywords

Search

Navigation