Skip to main content
SpringerLink
Log in

Instance launch-time analysis of OpenStack virtualization technologies with control plane network errors

  • Published:
Computing Aims and scope Submit manuscript

Abstract

We analyzed the performance of a multi-node OpenStack cloud amid different types of controlled and self-induced network errors between controller and compute-nodes on the control plane network. These errors included limited bandwidth, delays and packet losses of varying severity. This study compares the effects of network errors on spawning times of batches of instances created using three different virtualization technologies supported by OpenStack, i.e., Docker containers, Linux containers and KVM virtual machines. We identified minimum/maximum thresholds for bandwidth, delay and packet-loss rates below/beyond which instances fail to launch. To the authors’ best knowledge, this is the first comparative measurement study of its kind on OpenStack. The results will be of particular interest to designers and administrators of distributed OpenStack deployments.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23

Similar content being viewed by others

Notes

  1. OpenStack documentation uses the term instance to refer to a VM. We will use the terms VM and instance interchangeably.

  2. Flavor is the term used in OpenStack documentation to refer to various configurations of VM instances.

References

  1. Akioka S, Muraoka Y (2010) HPC benchmarks on Amazon EC2. In: 2010 IEEE 24th international conference on advanced information networking and applications workshops (WAINA). IEEE, pp 1029–1034

  2. Binnig C, Kossmann D, Kraska T, Loesing S (2009) How is the weather tomorrow?: towards a benchmark for the cloud. In: Proceedings of the second international workshop on testing database systems. ACM, p 9

  3. Cooper BF, Silberstein A, Tam E, Ramakrishnan R, Sears R (2010) Benchmarking cloud serving systems with YCSB. In: Proceedings of the 1st ACM symposium on Cloud computing. ACM, pp 143–154

  4. Costa P, Migliavacca M, Pietzuch P, Wolf AL (2012) Naas: network-as-a-service in the cloud. In: Proceedings of the 2nd USENIX conference on Hot Topics in Management of Internet, Cloud, and Enterprise Networks and Services, Hot-ICE, vol 12, p 1

  5. Erickson D (2012) Floodlight java based openflow controller. Last accessed, Ago

  6. Erickson D (2013) The beacon openflow controller. In: Proceedings of the second ACM SIGCOMM workshop on Hot topics in software defined networking. ACM, pp 13–18

  7. Feamster N, Rexford J, Zegura E (2013) The road to SDN: an intellectual history of programmable networks

  8. Folkerts E, Alexandrov A, Sachs K, Iosup A, Markl V, Tosun C (2013) Benchmarking in the cloud: what it should, can, and cannot be. In: Selected topics in performance evaluation and benchmarking. Springer, pp 173–188

  9. Garfinkel SL (2007) An evaluation of Amazon’s grid computing services: EC2, S3, and SQS. In: Center for. Citeseer

  10. Google PerfKit tool for cloud benchmarking. http://www.infoworld.com/article/2884196/cloud-computing/google-whips-up-perfkit-tools-to-make-cloud-benchmarking-easier.html

  11. Gude N, Koponen T, Pettit J, Pfaff B, Casado M, McKeown N, Shenker S (2008) NOX: towards an operating system for networks. ACM SIGCOMM Comput Commun Rev 38(3):105–110

    Article  Google Scholar 

  12. Gupta R (2016) Request flow for provisioning instance in openstack. http://ilearnstack.com/2013/04/26/request-flow-for-provisioning-instance-in-openstack.html. Last Accessed May 2016

  13. Handigol N, Heller B, Jeyakumar V, Lantz B, McKeown N (2012) Reproducible network experiments using container-based emulation. In: Proceedings of the 8th international conference on Emerging networking experiments and technologies. ACM, pp 253–264

  14. Hill Z, Li J, Mao M, Ruiz-Alvarez A, Humphrey M (2010) Early observations on the performance of windows azure. In: Proceedings of the 19th ACM international symposium on high performance distributed computing. ACM, pp 367–376

  15. Hubert B (2016) Tc manpage—linux advanced routing & traffic control. http://lartc.org/manpages/tc.txt. Last Accessed 8 Oct 2016

  16. Iosup A, Ostermann S, Yigitbasi MN, Prodan R, Fahringer T, Epema DHJ (2011) Performance analysis of cloud computing services for many-tasks scientific computing. IEEE Trans Parallel Distri Syst 22(6):931–945

    Article  Google Scholar 

  17. Jackson KR, Ramakrishnan L, Muriki K, Canon S, Cholia S, Shalf J, Wasserman HJ, Wright NJ (2010) Performance analysis of high performance computing applications on the Amazon web services cloud. In: 2010 IEEE Second International Conference on Cloud Computing Technology and Science (CloudCom). IEEE, pp 159–168

  18. Koponen T, Casado M, Gude N, Stribling J, Poutievski L, Zhu M, Ramanathan R, Iwata Y, Inoue H, Hama T et al (2010) Onix: a distributed control platform for large-scale production networks. OSDI 10:1–6

    Google Scholar 

  19. Lantz B, Heller B, McKeown N (2010) A network in a laptop: rapid prototyping for software-defined networks. In: Proceedings of the 9th ACM SIGCOMM Workshop on Hot Topics in Networks. ACM, p 19

  20. Li A, Zong X, Kandula S, Yang X, Zhang M (2011) Cloudprophet: towards application performance prediction in cloud. In: ACM SIGCOMM Computer Communication Review, vol 41. ACM, pp 426–427

  21. Luo C, Zhan J, Jia Z, Wang L, Gang L, Zhang L, Cheng-Zhong X, Sun N (2012) Cloudrank-d: benchmarking and ranking cloud computing systems for data processing applications. Front Comput Sci 6(4):347–362

    MathSciNet  Google Scholar 

  22. Malik A, Ahmed J, Qadir J, Ilyas MU (2017) A measurement study of open source SDN layers in openstack under network perturbation. Comput Commun 102:139–149

    Article  Google Scholar 

  23. Mao M, Humphrey M (2012) A performance study on the vm startup time in the cloud. In: 2012 IEEE 5th international conference on cloud computing (CLOUD). IEEE, pp 423–430

  24. Mendonca M, Astuto BN, Nguyen XN, Obraczka K, Turletti T et al (2013) A survey of software-defined networking: past, present, and future of programmable networks

  25. Moreno-Vozmediano R, Montero RS, Llorente IM (2009) Elastic management of cluster-based services in the cloud. In: Proceedings of the 1st workshop on Automated control for datacenters and clouds. ACM, pp 19–24

  26. O’Loughlin J, Gillam L (2013) Towards performance prediction for public infrastructure clouds: an EC2 case study. In: 2013 IEEE 5th International Conference on Cloud Computing Technology and Science (CloudCom), vol 1. IEEE, pp 475–480

  27. OpenStack. Chapter 1. [a]rchitecture. http://docs.openstack.org/juno/install-guide/install/apt/content/choverview.html

  28. Ostermann S, Iosup A, Yigitbasi N, Prodan R, Fahringer T, Epema D (2010) A performance analysis of EC2 cloud computing services for scientific computing. In: Cloud computing. Springer, pp 115–131

  29. Rak M, Aversano G (2012) Benchmarks in the cloud: the mosaic benchmarking framework. In: 2012 14th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC). IEEE, pp 415–422

  30. Rehr JJ, Vila Fernando D, Gardner JP, Svec L, Prange M (2010) Scientific computing in the cloud. Comput Sci Eng 12(3):34–43

    Article  Google Scholar 

  31. Ristenpart T, Tromer E, Shacham H, Savage S (2009) Hey, you, get off of my cloud: exploring information leakage in third-party compute clouds. In: Proceedings of the 16th ACM conference on Computer and communications security. ACM, pp 199–212

  32. Russell B (2015) Passive benchmarking with docker LXC, KVM & OpenStack

  33. Schad J, Dittrich J, Quiané-Ruiz J-A (2010) Runtime measurements in the cloud: observing, analyzing, and reducing variance. Proc VLDB Endow 3(1–2):460–471

    Article  Google Scholar 

  34. Sefraoui O, Aissaoui M, Eleuldj M (2012) Openstack: toward an open-source solution for cloud computing. Int J Comput Appl 55:38–42

    Google Scholar 

  35. Sobel W, Subramanyam S, Sucharitakul A, Nguyen J, Wong H, Klepchukov A, Patil , Fox A, Patterson D (2008) Cloudstone: multi-platform, multi-language benchmark and measurement tools for web 2.0. In: Proc. of CCA, vol 8

  36. Steinmetz D, Perrault BW, Nordeen R, Wilson J, Wang X (2012) Cloud computing performance benchmarking and virtual machine launch time. In: Proceedings of the 13th annual conference on Information technology education. ACM, pp 89–90

  37. Tseitlin A (2013) The antifragile organization. Commun ACM 56(8):40–44

    Article  Google Scholar 

  38. Wu Z, Xu Z, Wang H (2012) Whispers in the hyper-space: high-speed covert channel attacks in the cloud. In: Presented as part of the 21st USENIX Security Symposium (USENIX Security 12), pp 159–173

  39. Xu Y, Bailey M, Jahanian F, Joshi K, Hiltunen M, Schlichting R (2011) An exploration of L2 cache covert channels in virtualized environments. In: Proceedings of the 3rd ACM workshop on Cloud computing security workshop. ACM, pp 29–40

  40. Yigitbasi N, Iosup A, Epema D, Ostermann S (2009) C-meter: a framework for performance analysis of computing clouds. In: Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid. IEEE Computer Society, pp 472–477

Download references

Author information

Authors and Affiliations

  1. Department of Electrical Engineering, School of Electrical Engineering and Computer Science (SEECS), National University of Sciences and Technology (NUST), Islamabad, 44000, Pakistan

    Jawad Ahmed, Aqsa Malik & Muhammad U. Ilyas

  2. Department of Computer Science, Faculty of Computing and Information Technology, University of Jeddah, Jeddah, Saudi Arabia

    Muhammad U. Ilyas & Jalal S. Alowibdi

  3. School of Electrical Engineering and Telecommunications, University of New South Wales, Sydney, NSW 2052, Australia

    Jawad Ahmed

Authors
  1. Jawad Ahmed
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Aqsa Malik
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Muhammad U. Ilyas
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jalal S. Alowibdi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Muhammad U. Ilyas.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ahmed, J., Malik, A., Ilyas, M.U. et al. Instance launch-time analysis of OpenStack virtualization technologies with control plane network errors. Computing 101, 989–1014 (2019). https://doi.org/10.1007/s00607-018-0626-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00607-018-0626-5

Keywords

Mathematics Subject Classification

Search

Navigation