Abstract
We analyzed the performance of a multi-node OpenStack cloud amid different types of controlled and self-induced network errors between controller and compute-nodes on the control plane network. These errors included limited bandwidth, delays and packet losses of varying severity. This study compares the effects of network errors on spawning times of batches of instances created using three different virtualization technologies supported by OpenStack, i.e., Docker containers, Linux containers and KVM virtual machines. We identified minimum/maximum thresholds for bandwidth, delay and packet-loss rates below/beyond which instances fail to launch. To the authors’ best knowledge, this is the first comparative measurement study of its kind on OpenStack. The results will be of particular interest to designers and administrators of distributed OpenStack deployments.























Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Notes
OpenStack documentation uses the term instance to refer to a VM. We will use the terms VM and instance interchangeably.
Flavor is the term used in OpenStack documentation to refer to various configurations of VM instances.
References
Akioka S, Muraoka Y (2010) HPC benchmarks on Amazon EC2. In: 2010 IEEE 24th international conference on advanced information networking and applications workshops (WAINA). IEEE, pp 1029–1034
Binnig C, Kossmann D, Kraska T, Loesing S (2009) How is the weather tomorrow?: towards a benchmark for the cloud. In: Proceedings of the second international workshop on testing database systems. ACM, p 9
Cooper BF, Silberstein A, Tam E, Ramakrishnan R, Sears R (2010) Benchmarking cloud serving systems with YCSB. In: Proceedings of the 1st ACM symposium on Cloud computing. ACM, pp 143–154
Costa P, Migliavacca M, Pietzuch P, Wolf AL (2012) Naas: network-as-a-service in the cloud. In: Proceedings of the 2nd USENIX conference on Hot Topics in Management of Internet, Cloud, and Enterprise Networks and Services, Hot-ICE, vol 12, p 1
Erickson D (2012) Floodlight java based openflow controller. Last accessed, Ago
Erickson D (2013) The beacon openflow controller. In: Proceedings of the second ACM SIGCOMM workshop on Hot topics in software defined networking. ACM, pp 13–18
Feamster N, Rexford J, Zegura E (2013) The road to SDN: an intellectual history of programmable networks
Folkerts E, Alexandrov A, Sachs K, Iosup A, Markl V, Tosun C (2013) Benchmarking in the cloud: what it should, can, and cannot be. In: Selected topics in performance evaluation and benchmarking. Springer, pp 173–188
Garfinkel SL (2007) An evaluation of Amazon’s grid computing services: EC2, S3, and SQS. In: Center for. Citeseer
Google PerfKit tool for cloud benchmarking. http://www.infoworld.com/article/2884196/cloud-computing/google-whips-up-perfkit-tools-to-make-cloud-benchmarking-easier.html
Gude N, Koponen T, Pettit J, Pfaff B, Casado M, McKeown N, Shenker S (2008) NOX: towards an operating system for networks. ACM SIGCOMM Comput Commun Rev 38(3):105–110
Gupta R (2016) Request flow for provisioning instance in openstack. http://ilearnstack.com/2013/04/26/request-flow-for-provisioning-instance-in-openstack.html. Last Accessed May 2016
Handigol N, Heller B, Jeyakumar V, Lantz B, McKeown N (2012) Reproducible network experiments using container-based emulation. In: Proceedings of the 8th international conference on Emerging networking experiments and technologies. ACM, pp 253–264
Hill Z, Li J, Mao M, Ruiz-Alvarez A, Humphrey M (2010) Early observations on the performance of windows azure. In: Proceedings of the 19th ACM international symposium on high performance distributed computing. ACM, pp 367–376
Hubert B (2016) Tc manpage—linux advanced routing & traffic control. http://lartc.org/manpages/tc.txt. Last Accessed 8 Oct 2016
Iosup A, Ostermann S, Yigitbasi MN, Prodan R, Fahringer T, Epema DHJ (2011) Performance analysis of cloud computing services for many-tasks scientific computing. IEEE Trans Parallel Distri Syst 22(6):931–945
Jackson KR, Ramakrishnan L, Muriki K, Canon S, Cholia S, Shalf J, Wasserman HJ, Wright NJ (2010) Performance analysis of high performance computing applications on the Amazon web services cloud. In: 2010 IEEE Second International Conference on Cloud Computing Technology and Science (CloudCom). IEEE, pp 159–168
Koponen T, Casado M, Gude N, Stribling J, Poutievski L, Zhu M, Ramanathan R, Iwata Y, Inoue H, Hama T et al (2010) Onix: a distributed control platform for large-scale production networks. OSDI 10:1–6
Lantz B, Heller B, McKeown N (2010) A network in a laptop: rapid prototyping for software-defined networks. In: Proceedings of the 9th ACM SIGCOMM Workshop on Hot Topics in Networks. ACM, p 19
Li A, Zong X, Kandula S, Yang X, Zhang M (2011) Cloudprophet: towards application performance prediction in cloud. In: ACM SIGCOMM Computer Communication Review, vol 41. ACM, pp 426–427
Luo C, Zhan J, Jia Z, Wang L, Gang L, Zhang L, Cheng-Zhong X, Sun N (2012) Cloudrank-d: benchmarking and ranking cloud computing systems for data processing applications. Front Comput Sci 6(4):347–362
Malik A, Ahmed J, Qadir J, Ilyas MU (2017) A measurement study of open source SDN layers in openstack under network perturbation. Comput Commun 102:139–149
Mao M, Humphrey M (2012) A performance study on the vm startup time in the cloud. In: 2012 IEEE 5th international conference on cloud computing (CLOUD). IEEE, pp 423–430
Mendonca M, Astuto BN, Nguyen XN, Obraczka K, Turletti T et al (2013) A survey of software-defined networking: past, present, and future of programmable networks
Moreno-Vozmediano R, Montero RS, Llorente IM (2009) Elastic management of cluster-based services in the cloud. In: Proceedings of the 1st workshop on Automated control for datacenters and clouds. ACM, pp 19–24
O’Loughlin J, Gillam L (2013) Towards performance prediction for public infrastructure clouds: an EC2 case study. In: 2013 IEEE 5th International Conference on Cloud Computing Technology and Science (CloudCom), vol 1. IEEE, pp 475–480
OpenStack. Chapter 1. [a]rchitecture. http://docs.openstack.org/juno/install-guide/install/apt/content/choverview.html
Ostermann S, Iosup A, Yigitbasi N, Prodan R, Fahringer T, Epema D (2010) A performance analysis of EC2 cloud computing services for scientific computing. In: Cloud computing. Springer, pp 115–131
Rak M, Aversano G (2012) Benchmarks in the cloud: the mosaic benchmarking framework. In: 2012 14th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC). IEEE, pp 415–422
Rehr JJ, Vila Fernando D, Gardner JP, Svec L, Prange M (2010) Scientific computing in the cloud. Comput Sci Eng 12(3):34–43
Ristenpart T, Tromer E, Shacham H, Savage S (2009) Hey, you, get off of my cloud: exploring information leakage in third-party compute clouds. In: Proceedings of the 16th ACM conference on Computer and communications security. ACM, pp 199–212
Russell B (2015) Passive benchmarking with docker LXC, KVM & OpenStack
Schad J, Dittrich J, Quiané-Ruiz J-A (2010) Runtime measurements in the cloud: observing, analyzing, and reducing variance. Proc VLDB Endow 3(1–2):460–471
Sefraoui O, Aissaoui M, Eleuldj M (2012) Openstack: toward an open-source solution for cloud computing. Int J Comput Appl 55:38–42
Sobel W, Subramanyam S, Sucharitakul A, Nguyen J, Wong H, Klepchukov A, Patil , Fox A, Patterson D (2008) Cloudstone: multi-platform, multi-language benchmark and measurement tools for web 2.0. In: Proc. of CCA, vol 8
Steinmetz D, Perrault BW, Nordeen R, Wilson J, Wang X (2012) Cloud computing performance benchmarking and virtual machine launch time. In: Proceedings of the 13th annual conference on Information technology education. ACM, pp 89–90
Tseitlin A (2013) The antifragile organization. Commun ACM 56(8):40–44
Wu Z, Xu Z, Wang H (2012) Whispers in the hyper-space: high-speed covert channel attacks in the cloud. In: Presented as part of the 21st USENIX Security Symposium (USENIX Security 12), pp 159–173
Xu Y, Bailey M, Jahanian F, Joshi K, Hiltunen M, Schlichting R (2011) An exploration of L2 cache covert channels in virtualized environments. In: Proceedings of the 3rd ACM workshop on Cloud computing security workshop. ACM, pp 29–40
Yigitbasi N, Iosup A, Epema D, Ostermann S (2009) C-meter: a framework for performance analysis of computing clouds. In: Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid. IEEE Computer Society, pp 472–477
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Ahmed, J., Malik, A., Ilyas, M.U. et al. Instance launch-time analysis of OpenStack virtualization technologies with control plane network errors. Computing 101, 989–1014 (2019). https://doi.org/10.1007/s00607-018-0626-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00607-018-0626-5