column

Evaluating Interconnect and Virtualization Performance forHigh Performance Computing

Authors:

Lavanya Ramakrishnan,

R. Shane Canon,

Krishna Muriki,

Iwona Sakrejda,

Nicholas J. WrightAuthors Info & Claims

ACM SIGMETRICS Performance Evaluation Review, Volume 40, Issue 2

Pages 55 - 60

https://doi.org/10.1145/2381056.2381071

Published: 08 October 2012 Publication History

Abstract

Scientists are increasingly considering cloud computing platforms to satisfy their computational needs. Previous work has shown that virtualized cloud environments can have significant performance impact. However there is still a limited understanding of the nature of overheads and the type of applications that might do well in these environments. In this paper we detail benchmarking results that characterize the virtualization overhead and its impact on performance. We also examine the performance of various interconnect technologies with a view to understanding the performance impacts of various choices. Our results show that virtualization can have a significant impact upon performance, with at least a 60% performance penalty. We also show that less capable interconnect technologies can have a significant impact upon performance of typical HPC applications. We also evaluate the performance of the Amazon Cluster compute instance and show that it performs approximately equivalently to a 10G Ethernet cluster at low core counts.

References

[1]

E. Deelman, G. Singh, M. Livny, B. Berriman, and J. Good. The cost of doing science on the cloud: the montage example. In Proceedings of the 2008 ACM/IEEE conference on Supercomputing, pages 1--12. IEEE Press, 2008.

Digital Library

[2]

Amazon Elastic Block Store. http://aws.amazon.com/ebs/.

[3]

C. Evangelinos and C. Hill. Cloud Computing for parallel Scientific HPC Applications: Feasibility of running Coupled Atmosphere-Ocean Climate Models on Amazons EC2. ratio, 2(2.40):2--34, 2008.

[4]

M. Fenn, M. Murphy, and S. Goasguen. A study of a KVM-based cluster for grid computing. In Proceedings of the 47th Annual Southeast Regional Conference, pages 1--6. ACM, 2009.

Digital Library

[5]

I. Foster, T. Freeman, K. Keahey, D. Scheftner, B. Sotomayor, and X. Zhang. Virtual clusters for grid communities. In Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid, pages 513--520. Citeseer, 2006.

Digital Library

[6]

S. Hazelhurst. Scientific computing using virtual high-performance computing: a case study using the Amazon elastic computing cloud. In 2008 Annual Research Conference of the South African Institute of Computer Scientists and Information Technologists on IT research in Developing Countries: Riding the Wave of Technology, pages 94--103. ACM, 2008.

Digital Library

[7]

HPCC benchmark web page: http://icl.cs.utk.edu/hpcc/.

[8]

K. Jackson, L. Ramakrishnan, K. Muriki, S. Canon, S. Cholia, J. Shalf, H. Wasserman, and N.Wright. Performance Analysis of High Performance Computing Applications on the Amazon Web Services Cloud. In 2nd IEEE International Conference on Cloud Computing Technology and Science, 2010.

Digital Library

[9]

K. Keahey. Cloud Computing for Science. In Proceedings of the 21st International Conference on Scientific and Statistical Database Management, page 478. Springer-Verlag, 2009.

Digital Library

[10]

K. Keahey, R. Figueiredo, J. Fortes, T. Freeman, and M. Tsugawa. Science clouds: Early experiences in cloud computing for scientific applications. Cloud Computing and Applications, 2008, 2008.

[11]

K. Keahey, T. Freeman, J. Lauret, and D. Olson. Virtual workspaces for scientific applications. In Journal of Physics: Conference Series, volume 78, page 012038. Institute of Physics Publishing, 2007.

[12]

J. Napper and P. Bientinesi. Can cloud computing reach the top500? In Proceedings of the combined workshops on UnConventional high performance computing workshop plus memory access workshop, pages 17--20. ACM, 2009.

Digital Library

[13]

Nathan Regola and Jean Christophe Ducom. Recommendations for Virtualization Technologies in High Performance Computing. In 2nd IEEE International Conference on Cloud Computing Technology and Science, 2010.

Digital Library

[14]

S. Ostermann, A. Iosup, N. Yigitbasi, R. Prodan, T. Fahringer, and D. Epema. An early performance analysis of cloud computing services for scientific computing. Delft University of Tech., Tech. Rep, 2008.

[15]

M. Palankar, A. Iamnitchi, M. Ripeanu, and S. Garfinkel. Amazon S3 for science grids: a viable solution? In Proceedings of the 2008 international workshop on Data-aware distributed computing, pages 55--64. ACM, 2008.

Digital Library

[16]

J. Rehr, F. Vila, J. Gardner, L. Svec, and M. Prange. Scientific computing in the cloud. Computing in Science and Engineering, 99(PrePrints), 2010.

Digital Library

[17]

G. Wang and T. E. Ng. The impact of virtualization on network performance of amazon ec2 data center. In Proceedings of IEEE INFOCOM, 2010.

Digital Library

[18]

L. Youseff, R. Wolski, B. Gorda, and C. Krintz. Evaluating the performance impact of xen on mpi and process execution for hpc systems. In Proceedings of the 2nd International Workshop on Virtualization Technology in Distributed computing, page 1. IEEE Computer Society, 2006.

Digital Library

Cited By

Pretto GDalmazo BMarques JWu ZWang XKorkhov VNavaux PGaspary L(2022)Janus: a framework to boost HPC applications in the cloud based on SDN path provisioningCluster Computing10.1007/s10586-021-03470-625:2(947-964)Online publication date: 1-Apr-2022
https://dl.acm.org/doi/10.1007/s10586-021-03470-6
Старовойтенко Олексій Володимирович (2020)ДОСЯГНЕННЯ ЕФЕКТИВНОГО РОЗПОДІЛЕНОГО ПЛАНУВАННЯ ЗА ДОПОМОГОЮ ЧЕРГ ПОВІДОМЛЕНЬ У ХМАРІ ДЛЯ БАГАТОЗАДАЧНИХ ОБЧИСЛЕНЬ ТА ВИСОКОПРОДУКТИВНИХ ОБЧИСЛЕНЬInternational Academy Journal Web of Scholar10.31435/rsglobal_wos/30122020/7323Online publication date: 19-Dec-2020
https://doi.org/10.31435/rsglobal_wos/30122020/7323
Witte PLouboutin MModzelewski HJones CSelvage JHerrmann F(2020)An Event-Driven Approach to Serverless Seismic Imaging in the CloudIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2020.298262631:9(2032-2049)Online publication date: 1-Sep-2020
https://doi.org/10.1109/TPDS.2020.2982626
Show More Cited By

Index Terms

Evaluating Interconnect and Virtualization Performance forHigh Performance Computing

Recommendations

Exploring infiniband hardware virtualization in OpenNebula towards efficient high-performance computing
CCGRID '14: Proceedings of the 14th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing

It has been widely accepted that software virtualization has a big negative impact on high-performance computing (HPC) application performance. This work explores the potential use of Infiniband hardware virtualization in an OpenNebula cloud towards the ...
Evaluating interconnect and virtualization performance for high performance computing
PMBS '11: Proceedings of the second international workshop on Performance modeling, benchmarking and simulation of high performance computing systems

Scientists are increasingly considering cloud computing platforms to satisfy their computational needs. Previous work has shown that virtualized cloud environments can have significant performance impact. However there is still a limited understanding ...
High performance cloud computing

Today's high performance computing systems are typically managed and operated by individual organizations in private. Computing demand is fluctuating, however, resulting in periods where dedicated resources are either underutilized or overloaded. A ...

Comments

Information & Contributors

Information

Published In

cover image ACM SIGMETRICS Performance Evaluation Review

ACM SIGMETRICS Performance Evaluation Review Volume 40, Issue 2

September 2012

129 pages

ISSN:0163-5999

DOI:10.1145/2381056

Issue’s Table of Contents

Copyright © 2012 Authors.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 October 2012

Published in SIGMETRICS Volume 40, Issue 2

Check for updates

Author Tags

Qualifiers

Column

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

25
Total Citations
View Citations
329
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)1

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Pretto GDalmazo BMarques JWu ZWang XKorkhov VNavaux PGaspary L(2022)Janus: a framework to boost HPC applications in the cloud based on SDN path provisioningCluster Computing10.1007/s10586-021-03470-625:2(947-964)Online publication date: 1-Apr-2022
https://dl.acm.org/doi/10.1007/s10586-021-03470-6
Старовойтенко Олексій Володимирович (2020)ДОСЯГНЕННЯ ЕФЕКТИВНОГО РОЗПОДІЛЕНОГО ПЛАНУВАННЯ ЗА ДОПОМОГОЮ ЧЕРГ ПОВІДОМЛЕНЬ У ХМАРІ ДЛЯ БАГАТОЗАДАЧНИХ ОБЧИСЛЕНЬ ТА ВИСОКОПРОДУКТИВНИХ ОБЧИСЛЕНЬInternational Academy Journal Web of Scholar10.31435/rsglobal_wos/30122020/7323Online publication date: 19-Dec-2020
https://doi.org/10.31435/rsglobal_wos/30122020/7323
Witte PLouboutin MModzelewski HJones CSelvage JHerrmann F(2020)An Event-Driven Approach to Serverless Seismic Imaging in the CloudIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2020.298262631:9(2032-2049)Online publication date: 1-Sep-2020
https://doi.org/10.1109/TPDS.2020.2982626
Xu SGhazimirsaeed SHashmi JSubramoni HPanda D(2020)MPI Meets Cloud: Case Study with Amazon EC2 and Microsoft Azure2020 IEEE/ACM Fourth Annual Workshop on Emerging Parallel and Distributed Runtime Systems and Middleware (IPDRM)10.1109/IPDRM51949.2020.00010(41-48)Online publication date: Nov-2020
https://doi.org/10.1109/IPDRM51949.2020.00010
Arora ARakesh NMishra K(2019)Asset Distribution and Peerless Selection Approach for LTE based Multifarious VANET NetworksInternational Journal of Mathematical, Engineering and Management Sciences10.33889/IJMEMS.2019.4.1-0034:1(27-40)Online publication date: 1-Feb-2019
https://doi.org/10.33889/IJMEMS.2019.4.1-003
Pranav VSatish Kumar PKrishna M(2019)Performance study of cloud computing for scientific applicationsJournal of Physics: Conference Series10.1088/1742-6596/1228/1/0120241228(012024)Online publication date: 3-Jun-2019
https://doi.org/10.1088/1742-6596/1228/1/012024
Leena HPremasudha BBasavaraja P(2019)Data optimisation and partitioning in private cloud using dynamic clusters for agricultural datasetsInternational Journal of Dynamics and Control10.1007/s40435-019-00596-9Online publication date: 26-Nov-2019
https://doi.org/10.1007/s40435-019-00596-9
Pretto GDalmazo BMarques JWu ZWang XKorkhov VNavaux PGaspary L(2019)Boosting HPC Applications in the Cloud Through JIT Traffic-Aware Path ProvisioningComputational Science and Its Applications – ICCSA 201910.1007/978-3-030-24305-0_52(702-716)Online publication date: 29-Jun-2019
https://doi.org/10.1007/978-3-030-24305-0_52
Sadooghi IMartin JLi TBrandstatter KMaheshwari Kde Lacerda Ruivo TGarzoglio GTimm SZhao YRaicu I(2017)Understanding the Performance and Potential of Cloud Computing for Scientific ApplicationsIEEE Transactions on Cloud Computing10.1109/TCC.2015.24048215:2(358-371)Online publication date: 1-Apr-2017
https://doi.org/10.1109/TCC.2015.2404821
Molto GCaballer MPerez AAlfonso CBlanquer I(2017)Coherent Application Delivery on Hybrid Distributed Computing Infrastructures of Virtual Machines and Docker Containers2017 25th Euromicro International Conference on Parallel, Distributed and Network-based Processing (PDP)10.1109/PDP.2017.29(486-490)Online publication date: 2017
https://doi.org/10.1109/PDP.2017.29
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents