skip to main content
10.1145/2535800.2535802acmconferencesArticle/Chapter ViewAbstractPublication PagesscConference Proceedingsconference-collections
research-article

Integration of high-performance computing into a VCL cloud

Published:17 November 2013Publication History

ABSTRACT

High-Performance Computing (HPC) services can range from those on peta-flop supercomputers down to smaller computational clusters used for HPC application development, pilot runs and staging. What they all have in common is that traditionally HPC facilities tend to be isolated from the more general scientific computing services. Advent of the cloud computing has started changing that. In this paper we discuss a very successful production-level architecture and policy framework for supporting HPC services within a more general cloud computing infrastructure called VCL. This integrated environment has been operating at NC State since fall 2004. It typically delivers over 14 million HPC CPU hours per year to NC State faculty and students. Our experience is that integration of HPC and non-HPC services in a cloud can substantially reduce the cost of both services.

References

  1. Mladen Vouk, "Cloud Computing - Issues, Research and Implementations," Journal of Computing and Information Technology, 16 (4), 2008, pp 235-246Google ScholarGoogle ScholarCross RefCross Ref
  2. Patrick Dreher, Mladen A. Vouk, Eric Sills, Sam Averitt, "Evidence for a Cost Effective Cloud Computing Implementation Based Upon the NC State Virtual Computing Laboratory Model," in Advances in Parallel Computing, High Speed and Large Scale Scientific Computing, Edited by Wolfgang Gentzsch, Lucio Grandinetti, Gerhard Joubert, ISBN 978-1-60750-073-5, Volume 18, 2009, pp. 236 -- 250Google ScholarGoogle Scholar
  3. Henry E. Schaffer, Samuel F. Averitt, Marc I. Hoit, Aaron Peeler, Eric D. Sills, and Mladen A. Vouk, "NCSUs Virtual Computing Laboratory: A Cloud Computing Solution," IEEE Computer, pp. 94-97, July 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Mladen Vouk, Andy Rindos, Sam Averitt, John Bass, Michael Bugaev, Aaron Peeler, Henry Schaffer, Eric Sills, Sarah Stein, Josh Thompson, Matthew P. Valenzisi, "Using VCL Technology to Implement Distributed Reconfigurable Data Centers and Computational Services for Educational Institutions," IBM Journal of Research and Development, Vol. 53, No. 4, pp. 2:1-18, 2009 Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Cameron Seay, Gary Tucker, Virtual Computing Initiative at a Small Public University, Communications of the ACM, Vol 53 (3), March 2010, pp. 75-83 Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Mladen A. Vouk, Eric Sills, and Patrick Dreher, "Integration of High-Performance Computing into Cloud Computing Services," Ch 11 in Handbook of Cloud Computing, editors B. Furht and A. Escalante, Springer, ISBN: 978-1-4419-6523-3, pp. 255-276, 2010Google ScholarGoogle Scholar
  7. Apache VCL, <url>http://vcl.apache.org, also http://vcl.ncsu.edu</url>Google ScholarGoogle Scholar
  8. Nikhil Talpallikar, "High-Performance Cloud Computing: VCL Case Study", NC State University M.S. Thesis, 2012Google ScholarGoogle Scholar
  9. Kaushal Didwania, "Performance Evaluation of Greenplumin VCL Cloud Computing Environment", NC State University M.S. Thesis, 2012Google ScholarGoogle Scholar
  10. Georgy Mathew Kallumkal, "A Micro-cloud Model for Adaptable High Performance Computing," NC State University M.S. Thesis, 2013.Google ScholarGoogle Scholar
  11. NSF-Sponsored Workshop Report: Sustainable Funding and Business Models for Academic Cyberinfrastructure Facilities, D. Lifka, ed (2010) <url>http://www.cac.cornell.edu/~lifka/Downloads/SRCC/NS F-sponsored-Sustainable-Cyberinfrastructure-Report.pdf</url>Google ScholarGoogle Scholar
  12. Patrick Dreher, Mladen Vouk, Georgy Kallumkal, "Toward Implementation of a Software Defined Cloud on a Supercomputer" submitted to IC2E 2014 International Conference on Cloud EngineeringGoogle ScholarGoogle Scholar
  1. Integration of high-performance computing into a VCL cloud

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      VHPC '13: Proceedings of the 8th Workshop on Virtualization in High-Performance Cloud Computing
      November 2013
      10 pages
      ISBN:9781450325097
      DOI:10.1145/2535800

      Copyright © 2013 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 17 November 2013

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader