Skip to main content

Software Defined Data Center for High Performance Computing Applications

  • Conference paper
  • First Online:
Book cover Supercomputing (ISUM 2019)

Abstract

In recent years, traditional data centers have been used to host high-performance computing infrastructure, such as HPC clusters, addressing specific requirements for different research and scientific projects. Computes, storage, network, and security infrastructure is usually from heterogenous manufacturers and has multiple management interfaces.

This process implies a higher demand on data center administrators to manually attend the problems or particular configurations that require each of the HPC applications, which can affect its performance, together with the fact that it can present a poor resource allocation on Data Center. Software-Defined Data Centers (SDDC) have emerged as a solution for automating the management and self-provisioning of computing, storage, network, and security resources dynamically according to the software-defined policies for each of the applications running in the SDDC. With these paradigms in mind, this work aims to answer whether HPC applications can benefit in their performance using the advantages that SDDC offers to other applications such as business or enterprise. The results of this article are (i) we identify SDDC main components. (ii) we present an experimental approach to use SDDC network component for High-Performance MPI-based applications.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Kirkley, J.: Virtualization, the Cloud and HPC. InsideHPC (2014)

    Google Scholar 

  2. Avramov, L., Portolani, M.: The Policy Driven Data Center with ACI. Cisco Press (2015)

    Google Scholar 

  3. DMTF. https://www.dmtf.org/sites/default/files/standards/documents/DSP-IS05011.0.0.pdf. Accessed 10 Feb 2019

  4. Darabseh, A., Al-Ayyoub, M., Jararweh, Y., Benkhelifa, E., Vouk, M., Rindos, A.: SDDC: a software defined datacenter experimental framework. In: 3rd International Conference on Future Internet of Things and Cloud, pp. 189–194. IEEE Computer Society (2015)

    Google Scholar 

  5. Stallins, W.: Software-defined networks and openflow. Internet Protocol J. 16, 1 (2013)

    Google Scholar 

  6. Kreutz, D., Ramos, F., Verissimo, P., Rothenberg, E., Azodolmolky, S., Uhlig, S.: Software-defined networking: a comprehensive survey. Proc. IEEE 103(1), 1476 (2015)

    Article  Google Scholar 

  7. Carlson, M., et al.: Software Defined Storage. Storage Networking Industry Association (2015)

    Google Scholar 

  8. Darabseh, A., Al-Ayyoub, M., Jararweh, Y., Benkhelifa, E., Vouk, M., Rindos, A.: SDStorage: a software defined storage experimental framework. In: 2015 IEEE International Conference on Cloud Engineering, pp. 341–346. IEEE Computer Society (2015)

    Google Scholar 

  9. Darabseh, A., Al-Ayyoub, M., Jararweh, Y., Benkhelifa, E., Vouk, M., Rindos, A.: SDSecurity: a software defined security experimental framework. In: 2015 IEEE International Conference on Communication Workshop, pp. 1871–1876. IEEE (2015)

    Google Scholar 

  10. Portnoy, M.: Virtualization Essentials, 2nd edn. Wiley, New York (2016)

    Google Scholar 

  11. Medrano-Jaimes, F., Lozano-Rizk, J.E., Castañeda-Avila, S., Rivera-Rodriguez, R.: Use of containers for high-performance computing. In: Torres, M., Klapp, J., Gitler, I., Tchernykh, A. (eds.) ISUM 2018. CCIS, vol. 948, pp. 24–32. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-10448-1_3

    Chapter  Google Scholar 

  12. Rewer, C., Tchernykh, A., Cortes-Mendoza, J., Rivera-Rodriguez, R., et al.: Energy consumption and quality of service optimization in containerized cloud computing. In: 2018 Ivannikov Ispras Open Conference (ISPRAS), pp. 47–55. IEEE (2019)

    Google Scholar 

  13. Adufu, T., Choi, J., Kim, Y.: Is container-based technology a winner for high performance scientific applications? In: 17th Asia-Pacific Network Operations and Management Symposium (APNOMS), pp. 507–510. IEEE (2015)

    Google Scholar 

  14. Douglis, F., Krieger, O.: Virtualization. IEEE Internet Comput. 17, 6–9 (2013). IEEE Computer Society

    Article  Google Scholar 

  15. Sloan, J.: High Performance Linux Clusters, 1st edn. O’Reilly (2004)

    Google Scholar 

  16. Makpaisit, P., Ichikawa, K., Uthayopas, P.: MPI Reduce algorithm for OpenFlow- enabled network. In: Proceedings of the 15th International Symposium on Communi- cations and Information Technologies (ISCIT), pp. 261–264 (2015)

    Google Scholar 

  17. U-chupala, P., Ichikawa, K., et al.: Application-oriented bandwidth and latency aware routing with OpenFlow network. In: Proceedings of the IEEE 6th International Conference on Cloud Computing Technology and Science, pp. 775–780 (2014)

    Google Scholar 

  18. Mininet SDN simulator. Accessed 20 Mar 2019

    Google Scholar 

  19. OpenFlow. Open Networking Foundation. https://www.opennetworking.org. Accessed 20 Mar 2019

  20. MPICH. http://www.mpich.org. Accessed 10 Feb 2019

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to J. E. Lozano-Rizk .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Lozano-Rizk, J.E. et al. (2019). Software Defined Data Center for High Performance Computing Applications. In: Torres, M., Klapp, J. (eds) Supercomputing. ISUM 2019. Communications in Computer and Information Science, vol 1151. Springer, Cham. https://doi.org/10.1007/978-3-030-38043-4_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-38043-4_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-38042-7

  • Online ISBN: 978-3-030-38043-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics