Abstract
This paper introduces DevOps Portal for AI multi-cluster environment and management using Kubernetes (K8S), a representative container orchestration technology based on cloud-native. Specifically, we propose and verify the concept of DevOps Portal that provides the management function for multi-cluster operators in DevOps aspect and enables the operation of multiple clusters through the support of cluster selection from the developer’s point of view. In addition, after using DevOps Portal, developers can create an environment in which Machine Learning (ML) workflows can be performed according to the processing of data through a web dashboard. This allows partial validation of cloud-native based HPC/HPDA/AI workloads.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Kwon, J., Kim, J.: Supporting machine learning functionality over SmartX AI cluster for smart IoT-cloud services. In: Proceedings of Symposium of the Korean Institute of communications and Information Sciences, pp. 540–541 (2018)
Kwon, J., Kim, N.L., Kang, M., Kim, J.: Design and prototyping of container-enabled cluster for high performance data analytics. In: 2019 International Conference on Information Networking (ICOIN), pp. 436–438 (2019)
Jeon, I.: Integrated management of development operation organization in the non-stop environment considering security. In: Review of Korea Institute of Information Security and Cryptology (KIISC), pp. 47–52 (2015)
Kim, K., et al.: Kubernetes architecture for cloud services. J. Korean Inst. Commun. Sci. 35(11), 11–19 (2018)
Dex. https://github.com/dexidp/dex/blob/master/Documentation/kubernetes.md. Accessed 13 Oct 2019
Multi-user isolation in Kubeflow. https://www.kubeflow.org/docs/other-guides/multi-user-overview/. Accessed 14 Oct 2019
Piotr, M.: Scaling cloud-native Apache Spark on Kubernetes for workloads in external storages. EECS, KTH, Stockholm (2018)
Lee, S., Han, J., Kwon, J., Kim, J.: Relocatable service composition based on microservice architecture for cloud-native IoT-cloud services. Proc. Asia-Pac. Adv. Netw. (APAN) 48, 23–27 (2019)
Acknowledgments
This work was supported by GIST Research Institute (GRI) grant funded by the GIST in 2019 and Institute of Information & communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT) (No. 2015-0-00575, Global SDN/NFV Open-Source Software Core Module/Function Development).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Yoon, G., Han, J., Lee, S., Kim, J. (2020). DevOps Portal Design for SmartX AI Cluster Employing Cloud-Native Machine Learning Workflows. In: Barolli, L., Okada, Y., Amato, F. (eds) Advances in Internet, Data and Web Technologies. EIDWT 2020. Lecture Notes on Data Engineering and Communications Technologies, vol 47. Springer, Cham. https://doi.org/10.1007/978-3-030-39746-3_54
Download citation
DOI: https://doi.org/10.1007/978-3-030-39746-3_54
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-39745-6
Online ISBN: 978-3-030-39746-3
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)