Abstract
This paper proposes an integrated organization and sharing method for AI computing resources based on digital object to address the lack of unified integration and management capabilities of computing power, data, algorithm, and AI framework required for AI computing. It also tackles the difficulty of sharing, discovery, and flexible scheduling of distributed computing resources under the condition of storage-computing separation architecture. This method encapsulates AI computing resources, such as computing power, data, algorithm, and AI framework into a digital object, which comes from the Digital Object Architecture. Leveraging the interconnectivity and interoperability of digital object resources under the data network, this method enables widespread discovery and shared use. Furthermore, an AI computing and sharing platform is designed to implement and verify this method. The platform’s operation mode and application scenarios are also studied and analyzed in this paper.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Rao, S.S., Pradyumna, S., Kalambur, S., Sitaram, D.: Bodhisattva - rapid deployment of AI on containers. In: IEEE International Conference on Cloud Computing in Emerging Markets (CCEM), pp. 100–104. IEEE (2018)
Li, L.E., Chen, E., Hermann, J., Zhang, P., Wang, L.: Scaling machine learning as a service. In: Proceedings of the 3rd International Conference on Predictive Applications and APIs, pp. 14–29 (2017)
Kumar, R., Bansal, C., Maddila, C., Sharma, N., Martelock, S., Bhargava, R.: Building sankie: an AI platform for DevOps 2019. In: IEEE/ACM 1st International Workshop on Bots in Software Engineering (BotSE), pp. 48–53. IEEE (2019)
Moritz, P., Nishihara, R., Wang, S., et al.: Ray: a distributed framework for emerging {AI} applications. In: 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI) 2018, pp. 561–577 (2018)
Kahn, R., Wilensky, R.: A framework for distributed digital object services. Int. J. Digit. Librar. 6(2), 115–123 (2006)
Sharp, C.: Overview of the digital object architecture (DOA). An Internet Society Information Paper, Internet Society. https://www.internetsociety.org/resources/doc/2016/overview-of-the-digital-object-architecture-doa. Accessed 31 Aug 2023
Huang, G., Luo, C., Wu, K., Ma, Y., Zhang, Y., Liu, X.: Software-defined infrastructure for decentralized data lifecycle governance: principled design and open challenges. In: IEEE 39th International Conference on Distributed Computing Systems (ICDCS), pp. 1674–1683 (2019)
Digital Object Interface Protocol Specification version 2.0. https://www.dona.net/sites/default/files/2018-11/DOIPv2Spec_1.pdf. Accessed 31 Aug 2023
Digital Object Identifier Resolution Protocol Specification version 3.0. https://www.dona.net/sites/default/files/2022-06/DO-IRPV3.0--2022-06-30.pdf. Accessed 31 Aug 2023
Creasy, R.J.: The origin of the VM/370 time-sharing system. IBM J. Res. Dev. 25(5), 483–490 (1981)
Zhuang, Z., Tran, C., Weng, J., Ramachandra, H., Sridharan, B.: Taming memory related performance pitfalls in Linux Cgroups. In: International Conference on Computing, Networking and Communications (ICNC), pp. 531–535. IEEE (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Zhao, Y., Ma, Z., Jiang, S., Liu, K. (2024). Integrated Organization and Sharing Method and Platform for AI Computing Resources Based on Digital Object. In: Tan, Y., Shi, Y. (eds) Data Mining and Big Data. DMBD 2023. Communications in Computer and Information Science, vol 2018. Springer, Singapore. https://doi.org/10.1007/978-981-97-0844-4_16
Download citation
DOI: https://doi.org/10.1007/978-981-97-0844-4_16
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-0843-7
Online ISBN: 978-981-97-0844-4
eBook Packages: Computer ScienceComputer Science (R0)