Abstract
Collecting and analysing large amounts of data in the Cloud-to-Edge computing continuum raises novel challenges that traditional centralised orchestration solutions cannot handle efficiently. To overcome the limitations of current centralised application management approaches, this paper presents a fully decentralised application-level orchestrator, based on the notion of self-organised interdependent Swarms. Application microservices are managed in a dynamic Orchestration Space by decentralised Orchestration Agents, governed by distributed intelligence that provides matchmaking between application requirements and resources, and supports the dynamic self-organisation of Swarms. Knowledge and trust, essential for the operation of the Orchestration Space, are managed through blockchain-based trusted solutions and the utilisation of emerging methods such as Self-Sovereign Identities (SSI) and Distributed Identifiers (DID). End-to-end security of the overall system is assured by utilising state-of-the-art cryptographic and privacy-preserving data analytics algorithms. A digital twin, that runs in parallel to the physical system, further improves its behaviour with predictive feedback. The presented concept is going to be implemented in the EU-funded Swarmchestrate project that starts in 2024.
This is a preview of subscription content, log in via an institution to check access.
References
Jiang, Y., Huang, Z., Tsang, D.H.: Challenges and solutions in fog computing orchestration. IEEE Netw. 32(3), 122–129 (2017). https://doi.org/10.1109/MNET.2017.1700271
Tomarchio, O., Calcaterra, D., Modica, G.D.: Cloud resource orchestration in the multi-cloud landscape: a systematic review of existing frameworks. J. Cloud Comput. 9(1), 49 (2020). https://doi.org/10.1186/s13677-020-00194-7
Costa, B., Bachiega, J., Jr., de Carvalho, L.R., Araujo, A.P.: Orchestration in fog computing: a comprehensive survey. ACM Comput. Surv. 55(2), 1–34 (2022)
Svorobej, S., Bendechache, M., Griesinger, F., Domaschka, J.: Orchestration from the cloud to the edge. The cloud-to-thing continuum: opportunities and challenges in cloud. Fog Edge Comput. 61–77 (2020)
Hong, C.H., Varghese, B.: Resource management in fog/edge computing: a survey on architectures, infrastructure, and algorithms. ACM Comput. Surv. 52(5), 1–37 (2019)
Kumara, I., et al.: SODALITE@RT: orchestrating applications on cloud-edge infrastructures. J. Grid Comput. 19, 1–23 (2021)
Masip-Bruin, X., et al.: Managing the cloud continuum: lessons learnt from a real fog-to-cloud deployment. Sensors 21(9), 2974 (2021)
Verginadis, Y., et al.: Prestocloud: a novel framework for data-intensive multi-cloud, fog, and edge function-as-a-service applications. Inf. Resour. Manage. J. 34(1), 66–85 (2021)
Ullah, A., et al.: Orchestration in the Cloud-to-Things compute continuum: taxonomy, survey and future directions. J. Cloud Comput. 12(1), 135 (2023)
Jimenez, L.L., Schelen, O.: HYDRA: decentralised location-aware orchestration of containerized applications. IEEE Trans. Cloud Comput. 10(4), 2664–2678 (2020)
Pires, A., Simão, J., Veiga, L.: Distributed and decentralised orchestration of containers on edge clouds. J. Grid Comput. 19, 1–20 (2021)
Özyar, U.C., Yurdakul, A.: A Decentralised framework with dynamic and event-driven container orchestration at the edge. In: Espoo, Finland, 2022, pp. 33–40 (2022). https://doi.org/10.1109/iThings-GreenCom-CPSCom-SmartData-Cybermatics55523.2022.00017
Nezami, Z., Zamanifar, K., Djemame, K., Pournaras, E.: Decentralised edge-to-cloud load balancing: service placement for the Internet of Things. IEEE Access 9, 64983–65000 (2021)
Ullah, A., Dagdeviren, H., Ariyattu, R., DesLauriers, J., Kiss, T., Bowden, J.: MiCADO-edge: towards an application-level orchestrator for the cloud-to-edge computing continuum. J. Grid Comput. 19(4), 47 (2021). https://doi.org/10.1007/s10723-021-09589-5
Tsagkaropoulos, A., Verginadis, Y., Compastié, M., Apostolou, D., Mentzas, G.: Extending TOSCA for edge and fog deployment support. Electronics 10(6), 737 (2021)
Kaur, K., Kumar, Y.: Swarm intelligence and its applications towards various computing: a systematic review. In: 2020 International Conference on Intelligent Engineering and Management (ICIEM), London, UK, pp. 57–62 (2020). https://doi.org/10.1109/ICIEM48762.2020.9160177
Lera, I., Guerrero, C., Juiz, C.: Availability-aware service placement policy in fog computing based on graph partitions. IEEE Internet Things J. 6(2), 3641–3651 (2018)
Sharma, V., Kumar, R., Rathore, N.: Topological broadcasting using parameter sensitivity-based logical proximity graphs in coordinated ground-flying ad hoc networks. J. Wirel. Mob. Netw. Ubiquitous Comput. Dependable Appl. 6(3), 54–72 (2015)
Preukschat, A., Reed, D.: Self-Sovereign Identity. Manning Publications (2021)
Decentralised Identifiers (DIDs) v1.0. https://www.w3.org/TR/did-core/. Accessed 10 Dec 2023
Kiss, T., et al.: MiCADO—microservice-based cloud application-level dynamic orchestrator. Future Gener. Comput. Syst. 94, 937–946 (2019)
Markus, A., Kertesz, A.: Investigating IoT application behaviour in simulated fog environments. In: Ferguson, D., Pahl, C., Helfert, M. (eds.) Cloud Computing and Services Science (CLOSER 2020). CCIS, vol. 1399, pp. 258–276. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-72369-9_11
Sporny, M., Longley, D., Chadwick, D.: Verifiable credentials data model V1.1. W3C (2022). Retrieved 18 March 2023. https://www.w3.org/TR/vc-data-model
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Kiss, T. et al. (2024). Swarmchestrate: Towards a Fully Decentralised Framework for Orchestrating Applications in the Cloud-to-Edge Continuum. In: Barolli, L. (eds) Advanced Information Networking and Applications. AINA 2024. Lecture Notes on Data Engineering and Communications Technologies, vol 203. Springer, Cham. https://doi.org/10.1007/978-3-031-57931-8_9
Download citation
DOI: https://doi.org/10.1007/978-3-031-57931-8_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-57930-1
Online ISBN: 978-3-031-57931-8
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)