Skip to main content
SpringerLink
Log in

SCORE: A Resource-Efficient Microservice Orchestration Model Based on Spectral Clustering in Edge Computing

  • Conference paper
  • First Online:
Book cover Service-Oriented Computing (ICSOC 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13740))

Included in the following conference series:

  • 1794 Accesses

Abstract

Microservices architecture has an essential characteristic of loose coupling compared to traditional monolithic applications, allowing applications to be created, updated, and extended independently. With lightweight virtualization technologies, such as container, microservices-based applications can be widely deployed to the edge of the network. However, challenges of deploying microservice in edge come from the contradiction between the latency sensitivity of applications and limited node resources. We propose a microservice orchestration model(SCORE) for edge scenarios that enable microservice scheduling based on spectrum clustering(MSSC) and dynamic resource allocation under multi-dimension constraints based on the sliding window(SW) mechanism. MSSC significantly reduces the cross-node communication traffic between microservices by portraying the dependencies between microservices through a graph and then using spectral clustering to map microservices to edge nodes. At the same time, the process of cluster scaling under multi-dimension provides more fine-grained resource allocation for microservices and improves resource utilization while ensuring service-level performance objectives(SLOs). The experimental results indicate that our approach reduces the inter-node communication traffic by 17.7% compared to baseline, and the overall average memory requested for processing a single request is 19.4% and 45.8% of baseline, respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Kubernetes documentation, https://kubernetes.io/. Accessed 30 Jun 2022

  2. Swarm mode overview, https://docs.docker.com/engine/swarm/. Accessed 30 Jun 2022

  3. OpenShift container platform 4.10 documentation, https://docs.openshift.com/container-platform/4.10/welcome/index.html. Accessed 30 Jun 2022

  4. Overview of microservices traces, https://github.com/alibaba/clusterdata/tree/master/cluster-trace-microservices-v2021. Accessed 30 Jun 2022

  5. An open source load testing tool, https://locust.io/. Accessed 30 Jun 2022

  6. eBPF-based networking, observability, security, https://docs.cilium.io/en/stable/. Accessed 30 Jun 2022

  7. The time series data platform where developers build IoT, analytics, and cloud applications, https://www.influxdata.com/. Accessed 30 Jun 2022

  8. Microservices demo application., https://github.com/GoogleCloudPlatform/microservices-demo. Accessed 30 Jun 2022

  9. Baarzi, A.F., Kesidis, G.: SHOWAR: right-sizing and efficient scheduling of microservices. In: Proceedings of the ACM Symposium on Cloud Computing, pp. 427–441 (2021)

    Google Scholar 

  10. Baresi, L., Guinea, S., Leva, A., Quattrocchi, G.: A discrete-time feedback controller for containerized cloud applications. In: Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering, pp. 217–228 (2016)

    Google Scholar 

  11. Chhikara, P., Tekchandani, R., Kumar, N., Obaidat, M.S.: An efficient container management scheme for resource-constrained intelligent IoT devices. IEEE Internet Things J. 8(16), 12597–12609 (2021). https://doi.org/10.1109/JIOT.2020.3037181

    Article  Google Scholar 

  12. Fourati, M.H., Marzouk, S., Jmaiel, M.: EPMA: elastic platform for microservices-based applications: towards optimal resource elasticity. J. Grid Comput. 20(1), 1–21 (2022)

    Article  Google Scholar 

  13. Fu, K., et al.: QoS-aware and resource efficient microservice deployment in cloud-edge continuum. In: 2021 IEEE International Parallel and Distributed Processing Symposium (IPDPS). pp. 932–941 (2021). https://doi.org/10.1109/IPDPS49936.2021.00102

  14. Hu, Y., Zhou, H., de Laat, C., Zhao, Z.: Concurrent container scheduling on heterogeneous clusters with multi-resource constraints. Future Gener. Comput. Syst. 102, 562–573 (2020)

    Article  Google Scholar 

  15. Jiang, C., Cheng, X., Gao, H., Zhou, X., Wan, J.: Toward computation offloading in edge computing: a survey. IEEE Access 7, 131543–131558 (2019). https://doi.org/10.1109/ACCESS.2019.2938660

    Article  Google Scholar 

  16. Kang, P., Lama, P.: Robust resource scaling of containerized microservices with probabilistic machine learning. In: 2020 IEEE/ACM 13th International Conference on Utility and Cloud Computing (UCC), pp. 122–131. IEEE (2020)

    Google Scholar 

  17. Li, X., Li, X., Tan, Y., Zhu, H., Tan, S.: Multi-resource workload mapping with minimum cost in cloud environment. Concurr. Comput.: Pract. Exper. 31(15), e5167 (2019)

    Article  Google Scholar 

  18. Luo, S., et al.: Characterizing microservice dependency and performance: Alibaba trace analysis. In: Proceedings of the ACM Symposium on Cloud Computing, p. 412–426. SoCC ’21, Association for Computing Machinery, New York, NY, USA (2021). https://doi.org/10.1145/3472883.3487003

  19. Mao, Y., Oak, J., Pompili, A., Beer, D., Han, T., Hu, P.: DRAPS: dynamic and resource-aware placement scheme for docker containers in a heterogeneous cluster. In: 2017 IEEE 36th International Performance Computing and Communications Conference (IPCCC), pp. 1–8. IEEE (2017)

    Google Scholar 

  20. Marko, L.: Qiniu: Kubernetes in Action. Publishing House of Electronics Industry, Beijing (2021)

    Google Scholar 

  21. Rausch, T., Rashed, A., Dustdar, S.: Optimized container scheduling for data-intensive serverless edge computing. Future Gener. Comput. Syst. 114, 259–271 (2021)

    Article  Google Scholar 

  22. Rossi, F., Nardelli, M., Cardellini, V.: Horizontal and vertical scaling of container-based applications using reinforcement learning. In: 2019 IEEE 12th International Conference on Cloud Computing (CLOUD), pp. 329–338. IEEE (2019)

    Google Scholar 

  23. Taherizadeh, S., Stankovski, V.: Dynamic multi-level auto-scaling rules for containerized applications. Comput. J. 62(2), 174–197 (2019)

    Article  Google Scholar 

  24. Tan, Y., Wu, F., Wu, Q., Liao, X.: Resource stealing: a resource multiplexing method for mix workloads in cloud system. J. Supercomput. 75(1), 33–49 (2019)

    Article  Google Scholar 

  25. Tang, Z., Zhou, X., Zhang, F., Jia, W., Zhao, W.: Migration modeling and learning algorithms for containers in fog computing. IEEE Trans. Serv. Comput. 12(5), 712–725 (2019). https://doi.org/10.1109/TSC.2018.2827070

    Article  Google Scholar 

  26. Yang, Z., Nguyen, P., Jin, H., Nahrstedt, K.: MIRAS: model-based reinforcement learning for microservice resource allocation over scientific workflows. In: 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS), pp. 122–132. IEEE (2019)

    Google Scholar 

  27. Yin, L., Luo, J., Luo, H.: Tasks scheduling and resource allocation in fog computing based on containers for smart manufacturing. IEEE Trans. Industr. Inform. 14(10), 4712–4721 (2018)

    Article  Google Scholar 

  28. Zhang, J., Zhou, X., Ge, T., Wang, X., Hwang, T.: Joint task scheduling and containerizing for efficient edge computing. IEEE Trans. Parallel Distrib. Syst. 32(8), 2086–2100 (2021)

    Article  Google Scholar 

  29. Zhong, Z., Buyya, R.: A cost-efficient container orchestration strategy in kubernetes-based cloud computing infrastructures with heterogeneous resources. ACM Trans. Internet Technol. (TOIT) 20(2), 1–24 (2020)

    Article  Google Scholar 

  30. Zhou, Z., Chen, X., Li, E., Zeng, L., Luo, K., Zhang, J.: Edge intelligence: paving the last mile of artificial intelligence with edge computing. Proc. IEEE 107(8), 1738–1762 (2019). https://doi.org/10.1109/JPROC.2019.2918951

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Computer, National University of Defense Technology, Changsha, 410073, China

    Ning Li, Yusong Tan, Xiaochuan Wang & Bao Li

  2. Tianjin Institute of Advanced Technology, Tianjin, 300450, China

    Jun Luo

Authors
  1. Ning Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yusong Tan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiaochuan Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Bao Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jun Luo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ning Li .

Editor information

Editors and Affiliations

  1. University of Malaga, Málaga, Spain

    Javier Troya

  2. University of Michigan-Dearborn, Dearborn, MI, USA

    Brahim Medjahed

  3. University of Castilla-La Mancha, Ciudad Real, Spain

    Mario Piattini

  4. The University of New South Wales, Sydney, NSW, Australia

    Lina Yao

  5. University of Seville, Seville, Spain

    Pablo Fernández

  6. University of Seville, Seville, Spain

    Antonio Ruiz-Cortés

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Li, N., Tan, Y., Wang, X., Li, B., Luo, J. (2022). SCORE: A Resource-Efficient Microservice Orchestration Model Based on Spectral Clustering in Edge Computing. In: Troya, J., Medjahed, B., Piattini, M., Yao, L., Fernández, P., Ruiz-Cortés, A. (eds) Service-Oriented Computing. ICSOC 2022. Lecture Notes in Computer Science, vol 13740. Springer, Cham. https://doi.org/10.1007/978-3-031-20984-0_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-20984-0_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-20983-3

  • Online ISBN: 978-3-031-20984-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation