Skip to main content
SpringerLink
Log in

A Hybrid Approach to Microservices Load Balancing

  • Chapter
  • First Online:
Microservices

Abstract

During the past few years, microservices have been becoming a common architectural pattern increasingly used to realize flexible and scalable service-based applications. Microservices have grown in popularity as a mainstay in the business environment, allowing companies to increase development and maintenance speed, predict performance and scale, with scalability being one of the most important nonfunctional requirements to be fulfilled. Load balancing is the most prominent approach in support of scalability. In the realm of microservices, one usually distinguishes between two types of load balancers, namely, client-side and server-side load balancers. This work proposes a novel hybrid approach to microservices load balancing that combines the benefits of client-side and server-side load balancing.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.00
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. M.L. Abbott, M.T. Fisher, The Art of Scalability: Scalable Web Architecture, Processes, and Organizations for the Modern Enterprise (Addison-Wesley, Boston, 2015)

    Google Scholar 

  2. C.M. Aderaldo, N.C. Mendonça, C. Pahl, P. Jamshidi, Benchmark requirements for microservices architecture research, in Proceedings of the 1st International Workshop on Establishing the Community-Wide Infrastructure for Architecture-Based Software (ECASE) (IEEE, Piscataway, 2017), pp. 8–13

    Google Scholar 

  3. A. Avritzer, V. Ferme, A. Janes, B. Russo, H. Schulz, A. van Hoorn, A quantitative approach for the assessment of microservice architecture deployment alternatives by automated performance testing, in Software Architecture, ed. by C.E. Cuesta, D. Garlan, J. Pérez (Springer, Cham, 2018), pp. 159–174

    Chapter  Google Scholar 

  4. A. Balalaie, A. Heydarnoori, P. Jamshidi, Migrating to cloud-native architectures using microservices: an experience report, in Advances in Service-Oriented and Cloud Computing, ed. by A. Celesti, P. Leitner (Springer, Cham, 2016)

    Google Scholar 

  5. L. Baresi, D.F. Mendonça, M. Garriga, Empowering low-latency applications through a serverless edge computing architecture, in Service-Oriented and Cloud Computing, F. De Paoli, S. Schulte, E.B. Johnsen (Springer, Berlin, 2017), pp. 196–210

    Chapter  Google Scholar 

  6. A.B. Bondi, Characteristics of scalability and their impact on performance, in Proceedings of the 2nd International Workshop on Software and Performance (ACM, New York, 2000), pp. 195–203

    Google Scholar 

  7. B. Butzin, F. Golatowski, D. Timmermann, Microservices approach for the internet of things, in 2016 IEEE 21st International Conference on Emerging Technologies and Factory Automation (ETFA) (2016), pp. 1–6

    Google Scholar 

  8. A. Christoforou, M. Garriga, A.S. Andreou, L. Baresi, Supporting the decision of migrating to microservices through multi-layer fuzzy cognitive maps, in Service-Oriented Computing, ed. by M. Maximilien, A. Vallecillo, J. Wang, M. Oriol (Springer, Berlin, 2017), pp. 471–480

    Chapter  Google Scholar 

  9. Damien, Load balancing strategies, in Beyond the Lines (2018). http://www.beyondthelines.net/computing/load-balancing-strategies/. Accessed Feb 2019

  10. N. Dragoni, S. Giallorenzo, A.L. Lafuente, M. Mazzara, F. Montesi, R. Mustafin, L. Safina, Microservices: Yesterday, Today, and Tomorrow (Springer, Cham, 2017), pp. 195–216

    Google Scholar 

  11. S.J. Fowler, Production-Ready Microservices: Building Standardized Systems Across an Engineering Organization, 1st edn. (O’Reilly Media, Newton 2016)

    Google Scholar 

  12. P.D. Francesco, I. Malavolta, P. Lago, Research on architecting microservices: trends, focus, and potential for industrial adoption, in 2017 IEEE International Conference on Software Architecture (ICSA) (2017), pp. 21–30

    Google Scholar 

  13. A. Gandhi, M. Harchol-Balter, R. Raghunathan, M.A. Kozuch, Autoscale: dynamic, robust capacity management for multi-tier data centers. ACM Trans. Comput. Syst. 30(4), 14:1–14:26 (2012)

    Article  Google Scholar 

  14. N.R. Herbst, S. Kounev, R. Reussner, Elasticity in cloud computing: what it is, and what it is not, in Proceedings of the 10th International Conference on Autonomic Computing (ICAC13) (USENIX, Berkeley, 2013), pp. 23–27

    Google Scholar 

  15. N. Jackson, Building Microservices with Go: Develop Seamless, Efficient, and Robust Microservices with Go (Packt Publishing, Birmingham, 2017)

    Google Scholar 

  16. P. Kookarinrat, Y. Temtanapat, Design and implementation of a decentralized message bus for microservices, in 2016 13th International Joint Conference on Computer Science and Software Engineering (JCSSE) (2016), pp. 1–6

    Google Scholar 

  17. A. Krylovskiy, M. Jahn, E. Patti, Designing a smart city internet of things platform with microservice architecture, in 2015 3rd International Conference on Future Internet of Things and Cloud (2015), pp. 25–30

    Google Scholar 

  18. J. Lewis, M. Fowler, Microservices: a definition of this new architectural term (2014), https://martinfowler.com/articles/microservices.html. Accessed May 2019

  19. R. Li, Baker street: avoiding bottlenecks with a client-side load balancer for microservices (2015), https://thenewstack.io/baker-street-avoiding-bottlenecks-with-a-client-side-load-balancer-for-microservices/. Accessed Feb 2019

  20. H. Liu, R. Zhang-Shen, On direct routing in the valiant load-balancing architecture, in Proceedings of the Global Telecommunications Conference (GLOBECOM), vol. 2 (2005), p. 6

    Google Scholar 

  21. D. Malavalli, S. Sathappan, Scalable microservice based architecture for enabling DMTF profiles, in 2015 11th International Conference on Network and Service Management (CNSM) (2015), pp. 428–432

    Google Scholar 

  22. A. Messina, R. Rizzo, P. Storniolo, M. Tripiciano, A. Urso, The database-is-the-service pattern for microservice architectures, in International Conference on Information Technology in Bio- and Medical Informatics, vol. 9832 (2016), pp. 223–233

    Chapter  Google Scholar 

  23. A. Messina, R. Rizzo, P. Storniolo, A. Urso, A simplified database pattern for the microservice architecture, in DBKDA 2016: The Eighth International Conference on Advances in Databases, Knowledge, and Data Applications (2016)

    Google Scholar 

  24. D. Namiot, M. Sneps-Sneppe, On micro-services architecture. Int. J. Open Inf. Technol. 2(9), 24–27 (2014)

    Google Scholar 

  25. S. Newman, Building Microservices: Designing Fine-Grained Systems, 1st edn. (O’Reilly Media, Newton, 2015)

    Google Scholar 

  26. H. Nguyen, Z. Shen, X. Gu, S. Subbiah, J. Wilkes, AGILE: elastic distributed resource scaling for infrastructure-as-a-service, in Proceedings of the 10th International Conference on Autonomic Computing (ICAC13), San Jose (USENIX, Berkeley, 2013), pp. 69–82

    Google Scholar 

  27. C. Pautasso, O. Zimmermann, M. Amundsen, J. Lewis, N. Josuttis, Microservices in practice, part 1: reality check and service design. IEEE Softw. 34(1), 91–98 (2017)

    Article  Google Scholar 

  28. P. Potvin, M. Nabaee, F. Labeau, K.K. Nguyen, M. Cheriet, Micro service cloud computing pattern for next generation networks. CoRR, abs/1507.06858 (2015)

    Google Scholar 

  29. M. Stiefel, What is so special about microservices? An interview with Mark Little (2015), https://www.infoq.com/news/2015/02/special-microservices-mark-litle/. Accessed June 2019

  30. D. Taibi, V. Lenarduzzi, C. Pahl, Architectural patterns for microservices: a systematic mapping study, in Proceedings of the 8th International Conference on Cloud Computing and Services Science, CLOSER 2018, Funchal, Madeira, Portugal, March 19–21, 2018 (2018), pp. 221–232

    Google Scholar 

  31. J. Thönes, Microservices. IEEE Softw. 32(1), 116–116 (2015)

    Article  Google Scholar 

  32. G. Toffetti, S. Brunner, M. Blöchlinger, F. Dudouet, A. Edmonds, An architecture for self-managing microservices, in Proceedings of the 1st International Workshop on Automated Incident Management in Cloud, AIMC’15 (ACM, New York, 2015), pp. 19–24

    Google Scholar 

  33. T. Ueda, T. Nakaike, M. Ohara, Workload characterization for microservices, in 2016 IEEE International Symposium on Workload Characterization IISWC (2016), pp. 85–94

    Google Scholar 

  34. M. Villamizar, O. Garcés, H. Castro, M. Verano, L. Salamanca, R. Casallas, S. Gil, Evaluating the monolithic and the microservice architecture pattern to deploy web applications in the cloud, in 2015 10th Computing Colombian Conference (10CCC) (2015), pp. 583–590

    Google Scholar 

  35. H. Zeiner, M. Goller, V.J.E. Jiménez, F. Salmhofer, W. Haas, SeCoS: Web of things platform based on a microservices architecture and support of time-awareness. e & i Elektrotechnik und Informationstechnik 133(3), 158–162 (2016)

    Google Scholar 

  36. O. Zimmermann, Microservices tenets. Comput. Sci. Res. Dev. 32(3), 301–310 (2017)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Information Engineering, Computer Science and Mathematics, University of L’Aquila, L’Aquila, Italy

    Marco Autili, Alexander Perucci & Lorenzo De Lauretis

Authors
  1. Marco Autili
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Alexander Perucci
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lorenzo De Lauretis
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Marco Autili .

Editor information

Editors and Affiliations

  1. Distributed Adaptive Systems (DAS) Research Unit, Fondazione Bruno Kessler, Trento, Italy

    Antonio Bucchiarone

  2. Department of Applied Mathematics and Computer Science, Technical University of Denmark, Kongens Lyngby, Denmark

    Nicola Dragoni

  3. Distributed Systems Group, Vienna University of Technology, Vienna, Austria

    Schahram Dustdar

  4. Dept of Computer Science, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands

    Patricia Lago

  5. Institute of Technologies and Software Development, Innopolis University, Innopolis, Russia

    Manuel Mazzara

  6. Institute of Technologies and Software Development, Innopolis University, Innopolis, Russia

    Victor Rivera

  7. Innopolis University, Innopolis, Russia

    Andrey Sadovykh

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Autili, M., Perucci, A., De Lauretis, L. (2020). A Hybrid Approach to Microservices Load Balancing. In: Bucchiarone, A., et al. Microservices. Springer, Cham. https://doi.org/10.1007/978-3-030-31646-4_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-31646-4_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-31645-7

  • Online ISBN: 978-3-030-31646-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation