Abstract
In this paper, we overview the tutorial presented at the 16th European Conference on Software Architecture. The tutorial’s goal was to summarize the challenges and approaches for verification and validation in microservices systems. We introduced the PPTAM approach for dependability assessment. PPTAM employs a variety of architectural artifacts and steps, including the use of operational data obtained from production-level application performance management (APM) tools, the automated assessment of load tests based on defined scalability requirements, and the development of computationally efficient algorithms for software performance anti-pattern (SPA) detection that could be implemented in CI/CD pipelines.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
The relative call frequency represents the proportion that a service contributes to accomplish the task of the system under study. If a service contributes 10% and fails, we consider the system to be 90% functional.
- 2.
PPTAM including a demo is publicly available at https://github.com/pptam.
- 3.
- 4.
- 5.
- 6.
References
Arcelli, D., Cortellessa, V., Trubiani, C.: Experimenting the influence of numerical thresholds on model-based detection and refactoring of performance antipatterns. Electron. Commun. EASST. 59 (2014)
Avritzer, A., et al.: Scalability testing automation using multivariate characterization and detection of software performance antipatterns. J. Syst. Softw. 193 (2022)
Avritzer, A., et al.: A multivariate characterization and detection of software performance antipatterns. In: ICPE 2021: ACM/SPEC International Conference on Performance Engineering. ACM (2021)
Avritzer, A., et al.: Pptam\({}^{\lambda }\): What, where, and how of cross-domain scalability assessment. In: 18th IEEE International Conference on Software Architecture (ICSA). IEEE (2021)
Avritzer, A., et al.: Scalability assessment of microservice architecture deployment configurations: a domain-based approach leveraging operational profiles and load tests. J. Syst. Softw. 165 (2020)
Avritzer, A., Ferme, V., Janes, A., Russo, B., Schulz, H., van Hoorn, A.: A quantitative approach for the assessment of microservice architecture deployment alternatives by automated performance testing. In: Proceedings of the European Conference on Software Architecture (ECSA) (2018)
Avritzer, A., et al.: PPTAM: production and performance testing based application monitoring. In: Companion of the ACM/SPEC International Conference on Performance Engineering (ICPE) (2019)
Calinescu, R., Cortellessa, V., Stefanakos, I., Trubiani, C.: Analysis and Refactoring of Software Systems Using Performance Antipattern Profiles (2020). https://doi.org/10.1007/978-3-030-45234-6_18
Camilli, M., Russo, B.: Modeling performance of microservices systems with growth theory. Empir. Softw. Eng. 27(2), 1–44 (2022). https://doi.org/10.1007/s10664-021-10088-0
Camilli, M., Colarusso, C., Russo, B., Zimeo, E.: Domain metric driven decomposition of data-intensive applications. In: 2020 IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW), pp. 189–196 (2020). https://doi.org/10.1109/ISSREW51248.2020.00071
Camilli, M., Colarusso, C., Russo, B., Zimeo, E.: Actor-driven decomposition of microservices through multi-level scalability assessment. ACM Trans. Softw. Eng. Methodol. (2023, to appear)
Camilli, M., Guerriero, A., Janes, A., Russo, B., Russo, S.: Microservices integrated performance and reliability testing. In: Proceedings of the 3rd ACM/IEEE International Conference on Automation of Software Test. ACM (2022)
Camilli, M., Janes, A., Russo, B.: Automated test-based learning and verification of performance models for microservices systems. JSS 187 (2022)
Cortellessa, V., Di Marco, A., Eramo, R., Pierantonio, A., Trubiani, C.: Approaching the model-driven generation of feedback to remove software performance flaws. In: Euromicro Conference on Software Engineering and Advanced Applications (2009)
Cusick, J., Avritzer, A., Tse, A., Janes, A.: Automated Dependability Assessment in DevOps Environments. In: IEEE International Symposium on Software Reliability Engineering Workshops, ISSRE 2022 - Workshops, Charlotte, NC, USA, October 31–November 3, 2022. IEEE (2022)
Heger, C., van Hoorn, A., Mann, M., Okanovic, D.: Application performance management: state of the art and challenges for the future. In: Proceedings of the 2017 ACM/SPEC International Conference on Performance Engineering (ICPE) (2017)
Microsoft: Performance tuning a distributed application (2019). https://docs.microsoft.com/en-us/azure/architecture/performance/
Pinciroli, R., Smith, C.U., Trubiani, C.: QN-based modeling and analysis of software performance antipatterns for cyber-physical systems. In: Proceedings of the ACM/SPEC International Conference on Performance Engineering (2021)
Schulz, H., Okanovic, D., van Hoorn, A., Ferme, V., Pautasso, C.: Behavior-driven load testing using contextual knowledge-approach and experiences. In: Companion of the ACM/SPEC International Conference on Performance Engineering (ICPE) (2019)
Smith, C.U., Williams, L.G.: Software performance antipatterns for identifying and correcting performance problems. In: International Computer Measurement Group Conference (2012)
Jansen, A., Malavolta, I., Muccini, H., Ozkaya, I., Zimmermann, O. (eds.) ECSA 2020. LNCS, vol. 12292. Springer, Cham (2020 ). https://doi.org/10.1007/978-3-030-58923-3
Trubiani, C., Di Marco, A., Cortellessa, V., Mani, N., Petriu, D.: Exploring synergies between bottleneck analysis and performance antipatterns. In: Proceedings of the 5th ACM/SPEC International Conference on Performance Engineering (2014)
Trubiani, C., Ghabi, A., Egyed, A.: Exploiting traceability uncertainty between software architectural models and performance analysis results. In: Weyns, D., Mirandola, R., Crnkovic, I. (eds.) ECSA 2015. LNCS, vol. 9278, pp. 305–321. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-23727-5_26
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Avritzer, A., Camilli, M., Janes, A., Russo, B., Trubiani, C., van Hoorn, A. (2023). Continuous Dependability Assessment of Microservice Systems. In: Batista, T., Bureš, T., Raibulet, C., Muccini, H. (eds) Software Architecture. ECSA 2022 Tracks and Workshops. ECSA 2022. Lecture Notes in Computer Science, vol 13928. Springer, Cham. https://doi.org/10.1007/978-3-031-36889-9_11
Download citation
DOI: https://doi.org/10.1007/978-3-031-36889-9_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-36888-2
Online ISBN: 978-3-031-36889-9
eBook Packages: Computer ScienceComputer Science (R0)