ABSTRACT
This paper evaluates the current state of the Function as a Service (FaaS) landscape and investigates the extent of the applicability of this new technology for the use-cases of today. We have selected the most popular Function as a Service platforms and have measured the relevant application performance parameters (latency and database access rate) under different types of load. Our source code used by our experiments is available from our public repository. Our measurements confirm that the investigated FaaS technologies have stable performance characteristics under various load conditions. They can be safely applied to a large number of use-cases, and their performance will hold up to the traditional solutions with also added benefits as well, such as less operational costs and better scalability.
- AWS Lambda homepage, https://aws.amazon.com/lambda, 2019.Google Scholar
- B. Janakiraman, "Serverless." https://martinfowler.com/bliki/Serverless.html, 2016.Google Scholar
- Fission homepage, https://fission.io, 2019.Google Scholar
- fn homepage, https://fnproject.io 2019.Google Scholar
- G. Hegyi, "Performance testing of Serverless platforms." https://github.com/gerhardberger/performance-testing, 2018.Google Scholar
- "Gestalt." http://www.galacticfog.com, 2019.Google Scholar
- Google Cloud Functions homepage, https://cloud.google.com/functions, 2019.Google Scholar
- I. B. et al., "Serverless computing: Current trends and open problems," Chaudhary S., Somani G., Buyya R. (eds) Research Advances in Cloud Computing (pp. 1--20), 2017.Google Scholar
- IBM OpenWhisk homepage. https://www.ibm.com/cloud/functions, 2019.Google Scholar
- J. A. Micheli, "Awesome Serverless." https://github.com/anaibol/awesome-serverless, 2018.Google Scholar
- J. Spillner, "Snafu: Function-as-a-service (faas) runtime design and implementation," arXiv preprint arXiv:1703.07562, 2017.Google Scholar
- K6 homepage https://k6.io, 2017.Google Scholar
- Kubeless homepage, https://kubeless.io, 2019.Google Scholar
- M. Billock, "The Serverless Performance Shootout." https://dzone.com/articles/the-serverless-performance-shootout, 2017.Google Scholar
- Microsoft Azure Functions, https://azure.microsoft.com/services/functions, 2019.Google Scholar
- N. Kbler, "Serverless Compute Manifesto." https://www.nk.de/2016/12/serverless-compute-manifesto.html, 2016.Google Scholar
- OpenFaaS homepage, https://github.com/openfaas/faas, 2019.Google Scholar
- P. F. M. Soto, "Running Go AWS Lambdas locally with SLS framework and SAM." https://medium.com/a-man-with-no-server/running-goaws-lambdas-locally-with-sls-framework-and-sam-af3d648d49cb, 2018.Google Scholar
- P. McGrath, "Serverless computing: Design, implementation, and performance," 37th IEEE I'ntl Conf. on Distributed Computing Systems Workshops, 2017.Google Scholar
- R. Lnn, "Open Source Load Testing Tool Benchmarks V2." https://blog.loadimpact.com/open-source-load-testing-tool-benchmarksv2, 2017.Google Scholar
Index Terms
- Performance Measurements of Function as a Service Platforms
Recommendations
Architectural Implications of Function-as-a-Service Computing
MICRO '52: Proceedings of the 52nd Annual IEEE/ACM International Symposium on MicroarchitectureServerless computing is a rapidly growing cloud application model, popularized by Amazon's Lambda platform. Serverless cloud services provide fine-grained provisioning of resources, which scale automatically with user demand. Function-as-a-Service (FaaS)...
Temporal Performance Modelling of Serverless Computing Platforms
WoSC '20: Proceedings of the 2020 Sixth International Workshop on Serverless ComputingAnalytical performance models have been shown very efficient in analyzing, predicting, and improving the performance of distributed computing systems. However, there is a lack of rigorous analytical models for analyzing the transient behaviour of ...
A case study on the stability of performance tests for serverless applications
Abstract Context:While in serverless computing, application resource management and operational concerns are generally delegated to the cloud provider, ensuring that serverless applications meet their performance requirements is ...
Highlights- Case study on the stability of performance tests of serverless applications.
- ...
Comments