skip to main content
10.1145/3386164.3390516acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiscsicConference Proceedingsconference-collections
research-article

Performance Measurements of Function as a Service Platforms

Authors Info & Claims
Published:06 June 2020Publication History

ABSTRACT

This paper evaluates the current state of the Function as a Service (FaaS) landscape and investigates the extent of the applicability of this new technology for the use-cases of today. We have selected the most popular Function as a Service platforms and have measured the relevant application performance parameters (latency and database access rate) under different types of load. Our source code used by our experiments is available from our public repository. Our measurements confirm that the investigated FaaS technologies have stable performance characteristics under various load conditions. They can be safely applied to a large number of use-cases, and their performance will hold up to the traditional solutions with also added benefits as well, such as less operational costs and better scalability.

References

  1. AWS Lambda homepage, https://aws.amazon.com/lambda, 2019.Google ScholarGoogle Scholar
  2. B. Janakiraman, "Serverless." https://martinfowler.com/bliki/Serverless.html, 2016.Google ScholarGoogle Scholar
  3. Fission homepage, https://fission.io, 2019.Google ScholarGoogle Scholar
  4. fn homepage, https://fnproject.io 2019.Google ScholarGoogle Scholar
  5. G. Hegyi, "Performance testing of Serverless platforms." https://github.com/gerhardberger/performance-testing, 2018.Google ScholarGoogle Scholar
  6. "Gestalt." http://www.galacticfog.com, 2019.Google ScholarGoogle Scholar
  7. Google Cloud Functions homepage, https://cloud.google.com/functions, 2019.Google ScholarGoogle Scholar
  8. I. B. et al., "Serverless computing: Current trends and open problems," Chaudhary S., Somani G., Buyya R. (eds) Research Advances in Cloud Computing (pp. 1--20), 2017.Google ScholarGoogle Scholar
  9. IBM OpenWhisk homepage. https://www.ibm.com/cloud/functions, 2019.Google ScholarGoogle Scholar
  10. J. A. Micheli, "Awesome Serverless." https://github.com/anaibol/awesome-serverless, 2018.Google ScholarGoogle Scholar
  11. J. Spillner, "Snafu: Function-as-a-service (faas) runtime design and implementation," arXiv preprint arXiv:1703.07562, 2017.Google ScholarGoogle Scholar
  12. K6 homepage https://k6.io, 2017.Google ScholarGoogle Scholar
  13. Kubeless homepage, https://kubeless.io, 2019.Google ScholarGoogle Scholar
  14. M. Billock, "The Serverless Performance Shootout." https://dzone.com/articles/the-serverless-performance-shootout, 2017.Google ScholarGoogle Scholar
  15. Microsoft Azure Functions, https://azure.microsoft.com/services/functions, 2019.Google ScholarGoogle Scholar
  16. N. Kbler, "Serverless Compute Manifesto." https://www.nk.de/2016/12/serverless-compute-manifesto.html, 2016.Google ScholarGoogle Scholar
  17. OpenFaaS homepage, https://github.com/openfaas/faas, 2019.Google ScholarGoogle Scholar
  18. P. F. M. Soto, "Running Go AWS Lambdas locally with SLS framework and SAM." https://medium.com/a-man-with-no-server/running-goaws-lambdas-locally-with-sls-framework-and-sam-af3d648d49cb, 2018.Google ScholarGoogle Scholar
  19. P. McGrath, "Serverless computing: Design, implementation, and performance," 37th IEEE I'ntl Conf. on Distributed Computing Systems Workshops, 2017.Google ScholarGoogle Scholar
  20. R. Lnn, "Open Source Load Testing Tool Benchmarks V2." https://blog.loadimpact.com/open-source-load-testing-tool-benchmarksv2, 2017.Google ScholarGoogle Scholar

Index Terms

  1. Performance Measurements of Function as a Service Platforms

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      ISCSIC 2019: Proceedings of the 2019 3rd International Symposium on Computer Science and Intelligent Control
      September 2019
      397 pages
      ISBN:9781450376617
      DOI:10.1145/3386164

      Copyright © 2019 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 6 June 2020

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited

      Acceptance Rates

      ISCSIC 2019 Paper Acceptance Rate77of152submissions,51%Overall Acceptance Rate192of401submissions,48%
    • Article Metrics

      • Downloads (Last 12 months)10
      • Downloads (Last 6 weeks)2

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader