skip to main content
10.1145/3489048.3530959acmconferencesArticle/Chapter ViewAbstractPublication PagesmetricsConference Proceedingsconference-collections
abstract
Public Access

WISEFUSE: Workload Characterization and DAG Transformation for Serverless Workflows

Published: 06 June 2022 Publication History

Abstract

We characterize production workloads of serverless DAGs at a major cloud provider. Our analysis highlights two major factors that limit performance: (a) lack of efficient communication methods between the serverless functions in the DAG, and (b) stragglers when a DAG stage invokes a set of parallel functions that must complete before starting the next DAG stage. To address these limitations, we propose WISEFUSE, an automated approach to generate an optimized execution plan for serverless DAGs for a user-specified latency objective or $ budget. We introduce three optimizations: (1) Fusion combines in-series functions together in a single VM to reduce the communication overhead between cascaded functions. (2) Bundling executes a group of parallel invocations of a function in one VM to improve resource sharing among the parallel workers to reduce skew. (3) Resource Allocation assigns the right VM size to each function or function bundle in the DAG to reduce the E2E latency and cost. We implement WISEFUSE to evaluate it experimentally using three popular serverless applications with different DAG structures, memory footprints, and intermediate data sizes. Compared to competing approaches and other alternatives, WISEFUSE shows significant improvements in E2E latency and cost. Specifically, for a machine learning pipeline, WISEFUSE achieves P95 latency that is 67% lower than Photons, 39% lower than Faastlane, and 90% lower than SONIC without increasing the $ cost.

References

[1]
Akkus, I. E., Chen, R., Rimac, I., Stein, M., Satzke, K., Beck, A., Aditya, P., and Hilt, V. SAND: Towards High-Performance serverless computing. In 2018 USENIX Annual Technical Conference (USENIX ATC 18) (Boston, MA, July 2018), USENIX Association, pp. 923--935.
[2]
Dukic, V., Bruno, R., Singla, A., and Alonso, G. Photons: Lambdas on a Diet. In Proceedings of the 11th ACM Symposium on Cloud Computing (New York, NY, USA, 2020), SoCC '20, Association for Computing Machinery, p. 45--59.
[3]
Klimovic, A., Wang, Y., Stuedi, P., Trivedi, A., Pfefferle, J., and Kozyrakis, C. Pocket: Elastic Ephemeral Storage for Serverless Analytics. In 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 18) (Carlsbad, CA, Oct. 2018), USENIX Association, pp. 427--444.
[4]
Kotni, S., Nayak, A., Ganapathy, V., and Basu, A. Faastlane: Accelerating Function-as-a-Service workflows. In 2021 USENIX Annual Technical Conference (USENIX ATC 21) (July 2021), USENIX Association, pp. 805--820.
[5]
Mahgoub, A., Shankar, K., Mitra, S., Klimovic, A., Chaterji, S., and Bagchi, S. SONIC: Application-aware data passing for chained serverless applications. In 2021 USENIX Annual Technical Conference (USENIX ATC 21) (July 2021), USENIX Association, pp. 285--301.
[6]
Shahrad, M., Fonseca, R., Goiri, Í., Chaudhry, G., Batum, P., Cooke, J., Laureano, E., Tresness, C., Russinovich, M., and Bianchini, R. Serverless in the Wild: Characterizing and Optimizing the Serverless Workload at a Large Cloud Provider. In 2020 USENIX Annual Technical Conference (USENIX ATC 20) (July 2020), USENIX Association, pp. 205--218.
[7]
Wang, L., Li, M., Zhang, Y., Ristenpart, T., and Swift, M. Peeking Behind the Curtains of Serverless Platforms. In 2018 USENIX Annual Technical Conference (USENIX ATC 18) (Boston, MA, July 2018), USENIX Association, pp. 133--146.

Cited By

View all
  • (2024)Forecasting Algorithms for Intelligent Resource Scaling: An Experimental AnalysisProceedings of the 2024 ACM Symposium on Cloud Computing10.1145/3698038.3698564(126-143)Online publication date: 20-Nov-2024
  • (2024)Caribou: Fine-Grained Geospatial Shifting of Serverless Applications for SustainabilityProceedings of the ACM SIGOPS 30th Symposium on Operating Systems Principles10.1145/3694715.3695954(403-420)Online publication date: 4-Nov-2024
  • (2024)FUSIONIZE++: Improving Serverless Application Performance Using Dynamic Task Inlining and Infrastructure OptimizationIEEE Transactions on Cloud Computing10.1109/TCC.2024.345110812:4(1172-1185)Online publication date: Oct-2024
  • Show More Cited By

Index Terms

  1. WISEFUSE: Workload Characterization and DAG Transformation for Serverless Workflows

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SIGMETRICS/PERFORMANCE '22: Abstract Proceedings of the 2022 ACM SIGMETRICS/IFIP PERFORMANCE Joint International Conference on Measurement and Modeling of Computer Systems
    June 2022
    132 pages
    ISBN:9781450391412
    DOI:10.1145/3489048
    • cover image ACM SIGMETRICS Performance Evaluation Review
      ACM SIGMETRICS Performance Evaluation Review  Volume 50, Issue 1
      SIGMETRICS '22
      June 2022
      118 pages
      ISSN:0163-5999
      DOI:10.1145/3547353
      Issue’s Table of Contents
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 06 June 2022

    Check for updates

    Author Tags

    1. dag transformation
    2. serverless
    3. workload characterization

    Qualifiers

    • Abstract

    Funding Sources

    Conference

    SIGMETRICS/PERFORMANCE '22
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 459 of 2,691 submissions, 17%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)132
    • Downloads (Last 6 weeks)24
    Reflects downloads up to 14 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Forecasting Algorithms for Intelligent Resource Scaling: An Experimental AnalysisProceedings of the 2024 ACM Symposium on Cloud Computing10.1145/3698038.3698564(126-143)Online publication date: 20-Nov-2024
    • (2024)Caribou: Fine-Grained Geospatial Shifting of Serverless Applications for SustainabilityProceedings of the ACM SIGOPS 30th Symposium on Operating Systems Principles10.1145/3694715.3695954(403-420)Online publication date: 4-Nov-2024
    • (2024)FUSIONIZE++: Improving Serverless Application Performance Using Dynamic Task Inlining and Infrastructure OptimizationIEEE Transactions on Cloud Computing10.1109/TCC.2024.345110812:4(1172-1185)Online publication date: Oct-2024
    • (2024)Mosaic: Harnessing the Micro-Architectural Resources of Servers in Serverless Environments2024 57th IEEE/ACM International Symposium on Microarchitecture (MICRO)10.1109/MICRO61859.2024.00103(1397-1412)Online publication date: 2-Nov-2024
    • (2024)EcoFaaS: Rethinking the Design of Serverless Environments for Energy Efficiency2024 ACM/IEEE 51st Annual International Symposium on Computer Architecture (ISCA)10.1109/ISCA59077.2024.00042(471-486)Online publication date: 29-Jun-2024
    • (2023)MXFaaS: Resource Sharing in Serverless Environments for Parallelism and EfficiencyProceedings of the 50th Annual International Symposium on Computer Architecture10.1145/3579371.3589069(1-15)Online publication date: 17-Jun-2023
    • (2023)HashCache: Accelerating Serverless Computing by Skipping Duplicated Function ExecutionIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2023.332333034:12(3192-3206)Online publication date: 10-Oct-2023
    • (2023)DVFaaS: Leveraging DVFS for FaaS WorkflowsIEEE Computer Architecture Letters10.1109/LCA.2023.328808922:2(85-88)Online publication date: 1-Jul-2023
    • (2023)Āpta: Fault-tolerant object-granular CXL disaggregated memory for accelerating FaaS2023 53rd Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN)10.1109/DSN58367.2023.00030(201-215)Online publication date: Jun-2023
    • (2023)MicroBlend: An Automated Service-Blending Framework for Microservice-Based Cloud Applications2023 IEEE 16th International Conference on Cloud Computing (CLOUD)10.1109/CLOUD60044.2023.00062(460-470)Online publication date: Jul-2023
    • Show More Cited By

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Login options

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media