skip to main content
research-article

Performance evaluation teaching in the age of cloud computing

Published:02 October 2023Publication History
Skip Abstract Section

Abstract

Cloud computing has been one of the most significant developments in computer science of the last two decades, fostering sharp changes in performance engineering practices across the computing industry and, at the same time, profoundly steering research trends in academia. A distinctive trait of this paradigm is that cloud engineers can programmatically control application performance, raising an expectation for computing graduates who find employment in software and system development to have basic performance engineering skills. This, in my view, calls for a broader and deeper education on software and system performance topics as part of the computing curriculum, while at the same time requiring a rethink of the syllabus of a classic performance evaluation module. This abstract presents my personal experience in doing so, including a discussion on the educational strengths and weaknesses of performance engineering emerging from cloud computing practice.

References

  1. A. Alnafessah, A. U. Gias, R. Wang, L. Zhu, G. Casale, and A. Filieri. Quality-aware devops research: Where do we stand? IEEE access, 9:44476--44489, 2021.Google ScholarGoogle Scholar
  2. K. R. Baker and D. Trietsch. Principles of sequencing and scheduling. John Wiley & Sons, 2013.Google ScholarGoogle Scholar
  3. P. J. Denning and J. P. Buzen. The operational analysis of queueing network models. ACM Computing Surveys (CSUR), 10(3):225--261, 1978.Google ScholarGoogle Scholar
  4. S. Eismann, J. Scheuner, E. Van Eyk, M. Schwinger, J. Grohmann, N. Herbst, C. L. Abad, and A. Iosup. A review of serverless use cases and their characteristics. arXiv preprint arXiv:2008.11110, 2020.Google ScholarGoogle Scholar
  5. J. L. Hellerstein, Y. Diao, S. Parekh, and D. M. Tilbury. Feedback control of computing systems. John Wiley & Sons, 2004.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. N. R. Herbst, S. Kounev, and R. Reussner. Elasticity in cloud computing: What it is, and what it is not. In 10th international conference on autonomic computing (ICAC 13), pages 23--27, 2013.Google ScholarGoogle Scholar
  7. P. Jamshidi and G. Casale. An uncertainty-aware approach to optimal configuration of stream processing systems. In 2016 IEEE 24th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS), pages 39--48. IEEE, 2016.Google ScholarGoogle ScholarCross RefCross Ref
  8. A. I. Khuri and J. A. Cornell. Response surfaces: designs and analyses. Routledge, 2018.Google ScholarGoogle ScholarCross RefCross Ref
  9. S. Kounev, K.-D. Lange, and J. Von Kistowski. Systems Benchmarking. Springer, 2020.Google ScholarGoogle ScholarCross RefCross Ref
  10. E. D. Lazowska, J. Zahorjan, G. S. Graham, and K. C. Sevcik. Quantitative system performance: computer system analysis using queueing network models. Prentice-Hall, Inc., 1984.Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. D. J. Lilja. Measuring computer performance: a practitioner's guide. Cambridge university press, 2005.Google ScholarGoogle Scholar
  12. T. L. Lo. The evolution of workload management in data processing industry: a survey. In Proceedings of 1986 ACM Fall joint computer conference, pages 768--777, 1986.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. B. Wilder. Cloud architecture patterns: using microsoft azure. " O'Reilly Media, Inc.", 2012.Google ScholarGoogle Scholar

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in

Full Access

  • Published in

    cover image ACM SIGMETRICS Performance Evaluation Review
    ACM SIGMETRICS Performance Evaluation Review  Volume 51, Issue 2
    September 2023
    110 pages
    ISSN:0163-5999
    DOI:10.1145/3626570
    • Editor:
    • Bo Ji
    Issue’s Table of Contents

    Copyright © 2023 Copyright is held by the owner/author(s)

    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 2 October 2023

    Check for updates

    Qualifiers

    • research-article
  • Article Metrics

    • Downloads (Last 12 months)32
    • Downloads (Last 6 weeks)8

    Other Metrics

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader