skip to main content
short-paper

Delayed workload shifting in many-server systems

Published:16 September 2015Publication History
Skip Abstract Section

Abstract

Motivated by the desire to shift workload during periods of overload, we extend established square-root capacity sizing rules for many-server systems in the Quality-and-Efficiency Driven (QED) regime. We propose Delayed Workload Shifting (DWS) which has two defining features: when there are n users in the system, newly arriving users are no longer admitted directly. Instead, these users will reattempt getting access after a stochastic delay until they are successful. The goal of DWS is to release pressure from the system during overloaded periods, and indeed we show that the performance gain can be substantial. We derive nontrivial corrections to classical QED approximations to account for DWS, and leverage these to control stationary and time-varying system behavior.

References

  1. J. Artelejo and A. Gómez-Corral. Retrial Queueing Systems. Springer-Verlag, 2008.Google ScholarGoogle ScholarCross RefCross Ref
  2. F. Avram, A. Janssen, and J. van Leeuwaarden. Loss systems with slow retrials in the Halfin-Whitt regime. Adv. Appl. Prob., 45:274--294, 2013.Google ScholarGoogle ScholarCross RefCross Ref
  3. S. Borst, A. Mandelbaum, and M. Reiman. Dimensioning large call centers. Oper. Res., 52, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. G. Falin and J. Templeton. Retrial Queues. Chapman & Hall, 1997.Google ScholarGoogle ScholarCross RefCross Ref
  5. S. Halfin and W. Whitt. Heavy-traffic limits for queues with many exponential servers. Oper. Res., 29(3):567--588, 1981. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. O. Jennings, A. Mandelbaum, W. Massey, and W. Whitt. Server staffing to meet time-varying demand. Manag. Sci., 42(10):1383--1394, 1996.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. W. Massey and R. Wallace. An asymptotically optimal design of the M/M/c/k queue. Unpublished, 2004.Google ScholarGoogle Scholar

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in

Full Access

  • Published in

    cover image ACM SIGMETRICS Performance Evaluation Review
    ACM SIGMETRICS Performance Evaluation Review  Volume 43, Issue 2
    September 2015
    79 pages
    ISSN:0163-5999
    DOI:10.1145/2825236
    Issue’s Table of Contents

    Copyright © 2015 Authors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 16 September 2015

    Check for updates

    Qualifiers

    • short-paper

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader