Shaoquan Zhang
ABSTRACT
In online service systems, delay experienced by a user from the service request to the service completion is one of the most critical performance metrics. To improve user delay experience, in this paper, we investigate a novel aspect of system design: proactive serving, where the system can predict future user request arrivals and allocate its capacity to serve these upcoming requests proactively. In particular, we investigate the average user delay under proactive serving from a queuing theory perspective. We show that proactive serving reduces the average user delay exponentially (as a function of the prediction window size) under M/M/1 queueing models. Our simulation results show that, for G/G/1 queueing models, the average user delay also decreases significantly under proactive serving.
- B. Coleman. Quality vs. performance in lookahead scheduling. In JCIS, 2006.Google Scholar
Cross Ref
- M. Mandelbaum and D. Shabtay. Scheduling unit length jobs on parallel machines with lookahead information. Journal of Scheduling, 2011. Google ScholarDigital Library
- J. Spencer, M. Sudan, and K. Xu. Queueing with future information. arXiv:1211.0618, 2012.Google Scholar
- J. Tadrous, A. Eryilmaz, and H. El Gamal. Proactive resource allocation: harnessing the diversity and multicast gains. IEEE Trans. Information Theory, 2013.Google Scholar
- S. Zhang, L. Huang, M. Chen, and X. Liu. Effect of proactive serving on user delay reduction in service systems. Technical report. https://sites.google. com/site/proactivetechreport/paper.pdf.Google Scholar
Index Terms
- Effect of proactive serving on user delay reduction in service systems
Recommendations
Effect of proactive serving on user delay reduction in service systems
Performance evaluation reviewIn online service systems, delay experienced by a user from the service request to the service completion is one of the most critical performance metrics. To improve user delay experience, in this paper, we investigate a novel aspect of system design: ...
Proactive Serving Decreases User Delay Exponentially: The Light-Tailed Service Time Case
In online service systems, the delay experienced by users from service request to service completion is one of the most critical performance metrics. To improve user delay experience, recent industrial practices suggest a modern system design mechanism: ...
Queue-Length, Waiting-Time and Service Batch Size Analysis for the Discrete-Time GI/D-MSP Queueing System
AbstractThis paper analyzes an infinite-buffer single-server bulk-service queueing system in which customers arrive according to a discrete-time renewal process. The customers are served under the discrete-time Markovian service process according to the ...
Comments