Cited By
View all- Kesidis GKonstantopoulos T(2020)TB/GI/1 queues with arrival traffic envelopesACM SIGMETRICS Performance Evaluation Review10.1145/3439602.343961348:2(27-29)Online publication date: 25-Nov-2020
Overbooking Lambda Functions in the Cloud
Pages 1 - 6
Abstract
We consider the problem of scheduling serverless-computing instances such as Amazon Lambda functions. Instead of a quota per tenant/customer, we assume demand for Lambda functions is modulated by token-bucket mechanisms per tenant. Such quotas are due to, e.g., limited resources (as in a fog/edge-cloud context) or to prevent excessive unauthorized invocation of numerous instances by malware. Based on an upper bound on the stationary number of active "Lambda servers" considering the execution-time distribution of Lambda functions, we describe an approach that the cloud could use to overbook Lambda functions for improved utilization of IT resources. An earlier bound for a single service tier is extended to multiple service tiers.
References
[1]
AWS. 2019. AWS Lambda Function Scaling. https://docs.aws.amazon.com/lambda/latest/dg/concurrent-executions.html.
[2]
R.S. Barga. 2017. Serverless Computing - Redefining the Cloud. In Proc. WoSC, https://www.serverlesscomputing.org/wosc17/presentations/barga-keynote-serverless.pdf.
[3]
M.C. Cohen, V. Mirrokni, P. Keller, and M. Zadimoghaddam. June 2017. Overcommitment in Cloud Services Bin packing with Chance Constraints. In Proc. ACM SIGMETRICS. Urbana-Campaign, IL.
[4]
R.L. Cruz. Aug. 1995. Quality of Service Guarantees in Virtual Circuit Switched Networks. IEEE JSAC Vol. 13, No. 6 (Aug. 1995), pages 1048--1056.
[5]
C. Delimitrou and C. Kozyrakis. 2016. HCloud: Resource-Efficient Provisioning in Shared Cloud Systems. In Proc. ASPLOS. Atlanta.
[6]
C. Delimitrou and C. Kozyrakis. Dec. 2013. QoS-Aware Scheduling in Heterogeneous Datacenters with Paragon. ACM Trans. on Computer Systems 31, 4 (Dec. 2013).
[7]
J. Heinanen, T. Finland, and R. Guerin. 1999. A single rate three color marker. RFC 2697 available at www.ietf.org (1999).
[8]
J. Heinanen, T. Finland, and R. Guerin. 1999. A two rate three color marker. RFC 2698 available at www.ietf.org (1999).
[9]
A. Jain, A.F. Baarzi, N. Alfares, G. Kesidis, B. Urgaonkar, and M. Kandemir. Nov. 2019; https://github.com/PSU-Cloud/splitserve-spark/blob/master/Paper/SplitServe.pdf. SplitServe: Efficient Splitting Complex Workloads across FaaS and IaaS.
[10]
G. Kesidis. Dec. 2019; https://arxiv.org/abs/1901.09842. Temporal Overbooking of Lambda Functions in the Cloud. In Proc. ACM/IFIP Workshop on Containers. Davis, CA.
[11]
G. Kesidis, K. Chakraborty, and L. Tassiulas. Dec. 2000. Traffic shaping for a loss system. IEEE Communication Letters 4, No. 12 (Dec. 2000), pp. 417--419.
[12]
G. Kesidis, N. Nasiriani, B. Urgaonkar, and C. Wang. 2016. Neutrality in Future Public Clouds: Implications and Challenges. In Proc. USENIX HotCloud.
[13]
E. Kim. July 19, 2018. Internal documents show how Amazon scrambled to fix Prime Day glitches. https://www.cnbc.com/2018/07/19/amazon-internal-documents-what-caused-prime-day-crash-company-scramble.html.
[14]
AWS Lambda. March 2019. Security Overview of AWS Lambda. https://d1.awsstatic.com/whitepapers/Overview-AWS-Lambda-Security.pdf.
[15]
S. Low and P. Varaiya. 1991. A simple theory of traffic resource allocation in ATM. In Proc. IEEE GLOBECOM.
[16]
G. McGrath and P.R. Brenner. 2017. Serverless computing: Design, implementation, and performance. In IEEE Int'l Conf. on Distributed Computing Systems Workshops.
[17]
T.P. Minka. 2002. Estimating a Gamma distribution. https://tminka.github.io/papers/minka-gamma.pdf.
[18]
Sergio Pacheco-Sanchez, Giuliano Casale, Bryan W. Scotney, Sally I. McClean, Gerard P. Parr, and Stephen Dawson. 2011. Markovian Workload Characterization for QoS Prediction in the Cloud. In IEEE CLOUD. IEEE, 147--154.
[19]
M. Stein. Sept. 2018. The Serverless Scheduling Problem and NOAH. https://arxiv.org/abs/1809.06100.
[20]
L. Wang, M. Li, Y. Zhang, T. Ristenpart, and M. Swift. 2018. Peeking Behind the Curtains of Serverless Platforms. In Proc. USENIX ATC. Boston.
[21]
R.W. Wolff. 1989. Stochastic Modeling and the Theory of Queues. Prentice-Hall, Englewood Cliffs, NJ.
Recommendations
On Multiplicative $\lambda$-Approximations and Some Geometric Applications
† Special Section on the Forty-Second Annual ACM Symposium on Theory of Computing (STOC 2010)Let $\mathcal{F}$ be a set system over an underlying finite set $X$, and let $\mu$ be a nonnegative measure over $X$; i.e., for every $S \subseteq X$, $\mu(S)=\sum_{x\in S} \mu(x)$. A measure $\mu^*$ on $X$ is called a multiplicative ${\lambda}$-...
Cloud in cloud: approaches and implementations
SIGITE '10: Proceedings of the 2010 ACM conference on Information technology educationFacilitated by the development of virtual machine (VM) technology, distributed computing and high-speed internet, cloud computing has been gradually adopted in industry and in education to deliver on-demand services and applications remotely. In this ...
Bounding the Independence Number in Some $$(n,k,\ell ,\lambda )$$(n,k,ℓ,?)-Hypergraphs
Given positive integers k, $$\ell $$ℓ and $$\lambda $$__ __ such that $$2\leqslant \ell \leqslant k-1$$2__ __ℓ__ __k-1, an $$(n,k,\ell ,\lambda )$$(n,k,ℓ,__ __)-hypergraph $$\mathcal {H}$$H is a k-uniform hypergraph on the vertex set [n] in which every ...
Comments
Information & Contributors
Information
Published In
December 2019
52 pages
ISBN:9781450370332
DOI:10.1145/3366615
Copyright © 2019 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 09 December 2019
Check for updates
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
Middleware '19
Sponsor:
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 203Total Downloads
- Downloads (Last 12 months)7
- Downloads (Last 6 weeks)0
Reflects downloads up to 03 Mar 2025
Other Metrics
Citations
Cited By
View all- Kesidis GKonstantopoulos T(2020)TB/GI/1 queues with arrival traffic envelopesACM SIGMETRICS Performance Evaluation Review10.1145/3439602.343961348:2(27-29)Online publication date: 25-Nov-2020
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in