skip to main content
10.1145/2093185.2093186acmconferencesArticle/Chapter ViewAbstractPublication PagesmiddlewareConference Proceedingsconference-collections
research-article

Eventual consistency: How soon is eventual? An evaluation of Amazon S3's consistency behavior

Published: 12 December 2011 Publication History

Abstract

Over the last few years, Cloud storage systems and so-called NoSQL datastores have found widespread adoption. In contrast to traditional databases, these storage systems typically sacrifice consistency in favor of latency and availability as mandated by the CAP theorem, so that they only guarantee eventual consistency. Existing approaches to benchmark these storage systems typically omit the consistency dimension or did not investigate eventuality of consistency guarantees. In this work we present a novel approach to benchmark staleness in distributed datastores and use the approach to evaluate Amazon's Simple Storage Service (S3). We report on our unexpected findings.

References

[1]
E. Anderson, X. Li, M. Shah, J. Tucek, and J. Wylie. What consistency does your key-value store actually provide. In Proceedings of the Sixth Workshop on Hot Topics in System Dependability (HotDep), 2010.
[2]
R. Baldoni, A. Corsaro, L. Querzoni, S. Scipioni, and S. Tucci-Piergiovanni. An adaptive coupling-based algorithm for internal clock synchronization of large scale dynamic systems. In Proceedings of the 2007 OTM Confederated international conference on On the move to meaningful internet systems-Volume Part I, pages 701--716. Springer-Verlag, 2007.
[3]
D. Bermbach, M. Klems, M. Menzel, and S. Tai. Metastorage: A federated cloud storage system to manage consistency-latency tradeoffs. In Proceedings of the 4th International Conference on Cloud Computing (IEEE Cloud 2011). IEEE, 2011.
[4]
B. Cooper, R. Ramakrishnan, U. Srivastava, A. Silberstein, P. Bohannon, H. Jacobsen, N. Puz, D. Weaver, and R. Yerneni. PNUTS: Yahoo!'s hosted data serving platform. Proceedings of the VLDB Endowment, 1(2):1277--1288, 2008.
[5]
B. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears. Benchmarking cloud serving systems with ycsb. In Proceedings of the 1st ACM symposium on Cloud computing, pages 143--154. ACM, 2010.
[6]
G. DeCandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman, A. Pilchin, S. Sivasubramanian, P. Vosshall, and W. Vogels. Dynamo: amazon's highly available key-value store. In Proc. SOSP, 2007.
[7]
A. Fox and E. Brewer. Harvest, yield, and scalable tolerant systems. In Proceedings of the 7th Workshop on Hot Topics in Operating Systems, 1999, pages 174--178. IEEE, 2002.
[8]
S. Ghemawat, H. Gobioff, and S. Leung. The Google file system. ACM SIGOPS Operating Systems Review, 37(5):29--43, 2003.
[9]
M. Klems, M. Menzel, and R. Fischer. Consistency benchmarking: Evaluating the consistency behavior of middleware services in the cloud. In Proceedings of the 8th International Conference on Service Oriented Computing (ICSOC). Springer, Dec. 2010.
[10]
D. Kossmann, T. Kraska, and S. Loesing. An evaluation of alternative architectures for transaction processing in the cloud. In Proceedings of the 2010 international conference on Management of data, pages 579--590. ACM, 2010.
[11]
T. Kraska, M. Hentschel, G. Alonso, and D. Kossmann. Consistency Rationing in the Cloud: Pay only when it matters. Proceedings of the VLDB Endowment, 2(1):253--264, 2009.
[12]
J. Kubiatowicz, D. Bindel, Y. Chen, S. Czerwinski, P. Eaton, D. Geels, R. Gummadi, S. Rhea, H. Weatherspoon, C. Wells, et al. Oceanstore: An architecture for global-scale persistent storage. ACM SIGARCH Computer Architecture News, 28(5):190--201, 2000.
[13]
A. Lakshman and P. Malik. Cassandra: a decentralized structured storage system. ACM SIGOPS Operating Systems Review, 44(2):35--40, 2010.
[14]
M. Menzel, M. Schoenherr, and S. Tai. (mc2)2: criteria, requirements and a software prototype for cloud infrastructure decisions. Software: Practice and Experience, 2011.
[15]
ntp.org. NTP Algorithm. http://www.ntp.org/ntpfaq/NTP-s-algo.htm (accessed on September 6, 2011).
[16]
S. Sakr, L. Zhao, H. Wada, and A. Liu. Clouddb autoadmin: Towards a truly elastic cloud-based data store. In The 9th IEEE International Conference on Web Services (ICWS 2011), Washington DC, USA, July 2011.
[17]
M. Satyanarayanan, J. Kistler, P. Kumar, M. Okasaki, E. Siegel, and D. Steere. Coda: A highly available file system for a distributed workstation environment. IEEE Transactions on computers, pages 447--459, 1990.
[18]
A. S. Tanenbaum and M. V. Steen. Distributed Systems - Principles and Paradigms. Pearson Education, Upper Saddle River, NJ, 2nd edition, 2007.
[19]
D. Terry, M. Theimer, K. Petersen, A. Demers, M. Spreitzer, and C. Hauser. Managing update conflicts in Bayou, a weakly connected replicated storage system. ACM SIGOPS Operating Systems Review, 29(5):172--182, 1995.
[20]
W. Vogels. Eventually consistent. Queue, 6:14--19, October 2008.
[21]
H. Wada, A. Fekete, L. Zhao, K. Lee, and A. Liu. Data consistency properties and the trade offs in commercial cloud storages: the consumers' perspective. In 5th biennial Conference on Innovative Data Systems Research, CIDR, volume 11, 2011.
[22]
H. Yu and A. Vahdat. Design and evaluation of a conit-based continuous consistency model for replicated services. ACM Transactions on Computer Systems (TOCS), 20(3):239--282, 2002.
[23]
L. Zhao, A. Liu, and J. Keung. Evaluating cloud platform architecture with the care framework. In 2010 Asia Pacific Software Engineering Conference, pages 60--69. IEEE, 2010.

Cited By

View all
  • (2025)The Role of Big Data Analytics in Revolutionizing Diabetes Management and Healthcare Decision-MakingIEEE Access10.1109/ACCESS.2025.352645613(10767-10785)Online publication date: 2025
  • (2024)MuCacheProceedings of the 21st USENIX Symposium on Networked Systems Design and Implementation10.5555/3691825.3691838(221-238)Online publication date: 16-Apr-2024
  • (2024)VConMC: Enabling Consistency Verification for Distributed Systems Using Implementation-Level Model Checkers and Consistency OraclesElectronics10.3390/electronics1306115313:6(1153)Online publication date: 21-Mar-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MW4SOC '11: Proceedings of the 6th Workshop on Middleware for Service Oriented Computing
December 2011
33 pages
ISBN:9781450310673
DOI:10.1145/2093185
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 December 2011

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Amazon S3
  2. cloud computing
  3. eventual consistency

Qualifiers

  • Research-article

Conference

Middleware '11
Sponsor:
  • ACM
  • USENIX Assoc

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)35
  • Downloads (Last 6 weeks)3
Reflects downloads up to 18 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)The Role of Big Data Analytics in Revolutionizing Diabetes Management and Healthcare Decision-MakingIEEE Access10.1109/ACCESS.2025.352645613(10767-10785)Online publication date: 2025
  • (2024)MuCacheProceedings of the 21st USENIX Symposium on Networked Systems Design and Implementation10.5555/3691825.3691838(221-238)Online publication date: 16-Apr-2024
  • (2024)VConMC: Enabling Consistency Verification for Distributed Systems Using Implementation-Level Model Checkers and Consistency OraclesElectronics10.3390/electronics1306115313:6(1153)Online publication date: 21-Mar-2024
  • (2024)CausalMesh: A Causal Cache for Stateful Serverless ComputingProceedings of the VLDB Endowment10.14778/3704965.370496917:13(4599-4613)Online publication date: 1-Sep-2024
  • (2024)Polyglotte Persistenz im DatenmanagementSchnelles und skalierbares Cloud-Datenmanagement10.1007/978-3-031-54388-3_7(161-188)Online publication date: 3-May-2024
  • (2024)Systeme für skalierbares DatenmanagementSchnelles und skalierbares Cloud-Datenmanagement10.1007/978-3-031-54388-3_4(61-90)Online publication date: 3-May-2024
  • (2023)Rendezvous: Where Serverless Functions Find ConsistencyProceedings of the 4th Workshop on Resource Disaggregation and Serverless10.1145/3605181.3626290(51-57)Online publication date: 23-Oct-2023
  • (2023)The Night Shift: Understanding Performance Variability of Cloud Serverless PlatformsProceedings of the 1st Workshop on SErverless Systems, Applications and MEthodologies10.1145/3592533.3592808(27-33)Online publication date: 8-May-2023
  • (2023)Efficient Causal Access in Geo-Replicated Storage SystemsJournal of Grid Computing10.1007/s10723-022-09640-z21:1Online publication date: 28-Jan-2023
  • (2022)Competitive Analysis for the Auditing Cloud ConsistencyInternational Journal of Scientific Research in Science and Technology10.32628/IJSRST229396(408-414)Online publication date: 1-Jun-2022
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media