Skip to main content

Invited Paper: Towards Practical Atomic Distributed Shared Memory: An Experimental Evaluation

  • Conference paper
  • First Online:
Stabilization, Safety, and Security of Distributed Systems (SSS 2022)

Abstract

Distributed Shared Storage Services may serve as building blocks to yield complex, decentralized, cloud applications in emerging technologies (e.g., IoT, VR/AR), as they offer a transparent cloud storage space where distributed applications can store, retrieve, and coordinate over shared data. Ideally, distributed applications would like to communicate through a “cloud” memory layer that may provide similar guarantees as a centralized sequential memory. Atomic Distributed Shared Memory (ADSM) provides the illusion of a sequential memory space despite asynchrony, network perturbations, and device failures. A plethora of algorithmic solutions along with proven correctness guarantees have been proposed to provide ADSM in a message passing system. None of them, however, has been adopted in a real working solution: commercial solutions avoid the use of ADSM algorithms, mainly due to their communication overhead. But what is exactly the performance overhead of an ADSM algorithm over existing commercial solutions? In this work we want to provide a first answer to this question by performing an in-depth experimental comparison of the state-of-the-art dynamic ADSM algorithm ARES, with two well-established open-source distributed storage solutions, Cassandra and Redis. The results show that ARES’s performance is comparable with the commercial systems, with respect to scalability, object size and throughput.

Supported by the EU’s NGIAtlantic.eu cascading grant agreement no. OC4-347; https://projects.algolysis.com/ares-ngi/.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 64.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 84.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://projects.algolysis.com/ares-ngi/results/.

References

  1. Cassandra. https://cassandra.apache.org/_/index.html

  2. Redis. https://redis.io

  3. Data repository. https://github.com/nicolaoun/ngiatlantic-public-data

  4. Aguilera, M.K., Keidar, I., Malkhi, D., Shraer, A.: Dynamic atomic storage without consensus. J. ACM 58(2), 7:1–7:32 (2011)

    Google Scholar 

  5. Ansible. https://www.ansible.com/overview/how-ansible-works

  6. Attiya, H.: Robust simulation of shared memory: 20 years after. Bull. EATCS 100, 99–114 (2010)

    MathSciNet  MATH  Google Scholar 

  7. Attiya, H., Bar-Noy, A., Dolev, D.: Sharing memory robustly in message-passing systems. J. ACM 42(1), 124–142 (1995)

    Article  MATH  Google Scholar 

  8. CloudlabUtah. Cloudlab Utah. https://www.cloudlab.us

  9. Dutta, P., Guerraoui, R., Levy, R., Chakraborty, A.: How fast can a distributed atomic read be? In: Proceedings of PODC, pp. 236–245 (2004)

    Google Scholar 

  10. Georgiou, C., Nicolaou, N., Shvartsman, A.: Fault-tolerant semifast implementations of atomic read/write registers. JPDC 69(1), 62–79 (2009)

    Google Scholar 

  11. Georgiou, C., Hadjistasi, T., Nicolaou, N., Schwarzmann, A.A.: Implementing three exchange read operations for distributed atomic storage. JPDC 163, 97–113 (2022)

    Google Scholar 

  12. Georgiou, C., Nicolaou, N., Trigeorgi, A.: Fragmented ARES: dynamic storage for large objects. In: Proceedings of DISC (2022, To appear). arXiv:2201.13292

  13. Gilbert, S., Lynch, N.A., Shvartsman, A.A.: RAMBO: a robust, reconfigurable atomic memory service for dynamic networks. Dist. Comp. 23(4), 225–272 (2010)

    Article  MATH  Google Scholar 

  14. Gramoli, V., Nicolaou, N., Schwarzmann, A.A.: Consistent Distributed Storage. Synthesis Lectures on DC Theory. Morgan & Claypool Publishers, San Rafael (2021)

    Book  Google Scholar 

  15. GRID5000. https://www.grid5000.fr/w/Grid5000:Home

  16. Herlihy, M., Wing, J.: Linearizability: a correctness condition for concurrent objects. ACM TOPLAS 12(3), 463–492 (1990)

    Article  Google Scholar 

  17. InstaGENI. https://groups.geni.net/geni/wiki/GeniAggregate

  18. jFed. https://jfed.ilabt.imec.be

  19. Lamport, L.: On interprocess communication, parts I and II. Distrib. Comput. 1(2), 77–101 (1986)

    Article  MathSciNet  MATH  Google Scholar 

  20. Lynch, N., Shvartsman, A.: Robust emulation of shared memory using dynamic quorum-acknowledged broadcasts. In: Proceedings of FTCS, pp. 272–281 (1997)

    Google Scholar 

  21. Nicolaou, N., et al.: ARES: adaptive, reconfigurable, erasure coded, atomic storage. ACM Trans. Storage (TOS) (2022, To appear). arXiv:1805.03727

  22. Ongaro, D., Ousterhout, J.: In search of an understandable consensus algorithm. In: Proceedings of USENIX ATC, pp. 305–320 (2014)

    Google Scholar 

  23. PyEClib. https://github.com/openstack/pyeclib

  24. PySyncObj. https://github.com/bakwc/PySyncObj

  25. Reed, I.S., Solomon, G.: Polynomial codes over certain finite fields. J. Soc. Ind. Appl. Math. 8, 300–304 (1960)

    Article  MathSciNet  MATH  Google Scholar 

  26. VirtualWall. https://doc.ilabt.imec.be/ilabt/virtualwall/

  27. ZeroMQ. https://zeromq.org

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Andria Trigeorgi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Trigeorgi, A. et al. (2022). Invited Paper: Towards Practical Atomic Distributed Shared Memory: An Experimental Evaluation. In: Devismes, S., Petit, F., Altisen, K., Di Luna, G.A., Fernandez Anta, A. (eds) Stabilization, Safety, and Security of Distributed Systems. SSS 2022. Lecture Notes in Computer Science, vol 13751. Springer, Cham. https://doi.org/10.1007/978-3-031-21017-4_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-21017-4_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-21016-7

  • Online ISBN: 978-3-031-21017-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics