skip to main content
10.1145/1996130.1996167acmconferencesArticle/Chapter ViewAbstractPublication PageshpdcConference Proceedingsconference-collections
poster

HyFlow: a high performance distributed software transactional memory framework

Published: 08 June 2011 Publication History

Abstract

We present HyFlow --- a distributed software transactional memory (D-STM) framework for distributed concurrency control. HyFlow is a Java framework for D-STM, with pluggable support for directory lookup protocols, transactional synchronization and recovery mechanisms, contention management policies, cache coherence protocols, and network communication protocols. HyFlow exports a simple distributed programming model that excludes locks: using (Java 5) annotations, atomic sections are defined as transactions, in which reads and writes to shared, local and remote objects appear to take effect instantaneously. No changes are needed to the underlying virtual machine or compiler. We describe HyFlow's architecture and implementation, and report on experimental studies comparing HyFlow against competing models including Java remote method invocation (RMI) with mutual exclusion and read/write locks, distributed shared memory (DSM), and directory-based D-STM. Our studies show that HyFlow outperforms competitors by as much as 40-190% on a broad range of transactional workloads on a 72-node system, with more than 500 concurrent transactions.

References

[1]
K. Arnold, R. Scheifler, J. Waldo, B. O'Sullivan, and A. Wollrath. Jini Specification. Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA.
[2]
R. L. Bocchino, V. S. Adve, and B. L. Chamberlain. Software transactional memory for large scale clusters. In PPoPP '08.
[3]
M. J. Demmer and M. Herlihy. The Arrow distributed directory protocol. In DISC '98.
[4]
T. Harris, J. Larus, and R. Rajwar. Transactional Memory, 2nd edition. Synthesis Lectures on Computer Architecture, 5(1):1--263, 2010.
[5]
M. Herlihy and M. P. Warres. A tale of two directories: implementing distributed shared objects in Java. In JAVA '99.
[6]
Y. Raz. The Dynamic Two Phase Commitment (D2PC) Protocol. In ICDT'95.
[7]
M. M. Saad and B. Ravindran. Distributed Hybrid-Flow STM: Technical Report. Technical report, ECE Dept., Virginia Tech, Dec.'10. URL http://hyflow.org/trac/hyflow/wiki/Publications.
[8]
M. M. Saad and B. Ravindran. Distributed Transactional Locking: Technical Report. Technical report, ECE Dept., Virginia Tech, Jan.'11. URL http://hyflow.org/trac/hyflow/wiki/Publications.
[9]
M. M. Saad and B. Ravindran. RMI-DSTM: Control Flow Distributed Software Transactional Memory: Technical Report. Technical report, ECE Dept., Virginia Tech, Feb.'11. URL http://hyflow.org/trac/hyflow/wiki/Publications.
[10]
W. N. Scherer III and M. L. Scott. Contention management in dynamic software transactional memory. In PODC'04.
[11]
E. Tilevich and Y. Smaragdakis. J-Orchestra: Automatic Java application partitioning. In ECOOP'02.
[12]
B. Zhang and B. Ravindran. Brief announcement: Relay: A cache-coherence protocol for distributed transactional memory. In OPODIS'09.

Cited By

View all
  • (2023)Replicating File Segments between Multi-Cloud Nodes in a Smart City: A Machine Learning ApproachSensors10.3390/s2310463923:10(4639)Online publication date: 10-May-2023
  • (2023)Flexible scheduling of transactional memory on treesTheoretical Computer Science10.1016/j.tcs.2023.114184(114184)Online publication date: Sep-2023
  • (2022)Flexible Scheduling of Transactional Memory on TreesStabilization, Safety, and Security of Distributed Systems10.1007/978-3-031-21017-4_10(146-163)Online publication date: 9-Nov-2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
HPDC '11: Proceedings of the 20th international symposium on High performance distributed computing
June 2011
296 pages
ISBN:9781450305525
DOI:10.1145/1996130

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 June 2011

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. control flow
  2. dataflow
  3. distributed systems
  4. hybrid flow
  5. java
  6. software transactional memory

Qualifiers

  • Poster

Conference

HPDC '11
Sponsor:

Acceptance Rates

Overall Acceptance Rate 166 of 966 submissions, 17%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)5
  • Downloads (Last 6 weeks)0
Reflects downloads up to 19 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Replicating File Segments between Multi-Cloud Nodes in a Smart City: A Machine Learning ApproachSensors10.3390/s2310463923:10(4639)Online publication date: 10-May-2023
  • (2023)Flexible scheduling of transactional memory on treesTheoretical Computer Science10.1016/j.tcs.2023.114184(114184)Online publication date: Sep-2023
  • (2022)Flexible Scheduling of Transactional Memory on TreesStabilization, Safety, and Security of Distributed Systems10.1007/978-3-031-21017-4_10(146-163)Online publication date: 9-Nov-2022
  • (2020)State Deployment in Fog ComputingMobiQuitous 2020 - 17th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services10.1145/3448891.3448955(38-47)Online publication date: 7-Dec-2020
  • (2018)Hybrid Transactional Replication: State-Machine and Deferred-Update Replication CombinedIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2018.279607929:7(1499-1514)Online publication date: 1-Jul-2018
  • (2017)Simulation of partial replication in Distributed Transactional Memory2017 Wireless Days10.1109/WD.2017.7918115(54-59)Online publication date: Mar-2017
  • (2017)Helenos: A realistic benchmark for distributed transactional memorySoftware: Practice and Experience10.1002/spe.254848:3(528-549)Online publication date: 9-Oct-2017
  • (2016)Data-centric execution of speculative parallel programsThe 49th Annual IEEE/ACM International Symposium on Microarchitecture10.5555/3195638.3195644(1-13)Online publication date: 15-Oct-2016
  • (2016)Partial Replication Policies for Dynamic Distributed Transactional Memory in Edge CloudsProceedings of the 1st Workshop on Middleware for Edge Clouds & Cloudlets10.1145/3017116.3022872(1-6)Online publication date: 12-Dec-2016
  • (2016)Atomic RMI 2: distributed transactions for JavaProceedings of the 6th International Workshop on Programming Based on Actors, Agents, and Decentralized Control10.1145/3001886.3001893(61-69)Online publication date: 30-Oct-2016
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media