Skip to main content
SpringerLink
Log in

Distributed Transaction and Self-healing System of DAOS

  • Conference paper
  • First Online:
Driving Scientific and Engineering Discoveries Through the Convergence of HPC, Big Data and AI (SMC 2020)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1315))

Included in the following conference series:

Abstract

The Distributed Asynchronous Object Storage (DAOS) is an open source scale-out storage system designed from the ground up to support Storage Class Memory (SCM) and NVMe storage in user space. DAOS uses an optimized two-phase commit protocol to guarantee atomicity of distributed I/O. This protocol is tightly coupled with the self-healing system of DAOS, in contrast with traditional two-phase commit protocol that is blocking when coordinator fails, this protocol can proceed in presence of failure, and it also has shorter transaction response time than the traditional protocol, these characteristics are important for massively distributed and low latency storage system like DAOS. This paper introduces the distributed transaction and self-healing system of DAOS, and presents the performance benefits of the transaction protocol.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Breitenfeld, M.: DAOS for Extreme-scale Systems in Scientific Applications (2017) https://arxiv.org/pdf/1712.00423.pdf

  2. Abhinandan, D., Indranil, G., Ashish, M.: SWIM: Scalable weakly-consistent infection-style process group membership protocol. In: DSN 2002 Proceedings of the 2002 International Conference on Dependable Systems and Networks. pp. 303–312 (2002)

    Google Scholar 

  3. Diego, O., John, O.: In Search of an Understandable Consensus Algorithm (2014) https://www.usenix.org/system/files/conference/atc14/atc14-paper-ongaro.pdf

  4. Sage, A., Weil, S., Brandt, Ethan, A., Miller, L., Carlos, M.: CRUSH: controlled, scalable, decentralized placement of replicated data. In: SC’06: Proceedings of the 2006 ACM/IEEE Conference on Supercomputing. (2006) https://doi.org/10.1109/sc.2006.19

  5. Butler, L., David, L.: A new presumed commit optimization for two phase commit. In: VLDB 1993: Proceedings of the 19th International Conference on Very Large Data Bases. pp. 630–640 (1993)

    Google Scholar 

  6. Suyash, G., Sadoghi, M.: EasyCommit: a non-blocking two-phase commit protocol. In: International Conference on Extending Database Technologies, At Vienna, Austria (2018) https://doi.org/10.5441/002/edbt.2018.15

  7. Yousef, J.A., George S.: Three-Phase Commit. Encyclopedia of Database Systems. Springer, Boston, MA (2009) https://doi.org/10.1007/978-0-387-39940-9

  8. George, S., Kathryn, B., Andrew, C., Mohan, C.: Two-phase commit optimizations and tradeoffs in the commercial environment. In: Proceedings of IEEE 9th International Conference on Data Engineering (1993) https://doi.org/10.1109/icde.1993.344028

  9. Liu, M.L., Agrawal, D., El Abbadi, A.: The performance of two phase commit protocols in the presence of site failures. Distr. Parallel Databases 6, 157–182 (1998)https://doi.org/10.1023/a:1008639314265

  10. Andy, R.: APIs for persistent memory programming (2018). https://storageconference.us/2018/Presentations/Rudoff.pdf

  11. Mercury Homepage: https://mercury-hpc.github.io/documentation/

  12. Libfabric Homepage: https://ofiwg.github.io/libfabric/

  13. SPDK Homepage: https://spdk.io/

  14. PMDK Homepage: https://pmem.io/pmdk/

  15. DAOS Homepage: https://github.com/daos-stack/daos

  16. Two-phase commit Wikipedia: https://en.wikipedia.org/wiki/Two-phase_commit_protocol

Download references

Author information

Authors and Affiliations

  1. Intel China Ltd. GTC, No. 36 3rd Ring Road, Beijing, China

    Zhen Liang & Yong Fan

  2. Intel Corporation, Santa Clara, CA, USA

    Di Wang

  3. Intel Corporation SAS, 2 Rue de Paris, 92196, Meudon Cedex, France

    Johann Lombardi

Authors
  1. Zhen Liang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yong Fan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Di Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Johann Lombardi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhen Liang .

Editor information

Editors and Affiliations

  1. Oak Ridge National Laboratory, Oak Ridge, TN, USA

    Jeffrey Nichols

  2. Oak Ridge National Laboratory, Oak Ridge, TN, USA

    Becky Verastegui

  3. Oak Ridge National Laboratory, Oak Ridge, TN, USA

    Arthur ‘Barney’ Maccabe

  4. Oak Ridge National Laboratory, Oak Ridge, TN, USA

    Oscar Hernandez

  5. Oak Ridge National Laboratory, Oak Ridge, TN, USA

    Suzanne Parete-Koon

  6. Oak Ridge National Laboratory, Oak Ridge, TN, USA

    Theresa Ahearn

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Liang, Z., Fan, Y., Wang, D., Lombardi, J. (2020). Distributed Transaction and Self-healing System of DAOS. In: Nichols, J., Verastegui, B., Maccabe, A.‘., Hernandez, O., Parete-Koon, S., Ahearn, T. (eds) Driving Scientific and Engineering Discoveries Through the Convergence of HPC, Big Data and AI. SMC 2020. Communications in Computer and Information Science, vol 1315. Springer, Cham. https://doi.org/10.1007/978-3-030-63393-6_22

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-63393-6_22

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-63392-9

  • Online ISBN: 978-3-030-63393-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation