Skip to main content
SpringerLink
Log in

Hydis: A Hybrid Consistent KVS with Effective Sync Among Replicas

  • Conference paper
  • First Online:
Advanced Parallel Processing Technologies (APPT 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14103))

Included in the following conference series:

  • 294 Accesses

Abstract

Distributed storage systems distribute user loads across regions. User requests from different geographical locations are directed to the nearest data center, benefiting reduced service latency and improved service quality. However, the consistency among regions holds against availability and richness of the underlying data services. To address these constraints, our study proposes Hydis, a hybrid consistency distributed key-value storage system based on optimized replica synchronization. Hydis guarantees high availability and scalability for geographically distributed systems and uses Conflict-free Replicated Data Types to construct HybridLattice that supports various consistency models. A novel Writeless-Consistency strategy is proposed to improve the synchronization efficiency between replicas, and a dynamic synchronization optimization based on this strategy is implemented for consistency algorithm to effectively reduce the synchronization overhead of distributed storage systems. A performance evaluation of the Hydis cluster deployed on Alibaba Cloud showed that the strong consistency algorithm in Hydis outperformed the Raft algorithm by 1.8X. Additionally, the causal consistency algorithm in Hydis outperformed the traditional Vector Clock algorithm by 2.5X.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. 400+ crypto currency pairs at 1-minute resolution. https://www.kaggle.com/datasets/tencars/392-crypto-currency-pairs-at-minute-resolution. Accessed 15 May 2023

  2. Azure DocumentDB. https://azure.microsoft.com/en-us/products/. Accessed 6 June 2023

  3. Google Protocol Buffers. https://github.com/protocolbuffers/protobuf. Accessed 10 June 2023

  4. gRPC. https://grpc.io/. Accessed 10 June 2023

  5. LevelDB. https://github.com/google/leveldb. Accessed 10 June 2023

  6. Bravo, M., Gotsman, A., de Régil, B., Wei, H.: Unistore: a fault-tolerant marriage of causal and strong consistency. In: USENIX Annual Technical Conference, pp. 923–937 (2021)

    Google Scholar 

  7. Brewer, E.: A certain freedom: thoughts on the cap theorem. In: Proceedings of the 29th ACM SIGACT-SIGOPS Symposium on Principles of Distributed Computing, pp. 335–335 (2010)

    Google Scholar 

  8. Brewer, E.: Cap twelve years later: how the “rules’’ have changed. Computer 45(2), 23–29 (2012)

    Article  Google Scholar 

  9. Conway, N., Marczak, W.R., Alvaro, P., Hellerstein, J.M., Maier, D.: Logic and lattices for distributed programming. In: Proceedings of the Third ACM Symposium on Cloud Computing, pp. 1–14 (2012)

    Google Scholar 

  10. DeCandia, G., et al.: Dynamo: Amazon’s highly available key-value store. ACM SIGOPS Oper. Syst. Rev. 41(6), 205–220 (2007)

    Article  Google Scholar 

  11. Demers, A., et al.: Epidemic algorithms for replicated database maintenance. In: Proceedings of the Sixth Annual ACM Symposium on Principles of Distributed Computing, pp. 1–12 (1987)

    Google Scholar 

  12. Du, Y., Xu, Z., Zhang, K., Liu, J., Huang, J., Stewart, C.: Cost-effective strong consistency on scalable geo-diverse data replicas. IEEE Trans. Cloud Comput. (2022)

    Google Scholar 

  13. Fouto, P., Preguiça, N., Leitão, J.: High throughput replication with integrated membership management. In: 2022 USENIX Annual Technical Conference (USENIX ATC 22), pp. 575–592 (2022)

    Google Scholar 

  14. Lakshman, A., Malik, P.: Cassandra: a decentralized structured storage system. ACM SIGOPS Oper. Syst. Rev. 44(2), 35–40 (2010)

    Article  Google Scholar 

  15. Lamport, L.: Paxos made simple. ACM SIGACT News (Distributed Computing Column) 32, 4 (Whole Number 121, December 2001) 51–58 (2001)

    Google Scholar 

  16. Letia, M., Preguiça, N., Shapiro, M.: CRDTs: consistency without concurrency control. arXiv preprint arXiv:0907.0929 (2009)

  17. Li, C., Porto, D., Clement, A., Gehrke, J., Preguiça, N., Rodrigues, R.: Making geo-replicated systems fast as possible, consistent when necessary. In: Presented as part of the 10th \(\{ USENIX\}\) Symposium on Operating Systems Design and Implementation (\(\{ OSDI\}\) 12), pp. 265–278 (2012)

    Google Scholar 

  18. Li, C., Preguiça, N., Rodrigues, R.: Fine-grained consistency for geo-replicated systems. In: 2018 \(\{ USENIX\}\) Annual Technical Conference (\(\{ USENIX\} \{ATC\}\) 18), pp. 359–372 (2018)

    Google Scholar 

  19. Li, P., Pan, L., Yang, X., Song, W., Xiao, Z., Birman, K.: Stabilizer: geo-replication with user-defined consistency. In: 2022 IEEE 42nd International Conference on Distributed Computing Systems (ICDCS), pp. 359–369. IEEE (2022)

    Google Scholar 

  20. Lloyd, W., Freedman, M.J., Kaminsky, M., Andersen, D.G.: Don’t settle for eventual: scalable causal consistency for wide-area storage with cops. In: Proceedings of the Twenty-Third ACM Symposium on Operating Systems Principles, pp. 401–416 (2011)

    Google Scholar 

  21. Lykhenko, T., Soares, R., Rodrigues, L.: FaaSTCC: efficient transactional causal consistency for serverless computing. In: Proceedings of the 22nd International Middleware Conference, pp. 159–171 (2021)

    Google Scholar 

  22. Mehdi, S.A., Littley, C., Crooks, N., Alvisi, L., Bronson, N., Lloyd, W.: I can’t believe it’s not causal! scalable causal consistency with no slowdown cascades. In: NSDI, vol. 17, pp. 453–468 (2017)

    Google Scholar 

  23. Ongaro, D., Ousterhout, J.: In search of an understandable consensus algorithm. In: 2014 \(\{ USENIX\}\) Annual Technical Conference (\(\{ USENIX\} \{ATC\}\) 14), pp. 305–319 (2014)

    Google Scholar 

  24. Reagan, R., Reagan, R.: Cosmos db. Web Applications on Azure: Developing for Global Scale, pp. 187–255 (2018)

    Google Scholar 

  25. Schultz, W., Avitabile, T., Cabral, A.: Tunable consistency in MongoDB. Proc. VLDB Endowment 12(12), 2071–2081 (2019)

    Article  Google Scholar 

  26. Seeger, M., Ultra-Large-Sites, S.: Key-value stores: a practical overview. Comput. Sci. Med. Stutt. (2009)

    Google Scholar 

  27. Shapiro, M., Preguiça, N., Baquero, C., Zawirski, M.: A comprehensive study of convergent and commutative replicated data types. Ph.D. thesis, Inria-Centre Paris-Rocquencourt; INRIA (2011)

    Google Scholar 

  28. Sreekanti, V., et al.: Cloudburst: stateful functions-as-a-service. arXiv preprint arXiv:2001.04592 (2020)

  29. Sun, Y., Zheng, Z., Song, S., Chiang, F.: Confidence bounded replica currency estimation. In: Proceedings of the 2022 International Conference on Management of Data, pp. 730–743 (2022)

    Google Scholar 

  30. Terrace, J., Freedman, M.J.: Object storage on CRAQ: high-throughput chain replication for read-mostly workloads. In: USENIX Annual Technical Conference (2009)

    Google Scholar 

  31. Terry, D.B., Prabhakaran, V., Kotla, R., Balakrishnan, M., Aguilera, M.K., Abu-Libdeh, H.: Consistency-based service level agreements for cloud storage. In: Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles, pp. 309–324 (2013)

    Google Scholar 

  32. Uluyol, M., Huang, A., Goel, A., Chowdhury, M., Madhyastha, H.V.: Near-optimal latency versus cost tradeoffs in geo-distributed storage. In: NSDI, vol. 20, pp. 157–180 (2020)

    Google Scholar 

  33. Van Renesse, R., Schneider, F.B.: Chain replication for supporting high throughput and availability. In: OSDI, vol. 4 (2004)

    Google Scholar 

  34. Viotti, P., Vukolić, M.: Consistency in non-transactional distributed storage systems. ACM Comput. Surv. (CSUR) 49(1), 1–34 (2016)

    Article  Google Scholar 

  35. Wang, Z., et al.: Craft: an erasure-coding-supported version of raft for reducing storage cost and network cost. In: FAST, pp. 297–308 (2020)

    Google Scholar 

  36. Wu, C., Faleiro, J.M., Lin, Y., Hellerstein, J.M.: Anna: a kvs for any scale. IEEE Trans. Knowl. Data Eng. 33(2), 344–358 (2019)

    Google Scholar 

Download references

Acknowledgments

This work was supported by the National Key R &D Program of China, No. 2022YFB4501703, the National Natural Science Foundation of China (KY0402022036), and the Provincial Key Research and Development Program of Jiangxi (012031379055).

Author information

Authors and Affiliations

  1. School of Mathematics and Computer Sciences, Nanchang University, Nanchang, China

    Junsheng Lou & Zichen Xu

Authors
  1. Junsheng Lou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zichen Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zichen Xu .

Editor information

Editors and Affiliations

  1. Shanghai Jiao Tong University, Shanghai, China

    Chao Li

  2. Tsinghua University, Beijing, Beijing, China

    Zhenhua Li

  3. National University of Defense Technology, Nanjing, China

    Li Shen

  4. Shanghai Jiao Tong University, Shanghai, China

    Fan Wu

  5. Nankai University, Tianjin, China

    Xiaoli Gong

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Lou, J., Xu, Z. (2024). Hydis: A Hybrid Consistent KVS with Effective Sync Among Replicas. In: Li, C., Li, Z., Shen, L., Wu, F., Gong, X. (eds) Advanced Parallel Processing Technologies. APPT 2023. Lecture Notes in Computer Science, vol 14103. Springer, Singapore. https://doi.org/10.1007/978-981-99-7872-4_9

Download citation

  • DOI: https://doi.org/10.1007/978-981-99-7872-4_9

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-99-7871-7

  • Online ISBN: 978-981-99-7872-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Societies and partnerships

Search

Navigation