Skip to main content

DBHUB: A Lightweight Middleware for Accessing Heterogeneous Database Systems

  • Conference paper
  • First Online:
Cloud Computing and Security (ICCCS 2018)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 11063))

Included in the following conference series:

Abstract

Traditional relational database management system (RDBMS) has the capability of full transaction processing but introduces the unnecessary overhead for dealing with the unstructured data in several big data scenarios. In contrast, the NoSQL systems can query the unstructured data with higher space-time efficiency, but most of them are lacking the function of transaction processing. To bridge the gap, we propose DBHUB, a lightweight middleware to combine the advantages of both sides. DBHUB provides the compatible APIs to upper applications and detects the received queries to extract the unstructured data automatically. In general, DBHUB handles the write query with RDBMS’s storage engine and serves the read query by NoSQL’s routine. We implement DBHUB in a practical system which including InnoDB in MySQL and MongoDB. The experimental results show that DBHUB can effectively accelerate the read query on unstructured data against the single RDBMS one. Meanwhile, the write query incurs mild overhead due to the write amplifications on heterogeneous databases.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.scholat.com/.

  2. 2.

    https://www.mongodb.com/cn.

References

  1. Aguilera, M.K., Leners, J.B., Walfish, M.: Yesquel: scalable SQL storage for web applications. In: Proceedings of the 25th Symposium on Operating Systems Principles (SOSP 2015), pp. 245–262. ACM, New York (2015)

    Google Scholar 

  2. Dashti, M., Basil John, S., Shaikhha, A., Koch, C.: Transaction repair for multi-version concurrency control. In: Proceedings of the 2017 ACM International Conference on Management of Data (SIGMOD 2017), pp. 235–250. ACM, New York (2017)

    Google Scholar 

  3. Dayan, N., Athanassoulis, M., Idreos, S.: Monkey: optimal navigable key-value store. In: Proceedings of the 2017 ACM International Conference on Management of Data (SIGMOD 2017), pp. 79–94. ACM, New York (2017)

    Google Scholar 

  4. Gessert, F., Schaarschmidt, M., Wingerath, W., Witt, E., Yoneki, E., Ritter, N.: Quaestor: query web caching for database-as-a-service providers. Proc. VLDB Endow. 10(12), 1670–1681 (2017)

    Article  Google Scholar 

  5. Lawrence, R.: Integration and virtualization of relational SQL and NoSQL systems including MySQL and MongoDB. In: 2014 International Conference on Computational Science and Computational Intelligence, vol. 1, pp. 285–290, March 2014

    Google Scholar 

  6. Lim, H., Kaminsky, M., Andersen, D.G.: Cicada: dependably fast multi-core in-memory transactions. In: Proceedings of the 2017 ACM International Conference on Management of Data (SIGMOD 2017), pp. 21–35. ACM, New York (2017)

    Google Scholar 

  7. Ramakrishnan, R., et al.: Azure data lake store: a hyperscale distributed file service for big data analytics. In: Proceedings of the 2017 ACM International Conference on Management of Data (SIGMOD 2017), pp. 51–63. ACM, New York (2017)

    Google Scholar 

  8. Sun, K., Fryer, D., Chu, J., Lakier, M., Brown, A.D., Goel, A.: Spiffy: enabling file-system aware storage applications. In: 16th USENIX Conference on File and Storage Technologies (FAST 2018), pp. 91–104. USENIX Association, Oakland (2018)

    Google Scholar 

  9. Tang, Y., Chen, L., Liu, J., Li, D.: Speeding up virtualized transaction logging with vTrans. In: 2016 IEEE 22nd International Conference on Parallel and Distributed Systems (ICPADS 2016), pp. 916–923, December 2016

    Google Scholar 

  10. Wu, C.: A NoSQL-SQL hybrid organization and management approach for real-time geospatial data: a case study of public security video surveillance. ISPRS Int. J. Geo-Inf. 6(1), 21 (2017)

    Article  Google Scholar 

Download references

Acknowledgements

This work was funded by the National Natural Science Foundation of China under grant number 61502180 and 61772211, by the Natural Science Foundation of Guangdong Province, China under grant number 2017A030303074 and 2016A030313441, by the Pearl River S&T Nova Program of Guangzhou under grant number 201710010189. We would like to thank Mr.Yijie Zhong for his wonderful work to improve this paper.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Dingding Li .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Li, D., Chen, W., Pan, M., Li, H., Liu, H., Tang, Y. (2018). DBHUB: A Lightweight Middleware for Accessing Heterogeneous Database Systems. In: Sun, X., Pan, Z., Bertino, E. (eds) Cloud Computing and Security. ICCCS 2018. Lecture Notes in Computer Science(), vol 11063. Springer, Cham. https://doi.org/10.1007/978-3-030-00006-6_37

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-00006-6_37

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-00005-9

  • Online ISBN: 978-3-030-00006-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics