Skip to main content
SpringerLink
Log in

Dynamic buffer management with extensible replacement policies

  • Regular Paper
  • Published:
The VLDB Journal Aims and scope Submit manuscript

Abstract

The objective of extensible DBMSs is to ease the construction of specialized DBMSs for nontraditional applications. Although much work has been done in providing various levels of extensibility (e.g., extensibility of data types and operators, query language extensibility, and query optimizer extensibility), there has been very limited research in providing extensibility at the buffer management level. Supporting extensibility at the buffer management level is important as it can contribute significantly to overall system performance.

This paper addresses the problem of supporting extensibility of buffer replacement policies. The main contribution is the proposal of a framework for modeling buffer replacement policies. This work is novel in two aspects. First, by providing a uniform and generic specification of buffer replacement policies, the proposed framework unifies existing work in this area. Second, our work introduces a new level of extensibility. None of the existing extensible DBMSs, to our knowledge, provides extensibility at the buffer management level. The proposed framework provides a basis for the construction of an extensible buffer manager as part of a 100% Java-based storage manager. We conducted an extensive performance study to investigate the performance of the proposed framework. The experimental results demonstrate that the proposed framework is indeed feasible for existing DBMSs and improves system performance significantly without costing significant overhead.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Batory, D.S., Barnett, J.R., Garza, J.F., Smith, K.P., Tsukuda, K., Twichell, B.C., Wise, T.E.: GENESIS: an extensible database management system. IEEE Trans. Softw. Eng. 14(11), 1711–1729 (1988)

    Article  Google Scholar 

  2. Bayer, R., McCreight, E.: Organization and maintenance of large ordered indices. Acta Informatica 1(3), 173–189 (1972)

    Article  Google Scholar 

  3. Bressan, S., Goh, C.L., Ooi, B.C., Tan, K.L.: A framework for modeling buffer replacement strategies. In: Proceedings of ACM CIKM international conference on information and knowledge management, pp. 62–69 (2000)

  4. Brown, K.P., Carey, M.J., Livny, M.: Goal-oriented buffer management revisited. In: Proceedings of the 1996 ACM-SIGMOD international conference, pp. 353–364 (1996)

  5. Carey, M.J., DeWitt, D.J., Graefe, G., Haight, D.M., Richardson, J.E., Schuh, D.T., Shekita, E.J., Vandenberg, S.L.: The EXODUS extensible DBMS project: an overview. In: Zdonik, S., Maier, D. (eds.) Readings in object-oriented database systems, pp. 474–499. Morgan Kaufmann, San Francisco (1990)

    Google Scholar 

  6. Carey, M.J., Haas, L.M.: Extensible database management systems. ACM SIGMOD Rec. 19(4), 54–60 (1990)

    Article  Google Scholar 

  7. Carey, M.J., Jauhari, R., Livny, M.: Priority in DBMS resource scheduling. In: Proceedings of 15th international conference on very large data bases, pp. 397–410. Amsterdam (1989)

  8. Chan, C.Y., Ooi, B.C., Lu, H.: Extensible buffer management of indexes. In: Proceedings of 18th international conference on very large data bases, pp. 444–454. Vancouver, Canada (1992)

  9. Chou, H.-T.: Buffer management of database systems. PhD thesis, University of Wisconsin-Madison. In: Computer Sciences Technical Report 597, University of Wisconsin-Madison (1985)

  10. Chou, H.-T., DeWitt, D.J.: An evaluation of buffer management strategies for relational database systems. In: Proceedings of 11th international conference on very large data bases, pp. 127–141. Stockholm (1985)

  11. Chou, H.-T., DeWitt, D.J., Katz, R.H., Klug, Design, A.C.: Implementation of the Wisconsin storage system. Soft. Pract. Exp. 15(10), 943–962 (1985)

    Google Scholar 

  12. Denning, P.J.: The working-set model for program behaviour. Commun. ACM 11(5), 323–333 (1968)

    Google Scholar 

  13. Dittrich, K., Geppert, A.: (eds.) Component Databases. Morgan Kaufmann, San Francisco (2001)

    Google Scholar 

  14. Effelsberg, W., Haerder, T.: Principles of database buffer management. ACM Trans. Database Syst. 9(4), 560–595 (1984)

    Article  Google Scholar 

  15. University of Wisconsin-Madison. Using the EXODUS storage manager, vo1. 3. (1991)

  16. Freytag, J.C.: A rule-based view of query optimization. In: Proceedings of ACM SIGMOD conference, pp. 173–180. San Francisco (1987)

  17. George, B., Haritsa, J.R.: Secure buffering in firm real-time database systems. In: VLDB Conference, pp. 364–475 (1998)

  18. Goh, C.L., Bressan, S.: Storm: a 100% Java persistent storage manager. In: Java and Databases L’objet, vol. 6, Hermes Science Publications, Paris, pp. 305–316 (2000)

    Google Scholar 

  19. Graefe, G., DeWitt, D.J.: The EXODUS optimizer generator. In: Proceedings of ACM SIGMOD conference, pp. 160–172. San Francisco (1987)

  20. Guttman, A.: R-trees: a dynamic index structure for spatial searching. In: Proceedings of ACM SIGMOD conference, pp. 47–57. Boston (1984)

  21. Haas, L.M., Chang, W., Lohman, G.M., McPherson, J., Wilms, P.F., Lapis, G., Lindsay, B., Pirahesh, H., Carey, M.J., Shekita, E.: Starburst mid-flight: as the dust clears. IEEE Trans. Knowl. Data Eng. 2(1), 143–160 (1990)

    Article  Google Scholar 

  22. Haas, L.M., Freytag, J.C., Lohman, G.M., Pirahesh, H.: Extensible query processing in Starburst. In: Proceedings of ACM SIGMOD conference, pp. 377–388. Portland, OR (1989)

  23. Huang, J., Stankovic, J.A.: Buffer management in real-time databases. COINS Technical Report 90-65, University of Massachusetts-Amherst (1990)

  24. Jauhari, R., Carey, M.J., Livny, M.: Priority-hints: an algorithm for priority-based buffer management. In: Proceedings of 16th international conference on very large data bases, pp. 708–721. Brisbane, Australia (1990)

  25. Jiang, S., Zhang, X.: LIRS: An efficient low inter-reference recency set replacement policy to improve buffer cache performance. In: Proceedings of SIGMETRICS, pp. 31–42 (2002)

  26. Kim, I., Yeom, H.Y., Lee, J.: Analysis of buffer replacement policies for www proxy. In: Proceedings of ACM symposium on applied computing table of contents, pp. 98–103. Atlanta, GA (1998)

  27. Lee, M.K.: Interaction between the query processor and buffer manager of a relational database system. Master’s thesis, Massachusetts Institute of Technology, 1989. In: Research Report RJ6884 (65710), IBM Research Division, Almaden Research Center, San Jose, CA (1989)

  28. Lee, S.H., Whang, K.Y., Moon, Y.S., Song, I.Y.: Dynamic buffer allocation in video-on-demand systems. In: Proceedings of ACM SIGMOD conference, pp. 343–354 (2001)

  29. Leutenegger, S.T., Lopez, M.A.: The effect of buffering on the performance of r-trees. In: ICDE, pp. 164–171 (1998)

  30. Lindsay, B., Haas, L.: Extensibility in the Starburst experimental database system. In: Blaser, A. (eds.), Lecture Notes in Computer Science 466, pp. 217–248. Berlin Heidelberg New York: Springer (1990) In: Proceedings of international symposium on database systems of the 90s, Muggelsee, Berlin (1990)

  31. Lindsay, B., McPherson, J., Pirahesh, H.: A data management extension architecture. In: Proceedings of ACM SIGMOD conference, pp. 220–226. San Francisco (1987)

  32. Linnemann, V., Kuspert, K., Dadam, P., Pistor, P., Erbe, R., Kemper, A., Sudkamp, N., Walch, G., Wallrath, M.: Design and implementation of an extensible database management system supporting user defined data types and functions. In: Proceedings of 14th international conference on very large data bases, pp. 294–305. Los Angeles (1988)

  33. Lohman, G.M.: Grammar-like functional rules for representing query optimization alternatives. In: Proceedings of ACM SIGMOD conference, pp. 18–27. Chicago (1988)

  34. McLeod, D.: 1988 VLDB panel on future directions in DBMS research: a brief, informal summary. ACM SIGMOD Rec. 18(1), 27–30 (1989)

    Google Scholar 

  35. O’Neil, E.J., O’Neil, P.E., Weikum, G.: The lru-k page replacement algorithm for database disk buffering. In: Proceedings of ACM SIGMOD conference, pp. 297–306 (1993)

  36. Ong, J., Fogg, D., Stonebraker, M.: Implementation of data abstraction in the relational database system ingrres. ACM SIGMOD Rec. 14(1), 1–14 (1984)

    Article  Google Scholar 

  37. Osborn, S.L., Heaven, T.E.: The design of a relational database system with abstract data types for domains. ACM Trans. Database Syst. 11(3), 357–373 (1986)

    Article  Google Scholar 

  38. L. Rowe and Stonebraker, M.: The POSTGRES data model. In: Proceedings of 13th international conference on very large data bases, pp. 83–96. Brighton, UK (1987)

  39. Sacco, G.M., Schkolnick, M.: A mechanism for managing the buffer pool in a relational database system using the hot set model. In: Proceedings of 8th international conference on very large data bases, pp. 257–262. Mexico City (1982)

  40. Sacco, G.M., Schkolnick, M.: Buffer management in relational database systems. ACM Trans. Database Syst. 11(4), 473–498 (1986)

    Article  Google Scholar 

  41. Silberschatz, A., Stonebraker, M., Ullman, J.: Database systems: achievements and opportunities. ACM SIGMOD Record 19(4), 6–22 (1990) The “Lagunita” report of the NSF invitational workshop on the future of database systems research. Palo Alto, CA (Feb. 22–23, 1990)

  42. Stonebraker, M.: Operating system support for database management. Commun. ACM 24(7), 412–418 (1981)

    Article  Google Scholar 

  43. Stonebraker, M.: Inclusion of new types in relational database systems. In: Proceedings of 2nd international conference on data engineering, pp. 262–269. Los Angeles (1986)

  44. Stonebraker, M., Rowe, L.A., Hirohama, M.: The implementation of POSTGRES. IEEE Trans. Knowl. Data Eng., pp. 125–142 (1990)

  45. Stonebraker, M., Rowe, L.A., Lindsay, B., Gray, J., Carey, M.J., Brodie, M., Berstein, P., Beech, D.: Third-generation database system manifesto. ACM SIGMOD Rec. 19(3), 31–44 (1990). Committee for Advanced DBMS Function

    Google Scholar 

  46. Teng, J.Z., Gumaer, R.A.: Managing IBM database 2 buffers to maximize performance. IBM Syst. J. 23(2), 211–218 (1984)

    Article  Google Scholar 

  47. Velez, F., Bernard, G., Darnis, V.: The O2 object manager: an overview. In: Proceedings of 15th international conference on very large data bases, pp. 357–366. Amsterdam (1989)

  48. Wilms, P.F., Schwarz, P.M., Schek, H.-J., Haas, L.M.: Incoporating data types in an extensible database architecture. In: Beeri, C., Schmidt, J.W., Dayal, U. (eds.) Proceedings of 3rd international conference on data and knowledge bases: improving usability and responsiveness, pp. 180–192. Jerusalem (1988)

  49. Zdonik, S.B., Maier, D.: Relational extensions and extensible database systems. In: Zdonik, S.B., Maier, D. (eds.) Readings in object-oriented database systems. Data Management Systems, pp. 445–449. Morgan Kaufmann, San Francisco (1990)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, National University of Singapore, Singapore, 117543, Singapore

    Chong Leng Goh, Yanfeng Shu, Zhiyong Huang & Beng Chin Ooi

Authors
  1. Chong Leng Goh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yanfeng Shu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhiyong Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Beng Chin Ooi
    View author publications

    You can also search for this author in PubMed Google Scholar

Additional information

Edited by M. Kersten

Rights and permissions

Reprints and permissions

About this article

Cite this article

Goh, C.L., Shu, Y., Huang, Z. et al. Dynamic buffer management with extensible replacement policies. The VLDB Journal 15, 99–120 (2006). https://doi.org/10.1007/s00778-004-0145-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00778-004-0145-1

Keywords

Search

Navigation