Skip to main content

Datenpartitionierung zur Optimierung der I/O-Parallelität in Non-Standard-Anwendungen

  • Conference paper
Datenbanksysteme in Büro, Technik und Wissenschaft

Part of the book series: Informatik aktuell ((INFORMAT))

Zusammenfassung

Disk–Arrays sind ein vielversprechender Ansatz zur Überwindung der viel zitierten “I/O–Krise”. Der Einsatz einer großen Anzahl kleiner Plattenlaufwerke birgt ein hohes Potential zur Parallelisierung von I/O–Aufträgen und trägt damit entscheidend zur Reduzierung der Antwortzeit einzelner I/O–Aufträge bei. Der Schlüssel zum erfolgreichen Einsatz dieser Technologie für Non–Standard–Datenbanksysteme liegt in der Partitionierung und Verteilung der Daten über die Platten des Disk–Arrays. In diesem Beitrag stellen wir eine Methode zur Partitionierung von Dateien vor, die nicht nur auf die Minimierung der Antwortzeit abzielt, sondern auch die Einhaltung von Durchsatzanforderungen der Anwendungen berücksichtigt. Dabei werden die Größen der Partitionen für jede Datei individuell bestimmt. In einer umfassenden Performance–Evaluation auf der Basis von I/O–Traces aus Non–Standard–Anwendungen vergleichen wir unsere Methode der dateispezifischen Partitionierung mit einfacheren Methoden, bei denen die Partitionsgröße global festgelegt wird.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

Literatur

  1. Abramowicz, K., Dittrich, K.R., Längle, R., Ranft, M., Raupp, T, Rehm, S., DAMOKLES — Architektur, Implementierung, Erfahrungen, Informatik Forschung und Entwicklung Band 6, Heft 1, 1991, pp. 1–13

    Google Scholar 

  2. Bitton, D. and Gray, J.N., Disk Shadowing, Proceedings of the 14th International Conference on Very Large Data Bases, 1988, pp. 331–338

    Google Scholar 

  3. Baker, M.G., Hartman, J.H., Kupfer, M.D., Shirriff, K.W., and Ousterhout, J.K, Measurements of a Distributed File System, Proceedings of the 13th ACM Symposium on Operating System Principles, 1991, pp. 198–212

    Google Scholar 

  4. Cattell, R.G.G. (Ed.), Special Section on Next–Generation Database Systems, Communications of the ACM, Vol. 34, No. 10, 1991

    Google Scholar 

  5. Chen, P.M. and Patterson, D. A., Maximizing Performance in a Striped Disk Array, Proceedings of the 17th International Symposium on ComputerArchitecture, 1990, pp. 322–331

    Google Scholar 

  6. Dadam, P., Linnemann, V, Advanced Information Management (AIM): Advanced Database Technology for Integrated Applications, IBM Systems Journal, Vol. 28, No. 4, 1989, pp. 661–681

    Article  Google Scholar 

  7. Flatto, L. and Hahn, S., Two Parallel Queues Created by Arrivals with ‘No Demands I, SIAM Journal of Applied Mathematics, Vol. 44, No. 5, 1984, pp. 1041–1053

    Article  MathSciNet  MATH  Google Scholar 

  8. Fujitsu, Product Information Fujitsu M262X, 1991

    Google Scholar 

  9. Garcia–Molina, H. et. al, Disk Arrays: Are they of Use for Database Processing (Panel), Proceedings of the 1st International Conference on Parallel and Distributed Information Systems, 1991, pp. 117–118

    Google Scholar 

  10. Gray, J.N., Horst B., and Walker, M., Parity Striping of Disk Arrays: Low–Cost Reliable Storage with Acceptable Throughput, Proceedings of the 16th International Conference on Very Large Data Bases, 1990, pp. 148–161

    Google Scholar 

  11. Härder, T. (Ed.), The PRIMA Project: Design and Implementation of a Non–Standard Database System, Technischer Bericht 26/88, Sonderforschungsbereich 124, Universität Kaiserslautern, 1988

    Google Scholar 

  12. Härder, T, Reuter, A., Architektur von Datenbanksystemen für Non–Standard–Anwendungen, in: Blaser, A., Pistor, P. (Hrsg.), DatenbanksystemefürBüro, Technik und Wissenschaft, GI–Fachtagung, Karlsruhe, 1985, Informatik–Fachbericht 94, Springer–Verlag, 1985

    Google Scholar 

  13. Hennessy, J.L. and Patterson, D.A., Computer Architecture: A Quantitative Approach, Morgan Kaufmann, San Mateo, CA, 1990

    Google Scholar 

  14. Highleyman, W, Performance Analysis of Transaction Processing Systems, Prentice Hall, 1989

    Google Scholar 

  15. Infotech SA Inc., The Mass Storage Report ‘82, Silver Spring, Maryland, 1992

    Google Scholar 

  16. Katz, R.H., Gibson, G.A., and Patterson, D.A., Disk System Architectures for High Performance Computing, Proceedings of the IEEE, Vol. 77, No. 12, 1989, pp. 1842–1858

    Article  Google Scholar 

  17. Kim, M.Y., Synchronized Disk Interleaving, IEEE Transactions on Computers, Vol. C-35, No. 11, 1986, pp. 978–988

    Article  Google Scholar 

  18. Kim, M.Y. and Tantawi, A.N., Asynchronous Disk Interleaving: Approximating Access Delays, IEEE Transactions on Computers, Vol. 40, No. 7, 1991, pp. 801–810

    Article  Google Scholar 

  19. Lee, E.K. and Katz, R.H., An Analytic Performance Model of Disk Arrays and its Application, Technical Report No. UCBICSD 91/660, University of California Berkeley, 1991

    Google Scholar 

  20. Livny, M., Khoshafian, S., and Boral, H., Multi—Disk Management Algorithms, Proceedings of the International Conference on Measurement and Modeling of Computer Systems, 1987, pp. 69–77

    Google Scholar 

  21. Merchant, A., Yu, P.S., Performance Analysis of a Dual Striping Strategy for Replicated Disk Arrays, Proceedings of the 2nd International Conference on Parallel and Distributed Information Systems, San Diego, 1993

    Google Scholar 

  22. Moad, J., Relief for Slow Storage Systems, Datamation, Vol. 36, No. 17, 1990, pp. 20–28

    Google Scholar 

  23. Muntz, R.R. and Lui, J.C.S., Performance Analysis of Disk Arrays Under Failure, Proceedings of the 16th International Conference on Very Large Data Bases, 1990, pp. 162–173

    Google Scholar 

  24. Nelson. R. and Tantawi, A.N., Approximate Analysis of Fork/Join Synchronisation in Parallel Queues, IEEE Transactions on Computers, Vol. 37, No. 6, 1991, pp. 739–743

    Google Scholar 

  25. Ng, S., Some Design Issues of Disk Arrays, Proceedings of the IEEE Compcon Spring Conference, 1989, pp. 137–142

    Google Scholar 

  26. Patterson, D.A., Gibson, G., and Katz, R.H., A Case for Redundant Arrays of Inexpensive Disks (RAID), Proceedings of the SIGMOD International Conference on Management of Data, 1988, pp. 109–116

    Google Scholar 

  27. Reuter, A., Performance and Reliability Issues in Future DBMSs, Proceedings of the International Symposium on Database Systems of the 90s, Lecture Notes in Computer Science 466, Springer, 1990, pp. 294–315

    Google Scholar 

  28. Salem, K. and Garcia —Molina, H., Disk Striping, Proceedings of the 2nd International Conference on Data Engineering, 1986, pp. 336–342

    Google Scholar 

  29. Schek, H.—J., Paul, H.—B., Scholl, M.H., Weikum, G., The DASDBS Project: Objectives, Experiences, and Future Prospects, IEEE Transactions on Knowledge and Data Engineering Vol. 2 No. 1, 1990, pp. 25–43

    Article  Google Scholar 

  30. Scheuermann, P., Weikum, G., and Zabback, P., Automatic Tuning of Data Placement and Load Balancing in Disk Arrays, In Database Systems for Next —Generation Applications — Principles and Practice, Advanced Database Research and Development Series, Word Scientific Publications, 1992

    Google Scholar 

  31. Schwetman, FL, CSIM Reference Manual (Revision 16), MCC Technical Report ACAST-252–87, Rev. 16, Microelectronics and Computer Technology Corporation, Austin, 1992

    Google Scholar 

  32. Sierra, H.M., An Introduction to Direct Access Storage Devices, Academic Press, 1990

    Google Scholar 

  33. Weikum, G., Hasse, C., Mönkeberg, A., Zabback, P., The COMFORT Project (Project Synopsis), Proceedings of the 2nd International Conference on Parallel and Distributed Information Systems, San Diego, 1993

    Google Scholar 

  34. Weikum, G., Zabback, P., and Scheuermann, P., Dynamic File Allocation in Disk Arrays, Technical Report No. 147, Computer Science Department, ETH Zurich, 1991

    Google Scholar 

  35. Weikum, G., Zabback, P., and Scheuermann, P., Dynamic File Allocation in Disk Arrays, Proceedings of the SIGMOD International Conference on Management of Data, 1991, pp. 406–415

    Google Scholar 

  36. Weikum, G. and Zabback, P., Tuning of Striping Units in Disk—Array—Based File Systems, Proceedings of the 2nd International Workshop on Research Issues on Data Engineering: Transaction and Query Processing (RIDE—TQP), 1992, pp. 80–87

    Google Scholar 

  37. Weikum, G. und Zabback, P., I/O—Parallelität und Fehlertoleranz in Disk—Arrays, Manuskript, ETH Zürich, 1992, erscheint in: Informatik—Spektrum

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1993 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Zabback, P., Weikum, G. (1993). Datenpartitionierung zur Optimierung der I/O-Parallelität in Non-Standard-Anwendungen. In: Stucky, W., Oberweis, A. (eds) Datenbanksysteme in Büro, Technik und Wissenschaft. Informatik aktuell. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-86096-6_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-86096-6_15

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-56487-4

  • Online ISBN: 978-3-642-86096-6

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics