Zusammenfassung
Disk–Arrays sind ein vielversprechender Ansatz zur Überwindung der viel zitierten “I/O–Krise”. Der Einsatz einer großen Anzahl kleiner Plattenlaufwerke birgt ein hohes Potential zur Parallelisierung von I/O–Aufträgen und trägt damit entscheidend zur Reduzierung der Antwortzeit einzelner I/O–Aufträge bei. Der Schlüssel zum erfolgreichen Einsatz dieser Technologie für Non–Standard–Datenbanksysteme liegt in der Partitionierung und Verteilung der Daten über die Platten des Disk–Arrays. In diesem Beitrag stellen wir eine Methode zur Partitionierung von Dateien vor, die nicht nur auf die Minimierung der Antwortzeit abzielt, sondern auch die Einhaltung von Durchsatzanforderungen der Anwendungen berücksichtigt. Dabei werden die Größen der Partitionen für jede Datei individuell bestimmt. In einer umfassenden Performance–Evaluation auf der Basis von I/O–Traces aus Non–Standard–Anwendungen vergleichen wir unsere Methode der dateispezifischen Partitionierung mit einfacheren Methoden, bei denen die Partitionsgröße global festgelegt wird.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
Literatur
Abramowicz, K., Dittrich, K.R., Längle, R., Ranft, M., Raupp, T, Rehm, S., DAMOKLES — Architektur, Implementierung, Erfahrungen, Informatik Forschung und Entwicklung Band 6, Heft 1, 1991, pp. 1–13
Bitton, D. and Gray, J.N., Disk Shadowing, Proceedings of the 14th International Conference on Very Large Data Bases, 1988, pp. 331–338
Baker, M.G., Hartman, J.H., Kupfer, M.D., Shirriff, K.W., and Ousterhout, J.K, Measurements of a Distributed File System, Proceedings of the 13th ACM Symposium on Operating System Principles, 1991, pp. 198–212
Cattell, R.G.G. (Ed.), Special Section on Next–Generation Database Systems, Communications of the ACM, Vol. 34, No. 10, 1991
Chen, P.M. and Patterson, D. A., Maximizing Performance in a Striped Disk Array, Proceedings of the 17th International Symposium on ComputerArchitecture, 1990, pp. 322–331
Dadam, P., Linnemann, V, Advanced Information Management (AIM): Advanced Database Technology for Integrated Applications, IBM Systems Journal, Vol. 28, No. 4, 1989, pp. 661–681
Flatto, L. and Hahn, S., Two Parallel Queues Created by Arrivals with ‘No Demands I, SIAM Journal of Applied Mathematics, Vol. 44, No. 5, 1984, pp. 1041–1053
Fujitsu, Product Information Fujitsu M262X, 1991
Garcia–Molina, H. et. al, Disk Arrays: Are they of Use for Database Processing (Panel), Proceedings of the 1st International Conference on Parallel and Distributed Information Systems, 1991, pp. 117–118
Gray, J.N., Horst B., and Walker, M., Parity Striping of Disk Arrays: Low–Cost Reliable Storage with Acceptable Throughput, Proceedings of the 16th International Conference on Very Large Data Bases, 1990, pp. 148–161
Härder, T. (Ed.), The PRIMA Project: Design and Implementation of a Non–Standard Database System, Technischer Bericht 26/88, Sonderforschungsbereich 124, Universität Kaiserslautern, 1988
Härder, T, Reuter, A., Architektur von Datenbanksystemen für Non–Standard–Anwendungen, in: Blaser, A., Pistor, P. (Hrsg.), DatenbanksystemefürBüro, Technik und Wissenschaft, GI–Fachtagung, Karlsruhe, 1985, Informatik–Fachbericht 94, Springer–Verlag, 1985
Hennessy, J.L. and Patterson, D.A., Computer Architecture: A Quantitative Approach, Morgan Kaufmann, San Mateo, CA, 1990
Highleyman, W, Performance Analysis of Transaction Processing Systems, Prentice Hall, 1989
Infotech SA Inc., The Mass Storage Report ‘82, Silver Spring, Maryland, 1992
Katz, R.H., Gibson, G.A., and Patterson, D.A., Disk System Architectures for High Performance Computing, Proceedings of the IEEE, Vol. 77, No. 12, 1989, pp. 1842–1858
Kim, M.Y., Synchronized Disk Interleaving, IEEE Transactions on Computers, Vol. C-35, No. 11, 1986, pp. 978–988
Kim, M.Y. and Tantawi, A.N., Asynchronous Disk Interleaving: Approximating Access Delays, IEEE Transactions on Computers, Vol. 40, No. 7, 1991, pp. 801–810
Lee, E.K. and Katz, R.H., An Analytic Performance Model of Disk Arrays and its Application, Technical Report No. UCBICSD 91/660, University of California Berkeley, 1991
Livny, M., Khoshafian, S., and Boral, H., Multi—Disk Management Algorithms, Proceedings of the International Conference on Measurement and Modeling of Computer Systems, 1987, pp. 69–77
Merchant, A., Yu, P.S., Performance Analysis of a Dual Striping Strategy for Replicated Disk Arrays, Proceedings of the 2nd International Conference on Parallel and Distributed Information Systems, San Diego, 1993
Moad, J., Relief for Slow Storage Systems, Datamation, Vol. 36, No. 17, 1990, pp. 20–28
Muntz, R.R. and Lui, J.C.S., Performance Analysis of Disk Arrays Under Failure, Proceedings of the 16th International Conference on Very Large Data Bases, 1990, pp. 162–173
Nelson. R. and Tantawi, A.N., Approximate Analysis of Fork/Join Synchronisation in Parallel Queues, IEEE Transactions on Computers, Vol. 37, No. 6, 1991, pp. 739–743
Ng, S., Some Design Issues of Disk Arrays, Proceedings of the IEEE Compcon Spring Conference, 1989, pp. 137–142
Patterson, D.A., Gibson, G., and Katz, R.H., A Case for Redundant Arrays of Inexpensive Disks (RAID), Proceedings of the SIGMOD International Conference on Management of Data, 1988, pp. 109–116
Reuter, A., Performance and Reliability Issues in Future DBMSs, Proceedings of the International Symposium on Database Systems of the 90s, Lecture Notes in Computer Science 466, Springer, 1990, pp. 294–315
Salem, K. and Garcia —Molina, H., Disk Striping, Proceedings of the 2nd International Conference on Data Engineering, 1986, pp. 336–342
Schek, H.—J., Paul, H.—B., Scholl, M.H., Weikum, G., The DASDBS Project: Objectives, Experiences, and Future Prospects, IEEE Transactions on Knowledge and Data Engineering Vol. 2 No. 1, 1990, pp. 25–43
Scheuermann, P., Weikum, G., and Zabback, P., Automatic Tuning of Data Placement and Load Balancing in Disk Arrays, In Database Systems for Next —Generation Applications — Principles and Practice, Advanced Database Research and Development Series, Word Scientific Publications, 1992
Schwetman, FL, CSIM Reference Manual (Revision 16), MCC Technical Report ACAST-252–87, Rev. 16, Microelectronics and Computer Technology Corporation, Austin, 1992
Sierra, H.M., An Introduction to Direct Access Storage Devices, Academic Press, 1990
Weikum, G., Hasse, C., Mönkeberg, A., Zabback, P., The COMFORT Project (Project Synopsis), Proceedings of the 2nd International Conference on Parallel and Distributed Information Systems, San Diego, 1993
Weikum, G., Zabback, P., and Scheuermann, P., Dynamic File Allocation in Disk Arrays, Technical Report No. 147, Computer Science Department, ETH Zurich, 1991
Weikum, G., Zabback, P., and Scheuermann, P., Dynamic File Allocation in Disk Arrays, Proceedings of the SIGMOD International Conference on Management of Data, 1991, pp. 406–415
Weikum, G. and Zabback, P., Tuning of Striping Units in Disk—Array—Based File Systems, Proceedings of the 2nd International Workshop on Research Issues on Data Engineering: Transaction and Query Processing (RIDE—TQP), 1992, pp. 80–87
Weikum, G. und Zabback, P., I/O—Parallelität und Fehlertoleranz in Disk—Arrays, Manuskript, ETH Zürich, 1992, erscheint in: Informatik—Spektrum
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1993 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zabback, P., Weikum, G. (1993). Datenpartitionierung zur Optimierung der I/O-Parallelität in Non-Standard-Anwendungen. In: Stucky, W., Oberweis, A. (eds) Datenbanksysteme in Büro, Technik und Wissenschaft. Informatik aktuell. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-86096-6_15
Download citation
DOI: https://doi.org/10.1007/978-3-642-86096-6_15
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-56487-4
Online ISBN: 978-3-642-86096-6
eBook Packages: Springer Book Archive