Skip to main content
SpringerLink
Log in

A framework for adaptive storage input/output on computational grids

  • Conference paper
  • First Online:
Parallel and Distributed Processing (IPPS 1999)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1586))

Included in the following conference series:

Abstract

Emerging computational grids consist of distributed collections of heterogeneous sequential and parallel systems and irregular applications with complex, data dependent execution behavior and time varying resource demands. To provide adaptive input/output resource management for these systems, we are developing PPFS II, a portable parallel file system. PPFS II supports rule-based, closed loop and interactive control of input/output subsystems on both parallel and wide area distributed systems.

This work was supported in part by the Defense Advanced Research Projects Agency under DARPA contracts DABT63-94-C0049 (SIO Initiative), F30602-96-C-0161, and DABT63-96-C-0027 by the National Science Foundation under grants NSF CDA 94-01124 and ACS 97-20202, and by the Department of Energy under contracts DOE B-341494, W-7405-ENG-48, and 1-B-333164.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Abraham, B., and Ledolter, J.Statistical Method for Forecasting. John Wiley and Sons, 1983.

    Google Scholar 

  2. Box, G. E., and Jenkins, G. M.Time Series Analysis Forecasting and Control, 2nd ed. San Francisco: Holden-day, 1976.

    Google Scholar 

  3. Chen, P. M., and Patterson, D. A. Maximizing Performance in a Striped Disk Array. In Proceedings of the 17th Annual International Symposium on Computer Architecture (1990), pp. 322–331.

    Google Scholar 

  4. Corbett, P. F., Prost, J.-P., Demetriou, C., Gibson, G., Riedel, E., Zelenka, J., Chen, Y., Felten, E., Li, K., Hartman, J., Peterson, L., Bershad, B., Wolman, A., and Aydt, R. Proposal for a Common Parallel File System Programming Interface Version 1.0. http://www.cs.arizona.edu/sio/api1.0.ps, Nov. 1996.

    Google Scholar 

  5. Crandall, P. E., Aydt, R. A., Chien, A. A., and Reed, D. A. Characterization of a Suite of Input/Output Intensive Applications. In Proceedings of Supercomputing ’95 (Dec. 1995).

    Google Scholar 

  6. Dibble, P. C., Scott, M. L., and Ellis, C. S. Bridge: A High-Performance File System for Parallel Processors. In Proc. 8th Int’l. Conf. on Distr. Computing Sys. (San Jose, CA, jun 1988), pp. 154–161.

    Google Scholar 

  7. Foster, I., and Kesselman, C. Globus: A Metacomputing Infrastructure Toolkit. International Journal of Supercomputing Applications and High Performance Computing 11, 2 (Summer 1997), 115–128.

    Google Scholar 

  8. Hartman, J. H., and Ousterhout, J. K. The Zebra Striped Network File System. ACM Transactions on Computer Systems 13, 3 (Aug. 1995), 274–310.

    Article  Google Scholar 

  9. Henderson, R. D., and Karniadakis, G. E. Unstructured Spectral Element Methods for Simulation of Turbulent Flows. Journal of Computational Physics 122(2) (1995), 191–217.

    Article  MATH  Google Scholar 

  10. Kimbrel, T., Tomkins, A., Patterson, R. H., Bershad, B., Cao, P., Felten, E., Gibson, G., and Karlin, A. R. A Trace-Driven Comparison of Algorithms for Parallel Prefetching and Caching. In Proceedings of the 1996 Symposium on Operating Systems Design and Implementation (1996), pp. 19–34.

    Google Scholar 

  11. Madhyastha, T. M., Elford, C. L., and Reed, D. A. Optimizing Input/Output Using Adaptive File System Policies. In Proceedings of the Fifth Goddard Conference on Mass Storage Systems and Technologies (Sept. 1996), pp. II:493–514.

    Google Scholar 

  12. Madhyastha, T. M., and Reed, D. A. Intelligent, Adaptive File System Policy Selection. In Proceedings of the Sixth Symposium on the Frontiers of Massively Parallel Computation (Oct 1996), IEEE Computer Society Press, pp. 172–179.

    Google Scholar 

  13. Madhyastha, T. M., and Reed, D. A. Exploiting Global Input/Output Access Pattern Classification. In Proceedings of SC ’97: High Performance Computing and Networking (San Jose, Nov. 1997), IEEE Computer Society Press.

    Google Scholar 

  14. Madhyastha, T. M., and Reed, D. A. Input/Output Access Pattern Classification Using Hidden Markov Models. In Proceedings of the Fifth Workshop on Input/Output in Parallel and Distributed Systems (San Jose, CA, Nov. 1997), ACM Press, pp. 57–67.

    Google Scholar 

  15. Patterson, D., Chen, P., Gibson, G., and Katz, R. H. Introduction to Redundant Arrays of Inexpensive Disks (RAID). In Proceedings of IEEE Compcon (Spring 1989), pp. 112–117.

    Google Scholar 

  16. Patterson, R., Gibson, G., Ginting, E., Stodolsky, D., and Zelenka, J. Informed Prefetching and Caching. In Proceedings of the 15th ACM Symposium on Operating Systems Principles, Copper Mountain, CO. (December 1995), pp. 79–95.

    Google Scholar 

  17. Reed, D., Aydt, R., Noe, R., Roth, P. C., Shields, K. A., Schwartz, B., and Tavera, L. Scalable Performance Analysis: The Pablo Performance Analysis Environment. In Proceedings of the Scalable Parallel Libraries Conference. IEEE Computer Society (1993), pp. 104–113.

    Google Scholar 

  18. Ribler, R. L., Vetter, J. S., Simitci, H., and Reed, D. A. Autopilot: Adaptive Control of Distributed Applications. In Proceedings of HPDC 7 (July 1998).

    Google Scholar 

  19. Salem, K., and Garcia-Molina, H. Disk Striping. In Proceedings of the 2ndInternational Conference on Data Engineering (Feb, 1986), ACM, pp. 336–342.

    Google Scholar 

  20. Scheuermann, P., Weikum, G., and Zabback, P. Data Partitioning and Load Balancing in Parallel Disk Systems. The VLDB Journal 7, 1 (Feb. 1998), 48–66.

    Article  Google Scholar 

  21. Simitci, H., and Reed, D. A. Adaptive Disk Striping for Parallel Input/Output. In submitted for publication (1999).

    Google Scholar 

  22. Smirni, E., and Reed, D. Workload Characterization of Input Output Intensive Parallel Applications. In Proceedings of the Conference on Modelling Techniques and Tools for Computer Performance Evaluation, Springer-Verlag Lecture Notes in Computer Science (June 1997), vol. 1245, pp. 169–180.

    Google Scholar 

  23. The MPI-IO Committee. MPI-IO: A Parallel File I/O Interface for MPI, April 1996. Version 0.5.

    Google Scholar 

  24. Wei, W. S.Time Series Analysis Univariate and Multivariate Methods. Addison-Wesley, 1990.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, University of Illinois, 61801, Urbana, Illinois, USA

    Huseyin Simitci, Daniel A. Reed, Ryan Fox, Mario Medina, James Oly, Nancy Tran & Guoyi Wang

Authors
  1. Huseyin Simitci
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Daniel A. Reed
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ryan Fox
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mario Medina
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. James Oly
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Nancy Tran
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Guoyi Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

José Rolim Frank Mueller Albert Y. Zomaya Fikret Ercal Stephan Olariu Binoy Ravindran Jan Gustafsson Hiroaki Takada Ron Olsson Laxmikant V. Kale Pete Beckman Matthew Haines Hossam ElGindy Denis Caromel Serge Chaumette Geoffrey Fox Yi Pan Keqin Li Tao Yang G. Chiola G. Conte L. V. Mancini Domenique Méry Beverly Sanders Devesh Bhatt Viktor Prasanna

Rights and permissions

Reprints and permissions

Copyright information

© 1999 Springer-Verlag

About this paper

Cite this paper

Simitci, H. et al. (1999). A framework for adaptive storage input/output on computational grids. In: Rolim, J., et al. Parallel and Distributed Processing. IPPS 1999. Lecture Notes in Computer Science, vol 1586. Springer, Berlin, Heidelberg . https://doi.org/10.1007/BFb0097936

Download citation

  • DOI: https://doi.org/10.1007/BFb0097936

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-65831-3

  • Online ISBN: 978-3-540-48932-0

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation