Skip to main content
SpringerLink
Log in

Scheduling parallel applications in distributed networks

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Prophet is a run-time scheduling system designed to support the efficient execution of parallel applications written in the Mentat programming language (Grimshaw, 1993). Prior results demonstrated that SPMD applications could be scheduled automatically in an Ethernet-based local-area workstation network with good performance (Weissman and Grimshaw, 1994 and 1995). This paper describes our recent efforts to extend Prophet along several dimensions: improved overhead control, greater resource sharing, greater resource heterogeneity, wide-area scheduling, and new application types. We show that both SPMD and task parallel applications can be scheduled effectively in a shared heterogeneous LAN environment containing ethernet and ATM networks by exploiting the application structure and dynamic run-time information.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. F. Berman and R. Wolski, Scheduling from the perspective of the application, in: Proceedings of the 5th IEEE International Symposium on High Performance Distributed Computing(August 1996).

  2. T.L. Casavant and J.G. Kuhl, A taxonomy of scheduling in general purpose distributed computing systems, IEEE Transactions on Software Engineering 14 (1988).

  3. K.M. Chandy and E.M. Schooler, Designing directories in distributed systems: a systematic framework, in: Proceedings of the 5th IEEE International Symposium on High Performance Distributed Computing(August 1996).

  4. D.L. Eager, E.D. Lazowska and J. Zahorjan, Adaptive load sharing in homogeneous distributed systems, IEEE Transactions on Software Engineering 12 (1986).

  5. S.M. Figueira and F. Berman, Modeling the effects of contention on the performance of heterogeneous applications, in: Proceedings of the 5th IEEE International Symposium on High Performance Distributed Computing(August 1996).

  6. I. Foster and C. Kesselman, Globus: a metacomputing infrastructure toolkit, International Journal of Supercomputing Applications (to appear).

  7. A.S. Grimshaw, Easy to use object-oriented parallel programming with Mentat, IEEE Computer (1993).

  8. A.S. Grimshaw and W.A. Wulf, The Legion vision of a worldwide virtual computer, Communications of the ACM 40(1) (1997).

  9. A.K. Jain, Fundamentals of Digital Image Processing(Prentice-Hall, Englewood Cliffs, NJ, 1989).

    Google Scholar 

  10. N. Nedeljkovic and M.J. Quinn, Data-parallel programming on a network of heterogeneous workstations, in: Proceedings of the 1st IEEE International Symposium on High Performance Distributed Computing(September 1992).

  11. H. Topcuoglu et al., The software architecture of a virtual distributed computing environment, in: Proceedings of the 6th IEEE International Symposium on High Performance Distributed Computing(August 1997).

  12. J.B. Weissman, Scheduling parallel computations in a heterogeneous environment, Ph.D. thesis, University of Virginia (August 1995).

  13. J.B. Weissman, The interference paradigm for network job scheduling, in: Heterogeneous Computing Workshop, 10th International Parallel Processing Symposium IPPS(April 1996).

  14. J.B. Weissman, Gallop: the benefits of wide-area computing for parallel processing, Report CS-97-8, The University of Texas at San Antonio, San Antonio (1997).

    Google Scholar 

  15. J.B. Weissman and A.S. Grimshaw, Network partitioning of data parallel computations, in: Proceedings of the 3rd IEEE International Symposium on High Performance Distributed Computing(August 1994).

  16. J.B. Weissman and A.S. Grimshaw, A framework for partitioning parallel computations in heterogeneous environments, Concurrency: Practice and Experience 7(5) (1995).

  17. J.B. Weissman and A.S. Grimshaw, A federated model for scheduling in wide-area systems, in: Proceedings of the 5th IEEE International Symposium on High Performance Distributed Computing(August 1996).

  18. R. Wolski, Forecasting network performance to support dynamic scheduling, in: Proceedings of the 6th IEEE International Symposium on High Performance Distributed Computing(1997).

Download references

Author information

Authors and Affiliations

  1. Division of Computer Science, University of Texas at San Antonio, San Antonio, TX, 78249, USA

    Jon B. Weissman & Xin Zhao

Authors
  1. Jon B. Weissman
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xin Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Weissman, J.B., Zhao, X. Scheduling parallel applications in distributed networks. Cluster Computing 1, 109–118 (1998). https://doi.org/10.1023/A:1019073113216

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1019073113216

Keywords

Search

Navigation