Skip to main content
Springer Nature Link
Log in

Heterogeneous Computing: Goals, Methods, and Open Problems

  • Conference paper
  • First Online:
High Performance Computing — HiPC 2001 (HiPC 2001)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2228))

Included in the following conference series:

Abstract

This paper discusses the material tob e presented by H. J. Siegel in his keynote talk. Distributed high-performance heterogeneous computing (HC) environments are composed of machines with varied computational capabilities interconnected by high-speed links. These environments are well suited to meet the computational demands of large, diverse groups of applications. One key factor in achieving the best performance possible from HC environments is the ability to assign effectively the applications to machines and schedule their execution. Several factors must be considered during this assignment. A conceptual model for the automatic decomposition of an application into tasks and assignment of tasks to machines is presented. An example of a static matching and scheduling approach for an HC environment is summarized. Some examples of current HC technology and open research problems are discussed.

This research was supported in part by the DARPA/ITO Quorum Program under the NPS subcontract numbers N62271-97-M-0900, N62271-98-M-0217, and 62271- 98-M-0448, and under the GSA subcontract number GS09K99BH0250. Some of the equipment used was donated by Intel and Microsoft.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Ali, S., Siegel, H. J., Maheswaran, M., Hensgen, D., Ali, S.: Representing task and machine heterogeneities for heterogeneous computing systems. Tamkang Journal of Science and Engineering. 3 (2000) 195–207

    Google Scholar 

  2. Armstrong, R.: Investigation of Effect of Different Run-Time Distributions on SmartNet Performance. Master’s Thesis, Department of Computer Science, Naval Postgraduate School, Monterey, CA (1997)

    Google Scholar 

  3. Banicescu, I., Velusamy, V.: Performance of scheduling scientific applications with adaptive weighted factoring. In: 10th IEEE Heterogeneous Computing Workshop (HCW 2001), in the CD-ROM Proceedings of the 15th International Parallel and Distributed Processing Symposium (IPDPS 2001). (2001) HCW 06

    Google Scholar 

  4. Braun, T. D., Siegel, H. J., Beck, N., Bölöni, L., Maheswaran, M., Reuther, A. I., Robertson, J. P., Theys, M. D., Yao, B.: A taxonomy for describing matching and scheduling heuristics for mixed-machine heterogeneous computing systems. In: IEEE Workshop on Advances in Parallel and Distributed Systems, in the Proceedings of the 17th IEEE Symposium on Reliable Distributed Systems. (1998) 330–335

    Google Scholar 

  5. Braun, T. D., Siegel, H. J., Beck, N., B:olöni, L. L., Maheswaran, M., Reuther, A. I., Robertson, J. P., Theys, M. D., Yao, B., Hensgen, D., Freund, R. F.: A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems. Journal of Parallel and Distributed Computing. 61 (2001) 180–837

    Article  Google Scholar 

  6. Braun, T. D.: Heterogeneous Distributed Computing: O.-line Mapping Heuristics for Independent Tasks and for Tasks with Dependencies, Priorities, Deadlines, and Multiple Versions. Ph.D. Thesis, School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN (2001)

    Google Scholar 

  7. Coffman, Jr., E. G. (ed.): Computer and Job-Shop Scheduling Theory. John Wiley & Sons, New York, NY (1976)

    MATH  Google Scholar 

  8. Cormen, T. H., Leiserson, C. E., Rivest, R. L.: Introduction to Algorithms. MIT Press, Cambridge, MA (1992)

    Google Scholar 

  9. Dietz, H. G., Cohen, W. E., Grant, B. K.: Would you run it here... or there? (AHS: Automatic heterogeneous supercomputing). In: International Conference on Parallel Processing. II (1993) 217–221

    Google Scholar 

  10. Eshaghian, M. M. (ed.): Heterogeneous Computing. Artech House, Norwood, MA (1996)

    Google Scholar 

  11. Fernandez-Baca, D.: Allocating modules to processors in a distributed system. In: IEEE Transactions Software Engineering. SE-15 (1989) 1427–1436

    Article  Google Scholar 

  12. Foster, I., Kesselman, C. (eds.): The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann, San Francisco, CA (1999)

    Google Scholar 

  13. Freund, R. F., Gherrity, M., Ambrosius, S., Campbell, M., Halderman, M., Hensgen, D., Keith, E., Kidd, T., Kussow, M., Lima, J. D., Mirabile, F., Moore, L., Rust, B., Siegel, H. J.: Scheduling resources in multi-user, heterogeneous computing environments with SmartNet. In: 7th Heterogeneous Computing Workshop (HCW’ 98). (1998) 184–199

    Google Scholar 

  14. Freund, R. F., Siegel, H. J.: Heterogeneous processing. In: IEEE Computer. 26 (1993) 13–17

    Google Scholar 

  15. Ghafoor, A., Yang, J.: Distributed heterogeneous supercomputing management system. In: IEEE Computer. 26 (1993) 78–86

    Google Scholar 

  16. Hensgen, D. A., Kidd, T., Schnaidt, M. C., St. John, D., Siegel, H. J., Braun, T. D., Maheswaran, M., Ali, S., Kim, J.-K., Irvine, C., Levin, T., Wright, R., Freund, R. F., Godfrey, M., Duman, A., Car., P., Kidd, S., Prasanna, V., Bhat, P., Alhusaini, A.: An overview of MSHN: A management system for heterogeneous networks. In: 8th Heterogeneous Computing Workshop (HCW’ 99). (1999) 184–198

    Google Scholar 

  17. Huh, E.-N., Welch, L. R., Shirazi, B. A., Cavanaugh, C. D.: Heterogeneous resource management for dynamic real-time systems. In: 9th IEEE Heterogeneous Computing Workshop (HCW 2000). (2000) 287–294

    Google Scholar 

  18. Ibarra, O. H., Kim, C. E.: Heuristic algorithms for scheduling independent tasks on nonidentical processors. Journal of the ACM. 24 (1977) 280–289

    Article  MATH  MathSciNet  Google Scholar 

  19. Jain, R.: The Art of Computer Systems Performance Analysis Techniques for Experimental Design, Measurement, Simulation, and Modeling. John Wiley & Sons, New York, NY (1991)

    MATH  Google Scholar 

  20. Kafil, M., Ahmad, I.: Optimal task assignment in heterogeneous distributed computing systems. In: IEEE Concurrency. 6 (1998) 42–51

    Article  Google Scholar 

  21. Kapadia, N. H., Fortes, J. A. B.: PUNCH: An architecture for web-enabled widearea network-computing. Cluster Computing: The Journal of Networks, Software Tools and Applications. 2 (1999) 153–164

    Google Scholar 

  22. Khokhar, A., Prasanna, V. K., Shaaban, M., Wang, C. L.: Heterogeneous computing: Challenges and opportunities. In: IEEE Computer. 26 (1993) 18–27

    Google Scholar 

  23. Kim, J.-K., Kidd, T., Siegel, H. J., Irvine, C., Levin, T., Hensgen, D. A., St. John, D., Prasanna, V. K., Freund, R. F., Porter, N. W.: Collective value of QoS: A performance measure framework for distributed heterogeneous networks. In: 10th IEEE Heterogeneous Computing Workshop (HCW 2001), in the CD-ROM Proceedings of the 15th International Parallel and Distributed Processing Symposium (IPDPS 2001). (2001) HCW_08

    Google Scholar 

  24. Klietz, A. E., Malevsky, A. V., Chin-Purcell, K.: A case study in metacomputing: Distributed simulations of mixing in turbulent convection. In: 2nd Workshop on Heterogeneous Processing (WHP’ 93). (1993) 101–106

    Google Scholar 

  25. Maheswaran, M. Ali, S., Siegel, H. J., Hensgen, D., Freund, R. F.: Dynamic mapping of a class of independent tasks onto heterogeneous computing systems. Journal of Parallel and Distributed Computing. 59 (1999) 107–121

    Article  Google Scholar 

  26. Maheswaran, M., Braun, T. D., Siegel, H. J.: Heterogeneous distributed computing. In: Webster, J. G. (ed.): Encyclopedia of Electrical and Electronics Engineering. John Wiley & Sons, New York, NY. 8 (1999) 679–690

    Google Scholar 

  27. Michalewicz, Z., Fogel, D. B.: How to Solve It: Modern Heuristics. Springer-Verlag, New York, NY (2000)

    MATH  Google Scholar 

  28. Norman, M. L., Beckman, P., Bryan, G., Dubinski, J., Gannon, D., Hernquist, L., Keahey, K., Ostriker, J. P., Shalf, J., Welling, J., Yang, S.: Galaxies Collide on the I-way: An example of heterogeneous wide-area collaborative supercomputing. The International Journal of Supercomputer Applications and High Performance Computing. 10 (1996) 132–144

    Article  Google Scholar 

  29. Siegel, H. J., Dietz, H. G., Antonio, J. K.: Software support for heterogeneous computing. In: Tucker, Jr., A. B. (ed.): The Computer Science and Engineering Handbook. CRC Press, Boca Raton, FL (1997) 1886–1909

    Google Scholar 

  30. Singh, H., Youssef, A.: Mapping and scheduling heterogeneous task graphs using genetic algorithms. In: 5th Heterogeneous Computing Workshop (HCW’ 96). (1996) 86–97

    Google Scholar 

  31. Wu, M.-Y., Shu, W., Zhang, H.: Segmented min-min: A static mapping algorithm for meta-tasks on heterogeneous computing systems. In: 9th IEEE Heterogeneous Computing Workshop (HCW 2000). (2000) 375–385

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. NOEMIX, Inc., 1425 Russ Blvd. Ste. T-110, 92101-4717, San Diego, CA, USA

    Tracy D. Braun

  2. Electrical and Computer Engineering Department, Colorado State University, 80523-1373, Fort Collins, CO, USA

    Howard Jay Siegel & Anthony A. Maciejewski

Authors
  1. Tracy D. Braun
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Howard Jay Siegel
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Anthony A. Maciejewski
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Mathematics and Computer Science, University of Paderborn, Fürstenallee 11, 33102, Paderborn, Germany

    Burkhard Monien

  2. Department of EE-Systems, Computer Engineering Division, University of Southern California, 3740 McClintock Avenue, EEB 200C, 90089-2562, Los Angeles, CA, USA

    Viktor K. Prasanna

  3. Independent Consultant, c/o Infosys Ltd., “Mangala”, Kuloor Ferry Road, Kottara, 575006, Mangalore, India

    Sriram Vajapeyam

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Braun, T.D., Siegel, H.J., Maciejewski, A.A. (2001). Heterogeneous Computing: Goals, Methods, and Open Problems. In: Monien, B., Prasanna, V.K., Vajapeyam, S. (eds) High Performance Computing — HiPC 2001. HiPC 2001. Lecture Notes in Computer Science, vol 2228. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45307-5_27

Download citation

  • DOI: https://doi.org/10.1007/3-540-45307-5_27

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-43009-4

  • Online ISBN: 978-3-540-45307-9

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation