Skip to main content
Springer Nature Link
Log in

An efficient scheduling scheme using estimated execution time for heterogeneous computing systems

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Computing systems should be designed to exploit parallelism in order to improve performance. In general, a GPU (Graphics Processing Unit) can provide more parallelism than a CPU (Central Processing Unit), resulting in the wide usage of heterogeneous computing systems that utilize both the CPU and the GPU together. In the heterogeneous computing systems, the efficiency of the scheduling scheme, which selects the device to execute the application between the CPU and the GPU, is one of the most critical factors in determining the performance. This paper proposes a dynamic scheduling scheme for the selection of the device between the CPU and the GPU to execute the application based on the estimated-execution-time information. The proposed scheduling scheme enables the selection between the CPU and the GPU to minimize the completion time, resulting in a better system performance, even though it requires the training period to collect the execution history. According to our simulations, the proposed estimated-execution-time scheduling can improve the utilization of the CPU and the GPU compared to existing scheduling schemes, resulting in reduced execution time and enhanced energy efficiency of heterogeneous computing systems.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  1. Agarwal V, Hrishikesh MS, Keckler SW, Burger D (2000) Clock rate versus IPC: the end of the road for conventional microArchitectures. In: Proceedings of 27th international symposium on computer architecture, pp 248–259

    Google Scholar 

  2. Eberly DH (2001) 3D game engine design. Morgan Kaufmann, San Francisco

    Google Scholar 

  3. Buck I, Foley T, Horn D, Sugerman J, Fatahalian K, Houston M, Hanrahan P (2004) Brook for GPUs: stream computing on graphics hardware. In: Proceedings of 31th annual conference on computer graphics (SIGGRAPH), pp 777–786

    Google Scholar 

  4. Owens JD, Luebke D, Govindaraju N, Harris M, Kruger J, Lefohn AE, Purcell TJ (2005) A survey of general-purpose computation on graphics hardware. In: Euro-graphics 2005, state of the art reports, pp 21–51

    Google Scholar 

  5. GPGPU. Available at http://www.gpgpu.org

  6. NVIDIA CUDA Programming. Available at http://www.nvidia.com/object/cuda_home_new.html

  7. Che S, Meng J, Sheaer J, Skadron K (2008) A performance study of general purpose applications on graphics processors using CUDA. J Parallel Distrib Comput 68(10):1370–1380

    Article  Google Scholar 

  8. Ryoo S, Rodrigues CI, Baghsorkhi SS, Stone SS, Kirk DB, Hwu WW (2008) Optimization principles and application performance evaluation of a multithreaded GPU using CUDA. In: Proceedings of the symposium on principles and practice of parallel programming, pp 73–82

    Google Scholar 

  9. Akenine-Moller T, Haines E (2002) Real-time rendering, 2nd edn. AK Peters, Natick

    Google Scholar 

  10. Gregg C, Brantley JS, Hazelwood K (2010) Contention-aware scheduling of parallel code for heterogeneous systems. In: Proceedings of the 2nd USENIX workshop on hot topics in parallelism, 6 pages

    Google Scholar 

  11. Gregg C, Boyer M, Hazelwood K, Skadron K (2011) Dynamic heterogeneous scheduling decisions using historical runtime data. In: Proceedings of the 2nd workshop on applications for multi- and many-core processors, 12 pages

    Google Scholar 

  12. Jimenez V, Vilanova L, Gelado I, Gil M, Fursin G, Navarro N (2009) Predictive runtime code scheduling for heterogeneous architectures. In: Proceedings of the 4th international conference on high performance embedded architectures and compilers, pp 19–33

    Chapter  Google Scholar 

  13. Parboil benchmark suite. Available at http://www.crhc.uiuc.edu/impact/parboil.php

  14. YuHai Y, Shengsheng Y, XueLian B (2007) A new dynamic scheduling algorithm for real-time heterogeneous multiprocessor systems. In: Proceedings of the workshop on intelligent information technology application, pp 112–115

    Chapter  Google Scholar 

Download references

Acknowledgements

This work was supported by the National Research Foundation of Korea Grant funded by the Korean Government (NRF-2011-013-D00105, 2012R1A1B4003492) and the ITRC (Information Technology Research Center) support program supervised by the NIPA (NIPA-2012-H0301-12-3005).

Author information

Authors and Affiliations

  1. School of Electronics and Computer Engineering, Chonnam National University, Gwangju, Korea

    Hong Jun Choi, Dong Oh Son, Seung Gu Kang & Cheol Hong Kim

  2. School of Electrical Engineering, University of Ulsan, Ulsan, Korea

    Jong Myon Kim

  3. School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, USA

    Hsien-Hsin Lee

Authors
  1. Hong Jun Choi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dong Oh Son
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Seung Gu Kang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jong Myon Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Hsien-Hsin Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Cheol Hong Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Cheol Hong Kim.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Choi, H.J., Son, D.O., Kang, S.G. et al. An efficient scheduling scheme using estimated execution time for heterogeneous computing systems. J Supercomput 65, 886–902 (2013). https://doi.org/10.1007/s11227-013-0870-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-013-0870-6

Keywords

Search

Navigation