Abstract
Current HPC technologies demand high amounts of power and energy to achieve good performances. In order to address the next milestone in peak power, powerful graphic processing units and manycore processors present in current HPC systems need to be programmed having energy efficiency in mind. As energy efficiency is a major issue in this area, the existing codes and libraries need to be adapted to improve the use of the available resources. Rewriting the code requires deep knowledge of programming and architectural details to achieve good efficiency, which is an ad-hoc solution for a concrete system. We present the Ull_Multiobjective_Framework, an interface that allows automatic dynamic balance of the workload for parallel iterative codes in heterogeneous environments. UllMF allows to include the overall energy consumption as a parameter during the balancing process. This tool hides all architectural measurement details, requires very low effort to the programmer and introduces a minimum overhead. The calibration library has been used to solve iterative problems over heterogeneous platforms. To validate it, we present an analysis of different Dynamic Programming problems over different hardware configurations of a MultiGPU heterogeneous system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Acosta, A., Almeida, F.: Skeletal based programming for dynamic programming on MultiGPU systems. J. Supercomput. 65(3), 1125–1136 (2013). https://doi.org/10.1007/s11227-013-0895-x
Acosta, A., Blanco, V., Almeida, F.: Dynamic load balancing on heterogeneous multi-GPU systems. Comput. Electr. Eng. 39(8), 2591–2602 (2013). https://doi.org/10.1016/j.compeleceng.2013.08.004
Cabrera, A., Almeida, F., Arteaga, J., Blanco, V.: Measuring energy consumption using EML (energy measurement library). Comput. Sci. - Res. Dev. 30(2), 135–143 (2014). https://doi.org/10.1007/s00450-014-0269-5
Dongarra, J., Bosilca, G., Chen, Z., Eijkhout, V., Fagg, G.E., Fuentes, E., Langou, J., Luszczek, P., Pjesivac-Grbovic, J., Seymour, K., You, H., Vadhiyar, S.S.: Self-adapting numerical software (SANS) effort. IBM J. Res. Dev. 50(2/3), 223–238 (2006)
Garzón, E.M., Moreno, J.J., Martínez, J.A.: An approach to optimise the energy efficiency of iterative computation on integrated GPU-CPU systems. J. Supercomput. 73(1), 114–125 (2017). https://doi.org/10.1007/s11227-016-1643-9
Guzek, M., Kliazovich, D., Bouvry, P.: HEROS: energy-efficient load balancing for heterogeneous data centers. In: Pu, C., Mohindra, A. (eds.) 8th IEEE International Conference on Cloud Computing, CLOUD 2015, New York City, NY, USA, 27 June–2 July 2015, pp. 742–749. IEEE (2015). https://doi.org/10.1109/CLOUD.2015.103
Martínez, J., Garzón, E., Plaza, A., García, I.: Automatic tuning of iterative computation on heterogeneous multiprocessors with ADITHE. J. Supercomput. 1–9 (2009). https://doi.org/10.1007/s11227-009-0350-1
Padoin, E.L., Castro, M.B., Pilla, L.L., Navaux, P.O.A., Méhaut, J.: Saving energy by exploiting residual imbalances on iterative applications. In: 21st International Conference on High Performance Computing, HiPC 2014, Goa, India, 17–20 December 2014, pp. 1–10. IEEE (2014). https://doi.org/10.1109/HiPC.2014.7116895
Peláez, I., Almeida, F., Suárez, F.: DPSKEL: a skeleton based tool for parallel dynamic programming. In: 7th International Conference Parallel Processing and Applied Mathematics, PPAM2007, Gdansk, Poland, pp. 1104–1113, September 2007. https://doi.org/10.1007/978-3-540-68111-3_117
Reddy, R., Lastovetsky, A.: Bi-objective optimization of data-parallel applications on homogeneous multicore clusters for performance and energy. IEEE Trans. Comput. PP(99), 1 (2017)
Steuwer, M., Gorlatch, S.: SkelCL: a high-level extension of OpenCL for multi-GPU systems. J. Supercomput. 69(1), 25–33 (2014). https://doi.org/10.1007/s11227-014-1213-y
Takouna, I., Rojas-Cessa, R., Sachs, K., Meinel, C.: Communication-aware and energy-efficient scheduling for parallel applications in virtualized data centers. In: IEEE/ACM 6th International Conference on Utility and Cloud Computing, UCC 2013, Dresden, Germany, 9–12 December 2013, pp. 251–255. IEEE (2013). https://doi.org/10.1109/UCC.2013.50
Acknowledgment
This work was supported by the Spanish Ministry of Education and Science through the TIN2016-78919-R project, the Government of the Canary Islands through the grant with reference TESIS2017010134, partially funded by FEDER funds; the Spanish network CAPAP-H4, and the European COST Actions NESUS and CHIPSET.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Cabrera, A., Acosta, A., Almeida, F., Blanco, V. (2018). Energy Efficient Dynamic Load Balancing over MultiGPU Heterogeneous Systems. In: Wyrzykowski, R., Dongarra, J., Deelman, E., Karczewski, K. (eds) Parallel Processing and Applied Mathematics. PPAM 2017. Lecture Notes in Computer Science(), vol 10778. Springer, Cham. https://doi.org/10.1007/978-3-319-78054-2_12
Download citation
DOI: https://doi.org/10.1007/978-3-319-78054-2_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-78053-5
Online ISBN: 978-3-319-78054-2
eBook Packages: Computer ScienceComputer Science (R0)