Abstract
We address a multicriteria non-preemptive energy-aware scheduling problem for computational Grid systems. This work introduces a new formulation of the scheduling problem for multicore heterogeneous computational Grid systems in which the minimization of the energy consumption, along with the makespan metric, is considered. We adopt a two-level model, in which a meta-broker agent (level 1) receives all user tasks and schedules them on the available resources, belonging to different local providers (level 2). The computing capacity and energy consumption of resources are taken from real multi-core processors from the main current vendors. Twenty novel list scheduling methods for the problem are proposed, and a comparative analysis of all of them over a large set of problem instances is presented. Additionally, a scalability study is performed in order to analyze the contribution of the best new bi-objective list scheduling heuristics when the problem dimension grows. We conclude after the experimental analysis that accurate trade-off schedules are computed by using the new proposed methods.
Similar content being viewed by others
References
Condor high throughput computing: Available online at http://www.cs.wisc.edu/condor/ (2011). Cited August 2011
Globus: Available online at http://www.globus.org/ (2012). Cited November 2012.
Openpbs: Available online at http://www.mcs.anl.gov/research/projects/openpbs/ (2012). Cited November 2012
Lsf—load sharing facility: Available online at http://www.vub.ac.be/BFUCC/LSF/ (2013). Cited January 2013.
Oar resource management system for high performance computing: Available online at http://oar.imag.fr (2013). Cited January 2013
Ali, S., Siegel, H.J., Maheswaran, M., Ali, S., Hensgen, D.: Task execution time modeling for heterogeneous computing systems. In: Proc. of the 9th Heterogeneous Computing Workshop, p. 185. IEEE Computer Society, Washington DC (2000)
Ambrosio, P., Auletta, V.: Deterministic monotone algorithms for scheduling on related machines. Theory Comput. Sci. 406, 173–186 (2008)
Barrondo, A., Tchernykh, A., Schaeffer, E., Pecero, J.E.: Energy efficiency of knowledge-free scheduling in peer-to-peer desktop Grids. In: Proc. of the International Conference on High Performance Computing & Simulation (HPCS), pp. 105–111 (2012)
Baskiyar, S., Abdel-Kader, R.: Energy aware DAG scheduling on heterogeneous systems. Cluster Comput. 13, 373–383 (2010)
Baskiyar, S., Palli, K.: Low power scheduling of DAGs to minimize finish times. In: Robert, Y., Parashar, M., Badrinath, R., Prasanna, V. (eds.) High Performance Computing—HiPC 2006. Lecture Notes in Computer Science, vol. 4297, pp. 353–362. Springer Berlin, Heidelberg (2006)
Berman, F., Fox, G., Hey, A.: Grid Computing: Making the Global Infrastructure a Reality. Wiley, New York (2003)
Blazewicz, J., Ecker, K.H., Pesch, E., Schmidt, G., Weglarz, J.: Handbook on Scheduling: From Theory to Applications. Springer (2007)
Braun, T., Siegel, H.J., Beck, N., Bölöni, L., Maheswaran, M., Reuther, A., Robertson, J., Theys, M., Yao, B., Hensgen, D., Freund, R.: A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems. J. Parallel Distrib. Comput. 61(6), 810–837 (2001)
Buscemi, M.G., Montanari, U., Taneja, S.: A game-theoretic analysis of Grid job scheduling. J. Grid Computing 10(3), 501–519 (2012)
Coutinho, F., de Carvalho, L.A.V.: Strategies based on green policies to the Grid resource allocation. In: Proceedings of the 21st International Conference on Parallel Architectures and Compilation Techniques, PACT ’12, pp. 487–488. ACM, New York (2012)
Da Costa, G., Gelas, J.-P., Georgiou, Y., Lefevre, L., Orgerie, A.-C., Pierson, J.-M., Richard, O., Sharma, K.: The green-net framework: Energy efficiency in large scale distributed systems. In: Proceedings of the 2009 IEEE International Symposium on Parallel&Distributed Processing, IPDPS ’09, pp. 1–8. IEEE Computer Society, Washington (2009)
Dail, H., Sievert, O., Berman, F., Casanova, H., YarKhan, A., Vadhiyar, S., Dongarra, J., Liu, C., Yang, L., Angulo, D., Foster, I.: Grid Resource Management, chapter Scheduling in the Grid Application Development Software Project, pp. 73–98. Kluwer Academic Publishers (2004)
Develder, C., Pickavet, M., Dhoedt, B., Demeester, P.: A power-saving strategy for Grids. In: Proceedings of GridNets2008, the ICST 2nd International Conference on Networks for Grid Applications and Workshops. ICST (2008)
Dorronsoro, B., Bouvry, P., Cañero, J., Maciejewski, A., Siegel, H.: Multi-objective robust static mapping of independent tasks on Grids. In: IEEE Congress on Evolutionary Computation (CEC). Part of the World Congress on Computational Intelligence (WCCI), pp. 3389–3396 (2010)
El-Rewini, H., Lewis, T., Ali, H.: Task Scheduling in Parallel and Distributed Systems. Prentice-Hall Inc. (1994)
Eshaghian, M.: Heterogeneous Computing. Artech House (1996)
Eyraud, L.: A pragmatic analysis of scheduling environments on new computing platforms. Int. J. High Perform. Comput. Appl. 20(4), 507–516 (2006)
Foster, I., Kesselman, C.: The Grid 2: Blueprint for a Future Computing Infrastructure. Morgan Kaufmann Publishers (2003)
Freund, R., Gherrity, M., Ambrosius, S., Campbell, M., Halderman, M., Hensgen, D., Keith, E., Kidd, T., Kussow, M., Lima, J., Mirabile, F., Moore, L., Rust, B., Siegel, H.: Scheduling resources in multi-user, heterogeneous, computing environments with SmartNet. In: Proc. of the 7th Heterogeneous Computing Workshop, p. 3. IEEE Computer Society, Washington DC (1998)
Freund, R., Sunderam, V., Gottlieb, A., Hwang, K., Sahni, S.: Special issue on heterogeneous processing. J. Parallel Distrib. Comput. 21(3) (1994)
Garey, M., Johnson, D.: Computers and Intractability. Freeman (1979)
Garg, S.K., Buyya, R., Siegel, H.J.: Scheduling parallel applications on utility Grids: time and cost trade-off management. In: Proc. of the 32nd Australasian Computer Science Conference ACSC, vol. 91, pp. 139–147 (2009)
Kumar Garg, S., Buyya, R.: Exploiting heterogeneity in Grid computing for energy-efficient resource allocation. In: Proceedings of the 2009 17th International Conference on Advanced Computing and Communications, ADCOM 2009, pp. 1–7. Bengaluru, India (2009)
GISELA: Grid Infrastructures for e-Science virtual communities in Europe and Latin-America (GISELA) project. Available at http://www.gisela-grid.eu/ (2011). Retrieved April 2011.
Gray, L., Kumar, A., Li, H.: Workload Characterization of the SPECpower_ssj2008 Benchmark. In: Kounev, S., Gorton, I., Sachs, K. (eds.) Performance Evaluation: Metrics, Models and Benchmarks. Lecture Notes in Computer Science, vol. 5119, pp. 262–282. Springer Berlin/Heidelberg (2008)
Hermenier, F., Loriant, N., Menaud, J.-M.: Power management in Grid computing with xen. In: Proceedings of the 2006 International Conference on Frontiers of High Performance Computing and Networking, ISPA’06, pp. 407–416. Springer, Berlin, Heidelberg (2006)
Hirales-Carbajal, A., Tchernykh, A., Yahyapour, R., González-García, J.L., Röblitz, T., Ramírez-Alcaraz, J.M.: Multiple workflow scheduling strategies with user run time estimates on a Grid. J. Grid Computing 10(2), 325–346 (2012)
Ibarra, O., Kim, C.: Heuristic algorithms for scheduling independent tasks on nonidentical processors. J. ACM 24(2), 280–289 (1977)
Kertész, A., Kacsuk, P.: Gmbs: A new middleware service for making Grids interoperable. Future Gener. Comput. Syst. 26(4), 542–553 (2010)
Khan, S., Ahmad, I.: A cooperative game theoretical technique for joint optimization of energy consumption and response time in computational Grids. IEEE Trans. Parallel Distrib. Syst. 20, 346–360 (2009)
Kim, J.-K., Siegel, H.J., Maciejewski, A., Eigenmann, R.: Dynamic resource management in energy constrained heterogeneous computing systems using voltage scaling. IEEE Trans. Parallel Distrib. Syst. 19, 1445–1457 (2008)
Kim, K., Buyya, R., Kim, J.: Power aware scheduling of bag-of-tasks applications with deadline constraints on DVS-enabled clusters. In: Proc. of the 7th IEEE International Symposium on Cluster Computing and the Grid, pp. 541–548. IEEE Computer Society, Washington DC (2007)
Kolodziej, J., Xhafa, F.: Intelligent Decision Systems in Large-Scale Distributed Environments. Studies in Computational Intelligence, chapter Task Allocation Oriented Users Decisions in Computational Grid, vol. 362, pp. 1–23. Springer Berlin-Heidelberg (2011)
Kurowski, K., Nabrzyski, J., Oleksiak, A., Weglarz, J.: A multicriteria approach to two-level hierarchy scheduling in Grids. J. Scheduling 11(5), 371–379 (2008)
Kurowski, K., Oleksiak, A., Witkowski, M., Nabrzyski, J.: Distributed power management and control system for sustainable computing environments. In: International Green Computing Conference, pp. 365–372. IEEE (2010)
Kwok, Y., Ahmad, I.: Static scheduling algorithms for allocating directed task graphs to multiprocessors. ACM Comput. Surv. 31(4), 406–471 (1999)
Lammie, M., Brenner, P., Thain, D.: Scheduling Grid workloads on multicore clusters to minimize energy and maximize performance. In: GRID, pp. 145–152. IEEE (2009)
Lee, Y.C., Zomaya, A.: Minimizing energy consumption for precedence-constrained applications using dynamic voltage scaling. In: Proc. of the 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, pp. 92–99. IEEE Computer Society, Washington DC (2009)
Lee, Y.C., Zomaya, A.: Energy conscious scheduling for distributed computing systems under different operating conditions. IEEE Trans. Parallel Distrib. Syst. 22, 1374–1381 (2011)
Lenstra, J., Shmoys, D., Tardos, É.: Approximation algorithms for scheduling unrelated parallel machines. Math. Program. 46, 259–271 (1990)
Leung, J., Kelly, L., Anderson, J.: Handbook of Scheduling: Algorithms, Models, and Performance Analysis. CRC Press, Inc. (2004)
Li, K.: Optimal load distribution for multiple heterogeneous blade servers in a cloud computing environment. J. Grid Comput. 11(1), 27–46 (2013)
Li, Y., Liu, Y., Qian, D.: A heuristic energy-aware scheduling algorithm for heterogeneous clusters. In: Proc. of the 2009 15th International Conference on Parallel and Distributed Systems, ICPADS ’09, pp. 407–413. IEEE Computer Society, Washington DC (2009)
Lindberg, P., Leingang, J., Lysaker, D., Khan, S., Li, J.: Comparison and analysis of eight scheduling heuristics for the optimization of energy consumption and makespan in large-scale distributed systems. J. Supercomputing 59(1), 323–360 (2012)
Ludwig, S.A., Moallem, A.: Swarm intelligence approaches for Grid load balancing. J. Grid Computing 9(3), 279–301 (2011)
Luo, P., Lü, K., Shi, Z.: A revisit of fast greedy heuristics for mapping a class of independent tasks onto heterogeneous computing systems. J. Parallel Distrib. Comput. 67(6), 695–714 (2007)
Mezmaz, M., Melab, N., Kessaci, Y., Lee, Y., Talbi, E.-G., Zomaya, A., Tuyttens, D.: A parallel bi-objective hybrid metaheuristic for energy-aware scheduling for cloud computing systems. J. Parallel Distrib. Comput. 71, 1497–1508 (2011)
Minas, L., Ellison, B.: Energy Efficiency for Information Technology: How to Reduce Power Consumption in Servers and Data Centers. Intel Press (2009)
Nesmachnow, S.: Cluster FING: High Performance Computing at Universidad de la República. Available online at http://www.fing.edu.uy/cluster (2011). Accessed June 2011
Orgerie, A.-C., Lefèvre, L., Gelas, J.-P.: Chasing gaps between bursts: towards energy efficient large scale experimental Grids. In: Proceedings of the 2008 Ninth International Conference on Parallel and Distributed Computing, Applications and Technologies, PDCAT ’08, pp. 381–389. IEEE Computer Society, Washington DC (2008)
Orgerie, A.-C., Lefèvre, L., Gelas, J.-P.: Save watts in your Grid: green strategies for energy-aware framework in large scale distributed systems. In: Proceedings of the 2008 14th IEEE International Conference on Parallel and Distributed Systems, ICPADS ’08, pp. 171–178. IEEE Computer Society, Washington, DC (2008)
Pecero, J., Bouvry, P., Fraire Huacuja, H.J., Khan, S.: A multi-objective grasp algorithm for joint optimization of energy consumption and schedule length of precedence-constrained applications. In: Int. Conf. Cloud and Green Computing, pp. 1–8. IEEE CS Press, Sydney (2011)
Pinel, F., Dorronsoro, B., Pecero, J., Bouvry, P., Khan, S.U.: A two-phase heuristic for the energy-efficient scheduling of independent tasks on computational Grids. Clust. Comput. (2012). doi:10.1007/s10586-012-0207-x
Pugliese, A., Talia, D., Yahyapour, R.: Modeling and supporting Grid scheduling. J. Grid Computing 6, 195–213 (2008)
Ramírez-Alcaraz, J.M., Tchernykh, A., Yahyapour, R., Schwiegelshohn, U., Quezada-Pina, A., González-García, J.L., Hirales-Carbajal, A.: Job allocation strategies with user run time estimates for online scheduling in hierarchical Grids. J. Grid Computing 9(1), 95–116 (2011)
Riedel, M., Laure, E., et al.: Interoperation of world-wide production e-science infrastructures. Concurr. Comput.: Pract. Exper. 21(8), 961–990 (2009)
Rizvandi, N., Taheri, J., Zomaya, A.: Some observations on optimal frequency selection in dvfs-based energy consumption minimization. J. Parallel Distrib. Comput. 71, 1154–1164 (2011)
Rodero, I., Guim, F., Corbalán, J., Fong, L., Sadjadi, S.M.: Grid broker selection strategies using aggregated resource information. Future Gener. Comput. Syst. 26(1), 72–86 (2010)
Schwiegelshohn, U., Yahyapour, R.: Attributes for communication between Grid scheduling instances. In: Nabrzyski, J., Schopf, J.M., Weglarz, J. (eds.) Grid Resource Management. International Series in Operations Research & Management Science, vol. 64, pp. 41–52. Springer US, Norwell (2004)
Shmoys, D.B., Wein, J., Williamson, D.P.: Scheduling parallel machines on-line. SIAM J. Comput. 24(6), 1313–1331 (1995)
SPEC: Standard performance evaluation corporation, power and performance methodology. Available online at http://www.spec.org/power/docs/SPEC-Power_and_Performance_Methodology.pdf (2011). Accessed September 2011
SPEC: Standard performance evaluation corporation, specpower_ssj2008. Available online at http://www.spec.org/power_ssj2008 (2011). Accessed September 2011
Subrata, R., Zomaya, A.Y., Landfeldt, B.: Cooperative power-aware scheduling in Grid computing environments. J. Parallel Distrib. Comput. 70(2), 84–91 (2010)
Tchernykh, A., Schwiegelshohn, U., Yahyapour, R., Kuzjurin, N.: On-line hierarchical job scheduling on Grids with admissible allocation. J. Scheduling 13(5), 545–552 (2010)
Xhafa, F., Abraham, A.: Computational models and heuristic methods for Grid scheduling problems. Future Gener. Comput. Syst. 26, 608–621 (2010)
Yin, F., Jiang, C., Deng, R., Yuan, J.: Grid resource management policies for load-balancing and energy-saving by vacation queuing theory. Comput. Electr. Eng. 35(6), 966–979 (2009)
Yu, J., Kirley, M., Buyya, R.: Multi-objective planning for workflow execution on Grids. In: IEEE/ACM Int. Conf. on Grid Computing, pp. 10–17 (2007)
Zhu, D., Melhem, R., Childers, B.: Scheduling with dynamic voltage/speed adjustment using slack reclamation in multiprocessor real-time systems. IEEE Trans. Parallel Distrib. Syst. 14, 686–700 (2003)
Zomaya, A., Teh, Y.: Observations on using genetic algorithms for dynamic load-balancing. IEEE Trans. Parallel Distrib. Syst. 12, 899–911 (2001)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Nesmachnow, S., Dorronsoro, B., Pecero, J.E. et al. Energy-Aware Scheduling on Multicore Heterogeneous Grid Computing Systems. J Grid Computing 11, 653–680 (2013). https://doi.org/10.1007/s10723-013-9258-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10723-013-9258-3