Abstract
The main aim of this work is to take advantage of the computer resources of a single organization or Multicluster system to execute distributed applications efficiently without excessively damaging the local users. In doing so we propose a Metascheduler environment named MetaLoRaS with a 2-level hierarchical architecture for a non-dedicated Multicluster with job prediction capabilities.
Among other Metaschedulers, the non-dedicated feature and an efficient prediction system are the most distinctive characteristics of MetaLoRaS. Another important contribution is the effective cluster selection mechanism, based on the prediction system.
In this article, we show how the hierarchical architecture and simulation mechanism are the best choices if we want to obtain an accurate prediction system and, at the same time, the best turnaround times for distributed jobs without damaging local user performance.
This work was supported by the MEyC-Spain under contract TIN 2004-03388.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Abawajy, J., Dandamudi, S.: Parallel Job Scheduling on Multicluster Computing Systems. In: Proceedings of the IEEE International Conference on Cluster Computing (CLUSTER 2003) (2003)
Acharya, A., Setia, S.: Availability and utility of idle memory in workstation clusters. In: Proceedings of the ACM SIGM./PERF.1999, pp. 35–46 (1999)
Bucur, A., Epema, D.: Local versus Global Schedulers with Processor Co-allocation in Multicluster Systems. In: Feitelson, D.G., Rudolph, L., Schwiegelshohn, U. (eds.) JSSPP 2002. LNCS, vol. 2537, pp. 184–204. Springer, Heidelberg (2002)
Hanzich, M., Giné, F., Hernández, P., Solsona, F., Luque, E.: Coscheduling and Multiprogramming level in a non-dedicated cluster. In: Kranzlmüller, D., Kacsuk, P., Dongarra, J. (eds.) EuroPVM/MPI 2004. LNCS, vol. 3241, pp. 327–336. Springer, Heidelberg (2004)
Hanzich, M., Giné, F., Hernández, P., Solsona, F., Luque, E.: Cisne: A new integral approach for scheduling parallel applications on non-dedicated clusters. In: Cunha, J.C., Medeiros, P.D. (eds.) Euro-Par 2005. LNCS, vol. 3648, pp. 220–230. Springer, Heidelberg (2005)
Jones, W., Ligon, W., Pang, L.: Characterization of Bandwidth-Aware Meta-Schedulers for Co-Allocating Jobs Across Multiple Clusters. The Journal of Supercomputing 34, 135–163 (2005)
Litzkow, M., Livny, M., Mutka, M.: Condor- a hunter of idle workstations. In: 8th Int’l Conference of Distributed Computing Systems (1988)
Bose, A., Wickman, B., Wood, C.: MARS: a metascheduler for distributed resources in campus grids. In: Proceedings. Fifth IEEE/ACM International Workshop on Grid Computing (2004)
Sabin, G., Kettimuthu, R., Rajan, A., Sadayappan, P.: Scheduling of Parallel Jobs in a Heterogeneous Multi-site Environment. In: Feitelson, D.G., Rudolph, L., Schwiegelshohn, U. (eds.) JSSPP 2003. LNCS, vol. 2862, pp. 87–104. Springer, Heidelberg (2003)
Santoso, J., van Albada, G.D., Nazief, B.A., Sloot, P.M.: Hierarchical Job Scheduling for Clusters of Workstations. In: Proceedings of the sixth annual conference of the Advanced School for Computing and Imaging (ASCI 2000), pp. 99–105 (2000)
Shmueli, E., Feitelson, D.G.: Backfilling with lookahead to optimize the performance of parallel job scheduling. In: Feitelson, D.G., Rudolph, L., Schwiegelshohn, U. (eds.) JSSPP 2003. LNCS, vol. 2862, pp. 228–251. Springer, Heidelberg (2003)
Subramani, V., Kettimuthu, R., Srinivasan, S., Sadayappan, P.: Distributed Job Scheduling on Computational Grids using Multiple Simultaneous Requests. In: Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing (2002)
Xu, M.: Effective Metacomputing using LSF MultiCluster, ccgrid. In: 1st International Symposium on Cluster Computing and the Grid, p. 100 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lérida, J.L., Solsona, F., Giné, F., Hanzich, M., Hernández, P., Luque, E. (2006). MetaLoRaS: A Predictable MetaScheduler for Non-dedicated Multiclusters. In: Guo, M., Yang, L.T., Di Martino, B., Zima, H.P., Dongarra, J., Tang, F. (eds) Parallel and Distributed Processing and Applications. ISPA 2006. Lecture Notes in Computer Science, vol 4330. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11946441_59
Download citation
DOI: https://doi.org/10.1007/11946441_59
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-68067-3
Online ISBN: 978-3-540-68070-3
eBook Packages: Computer ScienceComputer Science (R0)