Abstract
In this paper we investigate whether parallelization of an application code for multi-core machines can bring any benefit for clustering systems, especially those based on opportunistic usage of idle resources. Previous research has shown that transformation of shared memory applications into clustered applications is complicated. At the moment, there is no practical solution available. Therefore, we instead focus on message passing applications as possible candidates for parallelization. We demonstrate a low effort approach that allows programmers to transform a multi-core Erlang code into a code that can run in a cluster environment. We provide scalability measurements of the solution in small clusters of commodity computers and identify weak points of the solution.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Borkar, S.Y., Dubey, P., Kahn, K.C., Kuck, D.J., Mulder, H., Ramanathan, E.R.M., Thomas, V., Corporation, I., Pawlowski, S.S.: Intel ® processor and platform evolution for the next decade executive summary
Kacer, M., Langr, D., Tvrdik, P.: Clondike: Linux cluster of non-dedicated workstations. In: CCGRID 2005: Proceedings of the Fifth IEEE International Symposium on Cluster Computing and the Grid (CCGrid 2005), Washington, DC, USA, vol. 1, pp. 574–581. IEEE Computer Society, Los Alamitos (2005)
Vinoski, S.: Concurrency with erlang. IEEE Internet Computing 11(5), 90–93 (2007)
Larson, J.: Erlang for concurrent programming. Queue 6(5), 18–23 (2008)
Al Zain, A.D.I., Hammond, K., Berthold, J., Trinder, P., Michaelson, G., Aswad, M.: Low-pain, high-gain multicore programming in haskell: coordinating irregular symbolic computations on multicore architectures (abstract only). SIGPLAN Not. 44(5), 8–9 (2009)
Hewitt, C., Bishop, P., Steiger, R.: A universal modular actor formalism for artificial intelligence. In: IJCAI 1973: Proceedings of the 3rd international joint conference on Artificial intelligence, San Francisco, CA, USA, pp. 235–245. Morgan Kaufmann Publishers Inc., San Francisco (1973)
Agha, G.: Actors: a model of concurrent computation in distributed systems. MIT Press, Cambridge (1986)
Task assignment with unknown duration. J. ACM 49(2), 260–288 (2002)
Hamidzadeh, B., Lilja, D.J., Atif, Y.: Dynamic scheduling techniques for heterogeneous computing systems. Concurrency: Practice and Experience 7(7), 633–652 (1995)
Oh, H., Ha, S.: A static scheduling heuristic for heterogeneous processors. In: Fraigniaud, P., Mignotte, A., Robert, Y., Bougé, L. (eds.) Euro-Par 1996. LNCS, vol. 1124, pp. 573–577. Springer, Heidelberg (1996)
Tang, P., Yew, P.C.: Processor self-scheduling for multiple-nested parallel loops. In: ICPP, pp. 528–535 (1986)
Pastor, L., Bosque, J.L.: An efficiency and scalability model for heterogeneous clusters. In: IEEE International Conference on Cluster Computing, p. 427 (2001)
Edahiro, M.: Parallelizing fundamental algorithms such as sorting on multi-core processors for eda acceleration. In: ASP-DAC 2009: Proceedings of the 2009 Asia and South Pacific Design Automation Conference, Piscataway, NJ, USA, pp. 230–233. IEEE Press, Los Alamitos (2009)
Wu, C.C., Lai, L.F., Chiu, P.H.: Parallel loop self-scheduling for heterogeneous cluster systems with multi-core computers. In: APSCC 2008: Proceedings of the 2008 IEEE Asia-Pacific Services Computing Conference, Washington, DC, USA, pp. 251–256. IEEE Computer Society, Los Alamitos (2008)
Drosinos, N., Koziris, N.: Performance comparison of pure mpi vs hybrid mpi-openmp parallelization models on smp clusters. In: 18th Int. Parallel & Distributed Symposium, p. 15 (2004)
Mamidala, A.R., Kumar, R., De, D., Panda, D.K.: Mpi collectives on modern multicore clusters: Performance optimizations and communication characteristics. In: CCGRID 2008: Proceedings of the 2008 Eighth IEEE International Symposium on Cluster Computing and the Grid, Washington, DC, USA, pp. 130–137. IEEE Computer Society, Los Alamitos (2008)
Tu, B., Zou, M., Zhan, J., Zhao, X., Fan, J.: Multi-core aware optimization for mpi collectives. In: CLUSTER, pp. 322–325 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Šťava, M., Tvrdík, P. (2010). Multi-core Code in a Cluster – A Meaningful Option?. In: Bellavista, P., Chang, RS., Chao, HC., Lin, SF., Sloot, P.M.A. (eds) Advances in Grid and Pervasive Computing. GPC 2010. Lecture Notes in Computer Science, vol 6104. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-13067-0_6
Download citation
DOI: https://doi.org/10.1007/978-3-642-13067-0_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-13066-3
Online ISBN: 978-3-642-13067-0
eBook Packages: Computer ScienceComputer Science (R0)