Abstract
Workflow applications executed in Grid environments are not able to take advantage of all the potential parallelism they might have. This limitation in the usage of parallelism comes from the fact that when there is a producer/consumer situation communicating using files, the consumer does not start its execution till the producer has finished creating the file to be consumed, and the file has been copied to the consumer (if needed).
In this paper, we propose a publish/subscribe mechanism that allows consumers to read the file at the same time it is being produced. In addition, this mechanism is implemented in a transparent way to the application, so does not require any special feature from the local filesystems.
Finally, we show that our mechanisms can speedup applications significantly. In our best test we divided by two the execution time of some applications, but other applications may have even higher benefits.
This work has been partially supported by the Spanish Ministry of Science and Technology under the TIN2004-07739-C02-01 grant.
Chapter PDF
References
Badia, R., Labarta, J., Sirvent, R., Prez, J., Cela, J., Grima, R.: Programming Grid Applications with GRID superscalar. Journal of Grid Computing 1(2), 151–170 (2003)
Obtain detailed information from raw performance traces, http://www.cepba.upc.es/paraver/
Castro, M., Druschel, P., Kermarrec, A., Rowstron, A.: SCRIBE: A large-scale and decentralized application-level multicast infrastructure. IEEE Journal on Selected Areas in communications (JSAC) 20(8), 1489–1499 (2002)
Zhuang, S.Q., Zhao, B.Y., Joseph, A.D., Katz, R.H., Kubiatowicz, J.D.: Bayeux: An architecture for scalable and fault-tolerant wide-area data dissemination. In: Proceedings of NOSSDAV (June 2001)
Rss advisory board announcements and really simple syndication news, http://www.rssboard.org/
Lua, K., Crowcroft, J., Pias, M., Sharma, R., Lim, S.: A survey and comparison of peer-to-peer overlay network schemes. Communications Surveys & Tutorials, IEEE, 72–93 (2005)
Chen, K., Huang, Z., Li, B., Huang, E., Rajic, H., Kuhn, R., Chen, W.: Distributed File Streamer: A Framework for Distributed Application Data Coupling. In: 7th IEEE/ACM Grid, pp. 168–175. ACM Press, New York (2006)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Martí, J., Malo, J., Cortes, T. (2007). Increasing Parallelism for Workflows in the Grid. In: Kermarrec, AM., Bougé, L., Priol, T. (eds) Euro-Par 2007 Parallel Processing. Euro-Par 2007. Lecture Notes in Computer Science, vol 4641. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74466-5_45
Download citation
DOI: https://doi.org/10.1007/978-3-540-74466-5_45
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74465-8
Online ISBN: 978-3-540-74466-5
eBook Packages: Computer ScienceComputer Science (R0)