Abstract
This paper shows a new way of integrating task and data parallelism by means of a coordination language. Coordination and computational aspects are clearly separated. The former are established using the coordination language and the latter are coded using HPF (together with only a few extensions related to coordination). This way, we have a coordinator process that is in charge of both creating the different HPF tasks and establishing the communication and synchronization scheme among them. In the coordination part, processor and data layouts are also specified. The knowledge of data distribution belonging to the different HPF tasks at the coordination level is the key for an efficient implementation of the communication among them. Besides that, our system implementation requires no change to the runtime system support of the HPF compiler used.We also present some experimental results that show the efficiency of the model.
This work was supported by the Spanish project CICYT TIC-99-0754-C03-03
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Koelbel, C., Loveman, D., Schreiber, R., Steele, G., Zosel, M.: The High Performance Fortran Handbook. MIT Press (1994)
Dinda, P., Gross, T., O’Hallaron, D., Segall, E., Stichnoth, J., Subhlok, J., Webb, J., Yang, B.: The CMU task parallel program suite. Technical Report CMUCS-94-131, School of Computer Science, Carnegie Mellon University, (1994)
Agrawal, G., Sussman, A., Saltz, J.: An integrated runtime and compile-time approach for parallelizing structured and block structured applications. IEEE Transactions on Parallel and Distributed Systems, 6(7) (1995) 747–754
Chapman, B., Haines, M., Mehrotra, P., Zima, H., Rosendale, J.: Opus: A Coordination Language for Multidisciplinary Applications. Scientific Programming, 6(2) (1997)345–362
Foster, I., Kohr, D., Krishnaiyer, R., Choudhary, A.: A library-based approach to task parallelism in a data-parallel language. J. of Parallel and Distributed Computing, 45(2) (1997)148–158
Merlin, J. H., Baden, S. B., Fink, S. J. and Chapman, B. M.: Multiple data parallelism with HPF and KeLP. In: Sloot, P., Bubak, M., Hertzberger, R. (eds.): HPCN’98. Lecture Notes in Computer Science, Vol. 1401. Springer-Verlag (1998) 828–839
Bal, H.E., Haines, M.: Approaches for Integrating Task and Data Parallelism. IEEE Concurrency, 6(3) (1998) 74–84
Rauber, T., Rünger, G.: A Coordination Language for Mixed Task and Data Parallel Programs. 14th Annual ACM Symposium on Applied Computing (SAC’99). Special Track on Coordination Models. ACM Press, San Antonio, Texas. (1999) 146–155
Orlando S., Perego, R.: COLTHPF A Run-Time Support for the High-Level Coordination of HPF Tasks. Concurrency: Practice and experience, 11(8) (1999) 407–434
Carriero, N., Gelernter, D.: Coordination Languages and their Significance. Communications of the ACM, 35(2) (1992) 97–107
Díaz, M., Rubio, B., Soler, E., Troya, J. M.: Using Coordination for Solving Domain Decomposition-based Problems. Technical Report LCC-ITI 99/14. Departamento de Lenguajes y Ciencias de la Computacion. University of Málaga, (1999) http://www.lcc.uma.es/~tolo/publications.html
Díaz, M., Rubio, B., Soler, E., Troya, J.M.: BCL: A Border-based Coordination Language. International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA’2000), Las Vegas, Nevada. (2000) 753–760
Brandes, T.: ADAPTOR Programmer’s Guide (Version 7.0). Technical documentation, GMD-SCAI, Germany. (1999) ftp://ftp.gmd.de/GMD/adaptor/docs/pguide.ps
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Díaz, M., Rubio, B., Soler, E., Troya, J.M. (2000). Integration of Task and Data Parallelism: A Coordination-Based Approach. In: Valero, M., Prasanna, V.K., Vajapeyam, S. (eds) High Performance Computing — HiPC 2000. HiPC 2000. Lecture Notes in Computer Science, vol 1970. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44467-X_16
Download citation
DOI: https://doi.org/10.1007/3-540-44467-X_16
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-41429-2
Online ISBN: 978-3-540-44467-1
eBook Packages: Springer Book Archive