Abstract
Some processes are not easy to be programmed from scratch for parallel machines (clusters), but can be easily split on simple steps. Makefile::Parallel is a tool which lets users specify how processes depend on each other.
The language syntax resembles the well known Makefile[1] format, but instead of specifying files or targets dependencies, Makefile::Parallel specifies processes (or jobs) dependencies.
The scheduler reads the specification and submits jobs to the cluster scheduler (in our case, Rocks PBS) waiting them to end. When each process finishes, dependencies are calculated and direct dependent jobs are submitted.
Makefile::Parallel language includes features to specify parametric rules, used to split and join processes dependencies: some tasks can be split into smaller jobs working on different portions of files, and at the end, another process can be used to join results.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Campbell, D., Grevstad, C.: A tutorial for make. In: ACM 1985. Proceedings of the 1985 ACM annual conference on The range of computing: mid-80’s perspective, New York, NY, USA, pp. 374–380. ACM Press, New York (1985)
Douglas, D.E.: Pert and simulation. In: WSC 1978. Proceedings of the 10th conference on Winter simulation, Piscataway, NJ, USA, pp. 89–98. IEEE Press, Orlando, Florida, USA (1978)
Desarmenien, F.: Parse: Yapp — perl extension for generating and using lalr parsers. Perl module (2001), http://search.cpan.org/dist/Parse-Yapp/
Sacerdoti, F.D., Chandrai, S., Bhatia, K.: Grid systems deployment & management using rocks. In: IEEE International Conference on Cluster Computing, San Diego, IEEE Computer Society Press, Los Alamitos (2004)
Sloan, J.D.: High Performance Linux Clusters with OSCAR, Rocks, OpenMosix, and MPI. O’Reilly (2004)
Simões, A.M., Almeida, J.J.: Natools – a statistical word aligner workbench. In: SEPLN (September 2003)
SSSimões, A., Almeida, J.J.: Combinatory examples extraction for machine translation. In: Lønning, J.T., Oepen, S. (eds.) 11th Annual Conference of the European Association for Machine Translation, 19–20, June 2006, Oslo, Norway, (2006)
Gansner, E.R., North, S.C.: An open graph visualization system and its applications to software engineering. Software — Practice and Experience 30(11), 1203–1233 (2000)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Simões, A., Fonseca, R., Almeida, J.J. (2007). Makefile::Parallel Dependency Specification Language. In: Kermarrec, AM., Bougé, L., Priol, T. (eds) Euro-Par 2007 Parallel Processing. Euro-Par 2007. Lecture Notes in Computer Science, vol 4641. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74466-5_5
Download citation
DOI: https://doi.org/10.1007/978-3-540-74466-5_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74465-8
Online ISBN: 978-3-540-74466-5
eBook Packages: Computer ScienceComputer Science (R0)