Abstract
This article commences the special section on scientific workflows. A brief history is given of workflow approaches in general. More detail is given of scientific workflows, including sample applications. Challenges and research issues are then identified. Finally, an overview is given of the articles appearing in this special section.
Similar content being viewed by others
References
Al-Mashari, M., Irani, Z., Zairi, M.: Business process reengineering: a survey of international experience. Bus. Process Manag. J. 7(5), 437–455 (2001)
Alonso, G.: BioOpera: Grid Computing in Virtual Laboratories. ERCIM News (45) (2001)
Alonso, G., Pautasso, C.: JOpera: a toolkit for efficient visual composition of web services. Int. J. Electron. Commer. 9(2), 107–141 (2004)
Andrews, T., Curbera, F., Dholakia, H., Goland, Y., Klein, J., Leymann, F., Liu, K., Roller, D., Smith, D., Thatte, S., Trickovic, I., Weerawarana, S.: Business Process Execution Language for Web Services. Version 1.1. BEA, IBM, Microsoft, SAP, Siebel (2003)
Arkin, A., Askary, S., Bloch, B., Curbera, F., Goland, Y., Kartha, N., Lie, C.K., Thatte, S., Yendluri, P., Yiu, A.: Web Services Business Process Execution Language. Version 2.0. Organization for The Advancement of Structured Information Standards, Billerica, Massachusetts, USA (2007)
Barga, R., Gannon, D.: Scientific versus business workflows. In: Taylor, I.J., Deelman, E., Gannon, D.B., Shields, M. (eds.) Workflows for E-Science, pp. 9–16. Springer, Berlin (2007)
Barker, A., van Hemert, J.: Scientific workflow: A survey andresearch directions. In Wyrzykowski, R., Dongarra, J., Karczewski, K., Wasniewski, J. (eds.) Proceedings of the 7th International Conference on Parallel Processing and Applied Mathematics, volume 4967 of Lecture Notes in Computer Science, pp. 746-753. Springer, Berlin (2008)
Bhagat, J., Tanoh, F., Nzuobontane, E., Laurent, T., Orlowski, J., Roos, M., Wolstencroft, K., Aleksejevs, S., Stevens, R., Pettifer, S., Lopez, R., Goble, C.A.: BioCatalogue: A universal catalogue of web services for the life sciences. Nucl. Acids Res. 38(suppl_2), W689-W694 (2010)
BPMI. Business Process Modeling Notation. Version 1.0. Business Process Management Initiative (2004)
Christensen, S., Jørgensen, J.B., Kristensen, L.M.: Tools and algorithms for the construction and analysis of systems: third international workshop, TACAS’97 Enschede, The Netherlands, April 2-4, 1997 Proceedings, chapter Design/CPN–a computer tool for Coloured Petri Nets, pp. 209-223. Springer, Berlin (1997)
Cress Project. Communication representation employing systematic specification. http://www.cs.stir.ac.uk/kjt/research/cress. Online, retrieved (2016)
Dames Project. Data management through e-social science. http://www.dames.org.uk. Online, retrieved (2016)
Deelman, E., Singh, G., hui Su, M., Blythe, J., Gil, A., Kesselman, C., Mehta, G., Vahi, K., Berriman, G.B., Good, J., Laity, A., Jacob, J.C., Katz, D.S.: Pegasus: a framework for mapping complex scientific workflows onto distributed systems. Sci. Program. J. 13, 219–237 (2005)
e-Stat Project. E-Stat. http://www.bristol.ac.uk/cmm/research/estat. Online, retrieved (2016)
E lixir. Elixir–a distributed infrastructure for life-science information. https://www.elixir-europe.org/about. Online, retrieved (2016)
E lixir. Elixir–tools and data services registry. https://bio.tools. Online, retrieved (2016)
Ghanem, M., Curcin, V.: Scientific workflow systems–can one size fit all? In: Biomedical Engineering Conference, pp. 1-9, New York, USA. Institution of Electrical and Electronic Engineers Press (2008)
Ghanem, M., Curcin, V., Wendel, P., Guo, Y.: Building and using analytical workflows in Discovery Net. In: Dubitzky, W. (ed.) Data Mining Techniques in Grid Computing Environments, pp. 119–139. Wiley, Chichester (2009)
Gil, Y., Deelman, E., Ellisman, M., Fahringer, T., Fox, G., Gannon, D., Goble, C., Livny, M., Moreau, L., Myers, J.: Examining the challenges of scientific workflows. Computer 40(12), 24–32 (2007)
Goble, C.A., Bhagat, J., Aleksejevs, S., Cruickshank, D., Michaelides, D., Newman, D., Borkum, M., Bechhofer, S., Roos, M., Li, P., Roure, D.D.: myExperiment: a repository and social network for the sharing of bioinformatics workflows. Nucl. Acids Res. 38(suppl_2), W677–682 (2010)
Görlach, K., Sonntag, M., Karastoyanova, D., Leymann, F., Reiter, M.: Conventional Workflow Technology for Scientific Simulation, pp. 1-31. Guide to e-Science. Springer (2011)
Harel, D., Politi, M.: Modeling Reactive Systems With Statecharts : The Statemate Approach. McGraw-Hill Companies, London (1998)
Hey, T., Tansley, S., Tolle, K. (eds.): The Fourth Paradigm: Data-Intensive Scientific Discovery. Microsoft Research, Redmond (2009)
Huhns, M.N., Singh, M.P.: Service-oriented computing: key concepts and principles. IEEE Internet Comput. 9(1), 75–81 (2005)
IEEE. IEEE international symposium on scientific workflows and big data science. http://www.cs.wayne.edu/shiyong/swf/. Online, retrieved (2016)
Kepler Project. Kepler. https://kepler-project.org. Online, retrieved (2016)
Koehler, J., Alonso, G.: Service-oriented computing—introduction to the special theme. ERCIM News 70, 2007 (2007)
Lamprecht, A.-L.: User-Level Workflow Design–A BioinformaticsPerspective, volume 8311 of Lecture Notes in Computer Science.Springer, Berlin (2013)
Lamprecht, A.-L., Steffen, B., Margaria, T.: Scientific workflows with the jABC framework–a review after a decade in the field. Int. J. Softw. Tools Technol. Transf. (this issue)
Leymann, F.: Web Services Flow Language. Technical report, IBM,Somers, New York, USA (2001)
Ludäscher, B., Altintas, I., Berkley, C., Higgins, D., Jaeger, E., Jones, M., Lee, E.A., Tao, J., Zhao, Y.: Scientific workflow management and the Kepler systems. Concurr. Comput. Pract. Exp. 18(10), 1039–1065 (2006)
Ludäscher, B., Weske, M., McPhillips, T., Bowers, S.: Scientificworkflows: Business as usual? In Business Process Management,volume 5701 of Lecture Notes in Computer Science, pp. 31-47. Springer, Berlin (2009)
Margaria, T.: Components, Features, and Agents in the ABC. In: Ryan, M., Meyer, J.-J., Ehrich, H.-D. (eds.) Objects. Agents, and Features, volume 2975 of Lecture Notes in Computer Science, pp. 7-29. Springer, Berlin (2004)
Margaria, T., Kubczak, C., Steffen, B.: Bio-jETI: a service integration, design, and provisioning platform for orchestrated bioinformatics processes. BMC Bioinform. 9 Suppl 4:S12, (2008)
MethodBox Project. MethodBox. https://www.methodbox.org. Online, retrieved (2016)
Ménager, H., KalaŠ, M., Rapacki, K., Ison, J.: Using registries to integrate bioinformatics tools into workbench environments. Int. J. Softw. Tools Technol. Transf. (this issue)
myExperiment Project. myExperiment. http://www.myexperiment.org. Online, retrieved (2016)
myGrid Consortium. myGrid. http://www.mygrid.org.uk. Online, retrieved (2016)
NeISS Project. National e-infrastructure for social simulation–workflows. http://www.taverna.org.uk/introduction/related-projects/neiss. Online, retrieved (2016)
Object Management Group. Business Process Model and Notation. Version 2.0. Object Management Group, Needham, Massachusetts, USA (2011)
Oinn, T., Addis, M., Ferris, J., Marvin, D., Senger, M., Greenwood, M., Carver, T., Glover, K., Pocock, M.R., Wipat, A., Li, P.: Taverna: a tool for the composition and enactment of bioinformatics workflows. Bioinformatics 20(17), 3045–3054 (2004)
Oinn, T., Greenwood, M., Addis, M., Alpdemir, M.N., Ferris, J., Glover, K., Goble, C., Goderis, A., Hull, D., Marvin, D., Li, P., Lord, P., Pocock, M.R., Senger, M., Stevens, R., Wipat, A., Wroe, C.: Taverna: lessons in creating a workflow environment for the life sciences. Concurr. Comput. Pract. Exp. 18(10), 1067–1100 (2006)
PADLS Project. Portal of the Administrative Data Liaison Service. http://www.adls.ac.uk/padls. Online, retrieved (2016)
Papazoglou, M.P., Traverso, P., Dustdar, S., Leymann, F.: Service-oriented computing: a research roadmap. Int. J. Coop. Inf. Syst. 17(02), 223–255 (2008)
Qin, J., Fahringer, T.: Scientific Workflows—Programming, Optimization, and Synthesis with ASKALON and AWDL. Springer, Berlin (2012)
Research Data Alliance. RDA–research data sharing without barriers.https://rd-alliance.org. Online, retrieved (2016)
Rice, P., Longden, I., Bleasby, A.: Emboss: the European molecular biology open software suite. Trends Genet. 16(6), 276–277 (2000)
Rice, P.M., Bleasby, A.J., Ison, J.C., Mullan, L., Bottu, G.: Emboss User’s Guide: Practical Bioinformatics. Cambridge University Press, UK (2011)
Sinnott, R., Voorsluys, W.: A scalable cloud-based system for data-intensive spatial analysis. Int. J. Softw. Tools Technol. Transf. (this issue)
Steffen, B., Margaria, T., Claßen, A., Braun, V.: The METAFrame’95 Environment. In CAV, pp. 450-453 (1996)
Steffen, B., Margaria, T., Nagel, R., Jörges, S., Kubczak, C.: Model-driven development with the jABC. In: Bin, E., Ziv, A., Ur, S. (eds.) Hardware and Software. Verification and Testing, volume 4383 of Lecture Notes in Computer Science, pp. 92-108. Springer, Berlin (2007)
Stevens, R.D., Robinson, A.J., Goble, C.A.: myGrid: personalised bioinformatics on the information grid. Bioinformatics 19(suppl 1), i302–i304 (2003)
Taylor, F.W.: The Principles of Scientific Management. Harper and Brothers, New York (1911)
Taylor, I.J., Deelman, E., Gannon, D.B., Shields, M.: Workflows for E-Science: Scientific Workflows for Grids. Springer, Berlin (2007)
Thatte, S.: XLANG: Web services for business process design. Technical report, Microsoft, Redmond, Washington, USA (2001)
Turner, K.J., Lambert, P.S.: Workflows for quantitative data analysis in the social sciences. Softw. Tools Technol. Transf. 17, 321–338 (2015)
van der Aalst, W., de Leoni, M., Bolt, A.: Scientific workflows for process mining: building blocks, scenarios, and implementation. Int. J. Softw. Tools Technol. Transf. (this issue)
Vigder, M.R., Vinson, N.G., Singer, J., Stewart, D.A., Mews, K.: Supporting scientists’ everyday work: automating scientific workflows. IEEE Softw. 25(4), 52–58 (2008)
Wikipedia. Scientific workflow system. https://en.wikipedia.org/wiki/Scientific_workflow_system. Online, retrieved (2016)
Wolstencroft, K., Haines, R., Fellows, D., Williams, A., Withers, D., Owen, S., Soiland-Reyes, S., Dunlop, I., Nenadic, A., Fisher, P., Bhagat, J., Belhajjame, K., Bacall, F., Hardisty, A., de la Hidalga, A.N., Balcazar Vargas, M.P., Sufi, S., Goble, C.: The Taverna workflow suite: designing and executing workflows of web services on the desktop, web or in the cloud. Nucl. Acids Res. 41(W1), W557–W561 (2013)
Yu, J., Buyya, R.: A taxonomy of scientific workflow systems for grid computing. SIGMOD Rec. 34(3), 44–49 (2005)
Zhao, Y., Raicu, I., Foster, I.: Scientific workflow systems for 21st century, New bottle or new wine? In: Proceedings of congress on services–Part I, pp. 467-471, Los Alamitos, California, USA. IEEE Computer Society (2008)
Acknowledgments
We are very grateful to all authors of the special section for their contributions, to the referees for their careful reviewing of these articles, and to Julia Rehder for editorial support throughout.
This work was supported, in part, by Science Foundation Ireland grant 13/RC/2094 and co-funded under the European Regional Development Fund through the Southern and Eastern Regional Operational Programme to Lero - the Irish Software Research Centre (http://www.lero.ie).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Lamprecht, AL., Turner, K.J. Scientific workflows. Int J Softw Tools Technol Transfer 18, 575–580 (2016). https://doi.org/10.1007/s10009-016-0428-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10009-016-0428-z