Skip to main content

Scientific Workflow: A Survey and Research Directions

  • Conference paper
Book cover Parallel Processing and Applied Mathematics (PPAM 2007)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 4967))

Abstract

Workflow technologies are emerging as the dominant approach to coordinate groups of distributed services. However with a space filled with competing specifications, standards and frameworks from multiple domains, choosing the right tool for the job is not always a straightforward task. Researchers are often unaware of the range of technology that already exists and focus on implementing yet another proprietary workflow system. As an antidote to this common problem, this paper presents a concise survey of existing workflow technology from the business and scientific domain and makes a number of key suggestions towards the future development of scientific workflow systems.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Hollingsworth, D.: The Workflow Reference Model. Workflow Management Coalition. Document Number tc00-1003 edn. (January 1995)

    Google Scholar 

  2. The OASIS Committee: Web Services Business Process Execution Language (WS-BPEL) Version 2.0 (April 2007)

    Google Scholar 

  3. Wassermann, B., et al.: Sedna: A BPEL-based environment for visual scientific workflow modelling. Workflows for eScience - Scientific Workflows for Grids (December 2006)

    Google Scholar 

  4. van der Aalst, W., ter Hofstede, A.: Yet another workflow language. Information Systems 30(4), 245–275 (2005)

    Article  Google Scholar 

  5. van der Aalst, W.M.P., et al.: Design and Implementation of the YAWL system. In: Persson, A., Stirna, J. (eds.) CAiSE 2004. LNCS, vol. 3084, Springer, Heidelberg (2004), http://sourceforge.net/projects/yawl/

    Google Scholar 

  6. Lipp, M.: The Danet Workflow Component V2.1 (2007), http://wfmopen.sourceforge.net/

  7. Kavantzas, N., et al.: Web Services Choreography Description Language Version 1.0 (November 2005)

    Google Scholar 

  8. Deelman, E., Gil, Y.: Workshop on the Challenges of Scientific Workflows. Technical report, Information Sciences Institute, University of Southern California (May 2006)

    Google Scholar 

  9. Oinn, T., et al.: Taverna: a tool for the composition and enactment of bioinformatics workflows. Bioinformatics 20(17), 3045–3054 (2004)

    Article  Google Scholar 

  10. Zhao, J., et al.: Annotating, linking and browsing provenance logs for e-Science. In: 1st Workshop on Semantic Web Technologies for Searching and Retrieving Scientific Data, Sanibel Island, Florida, USA (October 2003)

    Google Scholar 

  11. Oinn, T., et al.: Delivering Web Service Coordination Capability to Users. In: WWW 2004, New York, pp. 438–439 (2004)

    Google Scholar 

  12. Ludascher, B., et al.: Scientific workflow management and the kepler system. Concurrency and Computation: Practice and Experience 18(10), 1039–1065 (2005)

    Article  Google Scholar 

  13. Buck, J.T., Ha, S., Lee, E.A., Messerschmitt, D.G.: Ptolemy: A framework for simulating and prototyping heterogeneous systems. Journal of Computer Simulation 4, 155–182 (1994)

    Google Scholar 

  14. Taylor, I.J., et al.: Distributed P2P Computing within Triana: A Galaxy Visualization Test Case. In: 17th International Parallel and Distributed Processing Symposium (IPDPS 2003), pp. 16–27. IEEE Computer Society, Los Alamitos (2003)

    Google Scholar 

  15. Allen, G., et al.: Enabling Applications on the Grid: A GridLab Overview. International Journal of High Performance Computing Applications: Special Issue on Grid Computing: Infrastructure and Applications 17(4), 449–466 (2003)

    Google Scholar 

  16. Deelman, E., et al.: Pegasus: A framework for Mapping Complex Scientific Workflows onto Distributed Systems. Scientific Programming Journal 13(3), 219–237 (2005)

    Google Scholar 

  17. Brown, J.L., et al.: GridNexus: A Grid Services Scientific Workflow System. International Journal of Computer Information Science (IJCIS) 6(2), 72–82 (2005)

    Google Scholar 

  18. Rowe, A., et al.: The Discovery Net System for High Throughput Bioinformatics. Bioinformatics 19(1), 225–231 (2003)

    Article  Google Scholar 

  19. Siepel, A.C., et al.: An integration platform for heterogeneous bioinformatics software components. IBM Systems Journal 40(2), 570–591 (2001)

    Article  Google Scholar 

  20. Buyya, R., Venugopal, S.: The Gridbus Toolkit for Service Oriented Grid and Utility Computing: An Overview and Status Report. In: Proceedings of the First IEEE International Workshop on Grid Economics and Business Model, pp. 19–36 (April 2004)

    Google Scholar 

  21. Mayer, A., et al.: Meaning and Behaviour in Grid Oriented Components. In: Parashar, M. (ed.) GRID 2002. LNCS, vol. 2536, pp. 100–111. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  22. Walton, C., Barker, A.D.: An Agent Based e-Science Experiment Builder. In: Proceedings of The 1st International Workshop on Semantic Intelligent Middleware for the Web and the Grid, European Conference on Artificial Intelligence (ECAI) (August 2004)

    Google Scholar 

  23. Janciak, I., Kloner, C.: Workflow enactment engine project v1.0 (2007), http://weep.gridminer.org/

Download references

Author information

Authors and Affiliations

Authors

Editor information

Roman Wyrzykowski Jack Dongarra Konrad Karczewski Jerzy Wasniewski

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Barker, A., van Hemert, J. (2008). Scientific Workflow: A Survey and Research Directions. In: Wyrzykowski, R., Dongarra, J., Karczewski, K., Wasniewski, J. (eds) Parallel Processing and Applied Mathematics. PPAM 2007. Lecture Notes in Computer Science, vol 4967. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-68111-3_78

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-68111-3_78

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-68105-2

  • Online ISBN: 978-3-540-68111-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics