Skip to main content
Log in

Distributed Workflow Management System based on Publish-Subscribe Notification for Web Services

  • Published:
New Generation Computing Aims and scope Submit manuscript

Abstract

In recent years, Grid technologies have been standardized based on Web service specifications. Of these specifications, the WS-Resources Framework and WS-Notification have attracted a great deal of attention. This paper focuses on scientific applications integration on the wide area network. We propose and implement a new distributed workflow management system called the “Application Igniting System.” This system is based on the publish-subscribe notification defined by the WS-Notification specification and realizes a flexible and loosely coupled workflow control by introducing some Web services, which handle message exchange. By applying to a typical bioinformatics workflow, we concluded that the overhead time related to message exchange is very short.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Foster, I., Kishimoto, H., Savva, A., Berry, D., Djaoui, A, Grimshaw, A., Horn, B., Maciel, F., Siebenlist, F., Subramaniam, R., Treadwell, J. and Reich, J.V., “The Open Grid Services Architecture, Version 1.0,” Global Grid Forum OGSA-WG, GFD-I.030, 2005. [Online]. Available: http://www.ggf.org/documents/GFD.30.pdf

  2. Czajkowski, K., Ferguson, F.D., Foster, I., Frey, J., Graham, S., Sedukhin, I., Snelling, D., Tuecke, S. and Vambenepe, W., “The WS-Resource Framework, Version 1.0,” 2004, [Online]. Available: http://www.oasis-open.org/committees/download.php/6796/ws-wsrf.pdf

  3. Graham, S., Niblett, R., Chappell, D., Lewis, A., Nagaratnam, N., Parikh, J., Patil, S., Samdarshi, S., Sedukhin, I., Snelling, D., Tuecke, S., Vambenepe, W. and Weihl, B., “Publish-Subscribe Notification for Web services, Version 1.0,” 2004, [Online]. Available: http://www.oasis-open.org/committees/download.php/6661/WSNpubsub-1-0.pdf

  4. Foster, I. and Kesselman, C., “Globus: A Metacomputing Infrastructure Toolkit,” Int. Journal of Supercomputer Applications 11, 2, pp.115-128, 1997.

  5. Altschul, S.F., Gish, W., Miller, W., Myers, E.W. and Lipman, D.J., “Basic Local Alignment Search Tool,” Journal of Molecular Biology 215, 3, pp. 403- 410, 1990.

  6. Thompson, J.D., Higgins, D.G. and Gibson, T.J., “CLUSTAL W: Improving the sensitivity of progressive multiple sequence alignment through sequence weighting, position-specific gap penalties and weight matrix choice,” Nucleic Acids Research 22, 22, pp. 4673-4680, 1994.

  7. Frey, J., Tannenbaum, T., Foster, I., Livny, M. and Tuecke, S., “Condor-G: A Computation Management Agent for Multi-Institutional Grids,” Proc. the 10th Int. Symp. on High Performance Distributed Computing, 2001.

  8. Deelman, E., Blythe, J., Gil, Y., Kesselman, C., Mehta, G., Vahi, K., Blackburn, K., Lazzarini, A., Arbree, A., Cavanaugh, R. and Koranda, S., “Mapping Abstract Complex Workflows onto Grid Environments,” Journal of Grid Computing 1, pp. 25-39, 2003.

  9. von Laszewski, G., “Java CoG Kit Workflow Concepts for Scientific Experiments,” Technical Report, Argonne National Laboratory, 2005.

  10. Yu, J. and Buyya, R., “A Novel Architecture for Realizing Grid Workflow using Tuple Spaces,” Proc. of the 5th IEEE/ACM Int. Workshop on Grid Computing (GRID 2004), 2004.

  11. Oinn, T., Addis, M., Ferris, J., Marvin, D., Senger, M., Greenwood, M., Carver, T., Glover, K., Pocock, M.R., Wipat, A. and Li, P., “Taverna: A tool for the composition and enactment of bioinformatics workflows,” Bioinformatics Journal 20, 17, pp. 3045-3054, 2004.

  12. Ludascher, B., Altintas, I., Berkley, C., Higgins, D., Jaeger, E., Jones, M., Lee, E.A., Tao, J. and Zhao, Y., “Scientific workflow management and the Kepler system: Research Articles,” Concurrency and Computation: Practice and Experience 18, 10, pp. 1039-1065, 2006.

  13. Yu, J. and Buyya, R., “A Taxonomy of Scientific Workflow Systems for Grid computing,” Special Issue on Scientific Workflows, SIGMOD Record 34, 3, pp. 44-49, ACM Press, 2005.

  14. Taylor, I., Shields, M. and Wang, I., “Resource Management of Triana P2P Services,” Grid Resource Management, Kluwer Academic Press, 2004.

  15. Allen, G., Davis, K., Dolkas, K.N., Doulamis, N.D., Goodale, T., Kielmann, T., Merzky, A., Nabrzyski, J., Pukacki, J., Radke, T., Russell, M., Seidel, E., Shalf, J. and Taylor, I., “Enabling Applications on the Grid - A GridLab Overview,” Int. Journal of High Performance Computing Applications (JHPCA), Special Issue on Grid Computing: Infrastructure and Applications, 2003.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hisashi Shimosaka.

About this article

Cite this article

Shimosaka, H., Hiroyasu, T. & Miki, M. Distributed Workflow Management System based on Publish-Subscribe Notification for Web Services. New Gener. Comput. 25, 395–408 (2007). https://doi.org/10.1007/s00354-007-0025-5

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00354-007-0025-5

Keywords

Navigation