Skip to main content
SpringerLink
Log in

A Decentralized Computational Infrastructure for Grid-Based Parallel Asynchronous Iterative Applications

  • Original Paper
  • Published:
Journal of Grid Computing Aims and scope Submit manuscript

Abstract

Parallel asynchronous iterative algorithms relax synchronization and communication requirements, and can potentially extend Desktop Grids beyond embarrassingly parallel applications to support a broader class of parallel iterative applications. This paper presents the design and implementation of CometG, a decentralized (peer-to-peer) computational infrastructure that extends Desktop Grid environments to support these applications. CometG provides a decentralized and scalable tuple space, efficient communication and coordination support, and application-level abstractions that can be used to implement Desktop Grid applications based on parallel asynchronous iterative algorithms using the master-worker/BOT paradigm. The deployment and evaluations of CometG and a CometG-based application in a wide-area environment using the PlanetLab [7] test bed, as well as a campus network are presented.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Abbreviations

BOT:

bag of task

PDE:

partial differential equation

References

  1. ‘Boinc.’ http://boinc.berkeley.edu/

  2. ‘Climatprediction.net.’ http://climateapps2.oucs.ox. ac.uk/cpdnboinc/download_main.php

  3. ‘Folding@Home.’ http://folding.stanford.edu/

  4. ‘mpiJava.’ http://www.hpjava.org/mpiJava.html

  5. ‘Predictor@Home.’ http://predictor.scripps.edu/

  6. ‘Project JXTA.’ http://www.jxta.org

  7. ‘Project PlanetLab.’ http://www.planet-lab.org

  8. ‘SETI@Home.’ http://setiathome.ssl.berkeley.edu/

  9. ‘XtremWeb.’ http://xw.lri.fr:4330/XtremWeb/

  10. Antoniu, G., Hatcher, P., Jan, M., Noblet, D.P.: Evaluation of JXTA communication layers. In: Proceedings of the Fifth International Workshop on Global and Peer-to-Peer Computing (2005)

  11. Bahi, J., Contassot-Vivier, S., Couturier, R.: Dynamic load balancing and efficient load estimators for asynchronous iterative algorithms. IEEE Trans. Parallel Distrib. Syst. 16(4), 289–299 (2005)

    Article  Google Scholar 

  12. Bahi, J., Contassot-Vivier, S., Couturier, R. Vernier, F.: A decentralized convergence detection algorithm for asynchronous parallel iterative algorithms. IEEE Trans. Parallel Distrib. Syst. 16(1), 4–13 (2005)

    Article  Google Scholar 

  13. Bahi, J.M., Domas, S., Mazouzi, K.: Combination of Java and asynchronism for the Grid: a comparative study based on a parallel power method. In: Proceedings of 18th International Parallel and Distributed Processing Symposium (2004)

  14. Bakken, D.E., Schlichting, R.D.: Supporting fault-tolerant parallel programming in Linda. IEEE Trans. Parallel Distrib. Syst. 6(3), 287–302 (1995)

    Article  Google Scholar 

  15. Baudet, G.M.: Asynchronous iterative methods for multiprocessors. J. ACM 25(2), 226–244 (1978)

    Article  MATH  MathSciNet  Google Scholar 

  16. Bertsekas, D.P., Tsitsiklis, J.N.: Convergence rate and termination of asynchronous iterative algorithms. In: Proceedings of the 3rd International Conference on Supercomputing, pp. 461–470 (1989)

  17. Bertsekas, D.P., Tsitsiklis, J.N.: Parallel and distributed computation: Numerical methods. Athena Scientific (1997)

  18. Browne, J.C., Yalamanchi, M., Kane, K., Sankaralingam, K.: General parallel computations on desktop grid and P2P systems. In: Proceedings of the 7th Workshop on Workshop on Languages, Compilers, and Run-time Support for Scalable Systems, pp. 1–8 (2004)

  19. Carriero, N., Gelernter, D.: Linda in context. Commun. ACM 32(4), 444–459 (1989)

    Article  Google Scholar 

  20. Cristian, F.: Understanding fault-tolerant distributed systems. Commun. ACM 34(2), 56–78 (1991)

    Article  Google Scholar 

  21. Cristian, F., Fetzer, C.: The timed asynchronous distributed system model. IEEE Trans. Parallel Distrib. Syst. 10(6), 642–657 (1999)

    Article  Google Scholar 

  22. Frommer, A., Szyld, D.: On asynchronous iterations. J. Comput. Appl. Math. 123(1), 201–216 (2000)

    Article  MATH  MathSciNet  Google Scholar 

  23. Gelernter, D.: Generative communication in Linda. ACM Trans. Program. Lang. Syst. 7(1), 80–112 (1985)

    Article  MATH  Google Scholar 

  24. Huet, F., Caromel, D., Bal, H.E.: A high performance Java middleware with a real application. In: Proceedings of the Supercomputing Conference (2004)

  25. Kondo, D., Taufer, M., Brooks, C., Casanova, H., Chien, A.: Characterizing and evaluating Desktop Grids: an empirical study. In: Proceedings of the International Parallel and Distributed Processing Symposium (2004)

  26. Kreyszig, E.: Advanced Engineering Mathematics. Wiley (1998)

  27. Li, Z., Parashar, M.: Comet: a scalable coordination space for decentralized distributed environments. In: Proceedings of the 2nd International Workshop on Hot Topics in Peer-to-Peer Systems, pp. 104–112 (2005)

  28. Moon, B., Jagadish, H.V., Faloutsos, C., Saltz, J.H.: Analysis of the clustering properties of the Hilbert space-filling curve. IEEE Trans. Knowl. Data Eng. 13(1), 124–141 (2001)

    Article  Google Scholar 

  29. Nieuwpoort, R.V., Maassen, J., Kielmann, T., Bal, H.E.: Satin: simple and efficient Java-based Grid programming. Scalable Computing: Practice and Experience 6(3), 19–32 (2005)

    Google Scholar 

  30. Obreiter, P.: Extending truple spaces towards a middleware for eCommerce. Thesis, University of Karlsruhe (2000)

  31. Oliveira, L., Lopes, L., Silva, F.: \(P^{3}\): parallel peer-to-peer an internet parallel programming environment. In: Proceedings of the Workshop on Web Engineering and Peer-to-Peer Computing (2002)

  32. Plaat, A.: Optimizing parallel applications for wide-area clusters. In: Proceedings of the 12th. International Parallel Processing Symposium, p. 784 (1998)

  33. Sankaralingam, K., Yalamanchi, M., Sethumadhavan, S., Browne, J.C.: Pagerank computation and keyword search on distributed systems and P2P networks. J. Grid Computing 1(3), 291–307 (2003)

    Article  Google Scholar 

  34. Schmidt, C., Parashar, M.: Enabling flexible queries with guarantees in P2P systems. IEEE Internet Computing, Special issue on Information Dissemination on the Web (3), 19–26 (2004)

    MATH  Google Scholar 

  35. Sterck, H.D., Markel, R.S., Phol, T., Rüde, U.: A lightweight Java taskspaces framework for scientific computing on computational Grids. In: Proceedings of the ACM symposium on Applied computing, pp. 1024–1030 (2003)

  36. Stoica, I., Morris, R., Karger, D., Kaashoek, F., Balakrishnan, H.: Chord: a scalable peer-to-peer lookup service for internet applications. In: Proceedings of the ACM SIGCOMM Conference (2001)

  37. Tolksdorf, R., Glaubitz, D.: Coordinating web-based systems with documents in XMLSpaces. In: Proceedings of the 6th International Conference on Cooperative Information Systems (2001)

  38. Wilkinson, B., Allen, M.: Parallel programming: Techniques and applications using networked workstations and parallel computers. Prentice Hall (2004)

  39. World Wide Web Consortium. Document Object Model (DOM) Level 2 Core Specification. W3C Recommendation (2000). http://www.w3.org/TR/DOM-Level-2-Core

  40. Yalamanchilli, N., Cohen, W.W.: Communication performance of Java-based parallel virtual machines. Concurrency – Practice and Experience 10(11–13), 1189–1196 (1998)

    Article  Google Scholar 

  41. Zhang, Y., Li, X.S., Marques, O.: Towards an automatic and application-based eigensolver selection. In: LACSI Symposium (2005) accepted

Download references

Author information

Authors and Affiliations

  1. The Applied Software Systems Laboratory, Department of Electrical and Computer Engineering, Rutgers University, Piscataway, NJ, 08854, USA

    Zhen Li & Manish Parashar

Authors
  1. Zhen Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Manish Parashar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhen Li.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Li, Z., Parashar, M. A Decentralized Computational Infrastructure for Grid-Based Parallel Asynchronous Iterative Applications. J Grid Computing 4, 355–372 (2006). https://doi.org/10.1007/s10723-006-9033-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10723-006-9033-9

Key words

Search

Navigation