skip to main content
10.1145/1066650.1066654acmotherconferencesArticle/Chapter ViewAbstractPublication PageslcrConference Proceedingsconference-collections
Article

General parallel computations on desktop grid and P2P systems

Published: 22 October 2004 Publication History

Abstract

This paper defines the requirements for effective execution of iterative computations requiring communication on a desktop grid. It then proposes a combination of a p2p communication model, an algorithmic approach (asynchronous iterations) and a programming model which has promise for satisfying those requirements. Experimental results from an implementation of asynchronous algorithms in pure p2p system will be given. The integration of the p2p communication model with a commercially supported implementation of the <u>SETI@Home</u> desktop grid system to yield a prototype implementation of a desktop grid with communication among its hosts is described and some very preliminary results from application of the extended desktop grid for computation of Google pageranks and solution of linear systems are given. The desktop grid prototype preserves anonymity among desktop hosts, supports dynamic communication set membership and enables transparent replication of computations for fault tolerance.

References

[1]
W. Adjie-Winoto, E. Schwartz, H. Balakrishnan, and J. Lilley. The design and implementation of an intentional naming system. In 17th ACM Symposium on Operating Systems Principles (SOSP), Kiawah Island, SC, December 1999.
[2]
J. M. Bahi, S. Domas, K. Mazoui "Jace: A Java Environment for Distributed Asynchronous Iterative Computations" Proceedings of 12th Euromicro Workshop on Parallel, Distributed and Network-Based Processing (PDP 2004), 11--13 February 2004, A Coruna, Spain
[3]
B. Bayerdorffer: Associative broadcast and the communication semantics of naming in concurrent systems. Ph.D. dissertation, Department of Computer Sciences, The University of Texas at Austin (1993).
[4]
B. Bayerdorffer, : Distributed computing with associative broadcast. Proceedings of the Twenty-Eighth Hawaii International Conference on System Sciences (1995).
[5]
Dimitri P. Bertsekas and John N. Tsitsiklis. Parallel and distributed computation. Prentice Hall, Englewood Cliffs, NJ, 1989.
[6]
Blathras, K., D. B. Szyld, and Y. Shi: 1999, 'Timing Models and Local Stopping Criteria for Asynchronous Iterative Algortihms'. Journal of Parallel and Distributed Computing58, 446--465.
[7]
Boinc, http://boinc.berkeley.edu/
[8]
J. M. Bull and T. L. Freeman "Numerical Performance of an Asynchronous Jacobi Iteration" In L. Bouge et. al., editors "Parallel Processing: CONPAR 92-VAPP V, pages 361--366, Springer-Verlag, 1992.
[9]
A. Butt, R. Zhang and Y. Hu "A Self-Organizing Flock of Condors" In Proceedings of SuperComputing 2003 (Phoenix, Arizona, November 2003)
[10]
G. Cimmino "Calcolo Aprossimato per le Soluzioni dei Sistemi di Equazioni Lineari" Ric. Sci.Prog. tecn econom. Naz. 19, 995--1023 (1938)
[11]
Y. Censor, D. Gordon and R Gordon "Component Averaging: An Efficient Iterative Numerical Algorithm for Large and Sparse Unstructured Problems" Parallel Computing 27, 777--808 (2001)
[12]
D. Chazan and W. Miranker, Chaotic relaxation, Linear Algebra and its Applications, 1969, pp. 199--222
[13]
Y. Chen, Y. and H. Zhang: 2003, 'Parallelization of the page ranking in the Google search engine'. http://manip.crhc.uiuc.edu/ chen/pagerank.ps.
[14]
A. Frommer and D. B. Szyld: 2000, "On asynchronous iterations", Journal of Computational and Applied Mathematics 123(1), 201--216
[15]
ICENI: http://www.lesc.ic.ac.uk/iceni/
[16]
S. Kacmartz "Angenaherte Auflosung von Systemen Linear Gleichungen" Bulletin International de l'Academie Polonaise des Sciences et Lettres pp. 355--357 (1937)
[17]
K. Kane and J. C. Browne: 2004, 'CoorSet: A Development Environment for Associatively Coordinated Components', In: Proceedings of Coordination 2004, (Also to appear in a volume in the Springer-Verlag LNCS Series).
[18]
K. Kane, J. C. Browne and H. Tian, "An Associative Broadcast Based Coordination Model for Distributed Processes", Proceedings of Coordination 2002, LNCS 2315, Springer-Verlag, 2002, pp. 96--110
[19]
K. Kane and Browne, J. C.: The Component Starting Component: an environment for distributed systems and peer to peer research. Department of Computer Sciences Technical Report TR-03-42, University of Texas at Austin (2003).
[20]
W. Kelly, P. Roe, et al., An Enhanced Programming Model for Internet Based Cycle Stealing, in Proceedings of the 2003 International Conference on Parallel and Distributed Processing Techniques and Applications, pp. 1649--1655, June 2003.
[21]
B. Lee, et. al. "Asynchronous Fast Adaptive Composite-Grid Methods: Numerical Results" SIAM Journal on Scientific Computing Volume 25, Number 2, pp. 682--700 (2003)
[22]
T. Liao: Light-weight Reliable Multicast Protocol. INRIA Technical Report (1998), http://webcanal.inria.fr/lrmp/lrmp_paper.ps
[23]
M. Litzkow, M. Livny, and M. Mutka, "Condor - A Hunter of Idle Workstations", Proceedings of the 8th International Conference of Distributed Computing Systems, pages 104--111, June, 1988.
[24]
Matrix Market, http://math.nist.gov/MatrixMarket
[25]
P. Newton and Browne, J. C.: The CODE 2.0 Graphical Parallel Programming Language. Proceedings of the ACM International Conference on Supercomputing (1992) 167--177.
[26]
L. Oliveira, L. Lopes, and F. Silva, "P3: Parallel Peer to Peer, An Internet Parallel Programming Environment" Proceedings of the Workshop on Web Engineering and Peer-to-Peer Computing (Pisa, Italy, 2002)
[27]
Pagerank: 2002, 'PageRank Explained', http://www/webrankinfo.com/ english/pagerank
[28]
M. Parashar, C. Edwards, K. Klimkowski and J. C. Browne) "A Common Data Management Infrastructure for Adaptive Algorithms for PDE Solutions," Proceedings of SC '97, San Jose, CA, November 1997, pp. 1--22.
[29]
C. Popa "Extended Kaczmartz-like Methods with Oblique Projections" Proceedings of Appl. Math. Mech. 2, 491--492 (2003).
[30]
A. Rowstron and P. Druschel, Pastry: Scalable, Distributed Object Location and Routing for Large-Scale Peer-to-Peer systems, Proceedings of the 18th IFIP/ACM International Conference on Distributed Systems Platforms (Middleware 2001), November 2001, pp. 329--350
[31]
Rowstron, A., Kermarrec, A-M., Castro, M., and Druschel, P.: SCRIBE: "The design of a large-scale event notification infrastructure". Proceedings of NGC2001, UCL, London (2001).
[32]
Y. Saad and H. van der Vorst "Iterative Solution of Linear Systems in the 20th Century" (Technical report, Department of Computer Science, University of Minnesota, Minneapolis, MN 55455, August 1999.)
[33]
Hans Sagan, Space-Filling Curves, (Springer-Verlag, New York, 1994.) ISBN: 0-387-94265-3.
[34]
Sankalingam. K, S. Sethumadhvan and J. C. Browne: "Distributed PageRank in Peer to Peer systems", In: Proceedings of the 12th International Symposium on High Performance Distributed Computing. pp. 58--68
[35]
Strikwerda, J. C.: 2002, 'A Probabilistic Analysis of Asynchronous Iteration'. Linear Algebra and its Applications349, 125--154.
[36]
SETI@home http://setiathome.ssl.berkeley.edu
[37]
C. Schmidt and M. Parashar "Flexible Information Discovery in Decentralized Distributed Systems" Proceedings HPDC 12 (Seattle, June 2003) pp. 266--235.
[38]
I. Taylor, O. F. Rana, R. Philp, Ian Wang and M. Shields "Supporting Peer-2-Peer Interactions in the Consumer Grid" Proceedings of HIPS'03 (Nice, France, April 22-26, 2003) pp. 3--14).
[39]
United Devices http://www.ud.com
[40]
J. N. Verbeke, Nadgir, G. Ruetsch, and I. Sharapov: 2002, 'Framework for Peer-to-Peer Distributed Computing in a Heterogeneous, Decentralized Environment'. In: Proceedings of the 3rd International Workshop on Grid Computing.
[41]
WestLake, J, R., A Handbook of Numerical Matrix Inversion and Solution of Linear Equations, (John Wiley & Sons, INC., 1968.)
[42]
M. Yalamanchi, "Experimental Evaluation of Peer to Peer Networks" (Masters Report, Department of Electrical and Computer Engineering, UT-Austin, May 2004)

Cited By

View all
  • (2009)Semantic shared space-based complex tasks allocation method for massive MAS2009 2nd IEEE International Conference on Computer Science and Information Technology10.1109/ICCSIT.2009.5234814(428-434)Online publication date: Aug-2009
  • (2007)Negotiated Coscheduling in a P2P Based HPC PlatformProceedings of the Sixth International Conference on Grid and Cooperative Computing10.1109/GCC.2007.88(133-141)Online publication date: 16-Aug-2007
  • (2007)JaceV: A Programming and Execution Environment for Asynchronous Iterative Computations on Volatile NodesHigh Performance Computing for Computational Science - VECPAR 200610.1007/978-3-540-71351-7_7(79-92)Online publication date: 2007
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
LCR '04: Proceedings of the 7th workshop on Workshop on languages, compilers, and run-time support for scalable systems
October 2004
134 pages
ISBN:9781450377997
DOI:10.1145/1066650
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

  • The Texas Learning & Computation Center
  • University of Houston

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 October 2004

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Article

Conference

LCR04
Sponsor:

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1
  • Downloads (Last 6 weeks)0
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2009)Semantic shared space-based complex tasks allocation method for massive MAS2009 2nd IEEE International Conference on Computer Science and Information Technology10.1109/ICCSIT.2009.5234814(428-434)Online publication date: Aug-2009
  • (2007)Negotiated Coscheduling in a P2P Based HPC PlatformProceedings of the Sixth International Conference on Grid and Cooperative Computing10.1109/GCC.2007.88(133-141)Online publication date: 16-Aug-2007
  • (2007)JaceV: A Programming and Execution Environment for Asynchronous Iterative Computations on Volatile NodesHigh Performance Computing for Computational Science - VECPAR 200610.1007/978-3-540-71351-7_7(79-92)Online publication date: 2007
  • (2006)JaceVProceedings of the 7th international conference on High performance computing for computational science10.5555/1761728.1761737(79-92)Online publication date: 10-Jun-2006
  • (2006)A fast response system for aerosol dispersion forecastingProceedings of the 17th IASTED international conference on Modelling and simulation10.5555/1167113.1167120(37-42)Online publication date: 24-May-2006
  • (2006)A Decentralized Computational Infrastructure for Grid-Based Parallel Asynchronous Iterative ApplicationsJournal of Grid Computing10.1007/s10723-006-9033-94:4(355-372)Online publication date: 4-May-2006

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media