Abstract
Heterogeneous networked clusters are being increasingly used as platforms for resource-intensive parallel and distributed applications. The fundamental underlying idea is to provide large amounts of processing capacity over extended periods of time by harnessing the idle and available resources on the network in an opportunistic manner. In this paper we present the design, implementation and evaluation of a framework that uses JavaSpaces to support this type of opportunistic adaptive parallel/distributed computing over networked clusters in a non-intrusive manner. The framework targets applications exhibiting coarse grained parallelism and has three key features: (1) portability across heterogeneous platforms, (2) minimal configuration overheads for participating nodes, and (3) automated system state monitoring (using SNMP) to ensure non-intrusive behavior. Experimental results presented in this paper demonstrate that for applications that can be broken into coarse-grained, relatively independent tasks, the opportunistic adaptive parallel computing framework can provide performance gains. Furthermore, the results indicate that monitoring and reacting to the current system state minimizes the intrusiveness of the framework.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Sun Microsystems, Javaspaces specification, http://www.javasoft.com/ products/javaspaces/specs/index.html (July 1998).
SNMP Documentation, http://www.snmpinfo.com (1997).
J. Murray, Windows NT SNMP, O'Reilly Publications, January 1998.
M. Lizkow, M. Livny and M. Mukta, Condor: A hunter of idle workstations, in: International Conference on Distributed Computing Systems (June 1998) pp. 104-111.
M. Lizkow, M. Livny and T. Tannenbaum, Checkpoint and migration of UNIX processes in the Condor distributed environment, Technical report 1346, University of Wisconsin-Madison, April 1997.
The Linda Group, http://www.cs.yale.edu/HTML/YALE/CS/Linda/ linda.html (January 1988).
D. Gelernter and D. Kaminsky, Supercomputing out of recycled garbage: Preliminary experience with Piranha, in: Proceedings of the 6th ACM International (July 1992) pp. 417-427.
J.E. Baldeschwieler, R.D. Blumofe and E.A. Brewer, ATLAS: An infrastructure for Global computing, in: Proceedings of the 7th ACM SIGOPS European Workshop: Systems Support for Worldwide Applications (September 1996) pp. 165-172.
P. Ledru, Adaptive parallelism: An early experiment with JavaTM remote method invocation, Operating System Review 3(4) (October 1997).
A. Baratloo, M. Karaul, Z. Kedem and P. Wyckoff, Charlotte: Metacomputing on the web, in: Proceedings of the 9th ISCA International Conference on Parallel and Distributed Computing Systems (PDCS) (September 1996) pp. 181-188.
A. Baratloo, M. Karaul, H. Karl and Z.M. Kedem, An infrastructure for network computing with Java applets, Concurrency: Practice and Experience 10(11–;13) (September 1998) 1029-1041.
B. Christiansen, P. Cappello, M.F. Ionescu, M.O. Neary, K. Schauser and D. Wu, Javelin: Internet-based parallel computing using Java, Concurrency: Practice and Experience 9(11) (1997) 1139-1160.
T. Brecht, H. Sandhu, J. Talbott and M. Shan, ParaWeb: Towards world-wide supercomputing, in: Proceedings of the 7th ACM SIGOPS European Workshop (September 1996) pp. 181-188.
Entropia: Harnessing your PC Network, http://www.entropia.com (September 2000).
SETI@home: The Search for Extraterrestrial Intelligence, http:// setiathome.ssl.berkeley.edu (July 1996).
M. Stang and S. Whinston, Enterprise computing with Jini technology, Issue of IT Professional, IEEE Computer Society 3(1) (2001) 33-38.
B. Venners, Objects, the Network, and Jini, http://www.artima.com/ jini/jiniology/intro.html (December 2001).
E. Freeman, S. Hupfer and K. Arnold, JavaSpaces Principles, Patterns, and Practice (Addison–;Wesley, 1999).
C. Laird, JavaSpaces: Making Distributed Computing Easier, http: //www.byte.com/documents/s=146/byt19990915s0001/ (September 1999).
M. Noble, Tonic: A Java TupleSpaces Benchmark Project, http:// hea-www.harvard.edu/mnoble/tonic/doc/ (January 2001).
Financial terms, Glossary of financial terms, http://www.centrex.com/ terms.html.
MC algorithm, MC algorithm for option pricing, http://www.puc-rio. br/marco.ind/monte-carlo.html.
A. Heirich and J. Arvo, A competitive analysis of load balancing strategies for parallel ray tracing, Journal of Supercomputing 12(1–;2) (1998) 57-68.
S. Brin and L. Page, The anatomy of a large-scale hypertextual web search engine, in: Proceedings of the 7th International World Wide Web Conference (April 1998) pp. 107-117.
S. Brin and L. Page, The PageRank Citation Ranking: Bringing Order to the Web, http://ww-db.stanford.edu/~ backrub/pageranksub.ps (January 1998).
S.D. Conte and C. de Boor, Elementary Numerical Analysis: An Algorithmic Approach (McGraw-Hill, 1980).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Batheja, J., Parashar, M. A Framework for Adaptive Cluster Computing Using JavaSpaces. Cluster Computing 6, 201–213 (2003). https://doi.org/10.1023/A:1023536503299
Issue Date:
DOI: https://doi.org/10.1023/A:1023536503299