Abstract
This paper addresses the architectural issues that arise in the design of a universally accessible wide-area network-computing system that is capable of making automatic cost/performance tradeoff decisions at run-time. The core system is designed around a three-level hierarchically distributed architecture, a choice driven by the dynamic, incremental, and distributed nature of the information associated with run-time cost/performance tradeoff decisions. Support for independent replication of each component in the hierarchy contributes to the overall scalability and reliability of the architecture. Meta-information is managed in a scalable manner by employing self-encoded resource identifiers that allow O(1) access to all managed information. Security and access control across administrative domains are provided by partitioning the infrastructure into independently-managed cells, and by giving administrators the ability to customize user-views directly at the location at which the request is processed. Demand-driven resource management is achieved by predicting the run-specific resource usage characteristics of tools via machine learning techniques. The concepts described in this paper are embodied in the Purdue University Network-Computing Hubs (PUNCH), a demand-based network-computing system that allows users to access and run unmodified tools via standard World Wide Web browsers. Tools do not have to be written in any particular language, and access to the source or object code is not required. The PUNCH infrastructure can be distributed in a manner that allows tools to be (user-transparently) executed wherever they reside. Currently, PUNCH contains over thirty tools developed by eight universities and four vendors, and serves more than five hundred users. During the past three years, PUNCH users have logged more than one million hits and have performed over seventy thousand simulations.
Similar content being viewed by others
References
C. Adasiewicz, Exploratorium: User friendly science and engineering, NCSA Access 9 (1995) 10-11.
P. Arbenz, W. Gander and M. Oettli, The remote computation system, in: High-Performance Computing and Networking, Lecture Notes in Computer Science, Vol. 1067 (Springer, Berlin, 1996).
P. Arbenz, W. Gander and M. Oettli, The remote computation system, Parallel Computing 23 (1997) 1421-1428.
C.G. Atkeson, S.A. Schaal and A.W. Moore, Locally weighted learning, AI Review 11 (1997) 11-73.
J.E. Baldeschwieler, R.D. Blumofe and E.A. Brewer, ATLAS: An infrastructure for global computing, in: Proceedings of the 7th ACM SIGOPS European Workshop (1996).
S. Baker, V. Cahill and P. Nixon, Bridging boundaries: CORBA in perspective, IEEE Internet Computing 1 (1997) 52-57.
R.G. Bias and D.J. Mayhew, eds., Cost-Justifying Usability (Academic Press, New York, 1994).
T. Brecht, H. Sandhu, M. Shan and J. Talbot, ParaWeb: Towards world wide supercomputing, in: Proceedings of the 7th ACM SIGOPS European Workshop (1996).
X window system version 11 release 6.3: Release notes, Manual, X Consortium, Inc. (1996).
H. Casanova and J. Dongarra, NetSolve: A network solver for solving computational science problems, in: Proceedings of the Supercomputing Conference (1996).
Citrix Systems, Inc., ICA technical paper, WWW document at www.citrix.com/technology/ (1996).
W.S. Cleveland and S.J. Devlin, Locally weighted regression: An approach to regression analysis by local fitting, Journal of the American Statistical Association 83 (1988) 596-610.
S.E. Dossick and G.E. Kaiser, WWW access to legacy client/server applications, Technical Report CUCS-003-96, Columbia University (1996).
S.E. Dossick, G.E. Kaiser and J.J. Yang, Distributed tool services via the World Wide Web, Technical Report CUCS-042-96, Department of Computer Science, Columbia University (1996).
I. Foster and C. Kesselman, Globus: A metacomputing infrastructure toolkit, International Journal of Supercomputer Applications 11 (1997).
I. Foster and C. Kesselman, The Globus project: A status report, in: Proceedings of the 1998 Heterogeneous Computing Workshop (HCW'98) (1998) pp. 4-18.
A.S. Grimshaw, A. Nguyen-Tuong and W.A. Wulf, Campus-wide computing: Early results using Legion at the University of Virginia, Technical Report CS-95-19, Department of Computer Science, University of Virginia (1995).
A.S. Grimshaw and W.A. Wulf, Legion: Flexible support for wide-area computing, in: Proceedings of the 7th ACM SIGOPS European Workshop (1996).
A.S. Grimshaw, W.A. Wulf et al., The Legion vision of a worldwide virtual computer, Communications of the ACM 40 (1997).
O. Gunther, R. Muller, P. Schmidt, H.K. Bhargava and R. Krishnan, MMM: A web-based system for sharing statistical computing modules, IEEE Internet Computing 1 (1997) 59-68.
P. Homburg, M.V. Steen and A.S. Tanenbaum, An architecture for a wide area distributed system, in: Proceedings of the 7th ACM SIGOPS European Workshop (1996).
P.T. Homer and R.D. Schlichting, Constructing scientific meta-computations, in: Proceedings of the International Conference on High-Performance Computing in the Asia-Pacific Region (HPC' Asia) (1995).
P.T. Homer and R.D. Schlichting, Configuring scientific applications in a heterogeneous distributed system, Distributed Systems Engineering 3 (1996) 173-184.
D. Israel, NCSA Symbio: A supercomputer for windows NT, in: NCSA Access Online (NCSA, 1997).
G.E. Kaiser, S.E. Dossick, W. Jiang, J.J. Yang and S.X. Ye, WWW-based collaboration environments with distributed tool services, World Wide Web Journal (1998).
N.H. Kapadia, C.E. Brodley, J.A.B. Fortes and M.S. Lundstrom, Resource usage prediction for demand-based network-computing, Technical Report TR-ECE 98-9, Department of Electrical and Computer Engineering, Purdue University (1998).
N.H. Kapadia, C.E. Brodley, J.A.B. Fortes and M.S. Lundstrom, Resource-usage prediction for demand-based network-computing, in: Proceedings of the 1998 Workshop on Advances in Parallel and Distributed Systems (APADS) (1998).
N. Kapadia, J.A.B. Fortes and M. Lundstrom, The Computational Electronics Hub: A network-based simulation laboratory, in: Summary Record of the Workshop on Materials and Process Research and the Information Highway (1996) pp. 31.
N.H. Kapadia, J.A.B. Fortes and M.S. Lundstrom, The Semiconductor Simulation Hub: A network-based microelectronics simulation laboratory, in: Proceedings of the 12th Biennial University Government Industry Microelectronics Symposium (1997) pp. 72-77.
N.H. Kapadia and J.A.B. Fortes, On the design of a demand-based network-computing system: The Purdue University Network-Computing Hubs, in: Proceedings of the 7th IEEE International Symposium on High Performance Distributed Computing (HPDC'98) (1998) pp. 71-80.
N.H. Kapadia and J.A.B. Fortes, The PUNCH network desktop, Technical Report TR-ECE 99-1, Department of Electrical and Computer Engineering, Purdue University (1999).
N.H. Kapadia, J.P. Robertson and J.A.B. Fortes, Interface issues in running computer architecture tools via the World Wide Web, in: Proceedings of the Workshop on Computer Architecture Education at the 25th Annual International Symposium on Computer Architecture (ISCA'98) (1998).
S.B. Lamine, J. Plaice and P. Kropf, Problems of computing on the Web, in: Proceedings of the 1997 High Performance Computing Symposium (1997) pp. 296-301.
M. Litzkow, M. Livny and M.W. Mutka, Condor a hunter of idle workstations, in: Proceedings of the 8th International Conference on Distributed Computing Systems (1988) pp. 104-111.
J. Martin, Computer Networks and Distributed Processing: Software, Techniques, and Architecture (Prentice-Hall, Englewood Cliffs, NJ, 1981).
F. Ramme, Building a virtual machine-room a focal point in metacomputing, Future Generation Computer Systems 11 (1995) 477-489.
A. Reinefeld, R. Baraglia, T. Decker, J. Gehring, D. Laforenza, F. Ramme, T. Romke and J. Simon, The MOL project: An open, extensible metacomputer, in: Proceedings of the 1997 IEEE Heterogeneous Computing Workshop (HCW97) (1997) pp. 17-31.
F.D. Reynolds, Evolving an operating system for the Web, Computer 29 (1996).
T. Richardson, Q. Stafford-Fraser, K.R. Wood and A. Hopper, Virtual network computing, IEEE Internet Computing 2 (1998) 33-38.
M. Sato, H. Nakada, S. Sekiguchi, S. Matsuoka, U. Nagashima and H. Takagi, Ninf: A network based information library for global world-wide computing infrastructure, in: High-Performance Computing and Networking, Lecture Notes in Computer Science, Vol. 1225 (Springer, Berlin, 1997) pp. 491-502.
S. Sekiguchi, M. Sato, H. Nakada, S. Matsuoka and U. Nagashima,-Ninf-: Network-based information library for globally high performance computing, in: Proceedings of Parallel Object-Oriented Methods and Applications (POOMA) (1996).
D. Souder, M. Herrington, R.P. Garg and D. DeRyke, JSPICE: A component-based distributed Java front-end for SPICE, in: Proceedings of the 1998 Workshop on Java for High-Performance Network Computing (1998).
M.V. Steen, P. Homburg and A.S. Tanenbaum, The architectural design of Globe: A wide-area distributed system, Technical Report IR-422, Department of Mathematics and Computer Science, Vrije Universiteit (1997).
V. Sunderam, Heterogeneous network computing: The next generation, Parallel Computing 23 (1997) 121-135.
L. Wall, T. Christiansen and R.L. Schwartz, Programming Perl (O'Reilly & Associates, 1996).
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Kapadia, N.H., Fortes, J.A. PUNCH: An architecture for Web-enabled wide-area network-computing. Cluster Computing 2, 153–164 (1999). https://doi.org/10.1023/A:1019026725028
Issue Date:
DOI: https://doi.org/10.1023/A:1019026725028