Abstract
Recently, Peer-to-Peer (P2P) technology has become important in designing (desktop) grids for large-scale distributed computing over the Internet. We present a middleware for distributed computing based on Peer-to-Peer systems. When combining public-resource computation ideas with concepts of P2P networks, new challenges occur due to the lack of global knowledge as there is no central administration possible. Our Peer-to-Peer desktop grid (P2P Grid) framework includes an efficient and fault-tolerant communication scheme for job distribution combining epidemic algorithms with chord-style multicasts. We show that this hybrid scheme is more efficient than both epidemic algorithms and chord-style multicasting alone.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Anderson, D.P.: BOINC: A System for Public-Resource Computing and Storage. In: 5th IEEE/ACM International Workshop on Grid Computing (2004)
Fedak, G., Germain, C., Neri, V., Cappello, F.: Xtremweb: A generic global computing system. In: CCGRID 2001: Proceedings of the 1st International Symposium on Cluster Computing and the Grid, Washington, DC, USA, p. 582. IEEE Computer Society Press, Los Alamitos (2001)
Page, A., Keane, T., Allen, R., Naughton, T.J., Waldron, J.: Multi-Tiered Distributed Computing Platform. In: Proc. of the PPPJ 2003, pp. 191–194, Computer Science Press, Inc. (2003)
Clark, D.: Face-to-Face with Peer-to-Peer Networking. Computer 34(1), 18–21 (2001)
Stoica, I., Morris, R., Liben-Nowell, D., Karger, D.R., Kaashoek, M.F., Dabek, F., Balakrishnan, H.: Chord: A Scalable Peer-to-Peer Lookup Service for Internet Applications. IEEE/ACM Trans. Netw. 11(1), 17–32 (2003)
Schlosser, M., Sintek, M., Decker, S., Nejdl, W.: HyperCuP – Hypercubes, Ontologies and Efficient Search on P2P Networks. In: Moro, G., Koubarakis, M. (eds.) AP2PC 2002. LNCS (LNAI), vol. 2530, pp. 112–124. Springer, Heidelberg (2003)
Portmann, M., Seneviratne, A.: Cost-effective Broadcast for Fully Decentralized Peer-to-peer Networks. Computer Communications 26(11), 1159–1167 (2003)
Yang, B., Garcia-Molina, H.: Designing a Super-peer Network. In: Proceedings of the 19th International Conference on Data Engineering (ICDE) (2003)
Eugster, P.T., Guerraoui, R., Kermarrec, A.M., Massoulie, L.: From Epidemics to Distributed Computing. IEEE Computer (2004)
Ripeanu, M.: Peer-to-Peer Architecture Case Study: Gnutella Network. In: Proc. of P2P 2001, p. 99. IEEE Computer Society Press, Washington (2001)
Chakravarti, A.J., Baumgartner, G., Lauria, M.: The Organic Grid: Self-Organizing Computation on a Peer-to-Peer Network. In: Proceedings of the International Conference on Autonomic Computing (ICAC 2004), New York (2004)
Gupta, R., Somani, K.: A.: CompuP2P: An Architecture for Sharing of Computing Resource. In Peer-to-Peer Networks With Selfish Nodes. In: Proc. of the Second Workshop on the Economics of P2P Systems, Harvard University (2004)
Aberer, K., Cudré-Mauroux, P., Datta, A., Despotovic, Z., Hauswirth, M., Punceva, M., Schmidt, R.: P-Grid: A Self-organizing Structured P2P System. ACM SIGMOD Record 32(3), 29–33 (2003)
Oliveira, L., Lopes, L.M.B., Silva, F.M.A.: P: Parallel peer to peer. In: Gregori, E., Cherkasova, L., Cugola, G., Panzieri, F., Picco, G.P. (eds.) NETWORKING 2002. LNCS, vol. 2376, pp. 274–288. Springer, Heidelberg (2002)
Jelasity, M., Preuß, M., Paechter, B.: A Scalable and Robust Framework for Distributed Applications. In: Proceedings of the 2002 Congress on Evolutionary Computation (CEC 2002), pp. 1540–1545. IEEE Press, Los Alamitos (2002)
Bäck, T.: Evolutionary Algorithms in Theory and Practice. Oxford University Press, New York (1996)
Tannenbaum, T., Wright, D., Miller, K., Livny, M.: Condor – A Distributed Job Scheduler. In: Sterling, T. (ed.) Beowulf Cluster Computing with Linux, MIT Press, Cambridge (2001)
Verbeke, J., Nadgir, N., Ruetsch, G., Sharapov, I.: Framework for Peer-to-Peer Distributed Computing in a Heterogeneous, Decentralized Environment. In: Parashar, M. (ed.) GRID 2002. LNCS, vol. 2536, pp. 1–12. Springer, Heidelberg (2002)
Eugster, P.T., Guerraoui, R.: Probabilistic Multicast. In: Proceedings of the 3rd IEEE International Conference on Dependable Systems and Networks (DSN 2002), pp. 313–322 (2002)
Merz, P., Gorunova, K.: Efficient Broadcast in P2P Grids. In: Proceedings of the IEEE/ACM International Symposium on Cluster Computing and the Grid, Cardiff, UK, ACM Press, New York (2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fischer, T., Fudeus, S., Merz, P. (2007). A Middleware for Job Distribution in Peer-to-Peer Networks. In: Kågström, B., Elmroth, E., Dongarra, J., Waśniewski, J. (eds) Applied Parallel Computing. State of the Art in Scientific Computing. PARA 2006. Lecture Notes in Computer Science, vol 4699. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-75755-9_132
Download citation
DOI: https://doi.org/10.1007/978-3-540-75755-9_132
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-75754-2
Online ISBN: 978-3-540-75755-9
eBook Packages: Computer ScienceComputer Science (R0)