Cited By
View all- Park JByun HLee J(2016)Bio-Inspired Load-Balancing Framework for Loosely Coupled Heterogeneous Server SystemsIEEE Transactions on Computers10.1109/TC.2016.253603265:11(3280-3292)Online publication date: 1-Nov-2016
Autonomic load balancing mechanisms in the P2P desktop grid
Article No.: 24, Pages 1 - 9
Abstract
Peer-to-Peer (P2P) desktop grid computing systems circumvent the performance bottleneck and limited scalability of centralized Grid architectures resulting in a massively scalable and robust system. We have designed a set of protocols that implement a distributed, decentralized desktop grid via P2P techniques. Incoming jobs having different types of resource requirements are matched with system nodes through proximity in an N-dimensional resource space.
In this paper, we address problems that arise from static load balancing mechanisms for assigning jobs to nodes that can arise for various reasons, including the heterogeneity of the available nodes or the jobs to be run, and from stale information in the P2P system. We greatly improve upon our prior work by providing lightweight yet effective dynamic load balancing mechanisms to overcome load imbalances caused by the limitations of the initial static job assignment scheme. Unlike other systems, we can effectively support resource constraints of jobs during the course of redistribution since we simplify the problem of matchmaking through building a multi-dimensional resource space and mapping jobs and nodes to this space. Throughout extensive simulation results, we show that dynamic load balancing makes the overall system more scalable, by improving system throughput and response time with low additional overhead.
References
[1]
D. Anderson. BOINC: A System for Public-Resource Computing and Storage. In Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing (GRID 2004), Nov. 2004.
[2]
D. P. Anderson, C. Christensen, and B. Allen. Designing a Runtime System for Volunteer Computing. In Proceedings of the 2006 IEEE/ACM SC06 Conference, Nov. 2006.
[3]
D. P. Anderson, J. Cobb, E. Korpela, M. Lebofsky, and D. Werthimer. SETI@home: An Experiment in Public-Resource Computing. Communications of the ACM, 45(11):56--61, Nov. 2002.
[4]
A. Awan, R. A. Ferreira, S. Jagannathan, and A. Grama. Unstructured Peer-to-Peer Networks for Sharing Processor Cycles. Parallel Computing, 32(2), Feb. 2006.
[5]
M. Becchi and P. Crowley. Dynamic Thread Assignment on Heterogeneous Multiprocessor Architectures. In Proceedings of the 3rd Conference on Computing frontiers, May 2006.
[6]
BOINC: Open-source software for volunteer computing and grid computing. Available at http://boinc.berkeley.edu/.
[7]
J. Bridgewater, P. O. Boykin, and V. Roychowdhury. Balanced Overlay Networks (BON): An Overlay Technology for Decentralized Load Balancing. IEEE Transactions on Parallel and Distributed Systems, 18(7):1122--1133, 2007.
[8]
D. Caromel, A. di Costanzo, and C. Mathieu. Peer-to-peer for computational grids: mixing clusters and desktop machines. Parallel Computing, 33(4-5):275--288, 2007.
[9]
A. S. Cheema, M. Muhammad, and I. Gupta. Peer-to-peer Discovery of Computational Resources for Grid Applications. In Proceedings of the 6th IEEE/ACM International Workshop on Grid Computing (GRID 2005), Nov. 2005.
[10]
Folding@Home. Available at http://folding.stanford.edu.
[11]
B. Godfrey, K. Lakshminarayanan, S. Surana, R. Karp, and I. Stoica. Load Balancing in Dynamic Structured P2P Systems. In Proceedings of the IEEE INFOCOM 2004, Mar. 2004.
[12]
R. Gupta, V. Sekhri, and A. K. Somani. CompuP2P: An Architecture for Internet Computing using Peer-to-Peer Networks. IEEE Transactions on Parallel and Distributed Systems, 17(11):1306--1320, Nov. 2006.
[13]
A. Iosup, C. Dumitrescu, and D. Epema. How are Real Grids Used? The Analysis of Four Grid Traces and Its Implications. In Proceedings of the 7th IEEE/ACM International Conference on Grid Computing (GRID 2006), Sept. 2006.
[14]
A. Iosup and D. Epema. Grid Computing Workloads: Bags of Tasks, Workflows, Pilots, and Others. IEEE Internet Computing, 15(2):19--26, 2011.
[15]
J.-S. Kim, P. Keleher, M. Marsh, B. Bhattacharjee, and A. Sussman. Using Content-Addressable Networks for Load Balancing in Desktop Grids. In Proceedings of the 16th IEEE International Symposium on High Performance Distributed Computing (HPDC 2007), June 2007.
[16]
J.-S. Kim, B. Nam, P. Keleher, M. Marsh, B. Bhattacharjee, and A. Sussman. Trade-offs in Matching Jobs and Balancing Load for Distributed Desktop Grids. Future Generation Computer Systems - The International Journal of Grid Computing: Theory, Methods and Applications, 24(5):415--424, 2008.
[17]
J.-S. Kim, B. Nam, M. Marsh, P. Keleher, B. Bhattacharjee, and A. Sussman. Integrating Categorical Resource Types into a P2P Desktop Grid System. In Proceedings of the 9 IEEE/ACM International Conference on Grid Computing (GRID 2008), Sept. 2008.
[18]
J. Ledlie, J. Schneidman, M. Seltzer, and J. Huth. Scooped, Again. In Proceedings of the 2nd International Workshop on Peer-to-Peer Systems (IPTPS '03), Feb. 2003.
[19]
M. Livny, J. Basney, R. Raman, and T. Tannenbaum. Mechanisms for High Throughput Computing. SPEEDUP Journal, 11(1), 1997.
[20]
C. Mastroianni, D. Talia, and O. Verta. A Super-Peer Model for Building Resource Discovery Services in Grids: Design and Simulation Analysis. In Proceedings of the European Grid Conference (EGC2005), Feb. 2005.
[21]
D. Oppenheimer, J. Albrecht, D. Patterson, and A. Vahdat. Design and Implementation Tradeoffs for Wide-Area Resource Discovery. In Proceedings of the 14th IEEE International Symposium on High Performance Distributed Computing (HPDC-14), July 2005.
[22]
I. Raicu, I. Foster, and Y. Zhao. Many-Task Computing for Grids and Supercomputers. In Proceedings of the Workshop on Many-Task Computing on Grids and Supercomputers (MTAGS'08), Nov. 2008.
[23]
I. Raicu, Z. Zhang, M. Wilde, I. Foster, P. Beckman, K. Iskra, and B. Clifford. Towards Loosely-Coupled Programming on Petascale Systems. In Proceedings of the 2008 ACM/IEEE conference on Supercomputing (SC'08), Nov. 2008.
[24]
I. Raicu, Y. Zhao, C. Dumitrescu, I. Foster, and M. Wilde. Falkon: a Fast and Light-weight tasK executiON framework. In Proceedings of the 2007 ACM/IEEE conference on Supercomputing (SC'07), Nov. 2007.
[25]
S. Ratnasamy, P. Francis, M. Handley, R. Karp, and S. Shenker. A Scalable Content Addressable Network. In Proceedings of the ACM SIGCOMM, Aug. 2001.
[26]
A. Roy and M. Livny. Condor and Preemptive Resume Scheduling. Grid Resource Management: State of the Art and Future Trends, pages 135--144, 2003.
[27]
H. Samet. Foundations of Multidimensional and Metric Data Structures. Morgan-Kaufmann, 2006.
[28]
N. G. Shivaratri, P. Krueger, and M. Singhal. Load Distributing for Locally Distributed Systems. Computer, 25(12):33--44, 1992.
[29]
SZTAKI Desktop Grid. Available at http://szdg.lpds.sztaki.hu/szdg/.
[30]
D. Thain, T. Tannenbaum, and M. Livny. Distributed computing in practice: the Condor experience. Concurrency and Computation: Practice and Experience, 17(2-4):323--356, 2005.
[31]
P. Trunfio, D. Talia, H. Papadakis, P. Fragopoulou, M. Mordacchini, M. Pennanen, K. Popov, V. Vlassov, and S. Haridi. Peer-to-Peer resource discovery in Grids: Models and systems. Future Generation Computer Systems, 23(7):864--878, Aug. 2007.
[32]
E. Walker, J. P. Gardner, V. Litvin, and E. L. Turner. Creating Personal Adaptive Clusters for Managing Scientific Jobs in a Distributed Computing Environment. In Proceedings of the Challenges of Large Applications in Distributed Environments (CLADE'06), June 2006.
[33]
D. Zhou and V. Lo. WaveGrid: a Scalable Fast-turnaround Heterogeneous Peer-based Desktop Grid System. In Proceedings of the 20th International Parallel & Distributed Processing Symposium, Apr. 2006.
[34]
Y. Zhu and Y. Hu. Efficient, Proximity-Aware Load Balancing for DHT-Based P2P Systems. IEEE Transactions on Parallel and Distributed Systems, vol. 16, no. 4, 2005, 16(4):349--361, 2005.
- Autonomic load balancing mechanisms in the P2P desktop grid
Recommendations
Using content-addressable networks for load balancing in desktop grids
HPDC '07: Proceedings of the 16th international symposium on High performance distributed computingDesktop grids have evolved to combine Peer-to-Peer and Grid computing techniques to improve the robustness, reliability and scalability of job execution infrastructures. However, efficiently matching incoming jobs to available system resources and ...
Scalable and effective peer-to-peer desktop grid system
We have designed a set of protocols that use peer-to-peer techniques to efficiently implement a distributed and decentralized desktop grid. Incoming jobs with different resource requirements are matched with system nodes through proximity in an N-...
A novel load balancing mechanism for P2P networking
GridNets '07: Proceedings of the first international conference on Networks for grid applicationsPeer to Peer (P2P) networking is a potential disruptive technology that can be used for the development of scalable, fully decentralized distributed applications. However, to realize its potential, P2P technology should address the needs of a variety of ...
Comments
Information & Contributors
Information
Published In
August 2013
247 pages
Copyright © 2013 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
- University of Arizona: University of Arizona
- OGF: Open Grid Forum
- Florida Intl University: Florida International Univeristy
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 09 August 2013
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
CAC '13
Sponsor:
- University of Arizona
- OGF
- Florida Intl University
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 95Total Downloads
- Downloads (Last 12 months)1
- Downloads (Last 6 weeks)1
Reflects downloads up to 02 Mar 2025
Other Metrics
Citations
Cited By
View all- Park JByun HLee J(2016)Bio-Inspired Load-Balancing Framework for Loosely Coupled Heterogeneous Server SystemsIEEE Transactions on Computers10.1109/TC.2016.253603265:11(3280-3292)Online publication date: 1-Nov-2016
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in