Skip to main content

Advertisement

SpringerLink
Log in

Labs of the World, Unite!!!

  • Published:
Journal of Grid Computing Aims and scope Submit manuscript

Abstract

eScience is rapidly changing the way we do research. As a result, many research labs now need non-trivial computational power. Grid and voluntary computing are well-established solutions for this need. However, not all labs can effectively benefit from these technologies. In particular, small and medium research labs (which are the majority of the labs in the world) have a hard time using these technologies as they demand high visibility projects and/or high-qualified computer personnel. This paper describes OurGrid, a system designed to fill this gap. OurGrid is an open, free-to-join, cooperative Grid in which labs donate their idle computational resources in exchange for accessing other labs’ idle resources when needed. It relies on an incentive mechanism that makes it in the best interest of participants to collaborate with the system, employs a novel application scheduling technique that demands very little information, and uses virtual machines to isolate applications and thus provide security. The vision is that OurGrid enables labs to combine their resources in a massive worldwide computing platform. OurGrid is in production since December 2004. Any lab can join it by downloading its software from http://www.ourgrid.org.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Abramson, D., Buyya, R., Giddy, J.: A computational economy for Grid computing and its implementation in the Nimrod-G resource broker. Future Gener. Comput. Syst. 18, 1061–1074 (2002)

    Article  MATH  Google Scholar 

  2. Anderson, D., Cobb, J., Korpela, E.: SETI@home: An experiment in public-resource computing. Communications of the ACM 45(11), 56–61 (2002)

    Article  Google Scholar 

  3. Anderson, D.: Public computing: Reconnecting people to science. Proceedings of Shared Knowledge and the Web, Madrid, Spain, Nov. 17–19 2003

  4. Andrade, N., Brasileiro, F., Cirne, W., Mowbray, M.: Discouraging free-riding in a peer-to-peer CPU-sharing Grid. Proceedings of 13th IEEE International Symposium on High-Performance Distributed Computing (HPDC13), Honolulu, Hawaii, 4–9 June 2004

  5. Andrade, N., Cirne, W., Brasileiro, F., Roisenberg, P.: OurGrid: An approach to easily assemble Grids with equitable resource sharing. Proceedings of 9th Workshop on Job Scheduling Strategies for Parallel Processing, June 2003

  6. Andrade, N., Mowbray, M., Cirne, W., Brasileiro, F.: When can an autonomous reputation scheme discourage free-riding in a peer-to-peer system? Proceedings of 4th Workshop on Global and Peer-to-Peer Computing (GP2PC), Chicago, USA, 19–22 April 2004

  7. AspectJ Team: The AspectJ Programming Guide. http://www.eclipse.org/aspectj/doc/released/progguide/index.html. Cited 14 March 2006 (2006)

  8. Barham, P., et al.: Xen and the art of virtualization. Proceedings of SOPS’2003

  9. Basu, S., Banerjee, S., Sharma, P., Lee, S.-J.: NodeWiz: Peer-to-peer resource discovery for Grids. Proceedings of 5th International Workshop on Global and Peer-to-Peer Computing (in conjunction with CCGRID 2005), May 2005

  10. Beck, K.: Extreme Programming Explained: Embrace Change. Addison-Wesley (1999)

  11. Berman, F., Fox, G., Hey, T. (eds.): Grid Computing: Making The Global Infrastructure a Reality. Wiley (2003)

  12. Bosilca, G., et al.: MPICH-V: Toward a scalable fault tolerant MPI for volatile nodes. In: Proceedings of 2002 ACM/IEEE Conference on Supercomputing, Baltimore, Maryland, pp. 1–18, 2002

  13. Buyya, R., Abramson, D., Giddy, J.: An economy driven resource management architecture for computational power Grids. Proceedings of International Conference on Parallel and Distributed Processing Techniques and Applications, 2000

  14. Buyya, R., Vazhkudai, S.: Compute Power Market: Towards a market-oriented Grid. Proceedings of 1st IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGrid 2001), Beijing, China, 2001

  15. Butt, A.R., Zhang, R., Hu, Y.: A self-organizing flock of condors. Proceedings of Supercomputing, 2003

  16. Casanova, H., et al.: Heuristics for scheduling parameter sweep applications in Grid environments. In: Proceedings of 9th Heterogeneous Computing Workshop, pp. 349–363, 2000

  17. CERN: Worldwide LCG Computing Grid. http://lcg.web.cern.ch/LCG/. Cited 14 March 2006 (2006)

  18. Cirne, W., Marzullo, K.: The Computational Co-op: Gathering Clusters into a Metacomputer. Proceedings of IPPS/SPDP’99, April 1999

  19. Cirne, W., et al.: Running bag-of-tasks applications on computational Grids: The MyGrid approach. Proceedings of ICCP’2003: International Conference on Parallel Processing, Oct. 2003

  20. Cohen, B.: Incentives build robustness in BitTorrent. Proceedings of Workshop on Economics of Peer-to-Peer Systems, June 2003

  21. COPAD project announcement. http://www.eradigital.com.br/clientes/ourgrid/news01.shtml. Cited 14 March 2006

  22. Costa, L., Cirne, W., Fireman, D.: Converting space shared resources into intermittent resources for use in bag-of-tasks Grids. Proceedings of 17th Symposium on Computer Architecture and High Performance Computing (SBAC-PAD’2005), Oct. 2005

  23. Czajkowski, K., et al. From Open Grid Services Infrastructure to WS-Resource Framework: Refactoring & Evolution. Version 1.1, 3/05/2004. http://www.globus.org/wsrf/specs/ogsi_to_wsrf_1.0.pdf. Cited 14 March 2006

  24. Damiani, E., Vimercati, S., Paraboschi, S., Samarati, P.: Managing and sharing servents’ reputations in peer-to-peer systems. IEEE Transactions on Data and Knowledge Engineering 15(4), 840–854 (2003)

    Article  Google Scholar 

  25. To appear: Dantas, A., Cirne, W., Saikoski, K.: Using AOP to Bring a Project Back in Shape: The OurGrid Case. J Braz Comput Soc. Available at http://walfredo.dsc.ufcg.edu.br/resume.html#publications Cited 14 March 2006

  26. Dodonov, E., Sousa, J., Guardia, H.: GridBox: Securing hosts from malicious and greedy applications. In: Proceedings of Middleware for Grid Computing, pp. 17–22, 2004

  27. Duarte, A., Brasileiro, F., Cirne, W., Alencar-Filho, J.: Collaborative fault diagnosis in Grids through automated tests. Proceedings of 20th International Conference on Advanced Information Networking and Applications (AINA’2006), April 2006

  28. Epema, D., et al.: A worldwide flock of condors: Load sharing among workstation clusters. Future Gener. Comput. Syst. 12 (1996)

  29. Fedak, G., et al.: XtremWeb: A generic global computing system. In: Proceedings of 1st International Symposium on Cluster Computing and the Grid, Brisbane, Australia, pp. 582–587, 2001

  30. Feitelson, D.: Parallel Workloads Archive. http://www.cs.huji.ac.il/labs/parallel/workload/. Cited 14 March 2006

  31. Figueiredo, R., Dinda, P., Fortes, J.: A Case for Grid Computing on Virtual Machines. Proceedings of Intl. Conf. on Distributed Computing Systems (ICDCS), 2003

  32. Frey, J., et al.: Condor-G: A computation management agent for multi-institutional Grids. Proceedings of 10th IEEE Symposium on High Performance Distributed Computing, HPDC’10, San Francisco, California, August 7–9, 2001

  33. Foster, I., Iamnitchi, A.: On death, taxes, and the convergence of peer-to-peer and Grid computing. Proceedings of 2nd International Workshop on Peer-to-Peer Systems (IPTPS’03), Berkeley, California, Feb 2003

  34. Foster, I., Kesselman, C. (eds.): The Grid: Blueprint for a New Computing Infrastructure, 2nd edn. Morgan Kaufmann, 2004

  35. Garfinkel, T.: Traps and pitfalls: Practical problems in system call interposition based security tools. Proceedings of Internet Society’s 2003 Symposium on Network and Distributed System Security (NDSS 2003)

  36. Garfinkel, T., et al.: Terra: A virtual machine-based platform for trusted computing. Proceedings of 19th Symposium on Operating System Principles (SOSP 2003)

  37. The Globus alliance: http://www.globus.org. Cited 14 March 2006

  38. Hughes, D., Coulson, G., Walkerdine, J.: Free riding on gnutella revisited: The bell tolls? IEEE Distrib. Syst. Online 6(6) (2005)

  39. Jabber, Inc.: http://www.jabber.org/. Cited 14 March 2006

  40. Kamvar, S., Schlosser, M., Garcia-Molina, H.: EigenRep: Reputation management in peer-to-peer networks. Proceedings of 12th International World Wide Web Conference, Budapest, Hungary, May 2003

  41. Kondo, D., Chien, A., Casanova, H: Resource management for short-lived applications on enterprise desktop Grids. Proceedings of Supercomputing’2004, Pittsburgh, Pennsylvania, Nov. 2004

  42. Lee, C., et al.: Are user runtime estimates inherently inaccurate? Proceedings of 10th Job Scheduling Strategies for Parallel Processing, June 2004

  43. Litzkow, M., Livny, M., Mutka, M.: Condor: A hunter of idle workstations. Proceedings of 8th International Conference of Distributed Computing Systems, pp. 104–111, June 1988

  44. Loscocco, P., et al.: The inevitability of failure: The flawed assumption of security in modern computing environments. In: Proceedings of 21st National Information Systems Security Conference, pp. 303–314, Oct. 1998

  45. Loscocco, P., Smalley, S.: Integrating flexible support for security policies into the linux operating system. Proceedings of FREENIX track of USENIX Annual Technical Conference, June 2001

  46. Medeiros, R., Cirne, W., Brasileiro, F., Sauvé, J.: Faults in Grids: Why are they so bad and what can be done about it? Proceedings of Grid 2003: 4th International Workshop on Grid Computing, November 2003

  47. Grid Economic Services Architecture Working Group. http://www.doc.ic.ac.uk/~sjn5/GGF/gesa-wg.html. Cited 14 March 2006

  48. Paranhos, D., Cirne, W., Brasileiro, F.: Trading cycles for information: Using replication to schedule bag-of-tasks applications on computational Grids. Proceedings of Europar’2003, Austria, 2003

  49. Riehle, D., Fraleigh, S., Bucka-Lassen, D., Omorogbe, N.: The architecture of a UML virtual machine. In: Proceedings of Conference on Object-Oriented Programming Systems, Languages, and Applications (OOPSLA ’01), pp. 327–341, 2001

  50. Ripeanu, M., Foster, I.: Mapping the gnutella network: Macroscopic properties of large-scale peer-to-peer systems. Proceedings of First International Workshop on Peer-to-Peer Systems (IPTPS), 2002

  51. Ripeanu, M.: The Globus Toolkit Ecosystem (and How to Make it Work for You). http://people.cs.uchicago.edu/~matei/GlobusEcosystem/. Cited 14 March 2006

  52. Santos, R., Andrade, A., Cirne, W., Brasileiro, F., Andrade, N.: Accurate autonomous accounting in peer-to-peer Grids. In: Proceedings 3rd Workshop on Middleware for Grid Computing (MGC2005), November 2005

  53. Santos-Neto, E., Cirne, W., Brasileiro, F., Lima, A.: Exploiting replication and data reuse to efficiently schedule data-intensive applications on Grids. In: Proceedings of 10th Workshop on Job Scheduling Strategies for Parallel Processing, June 2004

  54. Sarmenta, L: Sabotage-tolerance mechanisms for volunteer computing systems. Future Gener. Comput. Syst. 18(4) (2002)

  55. Saroiu, S., Gummadi, P., Gribble, S.: A measurement study of peer-to-peer file sharing systems. Proceedings of Multimedia Computing and Networking (MMCN) 2002, San Jose, California, Jan. 2002

  56. SegHidro project team: SegHidro Web Site http://seghidro.lsd.ufcg.edu.br/. Cited 14 March 2006

  57. SETI@home team: SETI@home statistics web page. http://setiathome.ssl.berkeley.edu/totals.html. Cited March 2005

  58. Silva, F., et al.: Running data mining applications on the Grid: A bag-of-tasks approach. Proceedings of International Conference on Computational Science and its Applications, 2004

  59. Son, S., Livny, M.: Recovering internet symmetry in distributed computing. Proceedings of GAN’03 Workshop on Grids and Advanced Networks, Tokyo, Japan, 12–15 May 2003

  60. Thain, D., Tannenbaum, T., Livny, M.: Distributed Computing in Practice: The Condor Experience. Concurrency and Computation: Practice and Experience 17(2–4), 23–356 (2005)

    Google Scholar 

  61. Tuecke, S., et al.: Open Grid Services Infrastructure (OGSI) Version 1.0. Global Grid Forum Draft Recommendation, 6/27/2003. http://www.globus.org/toolkit/draft-ggf-ogsi-gridservice-33_2003-06-27.pdf. Cited 14 March 2006

  62. Veronez, C., Osthoff, C., Pascutti, P.: HIV-I Protease mutants molecular dynamics research on Grid computing environment. In: Proceedings of WOB pp. 161–164, 2003

Download references

Author information

Authors and Affiliations

  1. Departamento de Sistemas e Computação, Laboratório de Sistemas Distribuídos, Universidade Federal de Campina Grande, Paraiba, Brazil

    Walfredo Cirne, Francisco Brasileiro, Nazareno Andrade, Lauro B. Costa & Alisson Andrade

  2. Hewlett Packard, Porto Alegre, RS, Brazil

    Reynaldo Novaes

  3. Hewlett Packard, Bristol, United Kingdom

    Miranda Mowbray

Authors
  1. Walfredo Cirne
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Francisco Brasileiro
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Nazareno Andrade
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Lauro B. Costa
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Alisson Andrade
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Reynaldo Novaes
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Miranda Mowbray
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Walfredo Cirne.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Cirne, W., Brasileiro, F., Andrade, N. et al. Labs of the World, Unite!!!. J Grid Computing 4, 225–246 (2006). https://doi.org/10.1007/s10723-006-9040-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10723-006-9040-x

Key words

Search

Navigation