Skip to main content

Advertisement

Springer Nature Link
Log in

Can Economics-based Resource Allocation Prove Effective in a Computation Marketplace?

  • Published:
Journal of Grid Computing Aims and scope Submit manuscript

Abstract

Several companies offer computation on demand for a fee. More companies are expected to enter this business over the next decade, leading to a marketplace for computation resources. Resources will be allocated through economic mechanisms that establish the relative values of providers and customers. Society at large should benefit from discoveries obtained through the vast computing power that will become available. Given such a computation marketplace, can economics-based resource allocation provide benefits for providers, customers and society? To investigate this question, we simulate a Grid economy where individual providers and customers pursue their own ends and we measure resulting effects on system welfare. In our experiments, customers attempt to maximize their individual utilities, while providers pursue strategies chosen from three classes: information-free, utilization-based and economics-based. We find that, during periods of excess demand, economics-based strategies yield overall resource allocation that benefits system welfare. Further, economics-based strategies respond well to sudden overloads caused by temporary provider failures. During periods of moderate demand, we find that economics-based strategies provide ample system welfare, comparable with that of utilization-based strategies. We also identify and discuss key factors that arise when using economic mechanisms to allocate resources in a computation marketplace.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Lundquist, E.: IBM bets $10 billion on ‘on-demand’ computing. eWeek.com (October 30, 2002)

  2. Morgan, T.: Sun Grid compute utility opens for public business. The Unix Guardian (March 23, 2006)

  3. Michelson, B.: StrikeIron’s web services marketplace a glimpse of the future, available today. Report from Patricia Seybold Group (April 6, 2006)

  4. Jeff Bezos’ Risky bet. Business Week.com (November 13, 2006)

  5. Seabright, P.: The Company of Strangers: A Natural History of Economic Life. Princeton University Press, Princeton (2006)

    Google Scholar 

  6. Landsburgh, S.: Price Theory & Applications, 6th edition. Thomson South-Western, OH (2006)

    Google Scholar 

  7. Mills, K., Dabrowski, C.: Investigating global behavior in computing Grids. Self-organizing systems. Lect. Notes Comput. Sci. 4124, 120–136 (2006)

    Article  Google Scholar 

  8. Organization for the Advancement of Structured Information Standards: Web site (http://www.oasis-open.org)

  9. Open Grid Forum: Web site (http://www.ogf.org)

  10. Web Services Agreement Specification (WS-Agreement). GFD.107, Open Grid Forum (May 2007)

  11. Chun, B.N., Culler, D.E.: User-centric performance analysis of market-based cluster batch schedulers. Proceedings of the 2nd IEEE International Symposium on Cluster Computing and the Grid (May 2002)

  12. Yeo, C.S., Buyya, R.: Service level agreement based allocation of cluster resources: handling penalty to enhance utility. Proceedings of the 7th IEEE International Conference on Cluster Computing. Boston (September 27–30, 2005)

  13. Irwin, D.E., Grit, L.E., Chase, J.S.: Balancing risk and reward in a market-based task service. Proceedings of 13th IEEE Symposium on High Performance Distributed Computing (June 2004)

  14. Popovici, F.I., Wilkes, J.: Profitable services in an uncertain world. Proceedings of Supercomputing (November 2005)

  15. AuYoung, A., et al.: Service contracts and aggregate utility functions. Proceedings of 15th IEEE International Symposium on High Performance Distributed Computing, pp. 119–131 (2006)

  16. Wolski, R., et al.: Grid resource allocation and control using computational economies. In: Berman, F., Fox, G., Hey, T. (eds.) Grid Computing: Making the Global Infrastructure a Reality, pp. 747–772. Wiley, New York (2003)

    Google Scholar 

  17. Gomoluch, J., Schroeder, M.: Market-based resource allocation for Grid computing: a model and simulation. Proceedings of the First International Workshop on Middleware for Grid Computing. Rio de Janeiro, pp. 211–218 (June 16–20, 2003)

  18. Vengerov, D.: Adaptive utility-based scheduling in resource-constrained systems. Proceedings of the 18th Australian Joint Conference on Artificial Intelligence. LNCS, Vol. 3809, Sydney, pp. 477–488 (December 5–9, 2005)

  19. Avraham, L., Rayfield, J.T., Dias, D.M.: Service-level agreements and commercial Grids. IEEE Internet Computing, 44–50 (July–August 2003)

  20. Technical Analysis of the August 14, 2003, Blackout: What Happened, Why, and What Did We Learn? Report to the North American Electric Reliability Council (NERC) Board of Trustees (July 13, 2004)

  21. Gregg, D.M., et al.: Assessing and quantifying denial of service attacks. Proceedings of the Military Communications Conference, pp. 76–80 (MILCOM 2001 Vol. 1)

  22. Smale, S.: Price adjustment and global Newton methods. Frontiers of Quantitative Economics IIIA, 191–205 (1975)

    Google Scholar 

  23. Dabrowski, C.: Investigating resource allocation in a standards-based Grid compute economy. NISTIR 7463. National Institute of Standards and Technology, October 2007

  24. SOAP V1.2 Part 1: Messaging Framework. W3C Recommendation (June 24, 2003)

  25. WS Addressing. BEA Systems, International Business Machines Corporation and Microsoft Corporation (March 2004)

  26. The WS Resource Framework, V 1.0, Computer Associates International, Fujitsu Limited, Hewlett-Packard Development Company, International Business Machines Corporation and the University of Chicago (2004)

  27. Foster, I., et al.: A globus primer describing globus toolkit version 4, Draft May 8, 2005

  28. WS Service Group, V 1.0, Computer Associates International, Fujitsu Limited, Hewlett-Packard Development Company, International Business Machines Corporation and the University of Chicago (March 2004)

  29. Czajkowski, K., et al.: SNAP: a protocol for negotiating service level agreements and coordinating resource management in distributed systems. Job Scheduling Strategies for Parallel Processing. Lect. Notes Comput. Sci. 2537, 153–183 (2002)

    Article  Google Scholar 

  30. Distributed Resource Management Application API Specification. V 1.0 Global Grid Forum (June 2002)

  31. Hovestadt, M., Kao, O., Keller, A., Streit, A.: Scheduling in HPC resource management systems: queuing vs. planning. Job Scheduling Strategies for Parallel Processing. Lect. Notes Comput. Sci. 2862, 1–20 (2003)

    Article  Google Scholar 

  32. Shan, H., Oliker, L. Job superscheduler architecture and performance in computational Grid environments. Proceedings of the 2003 ACM/IEEE Conference on Supercomputing. Phoenix, p. 44 (November 15–21, 2003)

  33. Parallel Workloads Archive. The Hebrew University of Jerusalem. http://www.cs.huji.ac.il/labs/parallel/workload/

  34. Ernemann, C., Krogmann, M., Lepping, J., Yahyapour, R.: Scheduling on the top 50 machines. Proceedings of the 10th Job Scheduling Strategies for Parallel Processing, LNCS, Springer Berlin (3277), pp. 17–46 (2004)

  35. Dey, A.: Orthogonal fractional factorial designs. Technometrics 29, (3), 387–388 (1987) Aug.

    Google Scholar 

  36. Yu, J., Buyya, R.: A taxonomy of workflow management systems for Grid computing. J. Grid Comput. 3, (3–4), 171–200 (2005) September

    Article  Google Scholar 

  37. Czajkowski, K., Foster, I., Kesselman, C.: Resource co-allocation in computational Grids. Proceedings of the 8th IEEE International Symposium on High Performance Distributed Computing (HPDC-8), Redondo Beach, CA, p. 37 (August 3–6, 1999)

Download references

Author information

Authors and Affiliations

  1. National Institute of Standards and Technology, Gaithersburg, MD, USA

    Kevin L. Mills & Christopher Dabrowski

Authors
  1. Kevin L. Mills
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Christopher Dabrowski
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Kevin L. Mills.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Mills, K.L., Dabrowski, C. Can Economics-based Resource Allocation Prove Effective in a Computation Marketplace?. J Grid Computing 6, 291–311 (2008). https://doi.org/10.1007/s10723-007-9094-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10723-007-9094-4

Keywords