Skip to main content
Log in

Autonomous Adaptive Agents for Single Seller Sealed Bid Auctions

  • Published:
Autonomous Agents and Multi-Agent Systems Aims and scope Submit manuscript

Abstract

In developing open, heterogeneous and distributed multi-agent systems researchers often face a problem of facilitating negotiation and bargaining amongst agents. It is increasingly common to use auction mechanisms for negotiation in multi-agent systems. The choice of auction mechanism and the bidding strategy of an agent are of central importance to the success of the agent model. Our aim is to determine the best agent learning algorithm for bidding in a variety of single seller auction structures in both static environments where a known optimal strategy exists and in complex environments where the optimal strategy may be constantly changing. In this paper we present a model of single seller auctions and describe three adaptive agent algorithms to learn strategies through repeated competition. We experiment in a range of auction environments of increasing complexity to determine how well each agent performs, in relation to an optimal strategy in cases where one can be deduced, or in relation to each other in other cases. We find that, with a uniform value distribution, a purely reactive agent based on Cliff’s ZIP algorithm for continuous double auctions (CDA) performs well, although is outperformed in some cases by a memory based agent based on the Gjerstad Dickhaut agent for CDA.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. P. Anthony N. R Jennings (2003) ArticleTitle“Developing a bidding agent for multiple heterogeneous auctions” ACM Trans. Internet Technol. 3 IssueID3 185–217

    Google Scholar 

  2. D. Ariely, A. Ockenfels, and A. E. Roth, An experimental analysis of ending rules in internet auctions. Published by Max Planck Institute for Research into Economic Systems, Strategic Interaction Group, Discussion Papers on Strategic Interaction, 2002.

  3. A. J. Bagnall and I. E Toft, “An agent model for first price and second price private value auctions”, in Proceedings of the 6th International Conference on Artificial Evolution, pp. 145–156, 2003.

  4. A. J. Bagnall and I. E Toft, “Zero intelligence plus and Gjerstad–Dickhaut agents for sealed bid auctions”, in Workshop on Trading Agent Design and Analysis, part of International Conference on Autonomous Agents and Multiagent Systems (AAMAS-2004), pp. 59–64, 2004.

  5. F. Brandt and G. Weiss, “Antisocial agents and Vickrey auctions”, in Revised Papers from the 8th International Workshop on Intelligent Agents VIII, Springer-Verlag, pp. 335–347, 2002.

  6. P. J. Brewer, M. Huang, B. Nelson and C.R. Plott, On the Behavioral Foundations of the Law of Supply and Demand: Human Convergence and Robot Randomness California Institute of Technology, Social Science Working Paper 1079, 1999.

  7. S.-F. Cheng E. Leung K. M. Lochner K. O’Malley D. M. Reeves L. J. Schvartzman M. P. Wellman (2005) ArticleTitle“Walverine: a Walrasian trading agent” Decision Support Syst. 39 169–184 Occurrence Handle10.1016/j.dss.2003.10.005

    Article  Google Scholar 

  8. S. H. Clearwater, Market-Based Control: A Paradigm for Distributed Resource Allocation. World Scientific Publishing Co., Inc., 1996

  9. D. Cliff and J. Bruten, Minimal-Intelligence Agents for Bargaining Behaviours in Market-Based Environments. Technical Report, HP Labs, June 1997.

  10. K. E. Drexler and M. S. Miller, “Incentive engineering for computational resource management”, in B. A. Huberman (ed.), The Ecology of Computation, 1988.

  11. J. D. Farmer, P. Patelli, and I. I. Zovko, The Predictive Power of Zero Intelligence in Financial Markets AFA 2004 San Diego Meetings, 2004.

  12. M. A. Gibney, N. R. Jennings, N. J. Vriend, and J. M. Griffiths, “Market-based call routing in telecommunications networks using adaptive pricing and real bidding”, in Proceedings of the Third International Workshop on Intelligent Agents for Telecommunications Applications, pp. 50–65, 1999.

  13. S. Gjerstad J. Dickhaut (1998) ArticleTitle“Price formation in double auctions” Games Econ. Behav. 22 IssueID1 1–29 Occurrence Handle10.1006/game.1997.0576 Occurrence Handle1604776 Occurrence Handle0892.90050

    Article  MathSciNet  MATH  Google Scholar 

  14. D. K. Gode S. Sunder (1993) ArticleTitle“Allocative efficiency of markets with zero intelligence traders: market as a partial substitute for individual rationality” J. of Political Econ. 101 IssueID1 119–137

    Google Scholar 

  15. A. Greenwald P. Stone (2001) ArticleTitle“Autonomous bidding agents in the trading agent competition” IEEE Internet Comput. 5 IssueID2 52–60 Occurrence Handle10.1109/4236.914648

    Article  Google Scholar 

  16. J. Grossklags, C. Schmidt, and J. Siegel, Dumb Software Agents on an Experimental Asset Market Working Paper, School of Information and Management Systems, UC Berkeley, 2000.

  17. M. He H. Leung N. R. Jennings (2003) ArticleTitle“A fuzzy logic based bidding strategy for autonomous agents in continuous double auctions” IEEE Trans. Knowledge Data Eng. 15 IssueID6 1345–1363

    Google Scholar 

  18. M. He N. R. Jennings (2003) ArticleTitle“SouthamptonTAC: an adaptive autonomous trading agent” ACM Trans. Internet Technol. 3 IssueID3 218–235

    Google Scholar 

  19. M. He N. R. Jennings (2004) ArticleTitle“Designing a successful trading agent: a fuzzy set approach” IEEE Trans. Fuzzy Syst. 12 IssueID3 389–410 Occurrence Handle10.1109/TFUZZ.2004.825064

    Article  Google Scholar 

  20. M. He N. R. Jennings H. Leung (2003) ArticleTitle“On agent-mediated electronic commerce” IEEE Trans. Knowledge Data Eng. 15 IssueID4 985–1003

    Google Scholar 

  21. W. Hsu and V. Soo, “Market performance of adaptive trading agents in synchronous double auctions”, in Proceedings of the 4th Pacific Rim International Workshop on Multi-Agents, Intelligent Agents, Springer-Verlag, pp. 108–121, 2001.

  22. M. P. Wellman J. Hu (1998) ArticleTitle“Conjectural equilibrium in multiagent learning” Machine Learning 3 IssueID2–3 179–200

    Google Scholar 

  23. J. Hu and M. P. Wellman, “Online learning about other agents in a dynamic multiagent system”, in Proceedings of the Second International Conference on Autonomous Agents, ACM Press, pp. 239–246, 1998.

  24. B. Huberman and S. H. Clearwater, “A multiagent system for controlling building environments”, in Proceedings of the First International Conference on Multiagent Systems, pp. 171–176, 1995.

  25. N. R. Jennings, M. He, and A. Prugel-Bennett. “An adaptive bidding agent for multiple english auctions a neuro-fuzzy approach”, in Proceedings of the IEEE Conference on Fuzzy Systems, Budapest, Hungary, 2004.

  26. J. H. Kagel and A. E. Roth (eds.), The Handbook of Experimental Economics. Princeton University Press, 1995.

  27. P. Klemperer (1999) ArticleTitle“Auction theory: a guide to the literature” J. Econ. Surveys 13 IssueID3 227–286 Occurrence Handle10.1111/1467-6419.00083

    Article  Google Scholar 

  28. V. Krishna, Auction Theory, Academic Press: San Diego, California, 2002.

  29. L. Li and S. F. Smith, “Speculation agents for dynamic multi-period continuous double auctions in B2B exchanges”, in Proceedings of the 37th Annual Hawaii International Conference on System Sciences (HICSS’04), 2004.

  30. M. Luck, P. McBurney, and C. Priest, Agent Technology: Enabling Next Generation Computing. A Roadmap for Agent Based Computing . AgentLink, England, 2003.

  31. D. Lucking-Reiley, “Using field experiments to test equivalence between auction formats: magic on the internet”, Am. Econ. Rev., 1999.

  32. R. P. McAfee J. McMillan (1987) ArticleTitle“Auctions and bidding” J. Econ. Literature 25 699–738

    Google Scholar 

  33. S. Park, E. H. Durfee, and W. P. Birmingham, “An adaptive agent bidding strategy based on stochastic modelling”, in Proceedings of the Third International Conference on Autonomous Agents, pp. 147–153, 1999.

  34. C. W. Pawlowski, A. M. Bell, S. Crawford, W. A. Sethares, and C. Finn, “An adaptive agent bidding strategy based on stochastic modelling”, in Proceedings of 31st International Conference on Environmental Systems, 2001.

  35. R. Porter Y. Shoham (2004) ArticleTitle“On cheating in sealed-bid auctions” J. Decision Support Syst. 35 41–54

    Google Scholar 

  36. C. Preist, A. Byde, and C. Bartolini, “Economic dynamics of agents in multiple auctions”, in Proceedings of the 5th International conference on Autonomous Agents, 2001, pp. 545–551.

  37. C. Preist and M. van Tol, “Adaptive agents in a persistent shout double auction”, in Proceedings of the First International Conference on Information and Computation Economies, ACM Press, pp. 11–18, 1998.

  38. A. E. Roth and A. Ockenfels, “Last-minute bidding and the rules for ending second-price auctions: evidence from eBay and Amazon on the internet Am. Econ. Rev., 2003 (Forthcoming).

  39. J. Rust J. Miller R. Palmer (1991) “The Double auction market institution: a survey” D. Friedman J. Rust (Eds) The Double Auction Market Institutions, Theories, and Evidence: Proceedings of the Workshop on Double Auction Markets Held June, 1991 in Santa Fe, New Mexico. Santa Fe Institute Addison-Wesley

    Google Scholar 

  40. J. Rust J. Miller R. Palmer (1991) “Behaviour of trading automata in a computerized double auction market” D. Friedman J. Rust (Eds) The Double Auction Market Institutions, Theories, and Evidence: Proceedings of the Workshop on Double Auction Markets Held June, 1991 in Santa Fe, New Mexico. Santa Fe Institute Addison-Wesley

    Google Scholar 

  41. R. Smith, “The Contract Net Protocol: high-level communication and control in a distributed problem solver,” IEEE Trans. Computers, vol. C-29, no. 12, pp. 1104–1113, 1980.

  42. V. Smith (1962) ArticleTitle“An experimental study of market behavior” J. Polit. Econ. 70 IssueID2 111–137 Occurrence Handle10.1086/258609

    Article  Google Scholar 

  43. M. D. Springer, The Algebra of Random Variables, John Wiley & Sons, 1979.

  44. P. Stone M. L. Littman S. Singh M. Kearns (2001) ArticleTitle“ATTac-2000: an adaptive autonomous bidding agent” J. Artif. Intell. Res. 15 189–206 Occurrence Handle0994.68575

    MATH  Google Scholar 

  45. G. Tesauro and D. Bredin, “Strategic sequential bidding in auctions using dynamic programming”, in AAMAS, Bolgna, Italy, 2002. ACM.

  46. G. Tesauro and R. Das, “High-performance bidding agents for the continuous double auction”, in Third ACM Conference on Electronic Commerce, pp. 206–209, 2001.

  47. I.E. Toft and A. J. Bagnall, Adaptive Agents for Simulated Sealed Bid Auctions. Technical Report CMP-C04-03, School of Computing Sciences, University of East Anglia, 2004.

  48. W. Vickrey (1961) ArticleTitle“Counterspeculation, auctions, and competitive sealed tenders” J. Finance 16 8–37

    Google Scholar 

  49. J. M. Vidal and E. H. Durfee, “The impact of nested agent models in an information economy”, in Proceedings of the Second International Conference on Multi-Agent Systems, pp. 377–384, 1996.

  50. P. Vytelingum, R. K. Dash, E. David, and N. R. Jennings, “A risk-based bidding strategy for continuous double auctions”, in Proceedings of the 16th European Conference on Artificial Intelligence , Valencia, Spain, 2004.

  51. C. A. Waldsburger T. Hogg B. Huberman J. O. Kephart S. Stornetta (1992) ArticleTitle“Spawn: a distributed computational economy” IEEE Trans. Software Eng. 18 IssueID2 103–117

    Google Scholar 

  52. M. Wooldridge N. R. Jennings (1995) ArticleTitle“Intelligent agents: theory and practice” Knowledge Eng. Rev. 10 IssueID2 115–152

    Google Scholar 

  53. G. Zuckerman, “Google shares prove winners at least for a day”, Wall Street J., 20 Aug. 2004: (C1, C3).

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Anthony Bagnall.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Bagnall, A., Toft, I. Autonomous Adaptive Agents for Single Seller Sealed Bid Auctions. Auton Agent Multi-Agent Syst 12, 259–292 (2006). https://doi.org/10.1007/s10458-005-4948-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10458-005-4948-2

Keywords

Navigation