Abstract
In developing open, heterogeneous and distributed multi-agent systems researchers often face a problem of facilitating negotiation and bargaining amongst agents. It is increasingly common to use auction mechanisms for negotiation in multi-agent systems. The choice of auction mechanism and the bidding strategy of an agent are of central importance to the success of the agent model. Our aim is to determine the best agent learning algorithm for bidding in a variety of single seller auction structures in both static environments where a known optimal strategy exists and in complex environments where the optimal strategy may be constantly changing. In this paper we present a model of single seller auctions and describe three adaptive agent algorithms to learn strategies through repeated competition. We experiment in a range of auction environments of increasing complexity to determine how well each agent performs, in relation to an optimal strategy in cases where one can be deduced, or in relation to each other in other cases. We find that, with a uniform value distribution, a purely reactive agent based on Cliff’s ZIP algorithm for continuous double auctions (CDA) performs well, although is outperformed in some cases by a memory based agent based on the Gjerstad Dickhaut agent for CDA.
Similar content being viewed by others
References
P. Anthony N. R Jennings (2003) ArticleTitle“Developing a bidding agent for multiple heterogeneous auctions” ACM Trans. Internet Technol. 3 IssueID3 185–217
D. Ariely, A. Ockenfels, and A. E. Roth, An experimental analysis of ending rules in internet auctions. Published by Max Planck Institute for Research into Economic Systems, Strategic Interaction Group, Discussion Papers on Strategic Interaction, 2002.
A. J. Bagnall and I. E Toft, “An agent model for first price and second price private value auctions”, in Proceedings of the 6th International Conference on Artificial Evolution, pp. 145–156, 2003.
A. J. Bagnall and I. E Toft, “Zero intelligence plus and Gjerstad–Dickhaut agents for sealed bid auctions”, in Workshop on Trading Agent Design and Analysis, part of International Conference on Autonomous Agents and Multiagent Systems (AAMAS-2004), pp. 59–64, 2004.
F. Brandt and G. Weiss, “Antisocial agents and Vickrey auctions”, in Revised Papers from the 8th International Workshop on Intelligent Agents VIII, Springer-Verlag, pp. 335–347, 2002.
P. J. Brewer, M. Huang, B. Nelson and C.R. Plott, On the Behavioral Foundations of the Law of Supply and Demand: Human Convergence and Robot Randomness California Institute of Technology, Social Science Working Paper 1079, 1999.
S.-F. Cheng E. Leung K. M. Lochner K. O’Malley D. M. Reeves L. J. Schvartzman M. P. Wellman (2005) ArticleTitle“Walverine: a Walrasian trading agent” Decision Support Syst. 39 169–184 Occurrence Handle10.1016/j.dss.2003.10.005
S. H. Clearwater, Market-Based Control: A Paradigm for Distributed Resource Allocation. World Scientific Publishing Co., Inc., 1996
D. Cliff and J. Bruten, Minimal-Intelligence Agents for Bargaining Behaviours in Market-Based Environments. Technical Report, HP Labs, June 1997.
K. E. Drexler and M. S. Miller, “Incentive engineering for computational resource management”, in B. A. Huberman (ed.), The Ecology of Computation, 1988.
J. D. Farmer, P. Patelli, and I. I. Zovko, The Predictive Power of Zero Intelligence in Financial Markets AFA 2004 San Diego Meetings, 2004.
M. A. Gibney, N. R. Jennings, N. J. Vriend, and J. M. Griffiths, “Market-based call routing in telecommunications networks using adaptive pricing and real bidding”, in Proceedings of the Third International Workshop on Intelligent Agents for Telecommunications Applications, pp. 50–65, 1999.
S. Gjerstad J. Dickhaut (1998) ArticleTitle“Price formation in double auctions” Games Econ. Behav. 22 IssueID1 1–29 Occurrence Handle10.1006/game.1997.0576 Occurrence Handle1604776 Occurrence Handle0892.90050
D. K. Gode S. Sunder (1993) ArticleTitle“Allocative efficiency of markets with zero intelligence traders: market as a partial substitute for individual rationality” J. of Political Econ. 101 IssueID1 119–137
A. Greenwald P. Stone (2001) ArticleTitle“Autonomous bidding agents in the trading agent competition” IEEE Internet Comput. 5 IssueID2 52–60 Occurrence Handle10.1109/4236.914648
J. Grossklags, C. Schmidt, and J. Siegel, Dumb Software Agents on an Experimental Asset Market Working Paper, School of Information and Management Systems, UC Berkeley, 2000.
M. He H. Leung N. R. Jennings (2003) ArticleTitle“A fuzzy logic based bidding strategy for autonomous agents in continuous double auctions” IEEE Trans. Knowledge Data Eng. 15 IssueID6 1345–1363
M. He N. R. Jennings (2003) ArticleTitle“SouthamptonTAC: an adaptive autonomous trading agent” ACM Trans. Internet Technol. 3 IssueID3 218–235
M. He N. R. Jennings (2004) ArticleTitle“Designing a successful trading agent: a fuzzy set approach” IEEE Trans. Fuzzy Syst. 12 IssueID3 389–410 Occurrence Handle10.1109/TFUZZ.2004.825064
M. He N. R. Jennings H. Leung (2003) ArticleTitle“On agent-mediated electronic commerce” IEEE Trans. Knowledge Data Eng. 15 IssueID4 985–1003
W. Hsu and V. Soo, “Market performance of adaptive trading agents in synchronous double auctions”, in Proceedings of the 4th Pacific Rim International Workshop on Multi-Agents, Intelligent Agents, Springer-Verlag, pp. 108–121, 2001.
M. P. Wellman J. Hu (1998) ArticleTitle“Conjectural equilibrium in multiagent learning” Machine Learning 3 IssueID2–3 179–200
J. Hu and M. P. Wellman, “Online learning about other agents in a dynamic multiagent system”, in Proceedings of the Second International Conference on Autonomous Agents, ACM Press, pp. 239–246, 1998.
B. Huberman and S. H. Clearwater, “A multiagent system for controlling building environments”, in Proceedings of the First International Conference on Multiagent Systems, pp. 171–176, 1995.
N. R. Jennings, M. He, and A. Prugel-Bennett. “An adaptive bidding agent for multiple english auctions a neuro-fuzzy approach”, in Proceedings of the IEEE Conference on Fuzzy Systems, Budapest, Hungary, 2004.
J. H. Kagel and A. E. Roth (eds.), The Handbook of Experimental Economics. Princeton University Press, 1995.
P. Klemperer (1999) ArticleTitle“Auction theory: a guide to the literature” J. Econ. Surveys 13 IssueID3 227–286 Occurrence Handle10.1111/1467-6419.00083
V. Krishna, Auction Theory, Academic Press: San Diego, California, 2002.
L. Li and S. F. Smith, “Speculation agents for dynamic multi-period continuous double auctions in B2B exchanges”, in Proceedings of the 37th Annual Hawaii International Conference on System Sciences (HICSS’04), 2004.
M. Luck, P. McBurney, and C. Priest, Agent Technology: Enabling Next Generation Computing. A Roadmap for Agent Based Computing . AgentLink, England, 2003.
D. Lucking-Reiley, “Using field experiments to test equivalence between auction formats: magic on the internet”, Am. Econ. Rev., 1999.
R. P. McAfee J. McMillan (1987) ArticleTitle“Auctions and bidding” J. Econ. Literature 25 699–738
S. Park, E. H. Durfee, and W. P. Birmingham, “An adaptive agent bidding strategy based on stochastic modelling”, in Proceedings of the Third International Conference on Autonomous Agents, pp. 147–153, 1999.
C. W. Pawlowski, A. M. Bell, S. Crawford, W. A. Sethares, and C. Finn, “An adaptive agent bidding strategy based on stochastic modelling”, in Proceedings of 31st International Conference on Environmental Systems, 2001.
R. Porter Y. Shoham (2004) ArticleTitle“On cheating in sealed-bid auctions” J. Decision Support Syst. 35 41–54
C. Preist, A. Byde, and C. Bartolini, “Economic dynamics of agents in multiple auctions”, in Proceedings of the 5th International conference on Autonomous Agents, 2001, pp. 545–551.
C. Preist and M. van Tol, “Adaptive agents in a persistent shout double auction”, in Proceedings of the First International Conference on Information and Computation Economies, ACM Press, pp. 11–18, 1998.
A. E. Roth and A. Ockenfels, “Last-minute bidding and the rules for ending second-price auctions: evidence from eBay and Amazon on the internet Am. Econ. Rev., 2003 (Forthcoming).
J. Rust J. Miller R. Palmer (1991) “The Double auction market institution: a survey” D. Friedman J. Rust (Eds) The Double Auction Market Institutions, Theories, and Evidence: Proceedings of the Workshop on Double Auction Markets Held June, 1991 in Santa Fe, New Mexico. Santa Fe Institute Addison-Wesley
J. Rust J. Miller R. Palmer (1991) “Behaviour of trading automata in a computerized double auction market” D. Friedman J. Rust (Eds) The Double Auction Market Institutions, Theories, and Evidence: Proceedings of the Workshop on Double Auction Markets Held June, 1991 in Santa Fe, New Mexico. Santa Fe Institute Addison-Wesley
R. Smith, “The Contract Net Protocol: high-level communication and control in a distributed problem solver,” IEEE Trans. Computers, vol. C-29, no. 12, pp. 1104–1113, 1980.
V. Smith (1962) ArticleTitle“An experimental study of market behavior” J. Polit. Econ. 70 IssueID2 111–137 Occurrence Handle10.1086/258609
M. D. Springer, The Algebra of Random Variables, John Wiley & Sons, 1979.
P. Stone M. L. Littman S. Singh M. Kearns (2001) ArticleTitle“ATTac-2000: an adaptive autonomous bidding agent” J. Artif. Intell. Res. 15 189–206 Occurrence Handle0994.68575
G. Tesauro and D. Bredin, “Strategic sequential bidding in auctions using dynamic programming”, in AAMAS, Bolgna, Italy, 2002. ACM.
G. Tesauro and R. Das, “High-performance bidding agents for the continuous double auction”, in Third ACM Conference on Electronic Commerce, pp. 206–209, 2001.
I.E. Toft and A. J. Bagnall, Adaptive Agents for Simulated Sealed Bid Auctions. Technical Report CMP-C04-03, School of Computing Sciences, University of East Anglia, 2004.
W. Vickrey (1961) ArticleTitle“Counterspeculation, auctions, and competitive sealed tenders” J. Finance 16 8–37
J. M. Vidal and E. H. Durfee, “The impact of nested agent models in an information economy”, in Proceedings of the Second International Conference on Multi-Agent Systems, pp. 377–384, 1996.
P. Vytelingum, R. K. Dash, E. David, and N. R. Jennings, “A risk-based bidding strategy for continuous double auctions”, in Proceedings of the 16th European Conference on Artificial Intelligence , Valencia, Spain, 2004.
C. A. Waldsburger T. Hogg B. Huberman J. O. Kephart S. Stornetta (1992) ArticleTitle“Spawn: a distributed computational economy” IEEE Trans. Software Eng. 18 IssueID2 103–117
M. Wooldridge N. R. Jennings (1995) ArticleTitle“Intelligent agents: theory and practice” Knowledge Eng. Rev. 10 IssueID2 115–152
G. Zuckerman, “Google shares prove winners at least for a day”, Wall Street J., 20 Aug. 2004: (C1, C3).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Bagnall, A., Toft, I. Autonomous Adaptive Agents for Single Seller Sealed Bid Auctions. Auton Agent Multi-Agent Syst 12, 259–292 (2006). https://doi.org/10.1007/s10458-005-4948-2
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10458-005-4948-2