Abstract
In this paper, we propose reputation oriented reinforcement learning algorithms for buying and selling agents in electronic marketplaces. We consider the fact that the quality of a good offered by multiple selling agents may not be the same, and a selling agent may alter the quality of its goods. In our approach, buying agents learn to avoid the risk of purchasing low quality goods and to maximize their expected value of goods by dynamically maintaining sets of reputable and disreputable sellers. Selling agents learn to maximize their expected profits by adjusting product prices and optionally altering the quality of their goods. This paper focusses on presenting results from experiments investigating the behaviour of an e-market populated with our buying and selling agents. Our results show that such a market can reach an equilibrium state where the agent population remains stable, and this equilibrium is optimal for the participant agents.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Chavez, A. and Maes, P., “Kasbah: An Agent Marketplace for Buying and Selling Goods,” inProc. of the First International Conference on the Practical Application of Intelligent Agents and Multi-Agent Technology, 1996.
Breban, S. and Vassileva, J., “Using Inter-agent Trust Relationships for Efficient Coalition Formation,” inProc. of the Fifteenth Conference of the Canadian Society for Computational Studies of Intelligence, pp. 221–236, May 2002.
Davis, R. and Smith, R. G., “Negotiation as a Metaphor for Distributed Problem Solving,” inArtificial Intelligence, 20, 1, pp. 63–109, Jan. 1983.
Ono, N. and Fukumoto, K., “Multi-Agent Reinforcement Learning: A Modular Approach,” inProc. of the Second International Conference on Multi-Agent Systems, pp. 252–258, 1996.
Sen, S., Sekaran, M. and Hale, J., “Learning to Coordinate without Sharing Information,” inProc. of the Twelfth National Conference on Artificial Intelligence, pp. 426–431, 1994.
Vidal, J. M. and Durfee, E. H., “The Impact of Nested Agent Models in an Information Economy,” inProc. of the Second International Conference on Multi-Agent Systems, pp. 377–384, 1996.
Wurman, P. R., Wellman, M. P. and Wash, W. E., “The Michigan Internet AuctionBot: A Configurable Auction Server for Humans and Software Agents,” inProc. of the Second International Conference on Autonomous Agents, pp. 301–308, 1998.
Yu, B. and Singh, M. P., “A Social Mechanism of Reputation Management in Electronic Communities,” inCooperative Information Agents IV (Klusch, M. and Kerschberg, L., eds),Lecture Notes in Artificial Intelligence, Vol. 1860, pp. 154–165, Springer-Verlag, Berlin, 2000.
Author information
Authors and Affiliations
Corresponding author
Additional information
Thomas Tran, Ph.D.: He is an Assistant Professor in the School of Information Technology and Engineering at the University of Ottawa. He received his Ph.D. from the University of Waterloo in 2004. His current research work is on Multi-Agent Systems, Intelligent Agents, Reinforcement Learning, Trust and Reputation Modelling, Agent Negotiation, Mechanism Design and Applications of AI to E-Commerce.
Robin Cohen, Ph.D.: She is a Professor in the School of Computer Science at the University of Waterloo. She received her Ph.D. from the University of Toronto in 1983. Her current research work is on User Modeling, Intelligent Interaction, Multi-Agent Systems, Adjustable Autonomy and Mixed-Initiative Systems and Dialogue, including Applications to E-Commerce.
About this article
Cite this article
Tran, T., Cohen, R. Equilibrium of E-markets populated with reputation oriented learning agents. New Gener Comput 23, 33–41 (2005). https://doi.org/10.1007/BF03037648
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF03037648