Abstract
We propose a reputation oriented reinforcement learning algorithm for buying agents in electronic market environments. We take into account the fact the quality of a good offered by different selling agents may not be the same, and a selling agent may alter the quality of its goods. In our approach, buying agents learn to avoid the risk of purchasing low quality goods and to maximize their expected value of goods by dynamically maintaining sets of reputable and disreputable sellers. Modelling the reputation of sellers allows buying agents to focus on those sellers with whom a certain degree of trust has been established. We also include the ability for buying agents to explore the marketplace in order to discover new reputable sellers. In this paper, we focus on presenting the experimental results that confirm the improved satisfaction for buying agents that model reputation according to our algorithm.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
A. Chavez, and P. Maes. Kasbah: An Agent Marketplace for Buying and Selling Goods. In Proceedings of the First International Conference on the Practical Application of Intelligent Agents and Multi-Agent Technology, 1996.
S. Breban, and J. Vassileva. Using Inter-agent Trust Relationships for Efficient Coalition Formation. In Proceedings of the Fifteenth Conference of the Canadian Society for Computational Studies of Intelligence, pages 221–236, May 2002.
R. Davis, and R. G. Smith. Negotiation as a Metaphor for Distributed Problem Solving. In Artificial Intelligence, 20(1): 63–109, January 1983.
J. Sabater, and C. Sierra. REGRET: A Reputation Model for Gregarious Societies. In Papers from the Fifth International Conference on Autonomous Agents Workshop on Deception, Fraud and Trust in Agent Societies, pages 61–69, 2001.
T. Tran, and R. Cohen. A Reputation-Oriented Reinforcement Learning Strategy for Agents in Electronic Marketplaces. In Computational Intelligence Journal, Special Issue on Agent Technology for Electronic Commerce, to appear in November 2002.
J. M. Vidal, and E. H. Durfee. The Impact of Nested Agent Models in an Information Economy. In Proceedings of the Second International Conference on Multi-Agent Systems, pages 377–384, 1996.
P. R. Wurman, M. P. Wellman, and W. E. Wash. The Michigan Internet Auction-Bot: A Configurable Auction Server for Humans and Software Agents. In Proceedings of the Second International Conference on Autonomous Agents, pages 301–308, 1998.
B. Yu, and M. P. Singh. A Social Mechanism of Reputation Management in Electronic Communities. In M. Klusch and L. Kerschberg, editors, Cooperative Information Agents IV, Lecture Notes in Artificial Intelligence, Vol. 1860, pages 154–165. Springer-Verlag, Berlin, 2000.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tran, T., Cohen, R. (2003). Modelling Reputation in Agent-Based Marketplaces to Improve the Performance of Buying Agents. In: Brusilovsky, P., Corbett, A., de Rosis, F. (eds) User Modeling 2003. UM 2003. Lecture Notes in Computer Science(), vol 2702. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44963-9_36
Download citation
DOI: https://doi.org/10.1007/3-540-44963-9_36
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40381-4
Online ISBN: 978-3-540-44963-8
eBook Packages: Springer Book Archive