Abstract
Automated negotiation techniques play an important role in facilitating human in reaching better negotiation outcomes, and until now lots of research efforts have been devoted to designing effective negotiation strategies. To evaluate the performance of different strategies, one important evaluation criterion is robustness, which is to investigate which negotiating strategies the agents are going to adopt finally if they are given the opportunity to repeatedly negotiate and allowed to change their choices. However the current way of evaluating the robustness suffers from several drawbacks. First, it is assumed that all agents can have access to the global payoff information, which may not be available beforehand in practice. Second, it is based on the single-agent best deviation principle, however, in practice, each agent may change their strategies simultaneously and in any possible rational way. To this end, we firstly propose the repeated negotiation game learning framework to evaluate the robustness of different negotiation strategies, in which each agent can adopt any rational learning approach to make decisions without knowing the global payoff information beforehand. In this way, we are able to provide more realistic and fine-grained robustness analysis and more insights in terms of the relative robustness of different negotiating strategies can be revealed from our analytical results.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Baarslag, T., Fujita, K., Gerding, E.H., Hindriks, K., Ito, T., Jennings, N.R., Jonker, C., Kraus, S., Lin, R., Robu, V., Williams, C.R.: Evaluating practical negotiating agents: Results and analysis of the 2011 international competition. Artificial Intelligence Journal 198, 73–103 (2013)
Baarslag, T., Hindriks, K., Jonker, C., Kraus, S., Lin, R.: The first automated negotiating agents competition (ANAC 2010). In: Ito, T., Zhang, M., Robu, V., Fatima, S., Matsuo, T. (eds.) New Trends in Agent-Based Complex Automated Negotiations. SCI, vol. 383, pp. 113–135. Springer, Heidelberg (2012)
Bowling, M.H., Veloso, M.M.: Multiagent learning using a variable learning rate. Artificial Intelligence 136, 215–250 (2003)
Brown, G.: Iterative solution of games by fictitious play. Activity analysis of production and allocation (1951)
Chen, S.Q., Ammar, H.B., Tuyls, K.I., Weiss, G.: Optimizing complex automated negotiation using sparse pseudo-input gaussian processes. In: AAMAS 2013, pp. 707–714 (2013)
Coehoorn, R.M., Jennings, N.R.: Learning an opponent’s preferences to make effective multi-issue negotiation trade-offs. In: ICEC 2004, pp. 59–68 (2004)
Hao, J.Y., Leung, H.F.: Abines: An adaptive bilateral negotiating strategy over multiple items. In: WI-IAT 2012, pp. 95–102 (2012)
Hindriks, K., Tykhonov, D.: Opponent modeling in auomated multi-issue negotiation using bayesian learning. In: AAMAS 2008, pp. 331–338 (2008)
Estelle, J., Wellman, M.P., Singh, S., Vorbeychik, Y., Soni, V.: Strategic interactions in a supply chain game. Computational Intelligence 21(1), 1–26 (2005)
Saha, S., Biswas, A., Sen, S.: Modeling opponent decision in repeated one-shot negotiations. In: AAMAS 2005, pp. 397–403 (2005)
Sen, S., Airiau, S.: Emergence of norms through social learning. In: IJCAI 2007, pp. 1507–1512 (2007)
Song, J.Y.H.S.Z., Leung, H.F., Ming, Z.: An efficient and robust negotiating strategy in bilateral negotiations over multiple items. Engineering Applications of Artificial Intelligence 34, 45–57 (2014)
Vytelingum, P., Cliff, D., Jennings, N.R.: Strategic bidding in continuous double auctions. Artificial Intelligence 172(14), 1700–1729 (2008)
Watkins, C.J.C.H., Dayan, P.D.: Q-learning. Machine Learning 3, 279–292 (1992)
Williams, C.R., Robu, V., Gerding, E.H., Jennings, N.R.: Using gaussian processes to optimise concession in complex negotiations against unknown opponents. In: IJCAI 2012, pp. 432–438 (2012)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Hao, J., Chen, S., Weiss, G., Leung, Hf., Tuyls, K. (2014). Robustness Analysis of Negotiation Strategies through Multiagent Learning in Repeated Negotiation Games. In: Müller, J.P., Weyrich, M., Bazzan, A.L.C. (eds) Multiagent System Technologies. MATES 2014. Lecture Notes in Computer Science(), vol 8732. Springer, Cham. https://doi.org/10.1007/978-3-319-11584-9_4
Download citation
DOI: https://doi.org/10.1007/978-3-319-11584-9_4
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-11583-2
Online ISBN: 978-3-319-11584-9
eBook Packages: Computer ScienceComputer Science (R0)