Skip to main content

Robustness Analysis of Negotiation Strategies through Multiagent Learning in Repeated Negotiation Games

  • Conference paper
Multiagent System Technologies (MATES 2014)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 8732))

Included in the following conference series:

  • 834 Accesses

Abstract

Automated negotiation techniques play an important role in facilitating human in reaching better negotiation outcomes, and until now lots of research efforts have been devoted to designing effective negotiation strategies. To evaluate the performance of different strategies, one important evaluation criterion is robustness, which is to investigate which negotiating strategies the agents are going to adopt finally if they are given the opportunity to repeatedly negotiate and allowed to change their choices. However the current way of evaluating the robustness suffers from several drawbacks. First, it is assumed that all agents can have access to the global payoff information, which may not be available beforehand in practice. Second, it is based on the single-agent best deviation principle, however, in practice, each agent may change their strategies simultaneously and in any possible rational way. To this end, we firstly propose the repeated negotiation game learning framework to evaluate the robustness of different negotiation strategies, in which each agent can adopt any rational learning approach to make decisions without knowing the global payoff information beforehand. In this way, we are able to provide more realistic and fine-grained robustness analysis and more insights in terms of the relative robustness of different negotiating strategies can be revealed from our analytical results.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Baarslag, T., Fujita, K., Gerding, E.H., Hindriks, K., Ito, T., Jennings, N.R., Jonker, C., Kraus, S., Lin, R., Robu, V., Williams, C.R.: Evaluating practical negotiating agents: Results and analysis of the 2011 international competition. Artificial Intelligence Journal 198, 73–103 (2013)

    Article  Google Scholar 

  2. Baarslag, T., Hindriks, K., Jonker, C., Kraus, S., Lin, R.: The first automated negotiating agents competition (ANAC 2010). In: Ito, T., Zhang, M., Robu, V., Fatima, S., Matsuo, T. (eds.) New Trends in Agent-Based Complex Automated Negotiations. SCI, vol. 383, pp. 113–135. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  3. Bowling, M.H., Veloso, M.M.: Multiagent learning using a variable learning rate. Artificial Intelligence 136, 215–250 (2003)

    Article  MathSciNet  Google Scholar 

  4. Brown, G.: Iterative solution of games by fictitious play. Activity analysis of production and allocation (1951)

    Google Scholar 

  5. Chen, S.Q., Ammar, H.B., Tuyls, K.I., Weiss, G.: Optimizing complex automated negotiation using sparse pseudo-input gaussian processes. In: AAMAS 2013, pp. 707–714 (2013)

    Google Scholar 

  6. Coehoorn, R.M., Jennings, N.R.: Learning an opponent’s preferences to make effective multi-issue negotiation trade-offs. In: ICEC 2004, pp. 59–68 (2004)

    Google Scholar 

  7. Hao, J.Y., Leung, H.F.: Abines: An adaptive bilateral negotiating strategy over multiple items. In: WI-IAT 2012, pp. 95–102 (2012)

    Google Scholar 

  8. Hindriks, K., Tykhonov, D.: Opponent modeling in auomated multi-issue negotiation using bayesian learning. In: AAMAS 2008, pp. 331–338 (2008)

    Google Scholar 

  9. Estelle, J., Wellman, M.P., Singh, S., Vorbeychik, Y., Soni, V.: Strategic interactions in a supply chain game. Computational Intelligence 21(1), 1–26 (2005)

    Article  MathSciNet  Google Scholar 

  10. Saha, S., Biswas, A., Sen, S.: Modeling opponent decision in repeated one-shot negotiations. In: AAMAS 2005, pp. 397–403 (2005)

    Google Scholar 

  11. Sen, S., Airiau, S.: Emergence of norms through social learning. In: IJCAI 2007, pp. 1507–1512 (2007)

    Google Scholar 

  12. Song, J.Y.H.S.Z., Leung, H.F., Ming, Z.: An efficient and robust negotiating strategy in bilateral negotiations over multiple items. Engineering Applications of Artificial Intelligence 34, 45–57 (2014)

    Article  Google Scholar 

  13. Vytelingum, P., Cliff, D., Jennings, N.R.: Strategic bidding in continuous double auctions. Artificial Intelligence 172(14), 1700–1729 (2008)

    Article  MATH  Google Scholar 

  14. Watkins, C.J.C.H., Dayan, P.D.: Q-learning. Machine Learning 3, 279–292 (1992)

    Google Scholar 

  15. Williams, C.R., Robu, V., Gerding, E.H., Jennings, N.R.: Using gaussian processes to optimise concession in complex negotiations against unknown opponents. In: IJCAI 2012, pp. 432–438 (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Hao, J., Chen, S., Weiss, G., Leung, Hf., Tuyls, K. (2014). Robustness Analysis of Negotiation Strategies through Multiagent Learning in Repeated Negotiation Games. In: Müller, J.P., Weyrich, M., Bazzan, A.L.C. (eds) Multiagent System Technologies. MATES 2014. Lecture Notes in Computer Science(), vol 8732. Springer, Cham. https://doi.org/10.1007/978-3-319-11584-9_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-11584-9_4

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-11583-2

  • Online ISBN: 978-3-319-11584-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics