Skip to main content
SpringerLink
Log in

Exploration costs as a means for improving performance in multiagent systems

  • Published:
Annals of Mathematics and Artificial Intelligence Aims and scope Submit manuscript

Abstract

We consider settings were agents are faced with several possible opportunities and need to choose one. Each opportunity may offer a different utility to the agent, and determining this utility may consume resources. The underlying costly exploration problem is termed “economic search”, though its essence is different from the traditional search notion in artificial intelligence (e.g. BFS, IDDFA, and A*), as there is no underlying combinatorial structure to the opportunities. We study the effects that search costs can have on individual and aggregate utility in distributed multi-agent economic-search settings. Traditionally, in such setting, search costs are regarded as a market inefficiency, and, as such, as something to be avoided or reduced to a minimum. We show, in contrast, that in many search settings, the introduction of search costs can actually improve the aggregate social welfare, or even the expected utility of each and every individual agent.We note that the proceeds from the search costs are assumed to be wasted, with no one directly benefiting from them. We demonstrate the benefits of search costs in both one-sided and two-sided search settings, using standard, classical models from economic-search theory. For the designers of multiagent systems, the results imply that deliberate (and potentially artificial) increase of search costs should be considered as possible means to improving the system’s overall performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Anshelevich, E., Das, S., Naamad, Y.: Anarchy, stability, and utopia: creating better matchings. Auton. Agent. Multi-Agent Syst. 26(1), 120–140 (2013)

    Article  Google Scholar 

  2. Atakan, A.: Assortative matching with explicit search costs. Econometrica 74(3), 667–680 (2006)

    Article  MATH  MathSciNet  Google Scholar 

  3. Attane, M., Garcia, I., Martinez, J., Papi, J.: Tecapsy - trans european car-pooling and parking systems. In: The Sustainable City II: Urban Regeneration and Sustainability (2002)

  4. Azaria, A., Sarne, D., Aumann, Y.: Distributed matching with mixed maximum-minimum utilities. In: Proceedings of Web Intelligence and Intelligent Agent Technology (WI-IAT), pages 134–139 (2012)

  5. Bakos, J.Y.: Reducing buyer search costs: Implications for electronic marketplaces. Manag. Sci. 42(12), 1676–1692 (1997)

    Article  Google Scholar 

  6. Bakos, Y.: The emerging role of electronic marketplaces on the internet. Communication of the ACM 41(8), 35–42 (1998)

    Article  Google Scholar 

  7. Baye, M.R., Morgan, J., Scholten, P.: Temporal price dispersion: Evidence from an online consumer electronics market. J. Interact. Mark. 18(4), 101–115 (2004)

    Article  Google Scholar 

  8. Baye, M.R., Morgan, J., Scholten, P.: Persistent price dispersion in online markets. In: Jansen, D. (ed.) The New Economy and Beyond. Edward Elgar Press, Northampton (2006)

    Google Scholar 

  9. Becker, G.S.: A theory of marriage: Part i. J. Polit. Econ. 81(4), 813–846 (1973)

    Article  Google Scholar 

  10. Benhabib, J., Bull, C.: Job search: The choice of intensity. J. Polit. Econ. 91, 747–764 (1983)

    Article  Google Scholar 

  11. Brynjolfsson, E., Hu, Y.J., Smith, M.D.: Consumer surplus in the digital economy: Estimating the value of increased product variety at online bookseller. Manag. Sci. 49(11), 1580–1596 (2003)

    Article  Google Scholar 

  12. Burdett, K., Coles, M.: Long-term partnership formation: marriage and employment. Econ. J. 109(456), 307–334 (1999)

    Article  Google Scholar 

  13. Burdett, K., Wright, R.: Two-sided search with nontransferable utility. Rev. Econ. Dyn. 1, 220–245 (1998)

    Article  MathSciNet  Google Scholar 

  14. Carrillo, P.: An empirical stationary equilibrium search model of the housing market*. Int. Econ. Rev. 53(1), 203–234 (2012)

    Article  MathSciNet  Google Scholar 

  15. Chade, H.: Two-sided search and perfect segregation with fixed search costs. Math. Soc. Sci. 42(1), 31–51 (2001)

    Article  MATH  MathSciNet  Google Scholar 

  16. Chade, H., Ventura, G.: On income taxation and marital decisions. Rev. Econ. Dyn. 8(3), 565–599 (2005)

    Article  Google Scholar 

  17. Chhabra, M., Das, S., Sarne, D.: Expert-mediated search. In: Proceedings of the 10th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2011), pp 415–422 (2011)

  18. Choi, S., Liu, J.: Optimal time-constrained trading strategies for autonomous agents. In: Proceedings of the International ICSC Symposium on Multi-agents and Mobile Agents in Virtual Organizations and E-commerce (MAMA’2000) (2000)

  19. Clay, K., Krishnan, R., Wolff, E., D. Fernandes: Retail strategies on the web: Price and non-price competition in the online book industry. J. Ind. Econ. 50, 351–367 (2002)

    Article  Google Scholar 

  20. Das, S., Kamenica, E.: Two-sided bandits and the dating market. In: Proceedings of the Nineteenth International Joint Conference on Artificial Intelligence (IJCAI-05), pp 947–952 (2005)

  21. Decker, K., Sycara, K., Williamson, M.: Middle-agents for the internet. In: Proceedings of the Fifteenth International Joint Conference on Artificial Intelligence (IJCAI-97), pp 578–583 (1997)

  22. Endriss, U., Kraus, S., Lang, J., Wooldridge, M.: Designing incentives for boolean games. In: Proceedings of the 10th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2011), pp 79–86 (2011)

  23. Ferguson, T.S.: Who solved the secretary problem Stat. Sci. 4 (3), 282–289 (1989)

    Article  MathSciNet  Google Scholar 

  24. Fontnouvelle, P.D.: Information dynamics in financial markets. Macroecon. Dyn. 4 (02), 139–169 (2000)

    Article  MATH  Google Scholar 

  25. Fotakis, D., Karakostas, G., Kolliopoulos, S.G.: On the existence of optimal taxes for network congestion games with heterogeneous users. In: Proceedings of the 3rd International Symposium on Algorithmic Game Theory (SAGT’10), pp 162–173 (2010)

  26. Gal, S., Landsberger, M., Levykson, B.: A compound strategy for search in the labor market. Int. Econ. Rev. 22(3), 597–608 (1981)

    Article  MATH  Google Scholar 

  27. Gale, D., Shapley, L.: College admissions and the stability of marriage. The American Mathematical Monthly 69, 9–15 (1962)

    Article  MATH  MathSciNet  Google Scholar 

  28. Hajaj, C., Hazon, N., Sarne, D., Elmalech, A.: Search more, disclose less. In: Proceedings of the Twenty-Seventh AAAI Conference on Artificial Intelligence (2013)

  29. Huang, J., Kazeykina, A.: Optimal strategies for reviewing search results. In: Proceedings of the Twenty-Fourth AAAI Conference on Artificial Intelligence (AAAI 2010) (2010)

  30. Janssen, M., Moraga-Gonzalez, J.L., Wildenbeest, M.R.: Truly costly sequential search and oligopolistic pricing. Int. J. Ind. Organ. 23(5-6), 451–466 (2005)

    Article  Google Scholar 

  31. Kephart, J.O., Greenwald, A.R.: Shopbot economics. Auton. Agent. Multi-Agent Syst. 5(3), 255–287 (2002)

    Article  MathSciNet  Google Scholar 

  32. Landsberger, M., Peled, D.: Duration of offers, price structure, and the gain from search. J. Econ. Theory 16(1), 17–37 (1977)

    Article  MATH  MathSciNet  Google Scholar 

  33. Lippman, S.A., McCall, J.J.: The economics of job search: A survey. Econ. Inq. 14(3), 155–189 (1976)

    Article  MathSciNet  Google Scholar 

  34. Manisterski, E., Sarne, D., Kraus, S.: Cooperative search with concurrent interactions. J. Artif. Intell. Res. (JAIR) 32, 1–36 (2008)

    MATH  MathSciNet  Google Scholar 

  35. Masters, A.M.: Wage posting in two-sided search and the minimum wage. Int. Econ. Rev. 40(4), 809–826 (1999)

    Article  Google Scholar 

  36. McMillan, J., M. Rothschild, S. Hart: Search. In: R. Aumann (ed.) Handbook of Game Theory with Economic Applications, chapter 27, pp 905–927 (1994)

  37. McNamara, J.M., Collins, E.J.: The job search problem as an employer-candidate game. J. Appl. Probab. 27(4) (1990)

  38. Morgan, P.: Search and optimal sample size. Rev. Econ. Stud. 50(4), 659–675 (1983)

    Article  MATH  Google Scholar 

  39. Morgan, P.: A model of search, coordination, and market segmentation. mimeo, SUNY Buffalo (1995)

  40. Morgan, P., Manning, R.: Optimal search. Econometrica 53(4), 923–944 (1985)

    Article  MATH  MathSciNet  Google Scholar 

  41. Mortensen, D.T.: Markets with search friction and the dmp model. Am. Econ. Rev. 101(4), 1073–91 (2011)

    Article  Google Scholar 

  42. Nahum, Y., Sarne, D., Das, S., Shehory, O.: Two-sided search with experts. In: Proceedings of ACM Conference on Electronic Commerce, pp 754–771 (2012)

  43. Nguyen, T., Roos, M., Rothe, J.: A survey of approximability and inapproximability results for social welfare optimization in multiagent resource allocation . Ann. Math. Artif. Intell. 68(1–3), 65–90 (2013)

  44. Penn, M., Polukarov, M., Tennenholtz, M.: Random order congestion games. Math. Oper. Res. 34(3), 706–725 (2009)

    Article  MATH  MathSciNet  Google Scholar 

  45. Penn, M., Polukarov, M., Tennenholtz, M.: Taxed congestion games with failures. Ann. Math. Artif. Intell. 56(2), 133–151 (2009)

    Article  MATH  MathSciNet  Google Scholar 

  46. Pereira, P.: Do lower search costs reduce prices and price dispersion Inf. Econ. Policy 17(1), 61–72 (2005)

    Article  Google Scholar 

  47. Rothschild, M.: Searching for the lowest price when the distribution of prices is unknown. J. Polit. Econ. 82, 689–711 (1974)

    Article  Google Scholar 

  48. Rysman, M.: The economics of two-sided markets. J. Econ. Perspect. 23(3), 125–43 (2009)

    Article  Google Scholar 

  49. Sarne, D., Aumann, Y.: Search costs as a means for improving market performance. In: David, E., Larson, K., Rogers, A., Shehory, O., Stein, S. (eds.) AMEC/TADA, volume 118 of Lecture Notes in Business Information Processing, pp 76–91. Springer (2010)

  50. Sarne, D., Aumann, Y.: The benefits of search costs in multiagent exploration. In: Proceedings of the International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2012), pp 1293–1294 (2012)

  51. Sarne, D., Elmalech, A., Grosz, B. J., Geva, M.: Less is more: restructuring decisions to improve agent search. In: Proceedings of the Tenth International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2011), pp 431–438 (2011)

  52. Sarne, D., Grosz, B.J.: Sharing experiences to learn user characteristics in dynamic environments with sparse data. In: Proceedings of the Sixth International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS 2007), pp 202–209 (2007)

  53. Sarne, D., Kraus, S.: The search for coalition formation in costly environments. In: Cooperative Information Agents VII, pp 117–136. Springer (2003)

  54. Sarne, D., Kraus, S.: Agents’ strategies for the dual parallel search in partnership formation applications. In: Faratin, P., Rodríguez-Aguilar, J.A. (eds.) AMEC, volume 3435 of Lecture Notes in Computer Science, pp 158–172. Springer (2004)

  55. Sarne, D., Kraus, S.: Time-variant distributed agent matching applications. In: Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS 2004), pp 168–175 (2004)

  56. Sarne, D., Kraus, S.: Managing parallel inquiries in agents’ two-sided search. Artif. Intell. 172(4-5), 541–569 (2008)

    Article  MATH  MathSciNet  Google Scholar 

  57. Sarne, D., Manisterski, E., Kraus, S.: Multi-goal economic search using dynamic search structures. Auton. Agent. Multi-Agent Syst. 21, 204–236 (2010)

    Article  Google Scholar 

  58. Shimer, R., Smith, L.: Assortative matching and search. Econometrica 68(2), 343–370 (2000)

    Article  MATH  MathSciNet  Google Scholar 

  59. Smith, L.: The marriage model with search frictions. J. Polit. Econ. 114(6), 1124–1146 (2006)

    Article  Google Scholar 

  60. Smith, L.: Frictional matching models. Annual Reviews in Economics 3, 319–338 (2011)

    Article  Google Scholar 

  61. Stigler, G.J.: The economics of information. J. Polit. Econ. 69(3), 213–225 (1961)

    Article  Google Scholar 

  62. Stiglitz, J.: Imperfect information in the product market. In: Schmalensee, R., Willig, R. (eds.) Handbook of Industrial Organization, volume 1, chapter 13, pp 769–847. Elsevier (1989)

  63. Tang, Z., Smith, M.D., Montgomery, A.: The impact of shopbot use on prices and price dispersion: Evidence from online book retailing. Int. J. Ind. Organ. 28(6), 579–590 (2010)

    Article  Google Scholar 

  64. Vaishnavi, V., Kuechler, W.: An approach to reducing e-commerce coordination costs in evolving markets using a semantic routing protocol. Journal of Electronic Commerce Research 4(3), 113–127 (2003)

    Google Scholar 

  65. Waldeck, R.: Search and price competition. J. Econ. Behav. Organ. 66(2), 347–357 (2008)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Computer Science Department, Bar-Ilan University, Ramat-Gan, 52900, Israel

    David Sarne & Yonatan Aumann

Authors
  1. David Sarne
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yonatan Aumann
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to David Sarne.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sarne, D., Aumann, Y. Exploration costs as a means for improving performance in multiagent systems. Ann Math Artif Intell 72, 297–329 (2014). https://doi.org/10.1007/s10472-014-9435-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10472-014-9435-5

Keywords

Mathematics Subject Classifications (2010)

Search

Navigation