Etan A. Green
ABSTRACT
Bargaining is ubiquitous. How can people bargain better? We train a reinforcement learning agent to bargain optimally in "Best Offer" listings on eBay, and we characterize its behavior in a manner that humans can use. As a buyer, the agent starts lower than human buyers and bargains longer. As the seller, the agent interprets offers as signals---of the buyer's willingness to pay and of the item's desirability---that human sellers ignore. Simple strategies derived from these agents purchase more items for lower prices than human buyers and sell more items for higher prices than human sellers.
- Matthew Backus, Thomas Blake, Brad Larsen, and Steven Tadelis. 2020. Sequential bargaining in the field: Evidence from millions of online bargaining interactions. The Quarterly Journal of Economics 135, 3 (2020), 1319--1361.Google Scholar
Cross Ref
- Matthew Backus, Thomas Blake, Jett Pettus, and Steven Tadelis. 2020. Communication and bargaining breakdown: An empirical analysis. NBER (2020).Google ScholarCross Ref
- Matthew Backus, Thomas Blake, and Steven Tadelis. 2019. On the empirical content of cheap-talk signaling: An application to bargaining. Journal of Political Economy 127, 4 (2019), 1599--1628.Google ScholarCross Ref
- Colin F Camerer. 1997. Progress in behavioral game theory. Journal of Economic Perspectives 11, 4 (1997), 167--188.Google ScholarCross Ref
- Colin F Camerer, Gideon Nave, and Alec Smith. 2019. Dynamic unstructured bargaining with private information: theory, experiment, and outcome prediction via machine learning. Management Science 65, 4 (2019), 1867--1890.Google ScholarDigital Library
- Douglas C Engelbart. 1962. Augmenting human intellect: A conceptual framework.Google Scholar
- Daniel Keniston, Bradley J Larsen, Shengwu Li, JJ Prescott, Bernardo S Silveira, and Chuan Yu. 2021. Fairness in Incomplete Information Bargaining: Theory and Widespread Evidence from the Field. NBER (2021).Google ScholarCross Ref
- Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7--9, 2015, Conference Track Proceedings, Yoshua Bengio and Yann LeCun (Eds.). http://arxiv.org/abs/1412.6980Google Scholar
- Jon Kleinberg, Himabindu Lakkaraju, Jure Leskovec, Jens Ludwig, and Sendhil Mullainathan. 2018. Human decisions and machine predictions. The Quarterly Journal of Economics 133, 1 (2018), 237--293.Google Scholar
- Jon Kleinberg, Jens Ludwig, Sendhil Mullainathan, and Ziad Obermeyer. 2015. Prediction policy problems. American Economic Review 105, 5 (2015), 491--95.Google ScholarCross Ref
- Bradley Larsen and Joachim Freyberger. 2021. How Well Does Bargaining Work in Consumer Markets? A Robust Bounds Approach. NBER (2021).Google Scholar
- Bradley J Larsen. 2021. The efficiency of real-world bargaining: Evidence from wholesale used-auto auctions. The Review of Economic Studies 88, 2 (2021), 851--882.Google ScholarCross Ref
- Yuxi Li. 2017. Deep reinforcement learning: An overview. arXiv preprint arXiv:1701.07274 (2017).Google Scholar
- Po-Hsuan Lin, Alexander L Brown, Taisuke Imai, Joseph Tao-yi Wang, Stephanie W Wang, and Colin F Camerer. 2020. Evidence of general economic principles of bargaining and trade from 2,000 classroom experiments. Nature Human Behaviour 4, 9 (2020), 917--927.Google ScholarCross Ref
- Reid McIlroy-Young, Siddhartha Sen, Jon Kleinberg, and Ashton Anderson. 2020. Aligning Superhuman AI with Human Behavior: Chess as a Model System (KDD). 1677--1687.Google Scholar
- Volodymyr Mnih, Adria Puigdomenech Badia, Mehdi Mirza, Alex Graves, Timothy Lillicrap, Tim Harley, David Silver, and Koray Kavukcuoglu. 2016. Asynchronous methods for deep reinforcement learning. In International conference on machine learning. PMLR, 1928--1937.Google Scholar
- Jonas Send and Marco Serena. 2022. An empirical analysis of insistent bargaining. Journal of Economic Psychology 90 (2022), 102516.Google ScholarCross Ref
- David Silver, Thomas Hubert, Julian Schrittwieser, Ioannis Antonoglou, Matthew Lai, Arthur Guez, Marc Lanctot, Laurent Sifre, Dharshan Kumaran, Thore Graepel, et al. 2018. A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play. Science 362, 6419 (2018), 1140--1144.Google Scholar
- Herbert A Simon and Allen Newell. 1958. Heuristic problem solving: The next advance in operations research. Operations research 6, 1 (1958), 1--10.Google Scholar
- Adam Stooke and Pieter Abbeel. 2019. rlpyt: A research code base for deep reinforcement learning in pytorch. arXiv preprint arXiv:1909.01500 (2019).Google Scholar
Index Terms
- The Science of the Deal: Optimal Bargaining on eBay Using Deep Reinforcement Learning
Recommendations
The sequential auction problem on eBay: an empirical analysis and a solution
EC '06: Proceedings of the 7th ACM conference on Electronic commerceBidders on eBay have no dominant bidding strategy when faced with multiple auctions each offering an item of interest. As seen through an analysis of 1,956 auctions on eBay for a Dell E193FP LCD monitor, some bidders win auctions at prices higher than ...
Last minute only bidding is implausible in eBay sealed bid type-of-auctions
AbstractIn recent years internet auctions have attracted much attention. This paper discusses the "last minute bidding" (sniping) phenomenon, first investigated by Roth and Ockenfels (American Economic Review 92, 1093-1103) in eBay, fixed-end, auctions. ...
An Experimental Investigation of Auctions and Bargaining in Procurement
In reverse auctions, buyers often retain the right to bargain further concessions from the winners. The optimal form of such procurement is an English auction followed by an auctioneer's option to engage in ultimatum bargaining with the winners. We ...
Comments