Abstract
Trading in information markets, such as machine learning markets, has been shown to be an effective approach for aggregating the beliefs of different agents. In a machine learning context, aggregation commonly uses forms of linear opinion pools, or logarithmic (log) opinion pools. It is interesting to relate information market aggregation to the machine learning setting.
In this paper we introduce a spectrum of compositional methods, Rényi divergence aggregators, that interpolate between log opinion pools and linear opinion pools. We show that these compositional methods are maximum entropy distributions for aggregating information from agents subject to individual biases, with the Rényi divergence parameter dependent on the bias. In the limit of no bias this reduces to the optimal limit of log opinion pools. We demonstrate this relationship practically on both simulated and real datasets.
We then return to information markets and show that Rényi divergence aggregators are directly implemented by machine learning markets with isoelastic utilities, and so can result from autonomous self interested decision making by individuals contributing different predictors. The risk averseness of the isoelastic utility directly relates to the Rényi divergence parameter, and hence encodes how much an agent believes (s)he may be subject to an individual bias that could affect the trading outcome: if an agent believes (s)he might be acting on significantly biased information, a more risk averse isoelastic utility is warranted.
Chapter PDF
Similar content being viewed by others
References
Abernethy, J., Frongillo, R.: A collaborative mechanism for crowdsourcing prediction problems. In: Advances in Neural Information Processing Systems 24 (NIPS 2011) (2011)
Bache, K., Lichman, M.: UCI machine learning repository (2013). http://archive.ics.uci.edu/ml
Barbu, A., Lay, N.: An introduction to artificial prediction markets for classification (2011). arXiv:1102.1465v3
Breiman, L.: Bagging predictors. Machine Learning 24(2), 123–140 (1996)
Chen, Y., Wortman Vaughan, J.: A new understanding of prediction markets via no-regret learning. In: Proceedings of the 11th ACM Conference on Electronic Commerce (2010)
Cole, R., Fleischer, L.: Fast-converging tatonnement algorithms for the market problem. Tech. rep., Dept. Computer Science. Dartmouth College (2007)
Dani, V., Madani, O., Pennock, D., Sanghai, S., Galebach, B.: An empirical comparison of algorithms for aggregating expert predictions. In: Proceedings of the Conference on Uncertainty in Artificial Intelligence (UAI) (2006)
Dietrich, F.: Bayesian group belief. Social Choice and Welfare 35(4), 595–626 (2010)
Dietterich, T.G.: Ensemble methods in machine learning. In: Kittler, J., Roli, F. (eds.) MCS 2000. LNCS, vol. 1857, pp. 1–5. Springer, Heidelberg (2000)
Domingos, P.: Why does bagging work? a Bayesian account and its implications. In: Proceedings KDD (1997)
Everingham, M., et al.: The 2005 PASCAL visual object classes challenge. In: Quiñonero-Candela, J., Dagan, I., Magnini, B., d’Alché-Buc, F. (eds.) MLCW 2005. LNCS (LNAI), vol. 3944, pp. 117–176. Springer, Heidelberg (2006)
Garg, A., Jayram, T., Vaithyanathan, S., Zhu, H.: Generalized opinion pooling. AMAI (2004)
Goldbloom, A.: Data prediction competitions - far more than just a bit of fun. In: IEEE International Conference on Data Mining Workshops (2010)
Green, K.: The \({{{\$}}}\)1 million Netflix challenge. Technology Review (2006)
van Hateren, J.H., van der Schaaf, A.: Independent component filters of natural images compared with simple cells in primary visual cortex. Proceedings: Biological Sciences 265(1394), 359–366 (1998)
Heskes, T.: Selecting weighting factors in logarithmic opinion pools. In: Advances in Neural Information Processing Systems 10 (1998)
Kahn, J.M.: A generative Bayesian model for aggregating experts’ probabilities. In: Proceedings of the 20th Conference on Uncertainty in Artificial Intelligence, pp. 301–308. AUAI Press (2004)
Lay, N., Barbu, A.: Supervised aggregation of classifiers using artificial prediction markets. In: Proceedings of ICML (2010)
Maynard-Reid, P., Chajewska, U.: Aggregating learned probabilistic beliefs. In: Proceedings of the Seventeenth Conference on Uncertainty in Artificial Intelligence, pp. 354–361. Morgan Kaufmann Publishers Inc. (2001)
Ottaviani, M., Sørensen, P.: Aggregation of information and beliefs in prediction markets, fRU Working Papers (2007)
Pennock, D., Wellman, M.: Representing aggregate belief through the competitive equilibrium of a securities market. In: Proceedings of the Thirteenth Conference on Uncertainty in Artificial Intelligence, pp. 392–400 (1997)
Bell, R.M., Koren, Y., Volinsky, C.: All together now: A perspective on the NETFLIX PRIZE. Chance 24 (2010)
Rubinstein, M.: An aggregation theorem for securities markets. Journal of Financial Economics 1(3), 225–244 (1974)
Rubinstein, M.: Securities market efficiency in an Arrow-Debreu economy. American Economic Review 65(5), 812–824 (1975)
Rubinstein, M.: The strong case for the generalised logarithmic utility model as the premier model of financial markets. Journal of Finance 31(2), 551–571 (1976)
Storkey, A.: When training and test sets are different: Characterising learning transfer. In: Lawrence, C.S.S. (ed.) Dataset Shift in Machine Learning, chap. 1, pp. 3–28. MIT Press (2009). http://mitpress.mit.edu/catalog/item/default.asp?ttype=2&tid=11755
Storkey, A.: Machine learning markets. In: Proceedings of Artificial Intelligence and Statistics, vol. 15. Journal of Machine Learning Research W&CP (2011). http://jmlr.csail.mit.edu/proceedings/papers/v15/storkey11a/storkey11a.pdf
Storkey, A., Millin, J., Geras, K.: Isoelastic agents and wealth updates in machine learning markets. In: Proceedings of ICML 2012 (2012)
West, M.: Bayesian aggregation. Journal of the Royal Statistical Society 147, 600–607 (1984)
Wolpert, D.H.: Stacked generalization. Neural Networks 5(2), 241–259 (1992). http://www.sciencedirect.com/science/article/pii/S0893608005800231
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Storkey, A.J., Zhu, Z., Hu, J. (2015). Aggregation Under Bias: Rényi Divergence Aggregation and Its Implementation via Machine Learning Markets. In: Appice, A., Rodrigues, P., Santos Costa, V., Soares, C., Gama, J., Jorge, A. (eds) Machine Learning and Knowledge Discovery in Databases. ECML PKDD 2015. Lecture Notes in Computer Science(), vol 9284. Springer, Cham. https://doi.org/10.1007/978-3-319-23528-8_35
Download citation
DOI: https://doi.org/10.1007/978-3-319-23528-8_35
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-23527-1
Online ISBN: 978-3-319-23528-8
eBook Packages: Computer ScienceComputer Science (R0)