The notion of mixed membership arises naturally in the context of multivariate data analysis (see Multivariate Data Analysis: An Overview) when attributes collected on individuals or objects originate from a mixture of different categories or components. Consider, for example, an individual with both European and Asian ancestry whose mixed origins correspond to a statement of mixed membership: “1/4 European and 3/4 Asian ancestry.” This description is conceptually very different from a probability statement of “25% chance of being European and 75% chance of being Asian”. The assumption that individuals or objects may combine attributes from several basis categories in a stochastic manner, according to their proportions of membership in each category, is a distinctive feature of mixed membership models. In most applications, the number and the nature of the basis categories, as well as individual membership frequencies, are typically considered latent or unknown. Mixed membership...
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References and Further Reading
Airoldi EM, Blei DM, Fienberg SE, Xing EP (2008a) Mixed-membership stochastic blockmodels. J Mach Learn Res 9:1981–2014
Airoldi EM, Fienberg SE, Joutard C, Love TM (2008b) Discovery of latent patterns with hierarchical Bayesian mixed-membership models and the issue of model choice. In: Poncelet P, Masseglia F, Teisseire M (eds) Data mining patterns: new methods and applications. pp 240–275
Barnard K, Duygulu P, Forsyth D, de Freitas N, Blei DM, Jordan MI (2003) Matching words and pictures. J Mach Learn Res 3: 1107–1135
Bartholomew DJ, Knott M (1999) Latent variable models and factor analysis, 2nd edn. Arnold, London
Blei DM, Lafferty JD (2007) A correlated topic model of Science. Ann Appl Stat 1:17–35
Blei DM, Ng AY, Jordan MI (2003a) Latent Dirichlet allocation. J Mach LearnRes 3:993–1002
Blei DM, Ng AY, Jordan MI (2003b) Modeling annotated data. In: Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM, pp 127–134
Chang J, Blei DM (2010) Hierarchical relational models for document networks. Ann Appl Stat 4, pp 124–150
Cooil B, Varki S (2003) Using the conditional Grade-of-Membership model toassess judgement accuracy. Psychometrika 68:453–471
Erosheva EA (2003) Bayesian estimation of the Grade of Membership Model. In: Bernardo J et al (eds) Bayesian statistics 7. Oxford University Press, Oxford, pp 501–510
Erosheva EA, Fienberg SE (2004) Partial membership models with application to disability survey data. In: Weihs C, Caul W (eds) Classification – the ubiquitous challenge. Springer, Heidelberg, pp 11–26
Erosheva EA, Fienberg SE, Lafferty J (2004) Mixed membership models of scientific publications. Proc Natl Acad Sci 101 (suppl 1):5220–5227
Erosheva EA, Fienberg SE, Joutard C (2007) Describing disability through individual-level mixture models for multivariate binary data. Ann Appl Stat 1:502–537
Griffiths TL, Steyvers M (2004) Finding scientific topics. Proc Natl Acad Sci 101 (suppl 1):5228–5235
Griffiths TL, Steyvers M, Tenenbaum JB (2007) Topics in Semantic Representation. Psychol Rev 114(2):211–244
Haberman SJ (1995) Book review of “Statistical applications using fuzzy sets,” by K.G. Manton, M.A. Woodbury and H.D. Tolley. J Am Stat Assoc 90:1131–1133
Hofmann T (2001) Unsupervised learning by probabilistic latent semantic analysis. Mach Learn 42:177–196
Manton KG, Woodbury MA, Tolley HD (1994) Statistical applications using fuzzy sets. Wiley, New York
Minka TP, Lafferty JD (2002) Expectation-propagation for the generative aspect model. In: Uncertainty in Artificial Intelligence: Proceedings of the Eighteenth Conference (UAI–2002), Morgan Kaufmann, San Francisco, pp 352–359
Potthoff RF, Manton KG, Woodburry MA (2000) Dirichlet generalizations of latent-class models. J Classif 17:315–353
Pritchard P, Stephens JK, Donnely P (2000) Inference of population structure using multilocus genotype data. Genetics 155:945–959
Rosenberg NA, Pritchard JK, Weber JL, Cann HM, Kidd KK, Zhivotovsky LA, Feldman MW (2002) Genetic structure of human populations. Science 298:2381–2385
Varki S, Cooil B, Rust RT (2000) Modeling fuzzy data in qualitative marketing research. J Market Res 37:480–489
Woodbury MA, Clive J, Garson A (1978) Mathematical typology: a grade of membership technique for obtaining disease definition. Comput Biomed Res 11:277–298
Xing E, Fu W, Song L (2010) A state-space mixed membership blockmodel for dynamic network tomography. Ann Appl Stat 4, in press
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this entry
Cite this entry
Erosheva, E.A., Fienberg, S.E. (2011). Mixed Membership Models. In: Lovric, M. (eds) International Encyclopedia of Statistical Science. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04898-2_367
Download citation
DOI: https://doi.org/10.1007/978-3-642-04898-2_367
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-04897-5
Online ISBN: 978-3-642-04898-2
eBook Packages: Mathematics and StatisticsReference Module Computer Science and Engineering