Abstract
Compositional data arise in many fields and their analysis has to be done with care since these data are bounded and summing up to a constant. In this paper, we propose a mixture model which combines several discriminative models through a set of Dirichlet-based weights. It is worth noticing that the Dirichlet distribution is not used here as a prior to the mixing coefficients but instead to model the repartition of the tasks among the classifiers. By doing so, we do not need to transform the data while keeping interpretable results. Experiments on synthetic and real-world data sets show the efficiency of our model.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Aitchison, J.: The Statistical Analysis of Compositional Data. Chapman and Hall, London, New York (1986)
Bouguila, N., Ziou, D., Vaillancourt, J.: Maximum likelihood estimation of the generalized Dirichlet mixture. Dept. Mathematiques et dinformatique, Univ. Sherbrooke, Shrebrooke, QC, Canada (2002)
Bouguila, N., Ziou, D., Vaillancourt, J.: Unsupervised learning of a finite mixture model based on the Dirichlet distribution and its application. IEEE Trans. Image Process. 13(11), 1533–1543 (2004)
Gorodkin, J.: Comparing two K-category assignments by a K-category correlation coefficient. Comput. Biol. Chem. 28(5), 367–374 (2004)
Hijazi, R.: Analysis of compositional data using Dirichlet covariate models. The American University, Washington, DC, USA (2003)
Jacobs, R., Jordan, M.I., Nowlan, S.J., Hinton, G.: Adaptive mixtures of local experts. Neural Comput. 3(1), 79–87 (1991)
Ksantini, R., Boufama, B.: A novel Bayesian logistic discriminant model with dirichlet distributions: an application to face recognition. In: Kamel, M., Campilho, A. (eds.) ICIAR 2009. LNCS, vol. 5627, pp. 461–470. Springer, Heidelberg (2009). doi:10.1007/978-3-642-02611-9_46
Masoudnia, S., Ebrahimpour, R.: Mixture of experts: a literature survey. Artif. Intell. Rev. 42, 275–293 (2014)
Ng, K.W., Tian, G.L., Tang, M.L.: Dirichlet and Related Distributions: Theory, Methods and Applications, vol. 888. Wiley, Hoboken (2011)
Otero, N., Tolosana-Delgado, R., Soler, A., Pawlowsky-Glahn, V., Canals, A.: Relative vs. absolute statistical analysis of compositions: 1 comparative study of surface waters of a mediterranean river. Water Res. 39(7), 1404–1414 (2005)
Schmidt, M.: minFunc: unconstrained differentiable multivariate optimization in Matlab (2012). http://www.di.ens.fr/mschmidt/Software/minFunc.html
Shi, J.Q., Murray-Smith, R., Titterington, D.: Bayesian regression and classification using mixtures of Gaussian processes. Int. J. Adapt. Control Signal Process. 17(2), 149–161 (2003)
Tsagris, M., Preston, S., Wood, A.T.: Improved classification for compositional data using the \(\alpha \)-transformation. J. Classif. 33(2), 243–261 (2016)
Xu, L., Jordan, M.I., Hinton, G.: An Alternative Model for Mixtures of Experts (1995)
Yuksel, S., Wilson, J., Gader, P.: Twenty years of mixture of experts. IEEE Trans. Neural Netw. Learn. Syst. 23(8), 1177–1193 (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Togban, E., Ziou, D. (2017). Classification Using Mixture of Discriminative Learners: The Case of Compositional Data. In: Karray, F., Campilho, A., Cheriet, F. (eds) Image Analysis and Recognition. ICIAR 2017. Lecture Notes in Computer Science(), vol 10317. Springer, Cham. https://doi.org/10.1007/978-3-319-59876-5_46
Download citation
DOI: https://doi.org/10.1007/978-3-319-59876-5_46
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-59875-8
Online ISBN: 978-3-319-59876-5
eBook Packages: Computer ScienceComputer Science (R0)