Abstract
Significant results have been achieved recently by exchanging information between multiple learners for clustering tasks. However, this approaches still suffer from a few issues regarding the choice of the information to trade, the stopping criteria and the trade-of between the information extracted from the data and the information exchanged by the models. We aim in this paper to address this issues through a novel approach propelled by the optimal transport theory. More specifically, the objective function is based on the Wasserstein metric, with a bidirectional transport of the information. This formulation leads to a high stability and increase of the quality. It also allows the learning of a stopping criteria. Extensive experiments were conducted on multiple data sets to evaluate the proposed method, which confirm the advantages of this approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bickel, S., Scheffer, T.: Estimation of mixture models using co-EM. In: Gama, J., Camacho, R., Brazdil, P.B., Jorge, A.M., Torgo, L. (eds.) ECML 2005. LNCS (LNAI), vol. 3720, pp. 35–46. Springer, Heidelberg (2005). https://doi.org/10.1007/11564096_9
Cleuziou, G., Exbrayat, M., Martin, L., Sublemontier, J.H.: CoFKM: a centralized method for multiple-view clustering. In: 2009 Ninth IEEE International Conference on Data Mining, pp. 752–757. IEEE (2009)
Courty, N., Flamary, R., Tuia, D.: Domain adaptation with regularized optimal transport. In: Calders, T., Esposito, F., Hüllermeier, E., Meo, R. (eds.) ECML PKDD 2014. LNCS (LNAI), vol. 8724, pp. 274–289. Springer, Heidelberg (2014). https://doi.org/10.1007/978-3-662-44848-9_18
Cuturi, M., Doucet, A.: Fast computation of Wasserstein barycenters. In: ICML, pp. 685–693 (2014)
Davies, D.L., Bouldin, D.W.: A cluster separation measure. IEEE Trans. Pattern Anal. Mach. Intell. 2, 224–227 (1979)
Forestier, G., Wemmert, C., Gançarski, P.: Collaborative multi-strategical classification for object-oriented image analysis. In: Workshop on Supervised and Unsupervised Ensemble Methods and Their Applications in conjunction with IbPRIA, pp. 80–90 (2007)
Ghassany, M., Grozavu, N., Bennani, Y.: Collaborative clustering using prototype-based techniques. Int. J. Comput. Intell. Appl. 11(03), 1250017 (2012)
Grozavu, N., Bennani, Y.: Topological collaborative clustering. Aust. J. Intell. Inf. Process. Syst. 12(2) (2010)
Ho, N., Nguyen, X.L., Yurochkin, M., Bui, H.H., Huynh, V., Phung, D.: Multilevel clustering via Wasserstein means. In: ICML, pp. 1501–1509 (2017)
Hu, T., Yu, Y., Xiong, J., Sung, S.Y.: Maximum likelihood combination of multiple clusterings. Pattern Recogn. Lett. 27(13), 1457–1464 (2006)
Kotsiantis, S., Pintelas, P.: Recent advances in clustering: a brief survey. WSEAS Trans. Inf. Sci. Appl. 1(1), 73–81 (2004)
Pedrycz, W.: Collaborative fuzzy clustering. Pattern Recogn. Lett. 23(14), 1675–1686 (2002)
Peyré, G., Cuturi, M., et al.: Computational optimal transport. Found. Trends® Mach. Learn. 11(5–6), 355–607 (2019)
Rastin, P., Cabanes, G., Grozavu, N., Bennani, Y.: Collaborative clustering: how to select the optimal collaborators? In: 2015 IEEE Symposium Series on Computational Intelligence, pp. 787–794. IEEE (2015)
Rousseeuw, P.J.: Silhouettes: a graphical aid to the interpretation and validation of cluster analysis. J. Comput. Appl. Math. 20, 53–65 (1987)
Schwarzschild, K.: Sitzungsberichte preuss. Akad. Wiss 424 (1916)
Sublime, J., Matei, B., Cabanes, G., Grozavu, N., Bennani, Y., Cornuéjols, A.: Entropy based probabilistic collaborative clustering. Pattern Recogn. 72, 144–157 (2017)
Villani, C.: Optimal Transport: Old and New, vol. 338. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-71050-9
Wu, J., Xiong, H., Chen, J.: Adapting the right measures for k-means clustering. In: SIGKDD, pp. 877–886. ACM (2009)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Ben Bouazza, F.E., Bennani, Y., Cabanes, G., Touzani, A. (2020). Collaborative Clustering Through Optimal Transport. In: Farkaš, I., Masulli, P., Wermter, S. (eds) Artificial Neural Networks and Machine Learning – ICANN 2020. ICANN 2020. Lecture Notes in Computer Science(), vol 12397. Springer, Cham. https://doi.org/10.1007/978-3-030-61616-8_70
Download citation
DOI: https://doi.org/10.1007/978-3-030-61616-8_70
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-61615-1
Online ISBN: 978-3-030-61616-8
eBook Packages: Computer ScienceComputer Science (R0)