Abstract
To support very high dimensionality, model-based clustering is an intuitive choice for document clustering. However, the current model-based algorithms are prone to generating the skewed clusters, which influence the quality of clustering seriously. In this paper, the reasons of skew are examined and determined as the inappropriate initial model, the unfitness of cluster model and the interaction between the decentralization of estimation samples and the over-generalized cluster model. This paper proposes a skew prevention document-clustering algorithm (MMPClust), which has two features: (1) a content-based cluster model is used to model the cluster better; (2) at the re-estimation step, a part of documents most relevant to its corresponding class are selected automatically for each cluster as the estimation samples to break this interaction. MMPClust has less restrictions and more applicability in document clustering than the previous methods.
Supported by the National Natural Science Foundation of China under Grant No.60173051 and the Teaching and Research Award Program for Outstanding Young Teachers in Higher Education Institution of the Ministry of Education, China
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Strehl, A., Ghosh, J., Mooney, R.: Impact of Similarity Measures on Web Page Clustering. In: Proc. 17th National Conf. On artificial Intelligence: Workshop of Artificial Intelligence for Web Search (2000)
Zhong, S.: Probabilistic Model-Based Clustering of Complex Data, PhD thesis, The University of Texas at Austin (2003)
Zhong, S., Ghosh, J.: A Unified Framework for Model-based Clustering. Machine Learning Research (2003)
Kamvar, S., Klein, D., Manning, C.: Interpreting and Extending Classical Agglomerative Clustering Algorithms Using A Model-based Approach. In: Proc. 19th Int. Conf. Machine Learning (2002)
Banfield, J.D., Raftery, A.E.: Model-based Gaussian and non-Gaussian Clustering. Biometrics (1993)
Fraley, C.: Algorithms for Model-based Gaussian Hierarchical Clustering. SIAM Journal on Scientific Computing (1999)
Vaithyanathan, S., Dom, B.: Model-based Hierarchical Clustering. In: Proc. 16th Conf. Uncertainty in Artificial Intelligence (2000)
Ramoni, M., Sebastiani, P., Cohen, P.: Bayesian Clustering by Dynamics. Machine Learning (2002)
Cadez, I.V., Ganey, S., Smyth, P.: A General Probabilistic Framework for Clustering Individuals and Objects. In: Proc. 6th ACM SIGKDD (2000)
Dhillon, I.S., Modha, D.S.: Concept Decompositions for Large Sparse Text Data Using Clustering. Machine Learning (2001)
Banerjee, A., Ghosh, J.: Frequency Sensitive Competitive Learning for Clustering on High-Dimensional Hyperspheres. In: Proc. IEEE Int. Joint Conf. Neural Networks (2002)
Meila, M., Heckerman, D.: An Experimental Comparison of Model-Based Clustering Methods. Machine Learning (2001)
Jain, A.K., Murty, M.N., Flynn, P.J.: Data Clustering: A Review. ACM Computing Surveys (1999)
Bradley, P.S., Bennett, K.P., Demiriz, A.: Constrained k-means Clustering, Technical Report MSR-TR-2000-65, Microsoft Research, Redmond, WA (2000)
Banerjee, A., Ghosh, J.: On Scaling Up Balanced Clustering Algorithms. In: Proc. 2nd SIAM Int. Conf. Data Mining (2002)
Zhong, S., Ghosh, J.: Model-based Clustering with Soft Balancing. In: ICDM 2003 (2003)
Karypis, G., Kumar, V.: A fast and high quality multilevel scheme for partitioning irregular graphs. SIAM Journal on Scientific Computing (1998)
McLachlan, G., Peel, D.: Finite Mixture Models. John Wiley & Sons, Chichester (2000)
Beyer, K., Goldstein, J., Ramakrishnan, R., Shaft, U.: When is Nearest Neighbors Meaningful? In: Beeri, C., Bruneman, P. (eds.) ICDT 1999. LNCS, vol. 1540, pp. 217–235. Springer, Heidelberg (1999)
Aggarwal, C.C., Hinneburg, A., Keim, D.A.: On the Surprising Behavior of Distance Metrics in High Dimensional Spaces. In: Van den Bussche, J., Vianu, V. (eds.) ICDT 2001. LNCS, vol. 1973, p. 420. Springer, Heidelberg (2000)
http://kdd.ics.uci.edu/databases/20newsgroups/20newsgroups.html
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Li, X., Yu, G., Wang, D. (2005). MMPClust: A Skew Prevention Algorithm for Model-Based Document Clustering. In: Zhou, L., Ooi, B.C., Meng, X. (eds) Database Systems for Advanced Applications. DASFAA 2005. Lecture Notes in Computer Science, vol 3453. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11408079_47
Download citation
DOI: https://doi.org/10.1007/11408079_47
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-25334-1
Online ISBN: 978-3-540-32005-0
eBook Packages: Computer ScienceComputer Science (R0)