skip to main content
10.1145/1281192.1281212acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
Article

Evolutionary spectral clustering by incorporating temporal smoothness

Published: 12 August 2007 Publication History

Abstract

Evolutionary clustering is an emerging research area essential to important applications such as clustering dynamic Web and blog contents and clustering data streams. In evolutionary clustering, a good clustering result should fit the current data well, while simultaneously not deviate too dramatically from the recent history. To fulfill this dual purpose, a measure of temporal smoothness is integrated in the overall measure of clustering quality. In this paper, we propose two frameworks that incorporate temporal smoothness in evolutionary spectral clustering. For both frameworks, we start with intuitions gained from the well-known k-means clustering problem, and then propose and solve corresponding cost functions for the evolutionary spectral clustering problems. Our solutions to the evolutionary spectral clustering problems provide more stable and consistent clustering results that are less sensitive to short-term noises while at the same time are adaptive to long-term cluster drifts. Furthermore, we demonstrate that our methods provide the optimal solutions to the relaxed versions of the corresponding evolutionary k-means clustering problems. Performance experiments over a number of real and synthetic data sets illustrate our evolutionary spectral clustering methods provide more robust clustering results that are not sensitive to noise and can adapt to data drifts.

References

[1]
C. C. Aggarwal, J. Han, J. Wang, and P. S. Yu. A framework for clustering evolving data streams. In Proc. of the 12th VLDB Conference, 2003.
[2]
F. R. Bach and M. I. Jordan. Learning spectral clustering, with application to speech separation. Journal of Machine Learning Research, 7, 2006.
[3]
D. Chakrabarti, R. Kumar, and A. Tomkins. Evolutionary clustering. In Proc. of the 12th ACM SIGKDD Conference, 2006.
[4]
M. Charikar, C. Chekuri, T. Feder, and R. Motwani. Incremental clustering and dynamic information retrieval. In Proc. of the 29th STOC Conference, 1997.
[5]
C. Chatfield. The Analysis of Time Series: An Introduction. Chapman & Hall/CRC.
[6]
F. R. K. Chung. Spectral Graph Theory. American Mathematical Society, 1997.
[7]
L. De Lathauwer, B. De Moor, and J. Vandewalle. A multilinear singular value decomposition. SIAM J. on Matrix Analysis and Applications, 21(4), 2000.
[8]
I. S. Dhillon, Y. Guan, and B. Kulis. Kernel k-means: spectral clustering and normalized cuts. In Proc. of the 10th ACM SIGKDD Conference, 2004.
[9]
C. Ding and X. He. K-means clustering via principal component analysis. In Proc. of the 21st ICML Conference, 2004.
[10]
K. Fan. On a theorem of Weyl concerning eigenvalues of linear transformations. In Proc. Natl. Acad. Sci., 1949.
[11]
G. Golub and C. V. Loan. Matrix Computations. Johns Hopkins University Press, third edition, 1996.
[12]
S. Guha, N. Mishra, R. Motwani, and L. O'Callaghan. Clustering data streams. In IEEE Symposium on Foundations of Computer Science, 2000.
[13]
C. Gupta and R. Grossman. Genic: A single pass generalized incremental algorithm for clustering. In SIAM Int. Conf. on Data Mining, 2004.
[14]
L. J. Hubert and P. Arabie. Comparing partitions. Journal of Classification, 2, 1985.
[15]
X. Ji and W. Xu. Document clustering with prior knowledge. In SIGIR, 2006.
[16]
Y. Li, J. Han, and J. Yang. Clustering moving objects. In Proc. of the 10th ACM SIGKDD Conference, 2004.
[17]
A. Ng, M. Jordan, and Y. Weiss. On spectral clustering: Analysis and an algorithm. In NIPS,2001.
[18]
H. Ning, W. Xu, Y. Chi, Y. Gong, and T. Huang. Incremental spectral clustering with application to monitoring of evolving blog communities. In SIAM Int. Conf. on Data Mining, 2007.
[19]
J. Shi and J. Malik. Normalized cuts and image segmentation. IEEE Trans. on Pattern Analysis and Machine Intelligence, 22(8), 2000.
[20]
K. Wagstaff, C. Cardie, S. Rogers, and S. Schroedl. Constrained K-means clustering with background knowledge. In Proc. 18th ICML Conference, 2001.
[21]
Y. Weiss. Segmentation using eigenvectors: A unifying view. In ICCV '99: Proceedings of the International Conference on Computer Vision-Volume 2, 1999.
[22]
H. Zha, X. He, C. H. Q. Ding, M. Gu, and H. D. Simon. Spectral relaxation for k-means clustering. In NIPS, 2001.

Cited By

View all
  • (2025)Exploring Evolutionary Spectral Clustering for Temporal-Smoothed Clustered Cell-Free NetworkingIEEE Wireless Communications Letters10.1109/LWC.2024.351153614:2(494-498)Online publication date: Feb-2025
  • (2024)Vertex clustering in diverse dynamic networksPLOS Complex Systems10.1371/journal.pcsy.00000231:4(e0000023)Online publication date: 5-Dec-2024
  • (2024)Recovering Static and Time-Varying Communities Using Persistent EdgesIEEE Transactions on Network Science and Engineering10.1109/TNSE.2023.333728111:2(2087-2099)Online publication date: Mar-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
KDD '07: Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining
August 2007
1080 pages
ISBN:9781595936097
DOI:10.1145/1281192
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 August 2007

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. evolutionary spectral clustering
  2. mining data streams
  3. preserving cluster membership
  4. temporal smoothness
  5. treserving cluster quality

Qualifiers

  • Article

Conference

KDD07

Acceptance Rates

KDD '07 Paper Acceptance Rate 111 of 573 submissions, 19%;
Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

Upcoming Conference

KDD '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)53
  • Downloads (Last 6 weeks)11
Reflects downloads up to 28 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Exploring Evolutionary Spectral Clustering for Temporal-Smoothed Clustered Cell-Free NetworkingIEEE Wireless Communications Letters10.1109/LWC.2024.351153614:2(494-498)Online publication date: Feb-2025
  • (2024)Vertex clustering in diverse dynamic networksPLOS Complex Systems10.1371/journal.pcsy.00000231:4(e0000023)Online publication date: 5-Dec-2024
  • (2024)Recovering Static and Time-Varying Communities Using Persistent EdgesIEEE Transactions on Network Science and Engineering10.1109/TNSE.2023.333728111:2(2087-2099)Online publication date: Mar-2024
  • (2024)Higher Order Knowledge Transfer for Dynamic Community Detection With Great ChangesIEEE Transactions on Evolutionary Computation10.1109/TEVC.2023.325756328:1(90-104)Online publication date: Feb-2024
  • (2024)LUSTC: A Novel Approach for Predicting Link States on Dynamic Attributed NetworksIEEE Transactions on Computational Social Systems10.1109/TCSS.2023.325226111:1(1075-1085)Online publication date: Feb-2024
  • (2024)An embedding-based distance for temporal graphsNature Communications10.1038/s41467-024-54280-415:1Online publication date: 17-Nov-2024
  • (2024)A Novel Method for Vertex Clustering in Dynamic NetworksComplex Networks & Their Applications XII10.1007/978-3-031-53499-7_36(445-456)Online publication date: 29-Feb-2024
  • (2023)A Unified Spectral Clustering Approach for Detecting Community Structure in Multilayer NetworksSymmetry10.3390/sym1507136815:7(1368)Online publication date: 5-Jul-2023
  • (2023)Monitoring Changes in Clustering Solutions: A Review of Models and ApplicationsJournal of Probability and Statistics10.1155/2023/74936232023(1-15)Online publication date: 3-Nov-2023
  • (2023)Community Detection in Weighted Time-Variant Social NetworkProceedings of the 2023 Fifteenth International Conference on Contemporary Computing10.1145/3607947.3608077(660-665)Online publication date: 3-Aug-2023
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media