Skip to main content

The Spherical k-means++ Algorithm via Local Search

  • Conference paper
  • First Online:
Algorithmic Aspects in Information and Management (AAIM 2020)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 12290))

Included in the following conference series:

  • 893 Accesses

Abstract

We consider the spherical k-means problem (SKMP), a generalization of the k-means clustering problem (KMP). Given a data set of n points \({\mathcal {P}}\) in d-dimensional unit sphere \({\mathbb {R}}^d\), and an integer \(k \le n\), it aims to partition the data set \({\mathcal {P}}\) into k sets so as to minimize the sum of cosine dissimilarity measure from each data point to its closest center. We present a constant expected approximation guarantee for this problem based on integrating the k-means++ seeding algorithm for the KMP and the local search technique.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ahmadian, S., Norouzi-Fard, A., Svensson, O., Ward, J.: Better guarantees for \(k\)-means and Euclidean \(k\)-median by primal-dual algorithms. In: Proceedings of FOCS, pp. 61–72 (2017)

    Google Scholar 

  2. Arthur, D., Vassilvitskii, S.: \(k\)-means++: the advantages of careful seeding. In: Proceedings of SODA, pp. 1027–1035 (2007)

    Google Scholar 

  3. Dhillon, I.S., Modha, D.S.: Concept decompositions for large sparse text data using clustering. Mach. Learn. 42, 143–175 (2001)

    Article  Google Scholar 

  4. Endo, Y., Miyamoto, S.: Spherical k-means++ clustering. In: Torra, V., Narukawa, Y. (eds.) MDAI 2015. LNCS (LNAI), vol. 9321, pp. 103–114. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-23240-9_9

    Chapter  Google Scholar 

  5. Feldman, D., Schmidt, M., Sohler, C.: Turning big data into tiny data: constant-size coresets for \(k\)-means, PCA and projective clustering. ArXiv preprint arXiv:1807.04518 (2018)

  6. Hornik, K., Feinerer, I., Kober, M., Buchta, C.: Spherical \(k\)-means clustering. J. Stat. Softw. 50, 1–22 (2012)

    Article  Google Scholar 

  7. Jain, A.K., Dubes, R.C.: Algorithms for Clustering Data. Prentice Hall, New Jersey (1988)

    MATH  Google Scholar 

  8. Jain, A.K., Murty, M.N., Flynn, P.J.: Data clustering: a review. ACM Comput. Surv. 31, 264–323 (1999)

    Article  Google Scholar 

  9. Kanungo, T., Mount, D.M., Netanyahu, N.S., Piatko, C.D., Silverman, R., Wu, A.Y.: A local search approximation algorithm for \(k\)-means clustering. Comput. Geom.: Theory Appl. 28, 89–112 (2004)

    Article  MathSciNet  Google Scholar 

  10. Kanungo, T., Mount, D.M., Netanyahu, N.S., Piatko, C.D., Silverman, R., Wu, A.Y.: An efficient \(k\)-means clustering algorithm: analysis and implementation. IEEE Trans. Pattern Anal. Mach. Intell. 24, 881–892 (2002)

    Article  Google Scholar 

  11. Kumar, A., Sabharwal, Y., Sen, S.: A simple linear time \((1+\varepsilon )\)-approximation algorithm for \(k\)-means clustering in any dimensions. In: Proceedings of FOCS, pp. 454–462 (2004)

    Google Scholar 

  12. Lattanzi, S., Sohler, C.: A better \(k\)-means++ algorithm via local search. In: Proceedings of ICML, pp. 3662–3671 (2019)

    Google Scholar 

  13. Li, M., Xu, D., Zhang, D., Zou, J.: The seeding algorithms for spherical \(k\)-means clustering. J. Glob. Optim. 76, 695–708 (2020)

    Article  MathSciNet  Google Scholar 

  14. Lloyd, S.: Least squares quantization in PCM. IEEE Trans. Inf. Theory 28, 129–137 (1982)

    Article  MathSciNet  Google Scholar 

  15. Macqueen, J.B.: Some methods for classification and analysis of multivariate observations. In: Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and Probability & Statistics, pp. 281–297 (1966)

    Google Scholar 

  16. Zhang, Dongmei, Cheng, Yukun, Li, Min, Wang, Yishui, Xu, Dachuan: Local search approximation algorithms for the spherical k-means problem. In: Du, Ding-Zhu, Li, Lian, Sun, Xiaoming, Zhang, Jialin (eds.) AAIM 2019. LNCS, vol. 11640, pp. 341–351. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-27195-4_31

    Chapter  Google Scholar 

Download references

Acknowledgements

The first two authors are supported by National Natural Science Foundation of China (Nos. 11871081, 11531014). The third author is supported by the Natural Sciences and Engineering Research Council of Canada (NSERC) grant 06446, and National Natural Science Foundation of China (Nos. 11771386, 11728104). The fourth author is supported by National Natural Science Foundation of China (No. 11201333).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ling Gai .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Tian, X., Xu, D., Du, D., Gai, L. (2020). The Spherical k-means++ Algorithm via Local Search. In: Zhang, Z., Li, W., Du, DZ. (eds) Algorithmic Aspects in Information and Management. AAIM 2020. Lecture Notes in Computer Science(), vol 12290. Springer, Cham. https://doi.org/10.1007/978-3-030-57602-8_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-57602-8_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-57601-1

  • Online ISBN: 978-3-030-57602-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics