Skip to main content

A New Approach for Partitional Clustering Using Entropy Notation and Hopfield Network

  • Conference paper
  • First Online:
Book cover Research and Development in Intelligent Systems XXVII (SGAI 2010)

Abstract

This paper proposes a new clustering algorithm which employs an improved stochastic competitive Hopfield network in order to organize data patterns into natural groups, or clusters, in an unsupervised manner. This Hopfield network uses an entropy based energy function to overcome the problem of insufficient understanding of the data and to obtain the optimal parameters for clustering. Additionally, a chaotic variable is introduced in order to escape from the local minima and gain a better clustering. By minimizing the entropy of each cluster using Hopfield network, we achieve a superior accuracy to that of the best existing algorithms such as optimal competitive Hopfield model, stochastic optimal competitive Hopfield network, k-means and genetic algorithm. The experimental results demonstrate the scalability and robustness of our algorithm over large datasets.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. McQueen, J.: Some methods for classification and analysis of multivariate observations. In: Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, pp. 281–297 (1967).

    Google Scholar 

  2. Bezdek, J. C., Ehrlich, R., & Full, W.: Fcm: The fuzzy c-means clustering algorithm. J. Computers & Geosciences, 10 (2-3), pp. 191–203 (1984).

    Article  Google Scholar 

  3. Sarafis, I., Zalzala, A. M., Trinder, P. W.: A genetic rule-based data clustering toolkit. In: Proceedings of the Evolutionary Computation (CEC '02), pp. 1238-1243. IEEE Computer Society, Washington, DC (2002).

    Google Scholar 

  4. Barbara, D., Couto, J., Li, Y.: COOLCAT An entropy based algorithm for categorical clustering. In: Proceedings of the eleventh international conference on Information and knowledge management. ACM Press (2002).

    Google Scholar 

  5. Galán-Marín, G., Mérida-Casermeiro, E., and Muñoz-Pérez.: Modeling competitive Hopfield networks for the maximum clique problem. J. Comput. Oper. Res. 30, pp. 603–624 (2003).

    Article  MATH  Google Scholar 

  6. Wang, J. and Zhou, Y.: Stochastic optimal competitive Hopfield network for partitional clustering. J. Expert Syst. Appl. 36, pp. 2072–2080 (2009).

    Article  Google Scholar 

  7. Azamimi, A., Uwate, Y., Nishio, Y.: An Improvement in Pattern Recognition Problem Using Chaotic BP Learning Algorithm. In: Proceedings of RISP International Workshop on Nonlinear Circuits and Signal Processing, pp. 213–216 (2009).

    Google Scholar 

  8. Krink, T., Paterlini, S.: Differential Evolution and Particle Swarm Optimization in Partitional Clustering. J. Computational Statistics and Data Analysis. 50, pp. 1220–1247 (2006).

    Article  MathSciNet  Google Scholar 

  9. Jarboui, B., Cheikh, M., Siarry, P., & Rebai, A.: Combinatorial particle swarm optimization (CPSO) for partitional clustering problem. J. Applied Mathematics and Computation. 192(2), pp. 337–345 (2007).

    Article  MATH  MathSciNet  Google Scholar 

  10. Frank, A. & Asuncion, A. (2010). UCI Machine Learning Repository [http://archive.ics.uci.edu/ml]. Irvine, CA: University of California, School of Information and Computer Science.

Download references

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Vahid Abrishami , Maryam Sabzevari or Mahdi Yaghobi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag London Limited

About this paper

Cite this paper

Abrishami, V., Sabzevari, M., Yaghobi, M. (2011). A New Approach for Partitional Clustering Using Entropy Notation and Hopfield Network. In: Bramer, M., Petridis, M., Hopgood, A. (eds) Research and Development in Intelligent Systems XXVII. SGAI 2010. Springer, London. https://doi.org/10.1007/978-0-85729-130-1_11

Download citation

  • DOI: https://doi.org/10.1007/978-0-85729-130-1_11

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-0-85729-129-5

  • Online ISBN: 978-0-85729-130-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics