Skip to main content

A Brief Review of Spin-Glass Applications in Unsupervised and Semi-supervised Learning

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 9947))

Abstract

Spin-glass theory developed in statistical mechanics has found its usage in various information science problems. In this study, we focus on the application of spin-glass models in unsupervised and semi-supervised learning. Several key papers in this field are reviewed, to answer the question that why and how spin-glass is adopted. The question can be answered from two aspects.

Firstly, adopting spin-glass models enables the vast knowledge base developed in statistical mechanics to be used, such as the self-organizing grains at the superparamagnetic phase has a natural connection to clustering. Secondly, spin-glass model can serve as a bridge for model development, i.e., one can map existing model into spin-glass manner, facilitate it with new features and finally map it back.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Nishimori, H.: Statistical Physics of Spin Glasses, Information Processing: An Introduction. Clarendon Press, Oxford (2001)

    Book  MATH  Google Scholar 

  2. Sourlas, N.: Spin-glass models as error-correcting codes. Nature 339(6227), 693–695 (1989)

    Article  Google Scholar 

  3. Inoue, J.-I., Carlucci, D.M.: Image restoration using the q-ising spin glass. Phys. Rev. E 64(3), 036121 (2001)

    Article  Google Scholar 

  4. Amit, D.J., Gutfreund, H., Sompolinsky, H.: Storing infinite numbers of patterns in a spin-glass model of neural networks. Phys. Rev. Lett. 55(14), 1530 (1985)

    Article  Google Scholar 

  5. Wu, F.-Y.: The potts model. Rev. Mod. Phys. 54(1), 235 (1982)

    Article  MathSciNet  Google Scholar 

  6. Wang, J.-S., Swendsen, R.H.: Cluster monte carlo algorithms. Phys. A 167(3), 565–579 (1990)

    Article  MathSciNet  Google Scholar 

  7. Blatt, M., Wiseman, S., Domany, E.: Data clustering using a model granular magnet. Neural Comput. 9(8), 1805–1842 (1997)

    Article  Google Scholar 

  8. Fortuin, C.M., Kasteleyn, P.W.: On the random-cluster model: I. introduction. and relation to other models. Physica 57(4), 536–564 (1972)

    Article  MathSciNet  Google Scholar 

  9. Blatt, M., Wiseman, S., Domany, E.: Superparamagnetic clustering of data. Phys. Rev. Lett. 76(18), 3251 (1996)

    Article  Google Scholar 

  10. Clement, C., Liarte, D., Middleton, A., Sethna, J.: Effective hamiltonians of 2D spin glass clusters. In: APS Meeting Abstracts, vol. 1, p. 50004 (2015)

    Google Scholar 

  11. Qin, S.-M., Zeng, Y., Zhou, H.-J.: Spin glass phase transitions in the random feedback vertex set problem, arXiv preprint arXiv:1603.09032 (2016)

  12. Getz, G., Shental, N., Domany, E.: Semi-supervised learning-a statistical physics approach, arXiv preprint cs/0604011 (2006)

    Google Scholar 

  13. Berg, B.A., Neuhaus, T.: Multicanonical ensemble: a new approach to simulate first-order phase transitions. Phys. Rev. Lett. 68(1), 9 (1992)

    Article  Google Scholar 

  14. Newman, M.E.: Finding community structure in networks using the eigenvectors of matrices. Phys. Rev. E 74(3), 036104 (2006)

    Article  MathSciNet  Google Scholar 

  15. Fortunato, S.: Community detection in graphs. Phys. Rep. 486(3), 75–174 (2010)

    Article  MathSciNet  Google Scholar 

  16. Reichardt, J., Bornholdt, S.: Statistical mechanics of community detection. Phys. Rev. E 74(1), 016110 (2006)

    Article  MathSciNet  Google Scholar 

  17. Eaton, E., Mansbach, R.: A spin-glass model for semi-supervised community detection. In: AAAI, Citeseer (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lei Zhu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing AG

About this paper

Cite this paper

Zhu, L., Ikeda, K., Pang, P., Zhang, R., Sarrafzadeh, A. (2016). A Brief Review of Spin-Glass Applications in Unsupervised and Semi-supervised Learning. In: Hirose, A., Ozawa, S., Doya, K., Ikeda, K., Lee, M., Liu, D. (eds) Neural Information Processing. ICONIP 2016. Lecture Notes in Computer Science(), vol 9947. Springer, Cham. https://doi.org/10.1007/978-3-319-46687-3_64

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-46687-3_64

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-46686-6

  • Online ISBN: 978-3-319-46687-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics