Skip to main content

Written Texts as Statistical Mechanical Problem

  • Conference paper
Advances in Information Retrieval Theory (ICTIR 2009)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 5766))

Included in the following conference series:

  • 1018 Accesses

Abstract

In this article we present a model of human written text based on statistical mechanics consideration. The empirical derivation of the potential energy for the parts of the text and the calculation of the thermodynamic parameters of the system, show that the “specific heat” corresponds to the semantic classification of the words in the text, separating keywords, function words and common words. This can give advantages when the model is used in text searching mechanisms.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Baeza-Yates, R., Ribeiro-Neto, B.: Modern Information Retrieval. Addison Wesley, Essex (1999)

    Google Scholar 

  2. Amati, G., van Rijsbergen, C.J.: Probabilistic Models of Information Retrieval Based on Measuring the Divergence from Randomness. ACM Trans. Inf. Syst. 20, 289–357 (2002)

    Article  Google Scholar 

  3. Robertson, S., Sparck Jones, K.: Relevance Weighting of Search Terms. J. Am. Soc. Inf. Sci. 27, 129–146 (1976)

    Article  Google Scholar 

  4. Robertson, S.: Understanding Inverse Document Frequency: On theoretical arguments for IDF. Journal of Documentation 60(5), 503–520 (2004)

    Article  Google Scholar 

  5. Baayen, R.H.: Word Frequency Distributions. Kluwer, Dordrecht (2001)

    Book  MATH  Google Scholar 

  6. Beck, C., Schloege, F.: Thermodynamics of Chaotic Systems. Cambridge University Press, Cambridge (1993)

    Book  Google Scholar 

  7. Labbé, C., Labbé, D., Hubert, P.: Automatic Segmentation of Texts and Corpora. Journal of Quantitative Linguistics 11(3), 193–216 (2004)

    Article  Google Scholar 

  8. The Gutenberg collection, http://www.gutenberg.org

  9. Shen, J., Koroutchev, K.: Message Exchange and Energy Model of Text. Technical report UAM Spain (June 2008)

    Google Scholar 

  10. The British National Corpus, Version II, Distributed by Oxford University Computing Service on behalf of the BNC Consortium (2001), http://www.natcorp.ox.ac.uk

  11. Erdelyi, A.: Asymptotic Expansions. Dover, New York (1956)

    MATH  Google Scholar 

  12. Voorhees, E., Harman, D. (eds.): TREC: experiment and evaluation in information retrieval. MIT Press, Cambridge (2005)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Koroutchev, K., Korutcheva, E., Shen, J. (2009). Written Texts as Statistical Mechanical Problem. In: Azzopardi, L., et al. Advances in Information Retrieval Theory. ICTIR 2009. Lecture Notes in Computer Science, vol 5766. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04417-5_22

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-04417-5_22

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-04416-8

  • Online ISBN: 978-3-642-04417-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics