Abstract
In this article we present a model of human written text based on statistical mechanics consideration. The empirical derivation of the potential energy for the parts of the text and the calculation of the thermodynamic parameters of the system, show that the “specific heat” corresponds to the semantic classification of the words in the text, separating keywords, function words and common words. This can give advantages when the model is used in text searching mechanisms.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Baeza-Yates, R., Ribeiro-Neto, B.: Modern Information Retrieval. Addison Wesley, Essex (1999)
Amati, G., van Rijsbergen, C.J.: Probabilistic Models of Information Retrieval Based on Measuring the Divergence from Randomness. ACM Trans. Inf. Syst. 20, 289–357 (2002)
Robertson, S., Sparck Jones, K.: Relevance Weighting of Search Terms. J. Am. Soc. Inf. Sci. 27, 129–146 (1976)
Robertson, S.: Understanding Inverse Document Frequency: On theoretical arguments for IDF. Journal of Documentation 60(5), 503–520 (2004)
Baayen, R.H.: Word Frequency Distributions. Kluwer, Dordrecht (2001)
Beck, C., Schloege, F.: Thermodynamics of Chaotic Systems. Cambridge University Press, Cambridge (1993)
Labbé, C., Labbé, D., Hubert, P.: Automatic Segmentation of Texts and Corpora. Journal of Quantitative Linguistics 11(3), 193–216 (2004)
The Gutenberg collection, http://www.gutenberg.org
Shen, J., Koroutchev, K.: Message Exchange and Energy Model of Text. Technical report UAM Spain (June 2008)
The British National Corpus, Version II, Distributed by Oxford University Computing Service on behalf of the BNC Consortium (2001), http://www.natcorp.ox.ac.uk
Erdelyi, A.: Asymptotic Expansions. Dover, New York (1956)
Voorhees, E., Harman, D. (eds.): TREC: experiment and evaluation in information retrieval. MIT Press, Cambridge (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Koroutchev, K., Korutcheva, E., Shen, J. (2009). Written Texts as Statistical Mechanical Problem. In: Azzopardi, L., et al. Advances in Information Retrieval Theory. ICTIR 2009. Lecture Notes in Computer Science, vol 5766. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04417-5_22
Download citation
DOI: https://doi.org/10.1007/978-3-642-04417-5_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-04416-8
Online ISBN: 978-3-642-04417-5
eBook Packages: Computer ScienceComputer Science (R0)