Abstract
The prevalence of creativity in the emergent online media language calls for more effective computational approach to semantic change. Two divergent metaphysical understandings are found with the task: juxtaposition-view of change and succession-view of change. This paper argues that the succession-view better reflects the essence of semantic change and proposes a successive framework for automatic semantic change detection. The framework analyzes the semantic change at both the word level and the individual-sense level inside a word by transforming the task into change pattern detection over time series data. At the word level, the framework models the word’s semantic change with S-shaped model and successfully correlates change patterns with classical semantic change categories such as broadening, narrowing, new word coining, metaphorical change, and metonymic change. At the sense level, the framework measures the conventionality of individual senses and distinguishes categories of temporary word usage, basic sense, novel sense and disappearing sense, again with S-shaped model. Experiments at both levels yield increased precision rate as compared with the baseline, supporting the succession-view of semantic change.
Similar content being viewed by others
References
Altmann, G., Buttlar, H.v., Rott, W., Strauss, U.: A law of change in language. In: Brainerd, B. (ed.) Proceedings of the Historical Linguistics, pp. 104–115. Brockmeyer, Bochum (1983)
Andersen, H.: Understanding linguistic innovations. In: Breivik, L.E., Jahr, E.H. (eds.) Proceedings of the Language Change : Contributions to the Study of its Causes, pp. 5–27. Mouton de Gruyter, Berlin ; New York (1989)
Bailey, C.J.N.: Variation and Linguistic Theory. Center for Applied Linguistics, Washington, D.C (1973)
Boussidan, A., Ploux, S.: Using topic salience and connotational drifts to detect candidates to semantic change. In: Proceedings of the 9th International Conference on Computational Semantics, pp. 315–319 (2011)
Breal, M.J.A.: Semantics : Studies in the Science of Meaning. Dover, New York (1964)
Broad, C.D.: Examination of McTaggart’s philosophy, Vol. II. Cambridge University Press, Cambridge (1938)
Brockwell, P.J., Davis, R.A.: Introduction to Time Series and Forecasting. Springer, New York (2002)
Brody, S., Lapata, M.: Bayesian word sense induction. In: Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics, pp. 103–111 (2009)
Cavallin, K.: Automatic extraction of potential examples of semantic change using lexical sets. In: Proceedings of the 11th Conference on Natural Language Processing, pp. 370–377 (2012)
Chang, C.C., Lin, C.J.: Libsvm : a library for support vector machines. ACM Trans. Intel. Syst. Technol. 2(27), 1–27 (2011)
Cook, C.P.: Exploiting linguistic knowledge to infer properties of neologisms. Ph.D. thesis (2010)
Cook, C.P., Hirst, G.: Automatic identification of words with novel but infrequent senses. In: Proceedings of the 25th Pacific Asia Conference on Language Information and Computation, pp. 265–274 (2011)
Crystal, D.: Language and the Internet. Cambridge University Press, New York (2006)
Dong, Z.: Hownet and the Computation of Meaning. World Scientific Publishing Co., Inc., USA (2006)
Dunning, T.: Accurate methods for the statistics of surprise and coincidence. Comput. Linguist. 19(1), 61–74 (1993)
Erk, K.: Unknown word sense detection as outlier detection. In: Proceedings of the Main Conference on Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics, pp. 128–135 (2006)
Ester, M., Kriegel, H.P., Sander, J., Xu, X.: A density-based algorithm for discovering clusters in large spatial databases with noise. In: Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining, pp. 226–231 (1996)
Firth, J.R.: A synopsis of linguistic theory, 1930-1955. In: Studies in Linguistic Analysis, pp. 1–32. Blackwell, Oxford (1957)
Fortson, B.W.I.: An approach to semantic change. In: Joseph, B.D., Janda, R.D. (eds.) Proceedings of the The Handbook of Historical Linguistics, pp. 648–666. Blackwell Pub., Malden, MA (2003)
Fritz, G.: Theories of meaning change - an overview. In: Maienborn, C., Heusinger, K.v., Portner, P. (eds.) Proceedings of the Semantics : An International Handbook of Natural Language Meaning, pp. 2625–2652. De Gruyter Mouton, Berlin; Boston (2011)
Geach, P.T.: Truth, Love, and Immortality: An Introduction to McTaggart’s Philosophy. Hutchinson, Michigan (1979)
Geeraerts, D.: Diachronic Prototype Semantics: A Contribution to Historical Lexicology. Oxford University Press, Oxford (1997)
Geeraerts, D.: Theories of Lexical Semantics. Oxford University Press, Oxford (2010)
Gulordava, K., Baroni, M.: A distributional similarity approach to the detection of semantic change in the google books ngram corpus. In: Proceedings of the GEMS 2011 Workshop on GEometrical Models of Natural Language Semantics, pp. 67–71 (2011)
Haken, H.: Synergetics: An Introduction: Nonequilibrium Phase Transitions and Self-Organization in Physics, Chemistry, and Biology. Springer, Berlin (1977)
Hale, M.: Historical Linguistics: Theory and Method. Blackwell, Malden, Oxford (2007)
Harris, Z.S.: Distributional structure. Word 10(2-3), 146–162 (1954)
Hilpert, M., Gries, S.T.: Assessing frequency changes in multistage diachronic corpora: Applications for historical corpus linguistics and the study of language acquisition. Lit. Linguist. Comput. 25(4), 385–401 (2009)
Hock, H.H.: Principles of Historical Linguistics. Mouton de Gruyter, Berlin; New York (1991)
Hung, K., LUK, R., Chung, K., Shu, W.: Determination of context window size. Int. J. Comput. Proc. Lang. 14(1), 71–80 (2001)
Janda, R.D., Joseph, B.D.: On language, change, and language change c or, of history, linguistics, and historical linguistics. In: Joseph, B.D., Janda, R.D. (eds.) Proceedings of the The Handbook of Historical Linguistics, pp. 3–180. Blackwell Pub., Malden, MA (2003)
Kroch, A.S.: Reflexes of grammar in patterns of language change. Lang. Var. Chang. 1, 199–244 (1989)
Labov, W.: Sociolinguistic Patterns. University of Pennsylvania Press, Philadelphia (1972)
Labov, W.: Principles of Linguistic Change: Internal Factors. Blackwell, Oxford, U.K. ; Cambridge Mass. (1994)
Lass, R.: Historical Linguistics and Language Change. Cambridge University Press, Cambridge ; New York (1997)
Lau, J.H., Cook, P., McCarthy, D., Newman, D., Baldwin, T.: Word sense induction for novel sense detection. In: Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics, pp. 591–601 (2012)
Manning, C.D., Schutze, H.: Foundations of Statistical Natural Language Processing. MIT Press, Cambridge, Mass. (1999)
Matsuda, K.: Constant rate hypothesis, 2nd edn. In: Brown, E.K., Anderson, A. (eds.) Proceedings of the Encyclopedia of language and linguistics, pp. 54–56. Elsevier, Amsterdam, Netherlands, Boston, Mass. (2006)
McCarthy, D., Koeling, R., Weeds, J., Carroll, J.: Finding predominant senses in untagged text. In: Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics, pp. 577–583
Michel, J.B., Shen, Y.K., Aiden, A.P., Veres, A., Gray, M.K., Team, T.G.B., Pickett, J.P., Hoiberg, D., Clancy, D., Norvig, P., Orwant, J., Pinker, S., Nowak, M.A., Aiden, E.L.: Quantitative analysis of culture using millions of digitized books. Science 331(6014), 176–182 (2011)
Navigli, R.: Word sense disambiguation: A survey. ACM Comput. Surv. 41(2), 1–69 (2009)
Osgood, C.E., Sebeok, T.A.: Psycholinguistics: a survey of theory and research problems. J. Abnorm. Soc. Psychol. 49(4, Part 2), 1–203 (1954)
Pantel, P., Lin, D.: Discovering word senses from text. In: Proceedings of the 8th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 613–619 (2002)
Riemer, N.: Introducing Semantics. Cambridge University Press, Cambridge (2010)
Robert, S.: Words and their meanings: Principles of variation and stabilization. In: Vanhove, M. (ed.) Proceedings From Polysemy to Semantic Change, pp. 55–92. John Benjamins Publishing Co, Amsterdam, The Netherlands (2008)
Rohrdantz, C., Hautli, A., Mayer, T., Butt, M., Keim, D.A., Plank, F.: Towards tracking semantic change by visual analytics. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, pp. 305–310 (2011)
Sagi, E., Kaufmann, S., Clark, B.: Semantic density analysis: comparing word meaning across time and phonetic space. In: Proceedings of the Workshop on Geometrical Models of Natural Language Semantics, pp. 104–111 (2009)
Snchez-Marco, C., Evert, S.: Measuring semantic change: The case of spanish participial constructions. In: Proceedings of Quantitative Investigations in Theoretical Linguistics 4, pp. 79–83 (2011)
Sweetser, E.: Metaphorical and Cultural Aspects of Semantic Structure. Cambridge University Press, Cambridge (1990)
Traugott, E.C.: Semantic change: Bleaching, strengthening, narrowing, extension. In: Brown, K. (ed.) Proceedings of the Encyclopedia of Language and Linguistics, pp. 124–131. Elsevier Science, Oxford (2006)
Traugott, E.C., Dasher, R.B.: Regularity in Semantic Change. Cambridge University Press, Cambridge (2002)
Turney, P.D., Pantel, P.: From frequency to meaning: vector space models of semantics. J. Artif. Intell. Res. 37(1), 141–188 (2010)
Ullmann, S.: The Principles of Semantics. Basil Blackwell, Oxford (1957)
Veronis, J.: Hyperlex: lexical cartography for information retrieval. Comput. Speech Lang. 18(3), 223–252 (2004)
Wang, W.S.Y., Ke, J., Minett, J.W.: Computational studies of language evolution. In: C.R.H. Lenders, W. (ed.) Proceedings of the Computational Linguistics and Beyond Perspectives at the Beginning of the 21st Century, pp. 65–106. Institute of Linguistics, Academia Sinica (2004)
Weaver, W.: Translation. In: Locke, W., Booth, D. (eds.) Proceedings of the Machine Translation of Languages, pp. 15–22. MIT Press, Cambridge, MA (1955)
Weinreich, U., Herzog, M., Labov, W.: Empirical foundations for a theory of language change. In: Lehmann, W.P. (ed.) Directions for Historical Linguistics: A Symposium, pp. 95–195. University of Texas Press, Austin (1968)
Wittgenstein, L.: Philosophical Investigations. Basil Blackwell Ltd, Oxford (1953)
Yokoyama, S., Sanada, H.: Logistic regression model for predicting language change. In: Khler, R. (ed.) Proceedings of the Linguistics, Quantitative, pp. 176–192. RAM-Verlag, Ldenscheid (2009)
Zuraw, K.: Probability in language change. In: Bod, R., Hay, J., Jannedy, S. (eds.) Proceedings of the Probabilistic Linguistics, pp. 139–176. MIT Press, Cambridge, Mass. (2003)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Tang, X., Qu, W. & Chen, X. Semantic change computation: A successive approach. World Wide Web 19, 375–415 (2016). https://doi.org/10.1007/s11280-014-0316-y
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11280-014-0316-y