Skip to main content
Log in

Semantic change computation: A successive approach

  • Published:
World Wide Web Aims and scope Submit manuscript

Abstract

The prevalence of creativity in the emergent online media language calls for more effective computational approach to semantic change. Two divergent metaphysical understandings are found with the task: juxtaposition-view of change and succession-view of change. This paper argues that the succession-view better reflects the essence of semantic change and proposes a successive framework for automatic semantic change detection. The framework analyzes the semantic change at both the word level and the individual-sense level inside a word by transforming the task into change pattern detection over time series data. At the word level, the framework models the word’s semantic change with S-shaped model and successfully correlates change patterns with classical semantic change categories such as broadening, narrowing, new word coining, metaphorical change, and metonymic change. At the sense level, the framework measures the conventionality of individual senses and distinguishes categories of temporary word usage, basic sense, novel sense and disappearing sense, again with S-shaped model. Experiments at both levels yield increased precision rate as compared with the baseline, supporting the succession-view of semantic change.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Altmann, G., Buttlar, H.v., Rott, W., Strauss, U.: A law of change in language. In: Brainerd, B. (ed.) Proceedings of the Historical Linguistics, pp. 104–115. Brockmeyer, Bochum (1983)

    Google Scholar 

  2. Andersen, H.: Understanding linguistic innovations. In: Breivik, L.E., Jahr, E.H. (eds.) Proceedings of the Language Change : Contributions to the Study of its Causes, pp. 5–27. Mouton de Gruyter, Berlin ; New York (1989)

    Google Scholar 

  3. Bailey, C.J.N.: Variation and Linguistic Theory. Center for Applied Linguistics, Washington, D.C (1973)

  4. Boussidan, A., Ploux, S.: Using topic salience and connotational drifts to detect candidates to semantic change. In: Proceedings of the 9th International Conference on Computational Semantics, pp. 315–319 (2011)

  5. Breal, M.J.A.: Semantics : Studies in the Science of Meaning. Dover, New York (1964)

    Google Scholar 

  6. Broad, C.D.: Examination of McTaggart’s philosophy, Vol. II. Cambridge University Press, Cambridge (1938)

    Google Scholar 

  7. Brockwell, P.J., Davis, R.A.: Introduction to Time Series and Forecasting. Springer, New York (2002)

    Book  MATH  Google Scholar 

  8. Brody, S., Lapata, M.: Bayesian word sense induction. In: Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics, pp. 103–111 (2009)

  9. Cavallin, K.: Automatic extraction of potential examples of semantic change using lexical sets. In: Proceedings of the 11th Conference on Natural Language Processing, pp. 370–377 (2012)

  10. Chang, C.C., Lin, C.J.: Libsvm : a library for support vector machines. ACM Trans. Intel. Syst. Technol. 2(27), 1–27 (2011)

    Article  Google Scholar 

  11. Cook, C.P.: Exploiting linguistic knowledge to infer properties of neologisms. Ph.D. thesis (2010)

  12. Cook, C.P., Hirst, G.: Automatic identification of words with novel but infrequent senses. In: Proceedings of the 25th Pacific Asia Conference on Language Information and Computation, pp. 265–274 (2011)

  13. Crystal, D.: Language and the Internet. Cambridge University Press, New York (2006)

    Book  Google Scholar 

  14. Dong, Z.: Hownet and the Computation of Meaning. World Scientific Publishing Co., Inc., USA (2006)

    Book  Google Scholar 

  15. Dunning, T.: Accurate methods for the statistics of surprise and coincidence. Comput. Linguist. 19(1), 61–74 (1993)

    Google Scholar 

  16. Erk, K.: Unknown word sense detection as outlier detection. In: Proceedings of the Main Conference on Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics, pp. 128–135 (2006)

  17. Ester, M., Kriegel, H.P., Sander, J., Xu, X.: A density-based algorithm for discovering clusters in large spatial databases with noise. In: Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining, pp. 226–231 (1996)

  18. Firth, J.R.: A synopsis of linguistic theory, 1930-1955. In: Studies in Linguistic Analysis, pp. 1–32. Blackwell, Oxford (1957)

    Google Scholar 

  19. Fortson, B.W.I.: An approach to semantic change. In: Joseph, B.D., Janda, R.D. (eds.) Proceedings of the The Handbook of Historical Linguistics, pp. 648–666. Blackwell Pub., Malden, MA (2003)

    Chapter  Google Scholar 

  20. Fritz, G.: Theories of meaning change - an overview. In: Maienborn, C., Heusinger, K.v., Portner, P. (eds.) Proceedings of the Semantics : An International Handbook of Natural Language Meaning, pp. 2625–2652. De Gruyter Mouton, Berlin; Boston (2011)

    Google Scholar 

  21. Geach, P.T.: Truth, Love, and Immortality: An Introduction to McTaggart’s Philosophy. Hutchinson, Michigan (1979)

    Google Scholar 

  22. Geeraerts, D.: Diachronic Prototype Semantics: A Contribution to Historical Lexicology. Oxford University Press, Oxford (1997)

    Google Scholar 

  23. Geeraerts, D.: Theories of Lexical Semantics. Oxford University Press, Oxford (2010)

    Google Scholar 

  24. Gulordava, K., Baroni, M.: A distributional similarity approach to the detection of semantic change in the google books ngram corpus. In: Proceedings of the GEMS 2011 Workshop on GEometrical Models of Natural Language Semantics, pp. 67–71 (2011)

  25. Haken, H.: Synergetics: An Introduction: Nonequilibrium Phase Transitions and Self-Organization in Physics, Chemistry, and Biology. Springer, Berlin (1977)

    MATH  Google Scholar 

  26. Hale, M.: Historical Linguistics: Theory and Method. Blackwell, Malden, Oxford (2007)

    Google Scholar 

  27. Harris, Z.S.: Distributional structure. Word 10(2-3), 146–162 (1954)

    Article  Google Scholar 

  28. Hilpert, M., Gries, S.T.: Assessing frequency changes in multistage diachronic corpora: Applications for historical corpus linguistics and the study of language acquisition. Lit. Linguist. Comput. 25(4), 385–401 (2009)

    Article  Google Scholar 

  29. Hock, H.H.: Principles of Historical Linguistics. Mouton de Gruyter, Berlin; New York (1991)

    Book  Google Scholar 

  30. Hung, K., LUK, R., Chung, K., Shu, W.: Determination of context window size. Int. J. Comput. Proc. Lang. 14(1), 71–80 (2001)

    Article  Google Scholar 

  31. Janda, R.D., Joseph, B.D.: On language, change, and language change c or, of history, linguistics, and historical linguistics. In: Joseph, B.D., Janda, R.D. (eds.) Proceedings of the The Handbook of Historical Linguistics, pp. 3–180. Blackwell Pub., Malden, MA (2003)

    Google Scholar 

  32. Kroch, A.S.: Reflexes of grammar in patterns of language change. Lang. Var. Chang. 1, 199–244 (1989)

    Article  Google Scholar 

  33. Labov, W.: Sociolinguistic Patterns. University of Pennsylvania Press, Philadelphia (1972)

    Google Scholar 

  34. Labov, W.: Principles of Linguistic Change: Internal Factors. Blackwell, Oxford, U.K. ; Cambridge Mass. (1994)

    Google Scholar 

  35. Lass, R.: Historical Linguistics and Language Change. Cambridge University Press, Cambridge ; New York (1997)

    Book  Google Scholar 

  36. Lau, J.H., Cook, P., McCarthy, D., Newman, D., Baldwin, T.: Word sense induction for novel sense detection. In: Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics, pp. 591–601 (2012)

  37. Manning, C.D., Schutze, H.: Foundations of Statistical Natural Language Processing. MIT Press, Cambridge, Mass. (1999)

    MATH  Google Scholar 

  38. Matsuda, K.: Constant rate hypothesis, 2nd edn. In: Brown, E.K., Anderson, A. (eds.) Proceedings of the Encyclopedia of language and linguistics, pp. 54–56. Elsevier, Amsterdam, Netherlands, Boston, Mass. (2006)

    Chapter  Google Scholar 

  39. McCarthy, D., Koeling, R., Weeds, J., Carroll, J.: Finding predominant senses in untagged text. In: Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics, pp. 577–583

  40. Michel, J.B., Shen, Y.K., Aiden, A.P., Veres, A., Gray, M.K., Team, T.G.B., Pickett, J.P., Hoiberg, D., Clancy, D., Norvig, P., Orwant, J., Pinker, S., Nowak, M.A., Aiden, E.L.: Quantitative analysis of culture using millions of digitized books. Science 331(6014), 176–182 (2011)

    Article  Google Scholar 

  41. Navigli, R.: Word sense disambiguation: A survey. ACM Comput. Surv. 41(2), 1–69 (2009)

    Article  Google Scholar 

  42. Osgood, C.E., Sebeok, T.A.: Psycholinguistics: a survey of theory and research problems. J. Abnorm. Soc. Psychol. 49(4, Part 2), 1–203 (1954)

    Google Scholar 

  43. Pantel, P., Lin, D.: Discovering word senses from text. In: Proceedings of the 8th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 613–619 (2002)

  44. Riemer, N.: Introducing Semantics. Cambridge University Press, Cambridge (2010)

    Book  Google Scholar 

  45. Robert, S.: Words and their meanings: Principles of variation and stabilization. In: Vanhove, M. (ed.) Proceedings From Polysemy to Semantic Change, pp. 55–92. John Benjamins Publishing Co, Amsterdam, The Netherlands (2008)

    Chapter  Google Scholar 

  46. Rohrdantz, C., Hautli, A., Mayer, T., Butt, M., Keim, D.A., Plank, F.: Towards tracking semantic change by visual analytics. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, pp. 305–310 (2011)

  47. Sagi, E., Kaufmann, S., Clark, B.: Semantic density analysis: comparing word meaning across time and phonetic space. In: Proceedings of the Workshop on Geometrical Models of Natural Language Semantics, pp. 104–111 (2009)

  48. Snchez-Marco, C., Evert, S.: Measuring semantic change: The case of spanish participial constructions. In: Proceedings of Quantitative Investigations in Theoretical Linguistics 4, pp. 79–83 (2011)

  49. Sweetser, E.: Metaphorical and Cultural Aspects of Semantic Structure. Cambridge University Press, Cambridge (1990)

    Google Scholar 

  50. Traugott, E.C.: Semantic change: Bleaching, strengthening, narrowing, extension. In: Brown, K. (ed.) Proceedings of the Encyclopedia of Language and Linguistics, pp. 124–131. Elsevier Science, Oxford (2006)

    Chapter  Google Scholar 

  51. Traugott, E.C., Dasher, R.B.: Regularity in Semantic Change. Cambridge University Press, Cambridge (2002)

    Google Scholar 

  52. Turney, P.D., Pantel, P.: From frequency to meaning: vector space models of semantics. J. Artif. Intell. Res. 37(1), 141–188 (2010)

    MathSciNet  MATH  Google Scholar 

  53. Ullmann, S.: The Principles of Semantics. Basil Blackwell, Oxford (1957)

    Google Scholar 

  54. Veronis, J.: Hyperlex: lexical cartography for information retrieval. Comput. Speech Lang. 18(3), 223–252 (2004)

    Article  Google Scholar 

  55. Wang, W.S.Y., Ke, J., Minett, J.W.: Computational studies of language evolution. In: C.R.H. Lenders, W. (ed.) Proceedings of the Computational Linguistics and Beyond Perspectives at the Beginning of the 21st Century, pp. 65–106. Institute of Linguistics, Academia Sinica (2004)

  56. Weaver, W.: Translation. In: Locke, W., Booth, D. (eds.) Proceedings of the Machine Translation of Languages, pp. 15–22. MIT Press, Cambridge, MA (1955)

    Google Scholar 

  57. Weinreich, U., Herzog, M., Labov, W.: Empirical foundations for a theory of language change. In: Lehmann, W.P. (ed.) Directions for Historical Linguistics: A Symposium, pp. 95–195. University of Texas Press, Austin (1968)

    Google Scholar 

  58. Wittgenstein, L.: Philosophical Investigations. Basil Blackwell Ltd, Oxford (1953)

    MATH  Google Scholar 

  59. Yokoyama, S., Sanada, H.: Logistic regression model for predicting language change. In: Khler, R. (ed.) Proceedings of the Linguistics, Quantitative, pp. 176–192. RAM-Verlag, Ldenscheid (2009)

    Google Scholar 

  60. Zuraw, K.: Probability in language change. In: Bod, R., Hay, J., Jannedy, S. (eds.) Proceedings of the Probabilistic Linguistics, pp. 139–176. MIT Press, Cambridge, Mass. (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xuri Tang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tang, X., Qu, W. & Chen, X. Semantic change computation: A successive approach. World Wide Web 19, 375–415 (2016). https://doi.org/10.1007/s11280-014-0316-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11280-014-0316-y

Keywords

Navigation