Skip to main content

Detection of Domain-Specific Trends in Text Collections

  • Conference paper
  • First Online:
Book cover Analysis of Images, Social Networks and Texts (AIST 2014)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 436))

  • 1175 Accesses

Abstract

This study considers the problem of automatic trend detection in document collections related to several specific domains. The suggested trend detection algorithm is based on the domain-specific trend model. The algorithm was evaluated on documents from shipbuilding and power engineering domains.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    The code, instructions and results can be found on https://bitbucket.org/ilnurgadelshin/trends.

  2. 2.

    The full lists of the found trends could be found on https://bitbucket.org/ilnurgadelshin/trends.

References

  1. Porter, F.: An algorithm for suffix stripping. Program 14(3), 130–137 (1980)

    Article  Google Scholar 

  2. Salton, G., Buckley, C.: Term-weighting approaches in automatic text retrieval. Inf. Process. Manage. 24(5), 513–523 (1988)

    Article  Google Scholar 

  3. Natural Language Toolkit. http://www.nltk.org/

  4. Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent Dirichlet allocation. J. Mach. Learn. Res. 3, 993–1022 (2003)

    MATH  Google Scholar 

  5. Vorontsov, K.V., Potapenko, A.A.: Regularization, robustness and sparseness of probabilistic topic models. Comput. Res. Model. 2, 161–174 (2012) (in Russian)

    Google Scholar 

  6. Teh, Y.W., Jordan, M.I.: Hierarchical Bayesian nonparametric models with applications. In: Hjort, N., Holmes, C., Müller, P., Walker, S. (eds.) Bayesian Nonparametrics Principles and Practice. Cambridge University Press, Cambridge (2009)

    Google Scholar 

  7. Teh, Y.W.: Dirichlet processes. In: Sammut, C., Webb, G.I. (eds.) Encyclopedia of Machine Learning, pp. 280–287. Springer, Heidelberg (2010)

    Google Scholar 

  8. Blei, D, Lafferty, J.: Dynamic topic models. In: ICML (2006)

    Google Scholar 

  9. Glance, N., Hurst, M., Tomokiyo, T.: BlogPulse: automated trend discovery for weblogs. In: WWW 2004, ACM (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Dmitry Ilvovsky .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Gadelshin, I., Antonova, A., Ilvovsky, D. (2014). Detection of Domain-Specific Trends in Text Collections. In: Ignatov, D., Khachay, M., Panchenko, A., Konstantinova, N., Yavorsky, R. (eds) Analysis of Images, Social Networks and Texts. AIST 2014. Communications in Computer and Information Science, vol 436. Springer, Cham. https://doi.org/10.1007/978-3-319-12580-0_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-12580-0_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-12579-4

  • Online ISBN: 978-3-319-12580-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics