Skip to main content

Extraction and Tracking of Scientific Topics by LDA

  • Conference paper
  • First Online:
Advances in Intelligent Networking and Collaborative Systems (INCoS 2017)

Part of the book series: Lecture Notes on Data Engineering and Communications Technologies ((LNDECT,volume 8))

Abstract

Scientific papers play an important role in the scientific research. Scientific researchers understand the research trends of their interested scientific topics. But the huge amount of papers makes them difficult to get a global view of scientific topics. In this paper, we proposed an automatic LDA-based method to extract scientific topics and track their evolutions. The method firstly divides the papers into some subsets according to the paper’s published year, then extracts scientific topics for each subset. To tract the evolutions of topics and their relations, a directed graph is constructed in terms of KL distances. The experimental results on Amind ACM-Citation-network dataset shows that our method is reasonable.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent dirichlet allocation. J. Mach. Learn. Res. 3, 993–1022 (2003)

    MATH  Google Scholar 

  2. Wang, X., Mccallum, A.: Topics over time: a non-Markov continuous-time model of topical trends. In: ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 424–433. ACM (2006)

    Google Scholar 

  3. Griffiths, T.L., Steyvers, M.: Finding scientific topics. In: Proceedings of the National Academy of Sciences of the United States of America, vol. 101(Suppl 1.1), p. 5228 (2004)

    Google Scholar 

  4. Hall, D., Jurafsky, D., Manning, C.D.: Studying the history of ideas using topic models. In: Conference on Empirical Methods in Natural Language Processing, pp. 363–371 (2008)

    Google Scholar 

  5. Wang, C., Blei, D., Heckerman, D.: Continuous time dynamic topic models. In: Mcallester, D., Nicholson, A. (eds.) Uncertainty in Artificial Intelligence, pp. 579–586 (2009)

    Google Scholar 

  6. Wei, X., Sun, J., Wang, X.: Dynamic mixture models for multiple time series. In: International Joint Conference on Artifical Intelligence, pp. 2909–2914. Morgan Kaufmann Publishers Inc. (2007)

    Google Scholar 

  7. Blei, D.M., Lafferty, J.D.: Dynamic topic models. In: Proceedings of the 23rd International Conference on Machine Learning. ACM (2006)

    Google Scholar 

  8. Tang, J., et al.: ArnetMiner: extraction and mining of academic social networks. In: ACM SIG KDD International Conference on Knowledge Discovery and Data Mining, pp. 990–998 (2008)

    Google Scholar 

Download references

Acknowledgments

This work was supported by the Chinese National Natural Science Foundation (Grant No.: 61602202), the Natural Science Foundation of Jiangsu Province, China (Grant No.: BK20160428), the Social Key Research and Development Project of Huaian, Jiangsu, China (Grant No.: HAS2015020) and the Graduate Student Scientific Research and Innovation Project of Jiangsu Province, China (Grant No.: 2015B38314).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yongjun Zhang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Cite this paper

Zhang, Y., Ma, J., Wang, Z., Chen, B. (2018). Extraction and Tracking of Scientific Topics by LDA. In: Barolli, L., Woungang, I., Hussain, O. (eds) Advances in Intelligent Networking and Collaborative Systems. INCoS 2017. Lecture Notes on Data Engineering and Communications Technologies, vol 8. Springer, Cham. https://doi.org/10.1007/978-3-319-65636-6_48

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-65636-6_48

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-65635-9

  • Online ISBN: 978-3-319-65636-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics