Skip to main content
SpringerLink
Log in
Book cover

International Conference on Future Data and Security Engineering

FDSE 2020: Future Data and Security Engineering. Big Data, Security and Privacy, Smart City and Industry 4.0 Applications pp 443–451Cite as

Using Topic Models to Label Documents for Classification

  • Conference paper
  • First Online:

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1306))

Abstract

Document classifiers are supervised learning models in which documents are assigned categories based on models that are trained on annotated datasets. In this paper, we use topic models to automatically assign categories to documents, which later are fed to document classification models. We perform experiments on several datasets in Vietnamese, collected from free online resources. Our method is promising and applicable to many datasets that have not been labeled.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    https://github.com/duyvuleo/VNTC.

  2. 2.

    https://vnexpress.net/.

  3. 3.

    https://www.nltk.org/.

  4. 4.

    https://github.com/undertheseanlp/underthesea.

  5. 5.

    https://github.com/stopwords/vietnamese-stopwords.

  6. 6.

    https://radimrehurek.com/gensim/index.html.

  7. 7.

    https://github.com/cemoody/lda2vec.

  8. 8.

    https://github.com/AnubhavGupta3377.

  9. 9.

    https://palmetto.demos.dice-research.org/.

References

  1. Hasnat, F., Hasan, M., Khan, N.H., Ali, A.: Text classification using machine learning algorithms. Doctoral dissertation, Brac University, Bangladesh (2018)

    Google Scholar 

  2. Benkhelifa, R., Laallam, F.Z.: Facebook posts text classification to improve information filtering. In: International Conference on Web Information Systems and Technologies, pp. 202–207 (2016)

    Google Scholar 

  3. Dadgar, S.M.H., Araghi, M.S., Farahani, M.M.: A novel text mining approach based on TF-IDF and support vector machine for news classification. In: IEEE International Conference on Engineering and Technology, pp. 112–116 (2016)

    Google Scholar 

  4. Kim Y.: Convolutional neural networks for sentence classification. arXiv preprint arXiv:1408.5882 (2014)

  5. Silva, J., Coheur, L., Mendes, A.C., Wichert, A.: From symbolic to sub-symbolic information in question classification. Artif. Intell. Rev. 35(2), 137–54 (2011)

    Article  Google Scholar 

  6. Wang, S.I., Manning, C.D.: Baselines and bigrams: simple, good sentiment and topic classification. In: the 50th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pp. 90–94 (2012)

    Google Scholar 

  7. Socher, R., Pennington, J., Huang, E.H., Ng, A.Y., Manning, C.D.: Semi-supervised recursive autoencoders for predicting sentiment distributions. In: The Conference on Empirical Methods in Natural Language Processing, pp. 151–161 (2011)

    Google Scholar 

  8. Tang, D., Qin, B., Liu, T.: Document modeling with gated recurrent neural network for sentiment classification. In: The Conference on Empirical Methods in Natural Language Processing, pp. 1422–1432 (2015)

    Google Scholar 

  9. Peng, H., et al.: Large-scale hierarchical text classification with recursively regularized deep graph-CNN. In: The 2018 World Wide Web Conference, pp. 1063–1072 (2018)

    Google Scholar 

  10. Rao, A., Spasojevic, N.: Actionable and political text classification using word embeddings and LSTM. arXiv preprint arXiv:1607.02501 (2016)

  11. Xiao, L., Wang, G., Zuo, Y.: Research on patent text classification based on Word2Vec and LSTM. In: The 11th International Symposium on Computational Intelligence and Design (ISCID), vol. 1, pp. 71–74 (2018)

    Google Scholar 

  12. Liu, G., Guo, J.: Bidirectional LSTM with attention mechanism and convolutional layer for text classification. Neurocomputing 337, 325–38 (2019)

    Article  Google Scholar 

  13. Google Scholar 

  14. Google Scholar 

  15. Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 (2013)

  16. Dumais, S.T.: Latent semantic analysis. Ann. Rev. Inf. Sci. Technol. 38(1), 188–230 (2004)

    Article  Google Scholar 

  17. Hofmann, T.: Unsupervised learning by probabilistic latent semantic analysis. Mach. Learn. 42(1–2), 177–196 (2001)

    Article  Google Scholar 

  18. Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent Dirichlet allocation. J. Mach. Learn. Res. 3(Jan), 993–1022 (2003)

    MATH  Google Scholar 

  19. Moody, C.E.: Mixing Dirichlet topic models and word embeddings to make LDA2Vec. arXiv preprint arXiv:1605.02019 (2016)

  20. Lam, K.N., To, T.H., Tran, T.T., Kalita, J.: Improving Vietnamese WordNet using word embedding. In: The 3rd International Conference on Natural Language Processing and Information Retrieval, pp. 110–114 (2019)

    Google Scholar 

  21. Pedregosa, F., et al.: Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825–2830 (2011)

    MathSciNet  MATH  Google Scholar 

  22. Jedrzejowicz, J., Zakrzewska, M.: Text classification using LDA-W2V hybrid algorithm. In: Czarnowski, I., Howlett, R.J., Jain, L.C. (eds.) Intelligent Decision Technologies 2019. SIST, vol. 142, pp. 227–237. Springer, Singapore (2020). https://doi.org/10.1007/978-981-13-8311-3_20

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Can Tho University, Can Tho, Vietnam

    Khang Nhut Lam & Lam Thanh Truong

  2. University of Colorado, Colorado Springs, USA

    Jugal Kalita

Authors
  1. Khang Nhut Lam
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lam Thanh Truong
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jugal Kalita
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Khang Nhut Lam .

Editor information

Editors and Affiliations

  1. Ho Chi Minh City University of Technology, Ho Chi Minh City, Vietnam

    Tran Khanh Dang

  2. Johannes Kepler University of Linz, Linz, Austria

    Josef Küng

  3. Hosei University, Tokyo, Japan

    Makoto Takizawa

  4. Sungkyunkwan University, Suwon, Korea (Republic of)

    Tai M. Chung

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Lam, K.N., Truong, L.T., Kalita, J. (2020). Using Topic Models to Label Documents for Classification. In: Dang, T.K., Küng, J., Takizawa, M., Chung, T.M. (eds) Future Data and Security Engineering. Big Data, Security and Privacy, Smart City and Industry 4.0 Applications. FDSE 2020. Communications in Computer and Information Science, vol 1306. Springer, Singapore. https://doi.org/10.1007/978-981-33-4370-2_32

Download citation

  • DOI: https://doi.org/10.1007/978-981-33-4370-2_32

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-33-4369-6

  • Online ISBN: 978-981-33-4370-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation