Skip to main content
SpringerLink
Log in

A Semantic-Based Approach for Keyphrase Extraction from Vietnamese Documents Using Thematic Vector

  • Conference paper
  • First Online:
Intelligent Information and Database Systems (ACIIDS 2022)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 13757))

Included in the following conference series:

  • 832 Accesses

Abstract

Keyphrase extraction plays an important role in many applications of Natural Language Processing. There are many effective proposals for English, but those approaches are not completely applicable for low resources languages such as Vietnamese. In this paper, we propose a Semantic-based Approach for Keyphrase Extraction (SAKE), which improved the TextRank algorithm [1]. In SAKE, we apply semantic to the phrases and incorporates the semantic to the ranking process. Technically, a document is represented as a graph, in which vertices are words and edges are relations among words. In each document, we get a representative thematic vector by computing the average of word embedding vectors. Each vertex has a similarity score to the thematic vector and this score will be involved to the scoring in the ranking process. The important vertices are highly weighted not only by their relationships to other vertices but also by the similarity to the document theme. We experimented our proposed method on Vietnamese news articles. The result shows that our SAKE improved TextRank for Vietnamese text by achieving 1.8% higher of F1-score.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    https://thanhnien.vn/

  2. 2.

    https://phunuonline.com.vn/

  3. 3.

    https://laodong.vn/

  4. 4.

    https://fasttext.cc/docs/en/crawl-vectors.html.

References

  1. Mihalcea, R., Tarau, P.: Textrank: Bringing order into text. In: Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing, pp. 404–411. Association for Computational Linguistics (2004)

    Google Scholar 

  2. Turney, P.D.: Learning algorithms for keyphrase extraction. Inf. Retrieval 2, 303–336 (2000). https://doi.org/10.1023/A:1009976227802

    Article  Google Scholar 

  3. Witten, I.H., Paynter, G.W., Frank, E., Gutwin, C., Nevill-Manning, C.G.: KEA: practical automatic keyphrase extraction. In: Proceedings of the Fourth ACM conference on Digital Libraries, pp. 254–255 (1999). https://doi.org/10.1145/313238.313437

  4. Danesh, S., Sumner, T., Martin, J. H.: SGRank: combining statistical and graphical methods to improve the state of the art in unsupervised keyphrase extraction. In: Proceedings of the Fourth Joint Conference on Lexical and Computational Semantics, pp. 117–126. Association for Computational Linguistics (2015). https://doi.org/10.18653/v1/S15-1013

  5. Florescu, C., Caragea, C.: PositionRank: an unsupervised approach to keyphrase extraction from scholarly documents. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, pp. 1105–1115. Association for Computational Linguistics (2017). https://doi.org/10.18653/v1/P17-1102

  6. Liu, J., Li, P., Zheng, Y., Sun M.: Clustering to find exemplar terms for keyphrase extraction. In: Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, pp. 257–266. Association for Computational Linguistics (2009). https://doi.org/10.3115/1699510.1699544

  7. Le, T.T.N., Nguyen, M.L., Shimazu, A.: Unsupervised keyphrase extraction: introducing new kinds of words to keyphrases. In: Kang, B.H., Bai, Q. (eds.) AI 2016. LNCS (LNAI), vol. 9992, pp. 665–671. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-50127-7_58

    Chapter  Google Scholar 

  8. Nguyen, C.Q., Hong, L.T., Phan, T.T.: A support vector machines approach to Vietnamese key phrase extraction. In: Proceedings of IEEE-RIVF International Conference on Computing and Communication Technologies, pp. 1–5 (2009). https://doi.org/10.1109/RIVF.2009.5174613

  9. Hung, B.T.: Vietnamese keyword extraction using hybrid deep learning methods. In: 2018 5th NAFOSTED Conference on Information and Computer Science (NICS), pp. 412–417 (2018). https://doi.org/10.1109/NICS.2018.8606906

  10. Nguyen, C.Q., Phan, T.T.: An ontology–based approach for key phrase extraction. In: Proceedings of the ACL-IJCNLP 2009 Conference Short Papers, pp. 181–184. Association for Computational Linguistics (2009). https://doi.org/10.3115/1667583.1667639

  11. AlamiMerrouni, Z., Frikh, B., Ouhbi, B.: Automatic keyphrase extraction: a survey and trends. J. Intell. Inf. Syst. 54(2), 391–424 (2019). https://doi.org/10.1007/s10844-019-00558-9

    Article  Google Scholar 

  12. Caragea, C., Bulgarov, F., Godea, A., Gollapalli, S.D.: Citation-enhanced keyphrase extraction from research papers: a supervised approach. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1435–1446. Association for Computational Linguistics (2014). https://doi.org/10.3115/v1/D14-1150

  13. Nguyen, T.D., Luong, M.T.: WINGNUS: keyphrase extraction utilizing document logical structure. In: Proceedings of the 5th International Workshop on Semantic Evaluation, pp. 166–169. Association for Computational Linguistics (2010)

    Google Scholar 

  14. Gollapalli, S.D., Li, X.L., Yang, P.: Incorporating expert knowledge into keyphrase extraction. In: AAAI 2017: Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, pp. 3180–3187 (2017)

    Google Scholar 

  15. Al-Zaidy, R., Caragea, C., Giles, C.L.: Bi-LSTM-CRF sequence labeling for keyphrase extraction from scholarly documents. In: WWW 2019: The World Wide Web Conference, New York, pp. 2551–2557. Association for Computing Machinery (2019). https://doi.org/10.1145/3308558.3313642

  16. Hasan, K.S., Ng, V.: Automatic Keyphrase extraction: a survey of the state of the art. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, pp. 1262–1273. Association for Computational Linguistics (2014). https://doi.org/10.3115/v1/P14-1119

  17. Papagiannopoulou, E., Tsoumakas, G.: A review of keyphrase extraction. In: Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, vol. 10, no. 2 (2020). https://doi.org/10.1002/widm.1339

  18. Page, L., Brin, S., Motwani, R., Winograd, T.: The PageRank Citation Ranking: Bringing Order to the Web. Technical Report, Stanford InfoLab (1999). http://ilpubs.stanford.edu:8090/422/

  19. Ye, H., Wang, L.: Semi-Supervised Learning for Neural Keyphrase Generation. arXiv preprint, p. arXiv:1808.06773 (2019). https://doi.org/10.48550/arXiv.1808.06773

  20. Mahata, D., Kuriakose, J., Shah, R.R., Zimmermann, R.: Key2Vec: automatic ranked keyphrase extraction from scientific articles using phrase embeddings. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers), pp. 634–639. Association for Computational Linguistics (2018). https://doi.org/10.18653/v1/N18-2100

  21. Thanh, V., Dat Quoc, N., Dai Quoc, N., Dras, M., Johnson, M.: VnCoreNLP: a Vietnamese natural language processing toolkit. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations, pp. 56–60. Association for Computational Linguistics (2018). https://doi.org/10.18653/v1/N18-5012

  22. Tuan-Phong, N., Anh-Cuong, L.: A hybrid approach to Vietnamese word segmentation. In: 2016 IEEE RIVF International Conference on Computing Communication Technologies, Research, Innovation, and Vision for the Future (RIVF), pp. 114–119 (2016). https://doi.org/10.1109/RIVF.2016.7800279

  23. Bojanowski, P., Grave, E., Joulin, A., Mikolov, T.: Enriching word vectors with subword information. In: Transactions of the Association for Computational Linguistics, vol. 5, pp. 135–146 (2017). https://doi.org/10.1162/tacl_a_00051

Download references

Author information

Authors and Affiliations

  1. HUTECH University, Ho Chi Minh City, Vietnam

    Linh Viet Le & Tho Thi Ngoc Le

Authors
  1. Linh Viet Le
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tho Thi Ngoc Le
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tho Thi Ngoc Le .

Editor information

Editors and Affiliations

  1. Wrocław University of Science and Technology, Wrocław, Poland

    Ngoc Thanh Nguyen

  2. Vietnam National University, Ho Chi Minh City, Ho Chi Minh City, Vietnam

    Tien Khoa Tran

  3. Al-Farabi Kazakh National University, Almaty, Kazakhstan

    Ualsher Tukayev

  4. National University of Kaohsiung, Kaohsiung, Taiwan

    Tzung-Pei Hong

  5. Wrocław University of Science and Technology, Wrocław, Poland

    Bogdan Trawiński

  6. University of Newcastle, Newcastle, NSW, Australia

    Edward Szczerbicki

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Le, L.V., Le, T.T.N. (2022). A Semantic-Based Approach for Keyphrase Extraction from Vietnamese Documents Using Thematic Vector. In: Nguyen, N.T., Tran, T.K., Tukayev, U., Hong, TP., Trawiński, B., Szczerbicki, E. (eds) Intelligent Information and Database Systems. ACIIDS 2022. Lecture Notes in Computer Science(), vol 13757. Springer, Cham. https://doi.org/10.1007/978-3-031-21743-2_33

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-21743-2_33

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-21742-5

  • Online ISBN: 978-3-031-21743-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation