Skip to main content
SpringerLink
Log in

Extractive Text Summarization for Turkish: Implementation of TF-IDF and PageRank Algorithms

  • Conference paper
  • First Online:
Intelligent Systems and Applications (IntelliSys 2022)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 544))

Included in the following conference series:

  • 739 Accesses

Abstract

Due to the massive amount of information available on the web, reaching the desired content has become more and more difficult. Automatic text summarization helps to solve the problem by minimizing the document size while keeping its core information. In this study, two extractive single document automatic text summarization systems for Turkish are presented which implement the statistical-based TF-IDF algorithm as well as the combination of TF-IDF with the graph-based PageRank algorithm. The study aims to reveal the usability and effectiveness of these algorithms for Turkish documents. Moreover, the results of the TF-IDF implementation and the hybrid approach are compared using the co-selection measures, precision, recall, and F-score. In the evaluation phase, the system-generated summaries are categorized and tested based on their word sizes and the predetermined thresholds and compared against the human-generated summaries. The results indicate that the hybrid system performs better than the TF-IDF system even in lower thresholds, and also both systems are inclined to improve average F-scores in higher threshold generated summarization.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Alguliev, R.M., Aliguliyev, R.M., Isazade, N.R.: Multiple documents summarization based on evolutionary optimization algorithm. Expert Syst. Appl. 40(5), 1675–1689 (2013). https://doi.org/10.1016/j.eswa.2012.09.014

    Article  Google Scholar 

  2. Altan, Z.: A Turkish automatic text summarization system. In: IASTED International Conference on Artificial Intelligence and Applications, Innsburg, Austria, pp. 311–316 (2004)

    Google Scholar 

  3. Baralis, E., Cagliero, L., Mahoto, N., Fiori, A.: GraphSum: discovering correlations among multiple terms for graph-based summarization. Inf. Sci. 249, 96–109 (2013). https://doi.org/10.1016/j.ins.2013.06.046

    Article  MathSciNet  Google Scholar 

  4. Demirci, F., Karabudak, E., İlgen, B.: Multi-document summarization for Turkish news. In: 2017 International Artificial Intelligence and Data Processing Symposium (IDAP), pp. 1–5. IEEE (2017)

    Google Scholar 

  5. Gambhir, M., Gupta, V.: Recent automatic text summarization techniques: a survey. Artif. Intell. Rev. 47(1), 1–66 (2016). https://doi.org/10.1007/s10462-016-9475-9

    Article  Google Scholar 

  6. Github.com: Zemberek-NLP (2018). https://github.com/ahmetaa/zemberek-nlp

  7. Güran, A.: Otomatik metin özetleme sistemi. Ph.D thesis, Yıldız Teknik University (2013)

    Google Scholar 

  8. Güran, A., Bayazit, N.G., Bekar, E.: Automatic summarization of Turkish documents using non-negative matrix factorization. In: INISTA 2011 - 2011 International Symposium on INnovations in Intelligent SysTems and Applications, pp. 480–484 (2011) https://doi.org/10.1109/INISTA.2011.5946121

  9. Hatipoglu, A., Omurca, S.İ: A Turkish Wikipedia text summarization system for mobile devices. Int. J. Inf. Technol. Comput. Sci. 1, 1 (2016). https://doi.org/10.5815/ijitcs.2016.01.01

    Article  Google Scholar 

  10. Jabar, A.T.: Generating Extractive Document Summaries using Weighted Undirected Graph and Page Rank Algorithm. Department of Computer Sciences, University of Lagos (2015)

    Google Scholar 

  11. Jones, K.S.: A statistical interpretation of term specificity and its application in retrieval. J. Documentation 60(5), 493–502 (1972). https://doi.org/10.1108/eb026526

    Article  Google Scholar 

  12. Jones, K.S.: Index term weighting. Inf. Storage Retr. 9(11), 619–633 (1973). https://doi.org/10.1016/0020-0271(73)90043-0

    Article  Google Scholar 

  13. Karakaya, K.M., Güvenir, H.A.: ARG : a tool for automatic report generation. J. Electr. Electron. Eng. 4(2), 1101–1109 (2004)

    Google Scholar 

  14. Kaynar, O., Görmez, Y., Işık, Y.E., Demirkoparan, F.: Comparison of graph based document summarization method. In: 2017 International Conference on Computer Science and Engineering (UBMK), pp. 598–603. IEEE (2017)

    Google Scholar 

  15. Kutlu, M., Ciǧir, C., Cicekli, I.: Generic text summarization for Turkish. Comput. J. 53(8), 1315–1323 (2010). https://doi.org/10.1093/comjnl/bxp124

    Article  Google Scholar 

  16. Kyoomarsi, F., Khosravi, H.: Optimizing machine learning approach based on fuzzy logic in text summarization. Int. J. Hybrid Inf. Technol. 2(2), 105–116 (2009)

    Google Scholar 

  17. Lee, J.H., Park, S., Ahn, C.M., Kim, D.: Automatic generic document summarization based on non-negative matrix factorization. Inf. Process. Manag. 45(1), 20–34 (2009). https://doi.org/10.1016/j.ipm.2008.06.002

    Article  Google Scholar 

  18. Litvak, M., Last, M.: Graph-based keyword extraction for single-document summarization. In: Coling 2008 - Proceedings of the Workshop on Multi-Source Multilingual Information Extraction and Summarization, Manchester, pp. 17–24 (2008). https://doi.org/10.3115/1613172.1613178

  19. Mihalcea, R.: Graph-based ranking algorithms for sentence extraction, applied to text summarization. In: Proceedings of the ACL Interactive Poster and Demonstration Sessions, pp. 170–173 (2004). https://doi.org/10.3115/1219044.1219064

  20. Mihalcea, R., Tarau, P.: TextRank: bringing order into texts. In: Proceedings of EMNLP 85, pp. 404–411 (2004). https://doi.org/10.3115/1219044.1219064

  21. Ouyang, Y., Li, W., Li, S., Lu, Q.: Applying regression models to query-focused multi-document summarization. Inf. Process. Manag. 47(2), 227–237 (2011). https://doi.org/10.1016/j.ipm.2010.03.005

    Article  Google Scholar 

  22. Ozsoy, M.G., Cicekli, I., Alpaslan, F.N.: Text summarization of turkish texts using latent semantic analysis. In: Coling 2010 - 23rd International Conference on Computational Linguistics, Proceedings of the Conference, Beijing, pp. 869–876 (2010)

    Google Scholar 

  23. Page, L., Brin, S.: The anatomy of a large-scale hypertextual Web search engine. Comput. Netw. 30(1–7), 107–117 (1998). https://doi.org/10.1016/s0169-7552(98)00110-x

    Article  Google Scholar 

  24. Pembe, F.C.: Automated query-biased and structure-preserving document summarization for web search tasks. Ph.D thesis, Boğaziçi University (2010)

    Google Scholar 

  25. Saggion, H., Lapalme, G.: Generating indicative-informative summaries with SumUM. Comput. Linguist. 28(4), 497–526 (2002). https://doi.org/10.1162/089120102762671963

    Article  Google Scholar 

  26. Tür, G., Tür, D.H., Oflazer, K.: A statistical information extraction system for Turkish. Nat. Lang. Eng. 9(2), 181–210 (2003). https://doi.org/10.1017/S135132490200284X

    Article  Google Scholar 

  27. Wong, K.F., Wu, M., Li, W.: Extractive summarization using supervised and semi-supervised learning. In: Coling 2008 - 22nd International Conference on Computational Linguistics, Proceedings of the Conference, pp. 985–992 (2008). https://doi.org/10.3115/1599081.1599205

  28. Zhang, J., Sun, Y., Wang, H., He, Y.: Calculating statistical similarity between sentences. J. Converg. Inf. Technol. 6(2) (2011). https://doi.org/10.4156/jcit.vol6.issue2.3

Download references

Author information

Authors and Affiliations

  1. Havelsan, Ankara, Turkey

    Emre Akülker

  2. Department of Software Engineering, Atılım University, Ankara, Turkey

    Çiğdem Turhan

Authors
  1. Emre Akülker
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Çiğdem Turhan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Çiğdem Turhan .

Editor information

Editors and Affiliations

  1. Saga University, Saga, Japan

    Kohei Arai

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Akülker, E., Turhan, Ç. (2023). Extractive Text Summarization for Turkish: Implementation of TF-IDF and PageRank Algorithms. In: Arai, K. (eds) Intelligent Systems and Applications. IntelliSys 2022. Lecture Notes in Networks and Systems, vol 544. Springer, Cham. https://doi.org/10.1007/978-3-031-16075-2_51

Download citation

Publish with us

Policies and ethics

Search

Navigation