Skip to main content
SpringerLink
Log in

Quality Classification of Scientific Publications Using Hybrid Summarization Model

  • Conference paper
  • First Online:
Maturity and Innovation in Digital Libraries (ICADL 2018)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 11279))

Included in the following conference series:

  • 1222 Accesses

Abstract

In this paper (Note that the dataset and code to reproduce the results can be accessed at the following URL: https://github.com/slab-itu/hsm), we intend to assess the quality of scientific publications by measuring the relationship between full text papers with that of their abstracts. A hybrid summarization model is proposed that combines text summarization and information retrieval (IR) techniques to classify scientific papers into different ranks based on their abstract correctness. Using the proposed model, we study the relationship between a correctly written abstract (in accordance with full-text) and the scholarly influence of scientific publications. The proposed supervised machine learning model is deployed on 460 full-text publications - randomly downloaded from Social Science Research Network (SSRN). In order to quantify the scholarly influence of publications, a composite score provided by SSRN is used that combines usage indicators along with citation counts. This score is then used to label the publications into high and low ranks. The results determine that the papers having abstracts in accordance with full text also show high scholarly rank with an encouraging accuracy of 73.91%. Finally, 0.701 Area Under the Curve (AUC) for receiver-operating characteristic is achieved that outperforms the traditional IR and summarization models with AUC of 0.536 and 0.58 respectively. Overall our findings suggest that a correctly written abstract in accordance to its full text have a high probability to attract more social usage and citations and vice versa.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 74.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    The data was downloaded from http://www.ssrn.com/ on Feb 16, 2015.

References

  1. Chang, H.T., Liu, S.W., Mishra, N.: A tracking and summarization system for online Chinese news topics. Aslib J. Inf. Manag. 67(6), 687–699 (2015)

    Article  Google Scholar 

  2. Luhn, H.P.: The automatic creation of literature abstracts. IBM J. Res. Dev. 2(2), 159–165 (1958)

    Article  MathSciNet  Google Scholar 

  3. Das, D., Martins, A.F.: A survey on automatic text summarization. Literature Survey for the Language and Statistics II Course at CMU, vol. 4, pp. 192–195 (2007)

    Google Scholar 

  4. Wu, I.C., Vakkari, P.: Supporting navigation in Wikipedia by information visualization: extended evaluation measures. J. Doc. 70(3), 392–424 (2014)

    Article  Google Scholar 

  5. Ravana, S.D., Rajagopal, P., Balakrishnan, V.: Ranking retrieval systems using pseudo relevance judgments. Aslib J. Inf. Manag. 67(6), 700–714 (2015)

    Article  Google Scholar 

  6. Ježek, K., Steinberger, J.: Automatic text summarization (The state of the art 2007 and new challenges). In: Proceedings of Znalosti, pp. 1–12 (2008)

    Google Scholar 

  7. Gupta, V., Lehal, G.S.: A survey of text summarization extractive techniques. J. Emerg. Technol. Web Intell. 2(3), 258–268 (2010)

    Google Scholar 

  8. Lloret, E.: Text summarization: an overview. Paper supported by the Spanish Government under the project TEXT-MESS (TIN2006-15265-C06-01) (2008)

    Google Scholar 

  9. Murray, G.: Abstractive meeting summarization as a Markov decision process. In: Barbosa, D., Milios, E. (eds.) CANADIAN AI 2015. LNCS (LNAI), vol. 9091, pp. 212–219. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-18356-5_19

    Chapter  Google Scholar 

  10. Fiszman, M., Rindflesch, T.C., Kilicoglu, H.: Abstraction summarization for managing the biomedical research literature. In: Proceedings of the HLT-NAACL Workshop on Computational Lexical Semantics, pp. 76–83. Association for Computational Linguistics (2004)

    Google Scholar 

  11. Hjørland, B., Nissen Pedersen, K.: A substantive theory of classification for information retrieval. J. Doc. 61(5), 582–597 (2005)

    Article  Google Scholar 

  12. Galvez, C., de Moya-Anegón, F., Solana, V.H.: Term conflation methods in information retrieval: non-linguistic and linguistic approaches. J. Doc. 61(4), 520–547 (2005)

    Article  Google Scholar 

  13. Pontes, E.L., Huet, S., Torres-Moreno, J.-M., Linhares, A.C.: Automatic text summarization with a reduced vocabulary using continuous space vectors. In: Métais, E., Meziane, F., Saraee, M., Sugumaran, V., Vadera, S. (eds.) NLDB 2016. LNCS, vol. 9612, pp. 440–446. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-41754-7_46

    Chapter  Google Scholar 

  14. Bordogna, G., Pasi, G.: Application of fuzzy set theory to extend boolean information retrieval. In: Crestani, F., Pasi, G. (eds.) Soft Computing in Information Retrieval. Studies in Fuzziness and Soft Computing, vol. 50, pp. 21–47. Physica, Heidelberg (2000). https://doi.org/10.1007/978-3-7908-1849-9_2

    Chapter  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Information Technology University, Lahore, Pakistan

    Hafiz Ahmad Awais Chaudhary & Saeed-Ul Hassan

  2. King Abdulaziz University, Jeddah, Saudi Arabia

    Naif Radi Aljohani & Ali Daud

Authors
  1. Hafiz Ahmad Awais Chaudhary
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Saeed-Ul Hassan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Naif Radi Aljohani
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ali Daud
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Saeed-Ul Hassan .

Editor information

Editors and Affiliations

  1. University College London Qatar, Doha, Qatar

    Milena Dobreva

  2. University of Waikato, Hamilton, New Zealand

    Annika Hinze

  3. University of Ljubljana, Ljubljana, Slovenia

    Maja Žumer

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Chaudhary, H.A.A., Hassan, SU., Aljohani, N.R., Daud, A. (2018). Quality Classification of Scientific Publications Using Hybrid Summarization Model. In: Dobreva, M., Hinze, A., Žumer, M. (eds) Maturity and Innovation in Digital Libraries. ICADL 2018. Lecture Notes in Computer Science(), vol 11279. Springer, Cham. https://doi.org/10.1007/978-3-030-04257-8_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-04257-8_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-04256-1

  • Online ISBN: 978-3-030-04257-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation