Skip to main content
SpringerLink
Log in

A survey on sentiment analysis of scientific citations

  • Published:
Artificial Intelligence Review Aims and scope Submit manuscript

Abstract

Sentiment analysis of scientific citations has received much attention in recent years because of the increased availability of scientific publications. Scholarly databases are valuable sources for publications and citation information where researchers can publish their ideas and results. Sentiment analysis of scientific citations aims to analyze the authors’ sentiments within scientific citations. During the last decade, some review papers have been published in the field of sentiment analysis. Despite the growth in the size of scholarly databases and researchers’ interests, no one as far as we know has carried out an in-depth survey in a specific area of sentiment analysis in scientific citations. This paper presents a comprehensive survey of sentiment analysis of scientific citations. In this review, the process of scientific citation sentiment analysis is introduced and recently proposed methods with the main challenges are presented, analyzed and discussed. Further, we present related fields such as citation function classification and citation recommendation that have recently gained enormous attention. Our contributions include identifying the most important challenges as well as the analysis and classification of recent methods used in scientific citation sentiment analysis. Moreover, it presents the normal process, and this includes citation context extraction, public data sources, and feature selection. We found that most of the papers use classical machine learning methods. However, due to limitations of performance and manual feature selection in machine learning, we believe that in the future hybrid and deep learning methods can possibly handle the problems of scientific citation sentiment analysis more efficiently and reliably.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Notes

  1. https://www.coursera.org/.

  2. https://catalog.ldc.upenn.edu/LDC2001T02.

  3. www.webofknowledge.com.

  4. www.scopus.com.

  5. https://www.acm.org/.

  6. http://www.springer.com/cn/.

  7. http://www.sciencedirect.com/.

  8. http://www.ieee.org/index.html.

  9. http://scholar.google.com/.

  10. https://www.ncbi.nlm.nih.gov/pubmed.

References

  • Abdullatif M (2013) Making the H-index more relevant: a step towards standard classes for citation classification. In: Paper presented at the IEEE 29th international conference on data engineering workshops (ICDEW), Brisbane, Australia., 8–12 April 2013, pp 330–333

  • Abdullatif M, Koh YS, Dobbie G, Alam S (2013) Verb selection using semantic role labeling for citation classification. In: Paper presented at the ACM workshop on computational scientometrics: theory and applications, CompSci 2013—co-located with CIKM San Francisco, California, USA, 28 Oct 2013, pp 25–30

  • Abdullatif M, Koh YS, Dobbie G (2015) Unsupervised semantic and syntactic based classification of scientific citations. In: Madria S, Hara T (eds) Big data analytics and knowledge discovery: 17th international conference, DaWaK 2015, Valencia, Spain, 1–4 Sept 2015, Proceedings. Springer, Cham, pp 28–39. https://doi.org/10.1007/978-3-319-22729-0_3

  • Abu-Jbara A, Radev DR (2012) Reference scope identification in citing sentences. In: Aria Haghighi YA-O (ed) Proceedings of the conference of the North American chapter of the association for computational linguistics: human language technologies, Montreal, Canada, 03 –08 June 2012. Association for Computational Linguistics (ACL), pp 80–90

  • Abu-Jbara A, Ezra J, Radev DR (2013) Purpose and polarity of citation: towards NLP-based bibliometrics. In: Lucy Vanderwende MR (ed) Proceedings of the North American association for computational linguistics (NAACL-HLT 2013), Atlanta, Georga, United States, 9–14 June 2013. Association for Computational Linguistics: Human Language Technologies, pp 596–606

  • Akhtar MS, Kumar A, Ekbal A, Bhattacharyya P (2016) A hybrid deep learning architecture for sentiment analysis. In: Paper presented at the the 26th international conference on computational linguistics: technical papers, COLING, Osaka, Japan, 11–17 Dec 2016, pp 482–493

  • Alvarez MH, Gómez JM (2014) Survey in sentiment, polarity and function analysis of citation. In: Nancy Green KA, Litman D, Reed C, Walker V (ed) Proceedings of the first workshop on argumentation mining, Baltimore, Maryland USA, 26 June 2014. Association for Computational Linguistics (ACL), pp 102–103

  • Angrosh MA, Cranefield S, Stanger N (2013) Conditional random field based sentence context identification: enhancing citation services for the research community. In: Ashman H, Sheng QZ, Trotman A (eds) Proceedings of the first Australasian web conference—Adelaide, Australia, January 2013. Australian Computer Society Inc., pp 59–68

  • Athar A (2011) Sentiment analysis of citations using sentence structure-based features. In: Sasa Petrovic EP (ed) Proceedings of the ACL 2011 student session, Portland, Oregon, 19–24 June 2011. Association for Computational Linguistics, 2000991, pp 81–87

  • Athar A (2014) Sentiment analysis of scientific citations. University of Cambridge, Computer Laboratory, Cambridge

    Google Scholar 

  • Athar A, Teufel S (2012a) Context-enhanced citation sentiment detection. In: Paper presented at the conference of the North American chapter of the association for computational linguistics: human language technologies. Montreal, Canada, pp 597–601

  • Athar A, Teufel S (2012b) Detection of implicit citations for sentiment detection. In: Antal van den Bosch N, Shatkay H, Delaware (eds) Proceedings of the workshop on detecting structure in scholarly discourse, Jeju, Republic of Korea, 25 May 2012b. Association for Computational Linguistics, 2391176, pp 18–26

  • Baccianella S, Esuli A, Sebastiani F (2010) SentiWordNet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining. In: Calzolari N (ed) Proceedings of the seventh international conference on language resources and evaluation (LREC’10), Valletta, Malta, 17–23 May 2010. European Language Resources Association (ELRA)

  • Barrett N (2012) Natural language processing techniques for the purpose of sentinel event information extraction. University of Victoria, B.C., Canada

  • Bethard S, Jurafsky D (2010) Who should I cite: learning literature search models from citation behavior. In: Huang J (ed) Proceedings of the 19th ACM international conference on Information and knowledge management, Toronto, Ontario, Canada, 26–30 Oct 2010. ACM, pp 609–618. https://doi.org/10.1145/1871437.1871517

  • Bing PCZSL, Yang W (2017) Recurrent attention network on memory for aspect sentiment analysis. In: Lucia Specia MP, Paul M (eds) Proceedings of the 2017 conference on empirical methods in natural language processing, Copenhagen, Denmark, 7–11 Sept 2017. Association for Computational Linguistics (ACL), pp 463–472

  • Butt BH, Rafi M, Jamal A, Ur Rehman RS, Alam SMZ, Alam MB (2015) Classification of research citations (CRC). In: Paper presented at the 1st workshop on mining scientific papers: computational linguistics and bibliometrics, CLBib 2015—co-located with 15th international society of scientometrics and informetrics conference, ISSI, Istanbul, Turkey, 29 June 2015, pp 18–27

  • Cambria E (2016) Affective computing and sentiment analysis. IEEE Intell Syst 31:102–107. https://doi.org/10.1109/MIS.2016.31

    Article  Google Scholar 

  • Cambria E, Schuller BW, Xia Y, Havasi C (2013) New avenues in opinion mining and sentiment analysis. IEEE Intell Syst 28:15–21. https://doi.org/10.1109/MIS.2013.30

    Article  Google Scholar 

  • Cambria E, Poria S, Bajpai R, Schuller BW (2016) SenticNet 4: a semantic resource for sentiment analysis based on conceptual primitives, Nicoletta Calzolari. In: Proceedings of COLING 2016, the 26th international conference on computational linguistics: technical papers, Osaka, Japan, 11–17 Dec 2016. pp 2666–2677

  • Chen M, Xu ZE, Weinberger KQ, Sha F (2012) Marginalized denoising autoencoders for domain adaptation. In: McCallum A (ed) Proceedings of the 29th international conference on international conference on machine learning, Edinburgh, Scotland, UK, June 26–July 1, 2012. ICML

  • Cho H, Kim S, Lee J, Lee J-S (2014) Data-driven integration of multiple sentiment dictionaries for lexicon-based sentiment classification of product reviews. Knowl Based Syst 71:61–71. https://doi.org/10.1016/j.knosys.2014.06.001

    Article  Google Scholar 

  • Ciancarini P, Di Iorio A, Nuzzolese AG, Peroni S, Vitali F (2013) Semantic annotation of scholarly documents and citations. In: Baldoni M, Baroglio C, Boella G, Micalizio R (eds) AI*IA 2013: advances in artificial intelligence: XIIIth international conference of the Italian association for artificial intelligence, Turin, Italy, 4–6 Dec 2013. Proceedings. Springer, Cham, pp 336–347. https://doi.org/10.1007/978-3-319-03524-6_29

  • Councill IG, Giles CL, Kan M-Y (2008) ParsCit: an open-source CRF reference string parsing package. In: Calzolari N (ed) Proceedings of the sixth international conference on language resources and evaluation (LREC’08), Marrakech, Morocco, 28–30 May 2008. European Language Resources Association (ELRA)

  • Denecke K (2008) Using sentiwordnet for multilingual sentiment analysis. In: Paper presented at the 2008 IEEE 24th international conference on data engineering workshop, 7–12 Apr 2008, pp 507–512

  • Di Iorio A, Nuzzolese AG, Peroni S (2013) Towards the automatic identification of the nature of citations. In: 3rd workshop on semantic publishing, SePublica 2013—10th extended semantic web conference, 26 May 2013, Montpellier, France, 2013. CEUR Workshop Proceedings. CEUR-WS, pp 63–74

  • Dong C, Schäfer U (2011) Ensemble-style self-training on citation classification. In: Wong K-F (ed) Proceedings of the 5th international joint conference on natural language processing, Chiang Mai, Thailand, 8–13 Nov 2011. Association for Computational Linguistics (ACL), pp 623–631

  • Dragoni M (2017) Extracting linguistic features from opinion data streams for multi-domain sentiment analysis. In: Dragoni M, Recupero DR (eds) Proceedings of the 3rd international workshop on emotions, modality, sentiment analysis and the semantic web co-located with 14th ESWC 2017, Portroz, 28 May 2017. CEUR workshop proceedings, vol 1874. CEUR-WS.org

  • Ebert S (2017) Artificial neural network methods applied to sentiment analysis. Ludwig-Maximilians-Universität (LMU), München

  • Esuli A, Sebastiani F (2006) Determining term subjectivity and term orientation for opinion mining. In: Paper presented at the 11th conference of the European chapter of the association for computational linguistics, EACL, 3–7 April 2006, Trento, Italy, pp 193–200

  • Feldman R (2013) Techniques and applications for sentiment analysis. Commun ACM 56:82–89. https://doi.org/10.1145/2436256.2436274

    Article  Google Scholar 

  • Garfield E (1965) Can citation indexing be automated. In: Statistical association methods for mechanized documentation, symposium proceedings, 1965. National Bureau of Standards, Miscellaneous Publication 269, Washington, DC, pp 189–192

  • Garfield E (1972) Citation analysis as a tool in journal evaluation journals can be ranked by frequency and impact of citations for science policy studies. Science 178:471–479. https://doi.org/10.1126/science.178.4060.471

    Article  Google Scholar 

  • Garfield E (1979) Is citation analysis a legitimate evaluation tool? Scientometrics 1:359–375. https://doi.org/10.1007/bf02019306

    Article  Google Scholar 

  • Goodarzi M, Mahmoudi MT, Zamani R (2014) A framework for sentiment analysis on schema-based research content via lexica analysis. In: Paper presented at the 7th international symposium on telecommunications (IST), 2014, Tehran, Iran 9–11 Sept 2014, pp 405–411

  • Harris ZS (2002) The structure of science information. J Biomed Inform 35:215–221. https://doi.org/10.1016/S1532-0464(03)00011-X

    Article  Google Scholar 

  • Hassan A, Mahmood A (2017) Deep learning approach for sentiment analysis of short texts. In: 2017 3rd international conference on control, automation and robotics (ICCAR), 24–26 April 2017, pp 705–707. https://doi.org/10.1109/ICCAR.2017.7942788

  • He Q, Pei J, Kifer D, Mitra P, Giles CL (2010) Context-aware citation recommendation. In: Rappa M (ed) Proceedings of the 19th international conference on World wide web. Raleigh, North Carolina, USA, 26–30 Apr 2010, pp 421–430. https://doi.org/10.1145/1772690.1772734

  • He Q, Kifer D, Pei J, Mitra P, Giles CL (2011) Citation recommendation without author supervision. In: King I (ed) Proceedings of the fourth ACM international conference on Web search and data mining, Hong Kong, China, 09–12 Feb 2011. ACM, 1935926, pp 755–764. https://doi.org/10.1145/1935826.1935926

  • Hernandez-Alvarez M, Gomez S JM (2015) Citation impact categorization: for scientific literature. In: Paper presented at the IEEE 18th international conference on computational science and engineering (CSE), 21–23 Oct 2015. Los Alamitos, CA, USA, pp 307–313

  • Hogenboom A, Iterson PV, Heerschop B, Frasincar F, Kaymak U (2011) Determining negation scope and strength in sentiment analysis. In: Paper presented at the 2011 IEEE international conference on systems, man, and cybernetics, 9–12 Oct 2011, pp 2589–2594

  • Huang EH, Socher R, Manning CD, Ng AY (2012) Improving word representations via global context and multipleword prototypes. In: Paper presented at the 50th annual meeting of the association for computational linguistics, ACL 2012, Jeju Island, Korea, Republic of, 8–14 July 2012, pp 873–882

  • Jha R, Abu-Jbara A, Radev DA (2013) System for summarizing scientific topics starting from keywords. In: 51st annual meeting of the association for computational linguistics, ACL 2013, 4–9 Aug 2013, Sofia, Bulgaria, 2013. ACL 2013—51st annual meeting of the association for computational linguistics, proceedings of the conference. Association for computational linguistics (ACL), pp 572–577

  • Jha R, Coke R, Radev D (2015) Surveyor: a system for generating coherent survey articles for scientific topics. In: Paper presented at the 29th AAAI conference on artificial intelligence, AAAI and the 27th innovative applications of artificial intelligence conference, IAAI, Austin, TX, United states, pp 2167–2173

  • Jiang P, Zhang C, Fu H, Niu Z, Yang Q (2010) An approach based on tree kernels for opinion mining of online product reviews. In: Paper presented at the 2010 IEEE international conference on data mining, 13–17 Dec 2010, pp 256–265

  • Jochim C, Schutze H (2012) Towards a generic and flexible citation classifier based on a faceted classification scheme. In: Paper presented at the 24th international conference on computational linguistics, COLING Mumbai, India, 8–15 Dec 2012, pp 1343–1358

  • Jochim C, Schutze H (2014) Improving citation polarity classification with product reviews. In: Paper presented at the 52nd annual meeting of the association for computational linguistics, ACL Baltimore, MD, United states, 23–25 June 2014, pp 42–48

  • Kang D, Park Y (2014) Review-based measurement of customer satisfaction in mobile service: sentiment analysis and VIKOR approach. Expert Syst Appl 41:1041–1050. https://doi.org/10.1016/j.eswa.2013.07.101

    Article  Google Scholar 

  • Kaplan D, Iida R, Tokunaga T (2009) Automatic extraction of citation contexts for research paper summarization: a coreference-chain based approach. In: Min-Yen Kan ST (ed) Proceedings of the 2009 workshop on text and citation analysis for scholarly digital libraries, Suntec, Singapore, 07 Aug 2009. Association for Computational Linguistics, 1699764, pp 88–95

  • Kataria S, Mitra P, Bhatia S (2010) Utilizing context in generative bayesian models for linked corpus. In: Paper presented at the 24th AAAI conference on artificial intelligence and the 22nd innovative applications of artificial intelligence conference, AAAI-10/IAAI-10, Atlanta, GA, United states, 11–15 July 2010, pp 1340–1345

  • Kim IC, Le DX, Thoma GR (2014) Automated method for extracting citation sentences from online biomedical articles using SVM-based text summarization technique. In: Paper presented at the IEEE international conference on systems, man, and cybernetics (SMC)2014 San Diego, CA, USA, 5–8 Oct 2014, pp 1991–1996

  • Kim IC, Thoma GR (2015) Automated classification of author’s sentiments in citation using machine learning techniques: a preliminary study. In: Paper presented at the IEEE conference on computational intelligence in bioinformatics and computational biology, CIBCB 2015, 15 Aug 2015, Niagara Falls, ON, Canada,

  • Kumar S (2016) Structure and dynamics of signed citation networks. In: Bourdeau J (ed) Proceedings of the 25th international conference companion on world wide web, Montral, Qubec, Canada, 11–15 Apr 2016. International World Wide Web Conferences Steering Committee, 2889391, pp 63–64. https://doi.org/10.1145/2872518.2889391

  • Li S-T, Tsai F-C (2013) A fuzzy conceptualization model for text mining with application in opinion polarity classification. Knowl Based Syst 39:23–33. https://doi.org/10.1016/j.knosys.2012.10.005

    Article  Google Scholar 

  • Liu B (2012) Sentiment analysis and opinion mining. Synthesis lectures on human language technologies. Morgan and Claypool Publishers, San Rafael. https://doi.org/10.2200/S00416ED1V01Y201204HLT016

    Google Scholar 

  • Liu B, Zhang L (2012) A survey of opinion mining and sentiment analysis. In: Aggarwal CC, Zhai C (eds) Mining text data. Springer, Boston, pp 415–463. https://doi.org/10.1007/978-1-4614-3223-4_13

    Chapter  Google Scholar 

  • Livne A, Gokuladas V, Teevan J, Dumais ST, Adar E (2014) CiteSight: supporting contextual citation recommendation using differential search. In: 37th international ACM SIGIR conference on research and development in information retrieval, SIGIR 2014, 6–11 July 2014, Gold Coast, QLD, Australia, 2014. SIGIR 2014—proceedings of the 37th international ACM SIGIR conference on research and development in information retrieval. Association for Computing Machinery, pp 807–816. https://doi.org/10.1145/2600428.2609585

  • Lu Y, He J, Shan D, Yan H (2011) Recommending citations with translation model. In: Paper presented at the 20th ACM conference on information and knowledge management, CIKM’11, Glasgow, United Kingdom, 24–28 Oct 2011, pp 2017–2020

  • Ma Z, Nam J, Weihe K (2016) Improve sentiment analysis of citations with author modelling. In: Knight K (ed) Proceedings of the fifth workshop on computational linguistics for literature—NAACL-HLT 2016, San Diego, California, USA, 16 June 2016. Association for Computational Linguistics (ACL), pp 122–127

  • MacRoberts MH, MacRoberts BR (1984) The negational reference: or the art of dissembling. Soc Stud Sci 14:91–94

    Article  Google Scholar 

  • Manning CD, Surdeanu M, Bauer J, Finkel JR, Bethard S, McClosky D (2014) The stanford corenlp natural language processing toolkit. In: Jingbo KBAZ (ed) Proceedings of the 52nd annual meeting of the association for computational linguistics: system demonstrations, Baltimore, Maryland, USA 22–27 June 2014. Association for Computational Linguistics, pp 55–60

  • McNee SM et al (2002) On the recommending of citations for research papers. In: Elizabeth Churchill JM (ed) The eight conference on computer supported cooperative work (CSCW 2002), 16–20 Nov 2002, New Orleans, LA, United states, 16–20 Nov 2002. Proceedings of the ACM conference on computer supported cooperative work. Association for Computing Machinery, pp 116–125. https://doi.org/10.1145/587078.587096

  • Medhat W, Hassan A, Korashy H (2014) Sentiment analysis algorithms and applications: a survey. Ain Shams Eng J 5:1093–1113. https://doi.org/10.1016/j.asej.2014.04.011

    Article  Google Scholar 

  • Meyers A (2013) Contrasting and corroborating citations in journal articles. In: 9th international conference on recent advances in natural language processing, RANLP 2013, 9–11 Sept 2013, Hissar, Bulgaria, 2013. International conference recent advances in natural language processing, RANLP. Association for Computational Linguistics (ACL), pp 460–466

  • Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. CoRR abs/1301.3781

  • Montoyo A, Martínez-Barco P, Balahur A (2012) Subjectivity and sentiment analysis: an overview of the current state of the area and envisaged developments. Decis Support Syst 53:675–679. https://doi.org/10.1016/j.dss.2012.05.022

    Article  Google Scholar 

  • Moravcsik MJ, Murugesan P (1975) Some results on the function and quality of citations. Soc Stud Sci 5:86–92. https://doi.org/10.1177/030631277500500106

    Article  Google Scholar 

  • Mudinas A, Zhang D, Levene M (2012) Combining lexicon and learning based approaches for concept-level sentiment analysis. In: Erik Cambria YZ, Xia Y, Howard N (eds) Proceedings of the first international workshop on issues of sentiment discovery and opinion mining, Beijing, China, 12–16 Aug 2012. ACM, 2346681, pp 1–8. https://doi.org/10.1145/2346676.2346681

  • Munkhdalai T, Lalor J, Yu H (2016) Citation analysis with neural attention models. In: Cyril Grouin TH, Névéol A, Zweigenbaum P (eds) Proceedings of the seventh international workshop on health text mining and information analysis (LOUHI), Austin, TX, 5 Nov 2016. Association for Computational Linguistics (ACL), p 69

  • Nakagawa T, Inui K, Kurohashi S (2010) Dependency tree-based sentiment classification using CRFs with hidden variables. In: 2010 human language technologies conference of the North American chapter of the association for computational linguistics, NAACL HLT 2010, 2–4 June 2010, Los Angeles, CA, United states, 2010. Association for Computational Linguistics (ACL), pp 786–794

  • Nallapati RM, Ahmed A, Xing EP, Cohen WW (2008) Joint latent topic models for text and citations. In: 14th ACM SIGKDD international conference on knowledge discovery and data mining, KDD 2008, 24–27 Aug 2008, Las Vegas, NV, United states, 2008. Proceedings of the ACM SIGKDD international conference on knowledge discovery and data mining. Association for Computing Machinery, pp 542–550. https://doi.org/10.1145/1401890.1401957

  • Nanba H, Okumura M (1999) Towards multi-paper summarization using reference information. In: Dean T (ed) Proceedings of sixteenth international joint conference on artificial intelligence. IJCAI 99. 1999, San Francisco, CA, USA, 31 July–6 Aug 1999. IJCAI-99. Proceedings of the sixteenth international joint conference on artificial intelligence. Morgan Kaufmann Publishers, pp 926–931

  • Nguyen D, Vo K, Pham D, Nguyen M, Quan T (2017) A deep architecture for sentiment analysis of news articles. In: Le N-T, van Do T, Nguyen NT, Thi HAL (eds) Advanced computational methods for knowledge engineering: proceedings of the 5th international conference on computer science, applied mathematics and applications, ICCSAMA 2017. Springer, Cham, pp 129–140. https://doi.org/10.1007/978-3-319-61911-8_12

  • Nicholls C, Song F (2010) Comparison of feature selection methods for sentiment analysis. In: 23rd Canadian conference on artificial intelligence, Canadian AI 2010, 31 May 2010–2 June 2010, Ottawa, ON, Canada, 2010. Lecture Notes in computer science (including subseries Lecture notes in artificial intelligence and lecture notes in bioinformatics). Springer, pp 286–289. https://doi.org/10.1007/978-3-642-13059-5_30

  • O’Leary DE (2011) Blog mining-review and extensions: ”from each according to his opinion”. Decis Support Syst 51:821–830. https://doi.org/10.1016/j.dss.2011.01.016

    Article  Google Scholar 

  • Pang B, Lee L (2008) Opinion mining and sentiment analysis. Found Trends Inf Retr 2:1–135. https://doi.org/10.1561/1500000011

    Article  Google Scholar 

  • Parthasarathy G, Tomar DC (2014) Sentiment analyzer: analysis of journal citations from citation databases. In: Paper presented at the 5th international conference—confluence the next generation information technology summit (Confluence), 2014 Noida, India, 25–26 Sept 2014, pp 923–928

  • Parthasarathy G, Tomar DC (2015) A survey of sentiment analysis for journal citation. Indian J Sci Technol. https://doi.org/10.17485/ijst/2015/v8i35/55134

    Google Scholar 

  • Piryani R, Madhavi D, Singh VK (2017) Analytical mapping of opinion mining and sentiment analysis research during 2000–2015. Inf Process Manag 53:122–150. https://doi.org/10.1016/j.ipm.2016.07.001

    Article  Google Scholar 

  • Poria S, Chaturvedi I, Cambria E, Hussain A (2016) Convolutional MKL based multimodal emotion recognition and sentiment analysis. In: Paper presented at the 2016 IEEE 16th international conference on data mining (ICDM), Barcelona, Spain, pp 439–448

  • Qazvinian V, Radev DR (2010) Identifying non-explicit citing sentences for citation-based summarization. In: 48th annual meeting of the association for computational linguistics, ACL 2010, 11–16 July 2010, Uppsala, Sweden, 2010. ACL 2010—48th annual meeting of the association for computational linguistics, proceedings of the conference. Association for Computational Linguistics (ACL), pp 555–564

  • Radev DR, Muthukrishnan P, Qazvinian V (2009) The ACL anthology network corpus. In: Min-Yen Kan ST (ed) Proceedings of the 2009 workshop on text and citation analysis for scholarly digital libraries, Suntec, Singapore, 7 Aug 2009. Association for Computational Linguistics, 1699759, pp 54–61

  • Radev DR, Muthukrishnan P, Qazvinian V, Abu-Jbara A (2013) The ACL anthology network corpus. Lang Resour Eval 47:919–944. https://doi.org/10.1007/s10579-012-9211-2

    Article  Google Scholar 

  • Rani S, Kumar P (2017) A sentiment analysis system to improve teaching and learning. IEEE Comput 50:36–43. https://doi.org/10.1109/MC.2017.133

    Article  Google Scholar 

  • Rojas-Barahona LM (2016) Deep learning for sentiment analysis language and linguistics. Compass 10:701–719. https://doi.org/10.1111/lnc3.12228

    Google Scholar 

  • Rui H, Liu Y, Whinston AB (2013) Whose and what chatter matters? The effect of tweets on movie sales. Decis Support Syst 55:863–870. https://doi.org/10.1016/j.dss.2012.12.022

    Article  Google Scholar 

  • Saif H, Fernández M, He Y, Alani H (2014) On stopwords, filtering and data sparsity for sentiment analysis of twitter. In: Nicoletta Calzolari (ed) Proceedings of the ninth international conference on language resources and evaluation, Reykjavik, Iceland, 26–31 May 2014. European Language Resources Association (ELRA), pp 810–817

  • Sendhilkumar S, Elakkiya E, Mahalakshmi G (2013) Citation semantic based approaches to identify article quality. In: Michal Wozniak HJLD (ed) Proceedings of the third international conference on computer science, engineering and applications-ICCSEA, Delhi, India, 24– 26 May 2013. Springer pp 411–420

  • Small H (2011) Interpreting maps of science using citation context sentiments: a preliminary investigation. Scientometrics 87:373–388. https://doi.org/10.1007/s11192-011-0349-2

    Article  Google Scholar 

  • Soleymani M, Garcia D, Jou B, Schuller BW, Chang S-F, Pantic M (2017) A survey of multimodal sentiment analysis. Image Vis Comput 65:3–14. https://doi.org/10.1016/j.imavis.2017.08.003

    Article  Google Scholar 

  • Sondhi P, Zhai C (2014) A constrained hidden Markov model approach for non-explicit citation context extraction. In: Paper presented at the 14th SIAM international conference on data mining, SDM 2014, 24–26 April 2014. Philadelphia, PA, United states, pp 361–369

  • Strapparava C, Valitutti A (2004) WordNet affect: an affective extension of wordnet. In: Paper presented at the fourth international conference on language resources and evaluation. Lisbon, Portugal, 26–28 May 2004

  • Strohman T, Croft WB, Jensen D (2007) Recommending citations for academic papers. In: 30th annual international ACM SIGIR conference on research and development in information retrieval, 23–26 July 2007. New York, NY, USA, 2007. 30th annual international ACM SIGIR conference on research and development in information retrieval. ACM, pp 705–706. https://doi.org/10.1145/1277741.1277868

  • Sugiyama K, Kumar T, Kan MY, Tripathi RC (2010) Identifying citing sentences in research papers using supervised learning. In: Paper presented at the 2010 international conference on information retrieval and knowledge management (CAMP), 17–18 March 2010, pp 67–72

  • Sula CA, Miller M (2014) Citations, contexts, and humanistic discourse: toward automatic extraction and classification. LLC 29:452–464. https://doi.org/10.1093/llc/fqu019

    Google Scholar 

  • Tang J, Zhang J (2009) A discriminative approach to topic-based citation recommendation. In: Theeramunkong T, Kijsirikul B, Cercone N, Ho T-B (eds) Advances in knowledge discovery and data mining: 13th Pacific-Asia conference, PAKDD 2009 Bangkok, Thailand, 27–30 April 2009 proceedings. Springer, Berlin, pp 572–579. https://doi.org/10.1007/978-3-642-01307-2_55

  • Tang H, Tan S, Cheng X (2009) A survey on sentiment detection of reviews. Expert Syst Appl 36:10760–10773. https://doi.org/10.1016/j.eswa.2009.02.063

    Article  Google Scholar 

  • Tang D, Qin B, Feng X, Liu T (2016) Effective LSTMs for target-dependent sentiment classification. In: Paper presented at the The 26th international conference on computational linguistics (COLING 2016). Osaka, Japan., 11–16 Dec 2016, pp 3298–3307

  • Teufel S, Carletta J, Moens M (1999) An annotation scheme for discourse-level argumentation in research articles. In: Henry S. Thompson AL (eds) Proceedings of the ninth conference on European chapter of the association for computational linguistics, Bergen, Norway, 08–12 June 1999. Association for Computational Linguistics, pp 110–117. https://doi.org/10.3115/977035.977051

  • Teufel S, Siddharthan A, Tidhar D (2006) Automatic classification of citation function. In: Mirella Lapata HTN (ed) Proceedings of the 2006 conference on empirical methods in natural language processing, Sydney, Australia, 25–27 October 2006. Association for Computational Linguistics, 1610091, pp 103–110

  • Tripathy A, Agrawal A, Rath SK (2016) Classification of sentiment reviews using n-gram machine learning approach. Expert Syst Appl 57:117–126. https://doi.org/10.1016/j.eswa.2016.03.028

    Article  Google Scholar 

  • Tsai C-T, Kundu G, Roth D (2013) Concept-based analysis of scientific literature. In: Qi He AI (ed) Proceedings of the 22nd ACM international conference on information and knowledge management, San Francisco, California, USA, October 27–November 01, 2013. Association for Computational Linguistics (ACM), 2505613, pp 1733–1738. https://doi.org/10.1145/2505515.2505613

  • Tsytsarau M, Palpanas T (2012) Survey on mining subjective data on the web. Data Min Knowl Discov 24:478–514. https://doi.org/10.1007/s10618-011-0238-6

    Article  MATH  Google Scholar 

  • Valdivia A, Luzón MV, Herrera F (2017) Sentiment analysis in tripadvisor. IEEE Intell Syst 32:72–77. https://doi.org/10.1109/MIS.2017.3121555

    Article  Google Scholar 

  • Vilares D, Alonso MA, Gómez-Rodríguez C (2017) Supervised sentiment analysis in multilingual environments. Inf Process Manag 53:595–607. https://doi.org/10.1016/j.ipm.2017.01.004

    Article  Google Scholar 

  • Wan X, Liu F (2014) Are all literature citations equally important? Automatic citation strength estimation and its applications. JASIST 65:1929–1938. https://doi.org/10.1002/asi.23083

    Google Scholar 

  • Wang H, Can D, Kazemzadeh A (2012) Bar F, Narayanan S (2012) A system for real-time twitter sentiment analysis of 2012 U.S. presidential election cycle. In: Zhang M (ed) Proceedings of the ACL 2012 system demonstrations, Jeju Island, Korea, 10–10 July 2012. Association for Computational Linguistics, 2390490, pp 115–120

  • Wang X, Liu Y, Sun C, Liu M, Wang X (2016) Extended dependency-based word embeddings for aspect extraction. In: Hirose A, Ozawa S, Doya K, Ikeda K, Lee M, Liu D (eds) Neural information processing: 23rd international conference, ICONIP 2016, Kyoto, Japan, 16–21 Oct 2016, Proceedings, Part IV. Springer, Cham, pp 104–111. https://doi.org/10.1007/978-3-319-46681-1_13

  • Webster JJ, Kit C (1992) Tokenization as the initial phase in NLP. In: Pisa AZ (ed) Proceedings of the 14th conference on computational linguistics-vol 4, Nantes, France, 23–28 Aug 1992. Association for Computational Linguistics, pp 1106–1110

  • Whidby MA (2012) Citation handling: processing citation texts in scientific documents. University of Maryland, College Park

    Google Scholar 

  • Widyantoro DH, Amin I (2014) Citation sentence identification and classification for related work summarization. In: Paper presented at the international conference on advanced computer science and information system, 2014 Hotel Ambhara, Jakarta, 18–19 Oct 2014, pp 291–296

  • Xu H, Martin E, Mahidadia A (2013) Using heterogeneous features for scientific citation classification. In: Proceedings of the 13th conference of the Pacific association for computational linguistics, Tokyo, Japan, September 2013. Association for Computational Linguistics (ACL)

  • Xu J, Zhang Y, Wu Y, Wang J, Dong X, Xu H (2015) Citation sentiment analysis in clinical trial papers. AMIA Annu Symp Proc 2015:1334–1341

    Google Scholar 

  • Zhao W, Guan Z, Chen L, He X, Cai D, Wang B, Wang Q (2017) Weakly-supervised deep embedding for product review sentiment analysis. IEEE Trans Knowl Data Eng. https://doi.org/10.1109/TKDE.2017.2756658

    Google Scholar 

Download references

Acknowledgements

This work is supported by the National Natural Science Foundation of China (No. 61370137), the National Basic Research Program of China (No. 2012CB7207002), the Ministry of Education—China Mobile Research Foundation Project (Nos. 2015/5-9 and 2016/2-7) and the 111 Project of Beijing Institute of Technology.

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, Beijing Institute of Technology, Beijing, China

    Abdallah Yousif, Zhendong Niu, John K. Tarus & Arshad Ahmad

  2. School of Computing and Information, University of Pittsburgh, Pittsburgh, PA, USA

    Zhendong Niu

Authors
  1. Abdallah Yousif
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhendong Niu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. John K. Tarus
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Arshad Ahmad
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhendong Niu.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yousif, A., Niu, Z., Tarus, J.K. et al. A survey on sentiment analysis of scientific citations. Artif Intell Rev 52, 1805–1838 (2019). https://doi.org/10.1007/s10462-017-9597-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10462-017-9597-8

Keywords

Search

Navigation