short-paper

GraphCite: Citation Intent Classification in Scientific Publications via Graph Embeddings

Authors:

Oana BalalauAuthors Info & Claims

WWW '22: Companion Proceedings of the Web Conference 2022

Pages 779 - 783

https://doi.org/10.1145/3487553.3524657

Published: 16 August 2022 Publication History

Abstract

Citations are crucial in scientific works as they help position a new publication. Each citation carries a particular intent, for example, to highlight the importance of a problem or to compare against results provided by another method. The authors’ intent when making a new citation has been studied to understand the evolution of a field over time or to make recommendations for further citations. In this work, we address the task of citation intent prediction from a new perspective. In addition to textual clues present in the citation phrase, we also consider the citation graph, leveraging high-level information of citation patterns. In this novel setting, we perform a thorough experimental evaluation of graph-based models for intent prediction. We show that our model, GraphCite, improves significantly upon models that take into consideration only the citation phrase. Our code is available online1.

References

[1]

Zafar Ali, Pavlos Kefalas, Khan Muhammad, Bahadar Ali, and Muhammad Imran. 2020. Deep learning in citation recommendation models survey. Expert Systems with Applications 162 (2020), 113790. https://doi.org/10.1016/j.eswa.2020.113790

[2]

Waleed Ammar, Dirk Groeneveld, Chandra Bhagavatula, Iz Beltagy, Miles Crawford, Doug Downey, Jason Dunkelberger, Ahmed Elgohary, Sergey Feldman, Vu Ha, 2018. Construction of the Literature Graph in Semantic Scholar. In NAACL-HLT (3).

[3]

Iz Beltagy, Kyle Lo, and Arman Cohan. 2019. SciBERT: A Pretrained Language Model for Scientific Text. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Association for Computational Linguistics, Hong Kong, China, 3615–3620. https://doi.org/10.18653/v1/D19-1371

[4]

Arman Cohan, Waleed Ammar, Madeleine van Zuylen, and Field Cady. 2019. Structural Scaffolds for Citation Intent Classification in Scientific Publications. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). Association for Computational Linguistics, Minneapolis, Minnesota, 3586–3596. https://doi.org/10.18653/v1/N19-1361

[5]

Randall Collins. 1994. Why the social sciences won’t become high-consensus, rapid-discovery science. In Sociological forum, Vol. 9. Springer, 155–177.

[6]

Lucio M. Dery, Paul Michel, Ameet Talwalkar, and Graham Neubig. 2022. Should We Be Pre-training? An Argument for End-task Aware Training as an Alternative. In International Conference on Learning Representations. https://openreview.net/forum?id=2bO2x8NAIMB

[7]

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). Association for Computational Linguistics, Minneapolis, Minnesota, 4171–4186. https://doi.org/10.18653/v1/N19-1423

[8]

Matthias Fey and Jan E. Lenssen. 2019. Fast Graph Representation Learning with PyTorch Geometric. In ICLR Workshop on Representation Learning on Graphs and Manifolds.

[9]

Suchin Gururangan, Ana Marasović, Swabha Swayamdipta, Kyle Lo, Iz Beltagy, Doug Downey, and Noah A. Smith. 2020. Don’t Stop Pretraining: Adapt Language Models to Domains and Tasks. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Online, 8342–8360. https://doi.org/10.18653/v1/2020.acl-main.740

[10]

William L Hamilton, Rex Ying, and Jure Leskovec. 2017. Inductive representation learning on large graphs. In Proceedings of the 31st International Conference on Neural Information Processing Systems. 1025–1035.

[11]

Chanwoo Jeong, Sion Jang, Eunjeong Park, and Sungchul Choi. 2020. A context-aware citation recommendation model with BERT and graph convolutional networks. Scientometrics 124, 3 (2020), 1907–1922.

Digital Library

[12]

David Jurgens, Srijan Kumar, Raine Hoover, Dan McFarland, and Dan Jurafsky. 2018. Measuring the Evolution of a Scientific Field through Citation Frames. Transactions of the Association for Computational Linguistics 6 (2018), 391–406. https://doi.org/10.1162/tacl_a_00028

[13]

Anita Khadka, Ivan Cantador, and Miriam Fernandez. 2020. Exploiting Citation Knowledge in Personalised Recommendation of Recent Scientific Publications. In Proceedings of The 12th Language Resources and Evaluation Conference. 2231–2240.

[14]

Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Kopf, Edward Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala. 2019. PyTorch: An Imperative Style, High-Performance Deep Learning Library. In Advances in Neural Information Processing Systems 32. Curran Associates, Inc., 8024–8035. http://papers.neurips.cc/paper/9015-pytorch-an-imperative-style-high-performance-deep-learning-library.pdf

Digital Library

[15]

Anton Tsitsulin, Davide Mottin, Panagiotis Karras, and Emmanuel Müller. 2018. Verse: Versatile graph embeddings from similarity measures. In Proceedings of the 2018 world wide web conference. 539–548.

Digital Library

[16]

Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Lio, and Yoshua Bengio. 2017. Graph attention networks. arXiv preprint arXiv:1710.10903(2017).

Cited By

H C RRaj KMadasamy A(2024)Citation Intent Classification Using Transformers2024 IEEE Students Conference on Engineering and Systems (SCES)10.1109/SCES61914.2024.10652428(1-6)Online publication date: 21-Jun-2024
https://doi.org/10.1109/SCES61914.2024.10652428
Buscaldi DDessí DMotta EMurgia MOsborne FReforgiato Recupero D(2024)Citation prediction by leveraging transformers and natural language processing heuristicsInformation Processing and Management: an International Journal10.1016/j.ipm.2023.10358361:1Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1016/j.ipm.2023.103583
Zhao YZhang ZXiao Y(2023)Leveraging MRC Framework for Research Contribution Patterns Identification in Citation SentencesLeveraging Generative Intelligence in Digital Libraries: Towards Human-Machine Collaboration10.1007/978-981-99-8088-8_16(180-193)Online publication date: 4-Dec-2023
https://dl.acm.org/doi/10.1007/978-981-99-8088-8_16
Show More Cited By

Index Terms

GraphCite: Citation Intent Classification in Scientific Publications via Graph Embeddings
1. Computing methodologies
  1. Artificial intelligence
    1. Natural language processing
  2. Machine learning
    1. Machine learning approaches
      1. Neural networks

Recommendations

Multi-task learning model for citation intent classification in scientific publications
Abstract
Citations play a significant role in the evaluation of scientific literature and researchers. Citation intent analysis is essential for academic literature understanding. Meanwhile, it is useful for enriching semantic information representation ...
Acknowledgments in scientific publications: Presence in Spanish science and text patterns across disciplines

The acknowledgments in scientific publications are an important feature in the scholarly communication process. This research analyzes funding acknowledgment presence in scientific publications and introduces a novel approach for discovering text ...
Nobel Citation Effects on Scientific Publications: A Case Study in Physics
Abstract
The Nobel Prize has been a prominent research topic in Scientometrics. This study aims to explore Nobel citation effects, which refer to changes in the cumulative citation counts of publications after authors have won the Nobel Prize. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

WWW '22: Companion Proceedings of the Web Conference 2022

April 2022

1338 pages

ISBN:9781450391306

DOI:10.1145/3487553

Editors:
Frédérique Laforest
INSA Lyon, France
,
Raphaël Troncy
EURECOM, France
,
Lionel Médini
Université Lyon 1, France
,
Ivan Herman
W3C / retired

Copyright © 2022 ACM.

Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

Sponsors

SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 August 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Funding Sources

GENCI-IDRIS

Conference

WWW '22

Sponsor:

SIGWEB

WWW '22: The ACM Web Conference 2022

April 25 - 29, 2022

Virtual Event, Lyon, France

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
164
Total Downloads

Downloads (Last 12 months)57
Downloads (Last 6 weeks)12

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

H C RRaj KMadasamy A(2024)Citation Intent Classification Using Transformers2024 IEEE Students Conference on Engineering and Systems (SCES)10.1109/SCES61914.2024.10652428(1-6)Online publication date: 21-Jun-2024
https://doi.org/10.1109/SCES61914.2024.10652428
Buscaldi DDessí DMotta EMurgia MOsborne FReforgiato Recupero D(2024)Citation prediction by leveraging transformers and natural language processing heuristicsInformation Processing and Management: an International Journal10.1016/j.ipm.2023.10358361:1Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1016/j.ipm.2023.103583
Zhao YZhang ZXiao Y(2023)Leveraging MRC Framework for Research Contribution Patterns Identification in Citation SentencesLeveraging Generative Intelligence in Digital Libraries: Towards Human-Machine Collaboration10.1007/978-981-99-8088-8_16(180-193)Online publication date: 4-Dec-2023
https://dl.acm.org/doi/10.1007/978-981-99-8088-8_16
Manghi PMannocci AOsborne FSacharidis DSalatino AVergoulis T(2022)Sci-K 2022 - International Workshop on Scientific Knowledge: Representation, Discovery, and AssessmentCompanion Proceedings of the Web Conference 202210.1145/3487553.3524883(735-738)Online publication date: 25-Apr-2022
https://dl.acm.org/doi/10.1145/3487553.3524883

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten