Skip to main content

Advertisement

Springer Nature Link
Log in

Enhanced context-aware citation recommendation with auxiliary textual information based on an auto-encoding mechanism

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

The process of retrieving suitable papers which are related to an interesting topic while doing research normally takes a lot of time and effort. Citation recommendation is frequently used to solve this problem by automatically suggesting a list of candidate papers that should match with the user’s references or topics of interest. Applying the recent research results of deep learning in multiple disciplines, the performance of citation recommendation systems has been significantly improved with the facilitation of powerful deep neural data analysis and representation learning techniques. However, most of the recent Neural Citation Network (NCN) model-based techniques still encounter limitations related to the capability of integrating auxiliary information to assist the citation contextual learning process. Thus, in this paper, we propose a novel context-aware NCN-based model with the extra textual data integration and Bidirectional Encoder Representations from Transformers (BERT) model to improve the performance of the citation recommendation task. To do this, an extensive deep neural auto-encoding mechanism with a self-attention-based mechanism is utilized in our proposed model to flexibly learn both associated textual and citation contextual data in the given dataset. These enriched citation contextual information representations are then utilized to improve the performance of the citation recommendation task as the end-to-end neural learning process. Extensive experiments in the standard arXiv dataset show the effectiveness and good performance of the proposed model.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Explore related subjects

Discover the latest articles and news from researchers in related subjects, suggested using machine learning.

Notes

  1. http://c-rex.org

  2. http://refseer.ist.psu.edu/data/

  3. https://github.com/dinhngocthi/GAsource/tree/master/NeuralCitationNetwork/neural_citation-master

References

  1. Pan Y, Fazhi H, Haiping Y (2019) A novel Enhanced Collaborative Autoencoder with knowledge distillation for top-N recommender systems. Neurocomputing 332, no. ISSN 0925–2312:137–148

    Article  Google Scholar 

  2. Pan Y, He F, Yu H (2020) A correlative denoising autoencoder to model social influence for top-N recommender system. Front Comput Sci 14(3):143301

    Article  Google Scholar 

  3. Pan Y, He F, Yu H (2020) Learning social representations with deep autoencoder for recommender system. World Wide Web 23:2259–2279

    Article  Google Scholar 

  4. McNee S, Albert I, Cosley D, Gopalkrishnan P, Lam S, Rashid A, Konstan J, Riedl J (2002) On the recommending of citations for research papers. In: The 2002 ACM conference on computer supported cooperative work 2002

  5. Cai X, Wang N, Yang L, Mei X (2022) Global-local neighborhood based network representation for citation recommendation. Appl Intell 52:1–18

    Article  Google Scholar 

  6. Ali Z, Kefalas P, Muhammad K, Ali B, Imran M (2020) Deep learning in citation recommendation models survey. Expert Syst Appl 162:113790

    Article  Google Scholar 

  7. Huang Z, Low C, Teng M, Zhang H, Ho D, Krass M, Grabmair M (2021) Context-aware legal citation recommendation using deep learning. In: The eighteenth international conference on artificial intelligence and law

  8. Da F, Kou G, Peng Y (2022) Deep learning based dual encoder retrieval model for citation recommendation. Technol Forecast Soc Chang 177:121545

    Article  Google Scholar 

  9. He Q, Pei J, Kifer D, Mitra P, Giles L (2010) Context-aware citation recommendation. In: The 19th international conference on world wide web 2010

  10. Chen L, Xia M (2021) A context-aware recommendation approach based on feature selection. Appl Intell 51(2):865–875

    Article  Google Scholar 

  11. Ebesu T, Fang Y (2017) Neural citation network for context-aware citation recommendation. In: the 40th international ACM SIGIR conference on Research and Development in information retrieval (SIGIR’2017)

  12. Färber M, Klein T, Sigloch J (2020) Neural citation recommendation: a reproducibility study. In: the 10th international workshop on bibliometric-enhanced information retrieval (BIR 2020)

  13. Jacob D, Ming-Wei C, Kenton L, Kristina T (2019) BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In: Proceedings of naacL-HLT, pp. 4171–4186 (2019)

  14. Färber M, Jatowt A (2020) Citation recommendation: approaches and datasets. Int J Digit Libr 21:375–405

    Article  Google Scholar 

  15. Su JH (2020) A personalized music recommender system using user contents, music contents and preference ratings. Vietnam J Comput Sci 7(1):77–92

    Article  Google Scholar 

  16. Galke L, Mai F, Vagliano I, Scherp A (2018) Multi-modal adversarial autoencoders for recommendations of citations and subject labels. In: The 26th conference on user modeling, adaptation and personalization

  17. Tang X, Wan X, Zhang X (2014) Cross-language context-aware citation recommendation in scientific articles. In: The 37th international ACM SIGIR conference on Research & Development in information retrieval

  18. Duma D, Liakata M, Clare A, Ravenscroft J, Klein E (2016) Rhetorical classification of anchor text for citation recommendation. D-Lib Magazine 22

  19. Kong X, Mao M, Wang W, Liu J, Xu B (2019) VOPRec: vector representation learning of papers with text information and structural identity for recommendation. IEEE Trans Emerg Topics Comput 9(1):226–237

  20. Péter M, Attila K (2021) Influential performance of nodes identified by relative entropy in dynamic networks. Vietnam J Comput Sci 8(1):93–112

    Article  Google Scholar 

  21. Pham P, Nguyen L, Vo B, Yun U (2021) Bot2Vec: a general approach of intra-community oriented representation learning for bot detection in different types of social networks. Inf Syst 103:101771

    Article  Google Scholar 

  22. Cai X, Zheng Y, Yang L, Dai T, Guo L (2019) Bibliographic network representation based personalized citation recommendation. IEEE Access 7:457–467

    Article  Google Scholar 

  23. Jeong C, Jang S, Park E (1907-1922) A context-aware citation recommendation model with BERT and graph convolutional networks. Scientometrics 124(3):2020–1922

    Google Scholar 

  24. Wang W (2020) Venue topic model–enhanced joint graph modelling for citation recommendation in scholarly big data. ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP), 20.1, pp. 1–15

  25. Chen J, Liu Y, Zhao S, Zhang Y (2020) Citation recommendation based on weighted heterogeneous information network containing semantic linking. In: 2019 IEEE international conference on multimedia and expo

  26. Huang W, Kataria S, Caragea C, Mitra P, Giles CL, Rokach L (2012) Recommending citations translating papers into references. In: The 21st ACM international conference on Information & Knowledge Management

  27. Huang W, Wu Z, Liang C, Mitra P, Giles LC (2015) A neural probabilistic model for context based citation recommendation. In: The 29th AAAI conference on artificial intelligence

  28. Färber M, Sampath A (2020) HybridCite: a hybrid model for context-AwareCitation recommendation. In: Proceedings of the ACM/IEEE joint conference on digital libraries in 2020

  29. Bulut B, Gündoğan E, Kaya B, Alhajj R, Kaya M (2020) User’s research interests based paper recommendation system: a deep learning approach. Putting social media and networking data in practice for education, planning, prediction and recommendation, pp. 117–130

  30. Khadka A, Knoth P (2018) Using citation-context to reduce topic drifting on pure citation-based recommendation. In: The 12th ACM conference on recommender systems

  31. Färber M, Zinecker V, Cartus IB, Celis S, Duma M (2021) C-rex: a comprehensive system for recommending in-text citations with explanations. In: Companion proceedings of the web conference

  32. Medić Z, Snajder J (2020) Improved local citation recommendation based on context enhanced with global information. In: The first workshop on scholarly document processing

  33. Wang J (2020) Deep memory network with bi-LSTM for personalized context-aware citation recommendation. Neurocomputing 410:103–113

    Article  Google Scholar 

  34. Collobert R, Weston J (2008) A unified architecture for natural language processing: deep neural networks with multitask learning. In: The 25th international conference on machine learning

  35. Bahdanau D, Cho K, Bengio Y (2015) Neural machine translation by jointly learning to align and translate. In: The 3rd international conference on learning representations (ICLR’15)

  36. Luong T, Pham H, Manning CD (2015) Effective Approaches to Attention-based Neural Machine Translation. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, Lisbon, Portugal, pp. 1412–1421

  37. Cho K, Merriënboer BV, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using RNN encoder-decoder for statistical machine translation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), Doha, Qatar

Download references

Author information

Authors and Affiliations

  1. Graduate University of Science and Technology, Vietnam Academy of Science and Technology, Ha Noi, Vietnam

    Thi N. Dinh

  2. Faculty of Information Technology, HUTECH University, Ho Chi Minh City, Viet Nam

    Phu Pham & Bay Vo

  3. Institute of Information Technology, Vietnam Academy of Science and Technology, Ha Noi, Vietnam

    Giang L. Nguyen

Authors
  1. Thi N. Dinh
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Phu Pham
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Giang L. Nguyen
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Bay Vo
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Bay Vo.

Ethics declarations

Competing interests

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dinh, T.N., Pham, P., Nguyen, G.L. et al. Enhanced context-aware citation recommendation with auxiliary textual information based on an auto-encoding mechanism. Appl Intell 53, 17381–17390 (2023). https://doi.org/10.1007/s10489-022-04423-1

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-022-04423-1

Keywords