Skip to main content
SpringerLink
Log in

Citation recommendation employing heterogeneous bibliographic network embedding

  • S. I. : Effective and Efficient Deep Learning
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

The massive number of research articles on the Web makes it troublesome for researchers to identify related works that could meet their preferences and interests. Consequently, various network representation learning-based models have been proposed to produce citation recommendations. Nevertheless, these models do not exploit semantic relations and contextual information between the objects of bibliographic papers’ networks, which can result in inadequate citation recommendations. Moreover, existing citation recommendation methods face problems such as lack of personalization, cold-start, and network sparsity. To mitigate such problems and produce individualized citation recommendations, we propose a heterogeneous network embedding model that jointly learns node representations by exploiting semantics corresponding to the author, time, context, field of study, citations, and topics. Compared to baseline models, the results produced by the proposed model over the DBLP datasets prove 10% and 12% improvement on mean average precision (MAP) and normalized discounted cumulative gain (nDCG@10) metrics, respectively. Also, the effectiveness of our model is analyzed on the cold-start papers and network sparsity problems, where it gains 12% and 9% better MAP and recall@10 scores, respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Notes

  1. https://lfs.aminer.cn/misc/dblp.v11.zip

  2. https://originalstatic.aminer.cn/misc/dblp.v12.7z

References

  1. Kunaver M, Požrl T (2017) Diversity in recommender systems-a survey. Knowl-Based Syst 123:154–162

    Article  Google Scholar 

  2. Covington P, Adams J, Sargin E (2016) Deep neural networks for youtube recommendations. In: Proceedings of the 10th ACM Conference on Recommender Systems, RecSys ’16, p. 191–198. Association for Computing Machinery, New York, NY, USA

  3. Walek B, Fojtik V(2020) A hybrid recommender system for recommending relevant movies using an expert system. Expert Systems with Applications p. 113452

  4. Ali Z, Khusro S, Ullah I(2016) A hybrid book recommender system based on table of contents (toc) and association rule mining. In: Proceedings of the 10th International Conference on Informatics and Systems, pp. 68–74

  5. Gu W, Dong S, Chen M (2015) Personalized news recommendation based on articles chain building. Neural Comput Appl 27:1263–1272

    Article  Google Scholar 

  6. Aliannejadi M, Rafailidis D, Crestani F (2019) A joint two-phase time-sensitive regularized collaborative ranking model for point of interest recommendation. IEEE Transactions on Knowledge and Data Engineering

  7. Huang T, fu Zhang D, Bi L (2020) Neural embedding collaborative filtering for recommender systems. Neural Computing and Applications pp. 1–15

  8. Wang C, Blei DM(2011) Collaborative topic modeling for recommending scientific articles. In: Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), pp. 448–456

  9. Bansal T, Belanger D, McCallum A (2016) Ask the gru: Multi-task learning for deep text recommendations. In: Proceedings of the 10th ACM Conference on Recommender Systems, RecSys ’16, pp. 107–114. New York, NY, USA

  10. Amami M, Pasi G, Stella F, Faiz R (2016) An LDA-based approach to scientific paper recommendation. In: Natural Language Processing and Information Systems: 21st International Conference on Applications of Natural Language to Information Systems, NLDB 2016, Salford, UK, June 22-24, 2016, Proceedings, pp. 200–210. Springer International Publishing

  11. Ayala-Gómez F, Daróczy B, Benczúr A, Mathioudakis M, Gionis A (2018) Global citation recommendation using knowledge graphs. J Intell Fuzzy Syst 34(5):3089–3100

    Article  Google Scholar 

  12. Galke L, Mai F, Vagliano I, Scherp A(2018) Multi-modal adversarial autoencoders for recommendations of citations and subject labels. In: Proceedings of the 26th Conference on User Modeling, Adaptation and Personalization, pp. 197–205

  13. Bhagavatula C, Feldman S, Power R, Ammar W (2018) Content-based citation recommendation. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), pp. 238–251. Association for Computational Linguistics, New Orleans, Louisiana

  14. Wang H, Li W (2015) Relational collaborative topic regression for recommender systems. IEEE Trans Knowl Data Eng 27(5):1343–1355

    Article  MathSciNet  Google Scholar 

  15. Cai X, Zheng Y, Yang L, Dai T, Guo L (2019) Bibliographic network representation based personalized citation recommendation. IEEE Access 7:457–467

    Article  Google Scholar 

  16. Du Z, Tang J, Ding Y (2019) Polar: Attention-based cnn for one-shot personalized article recommendation. In: Machine Learning and Knowledge Discovery in Databases, pp. 675–690

  17. Yang L, Zheng Y, Cai X, Dai H, Mu D, Guo L, Dai T (2018) A lstm based model for personalized context-aware citation recommendation. IEEE Access 6:59618–59627

    Article  Google Scholar 

  18. Cai X, Han J, Li W, Zhang R, Pan S, Yang L (2018) A three-layered mutually reinforced model for personalized citation recommendation. IEEE Tran Neural Netw Learn Syst 29(12):6026–6037

    Article  Google Scholar 

  19. Ali Z, Qi G, Kefalas P, Abro WA, Ali B(2020) A graph-based taxonomy of citation recommendation models. Artificial Intelligence Review pp. 1–44

  20. Khusro S, Ali Z, Ullah I (2016) Recommender systems: issues, challenges, and research opportunities. In: Information Science and Applications (ICISA) 2016, pp. 1179–1189. Springer

  21. Son J, Kim SB (2017) Academic paper recommender system using multilevel simultaneous citation networks. Decision Support Systems

  22. Pazzani MJ, Billsus, D (2007) Content-based recommendation systems. In: The adaptive web, pp. 325–341. Springer

  23. Lops P, de Gemmis M, Semeraro G (2011) Content-based Recommender Systems: State of the Art and Trends, chap. Content-based Recommender Systems: State of the Art and Trends, pp. 73–105. Springer US, Boston, MA

  24. Tian G, Jing L (2013) Recommending scientific articles using bi-relational graph-based iterative rwr. In: Proceedings of the 7th ACM Conference on Recommender Systems (RecSys), pp. 399–402

  25. Chakraborty T, Modani N, Narayanam R, Nagar S (2015) Discern: A diversified citation recommendation system for scientific queries. 31st IEEE International Conference on Data Engineering. (ICDE) 2015, Seoul, South Korea, April 13–17, 2015. Seoul, South Korea, pp 555–566

  26. Kong X, Mao M, Wang W, Liu J, Xu B(2019) Voprec: Vector representation learning of papers with text information and structural identity for recommendation. IEEE Transactions on Emerging Topics in Computing pp. 1–1

  27. Ali Z, Qi G, Muhammad K. Khalil A, Ullah I, Khan A(2021) Global citation recommendation employing multi-view heterogeneous network embedding. In: 2021 55th Annual Conference on Information Sciences and Systems (CISS), pp. 1–6 , https://doi.org/10.1109/CISS50987.2021.9400311

  28. Ebesu T, Fang Y (2017) Neural citation network for context-aware citation recommendation. In: Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1093–1096

  29. Pradhan T, Gupta A, Pal S (2020) Hasvrec: A modularized hierarchical attention-based scholarly venue recommender system. Knowl-Based Syst 204:106181

    Article  Google Scholar 

  30. Chen J, Liu Y, Zhao S, Zhang Y(2019) Citation recommendation based on weighted heterogeneous information network containing semantic linking. In: 2019 IEEE International Conference on Multimedia and Expo (ICME), pp. 31–36

  31. Sugiyama K, Kan MY (2013) Exploiting potential citation papers in scholarly paper recommendation. In: Proceedings of the 13th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL), pp. 153–162

  32. Gazdar A, Hidri L (2019) A new similarity measure for collaborative filtering based recommender systems. Knowledge-Based Systems p. 105058

  33. Achakulvisut T, Acuna DE, Ruangrong T, Kording K (2016) Science concierge: A fast content-based recommendation system for scientific publications. PLoS ONE 11(7):1–11

    Article  Google Scholar 

  34. Ali Z, Ullah I, Khan A, Jan AU, Muhammad K (2021) An overview and evaluation of citation recommendation models. Scientometrics pp. 1–37

  35. Ali Z, Kefalas P, Muhammad K, Ali B, Imran M (2020) Deep learning in citation recommendation models survey. Expert Syst Appl 162:113790

    Article  Google Scholar 

  36. Huang W, Wu Z, Liang C, Mitra P, Giles CL (2015) A neural probabilistic model for context based citation recommendation. In: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, pp. 2404–2410

  37. Yin J, Li X(2017) Personalized citation recommendation via convolutional neural networks. In: APWeb/WAIM, pp. 285–293

  38. Ali Z, Qi G, Muhammad K, Kefalas P, Khusro S (2021) Global citation recommendation employing generative adversarial network. Expert Systems with Applications p. 114888

  39. Abro WA, Qi G, Gao H, Khan MA, Ali Z(2019) Multi-turn intent determination for goal-oriented dialogue systems. In: 2019 International Joint Conference on Neural Networks (IJCNN), pp. 1–8. IEEE

  40. Wang J, Zhu L, Dai T, Wang Y (2020) Deep memory network with bi-lstm for personalized context-aware citation recommendation. Neurocomputing 410:103–113

    Article  Google Scholar 

  41. Martin A, Lara-Cabrera R, Vargas VM, Gutiérrez PA, Hervás-Martínez C, Camacho D (2020) Statistically-driven coral reef metaheuristic for automatic hyperparameter setting and architecture design of convolutional neural networks. In: 2020 IEEE Congress on Evolutionary Computation (CEC), pp. 1–8. IEEE

  42. Martín A, Vargas VM, Gutiérrez PA, Camacho D, Hervás-Martínez C (2020) Optimising convolutional neural networks using a hybrid statistically-driven coral reef optimisation algorithm. Appl Soft Comput 90:106144

    Article  Google Scholar 

  43. Goyal P, Ferrara E (2018): Graph embedding techniques, applications, and performance: A survey. Knowledge-Based Systems 151, 78–94

  44. Cui P, Wang X, Pei J, Zhu W (2018) A survey on network embedding. IEEE Trans Knowl Data Eng 31(5):833–852

    Article  Google Scholar 

  45. Li B, Pi D(2020) Network representation learning: a systematic literature review. Neural Computing and Applications pp. 1–33

  46. Christoforidis G, Kefalas P, Papadopoulos A, Manolopoulos Y (2021) Reline: point-of-interest recommendations using multiple network embeddings. Knowledge and Information Systems pp. 1–27

  47. Gupta S, Varma V(2017) Scientific article recommendation by using distributed representations of text and graph. In: Proceedings of the 26th International Conference on World Wide Web Companion, WWW ’17 Companion, pp. 1267–1268. International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, Switzerland

  48. Le Q, Mikolov T (2014) Distributed representations of sentences and documents. In: E.P. Xing, T. Jebara (eds.) Proceedings of the 31st International Conference on Machine Learning, Proceedings of Machine Learning Research, vol. 32, pp. 1188–1196. PMLR, Bejing, China

  49. Ganguly S, Pudi V (2017) Paper2vec: Combining graph and text information for scientific paper representation. In: Jose JM, Hauff C, Altıngovde IS, Song D, Albakour D, Watt S, Tait J (eds) Advances in Information Retrieval. Springer International Publishing, Cham, pp 383–395

    Chapter  Google Scholar 

  50. Ribeiro LF, Saverese PH, Figueiredo DR (2017) struc2vec: Learning node representations from structural identity. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 385–394. ACM

  51. Grover A, Leskovec, J (2016) Node2vec: Scalable feature learning for networks. In: Proceedings of the 22Nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD ’16, pp. 855–864. ACM, New York, NY, USA

  52. Cai X, Han J, Yang L (2018) Generative adversarial network based heterogeneous bibliographic network representation for personalized citation recommendation. In: Thirty-Second AAAI Conference on Artificial Intelligence, pp. 265–272

  53. Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J (2013) Distributed representations of words and phrases and their compositionality. In: Advances in neural information processing systems, pp. 3111–3119

  54. Tang J, Qu M, Wang M, Zhang M, Yan J, Mei Q(2015) Line: Large-scale information network embedding. In: Proceedings of the 24th International Conference on World Wide Web, WWW ’15, pp. 1067–1077. International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, Switzerland

  55. Cohan A, Feldman S, Beltagy I, Downey D, Weld D (2020) Specter: Document-level representation learning using citation-informed transformers. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 1–13. Association for Computational Linguistics, Online

  56. Beltagy I, Lo K, Cohan A(2019) Scibert: A pretrained language model for scientific text

  57. Kobayashi Y, Shimbo M, Matsumoto Y (2018) Citation recommendation using distributed representation of discourse facets in scientific articles. In: Proceedings of the 18th ACM/IEEE on Joint Conference on Digital Libraries, JCDL ’18, pp. 243–251. ACM, New York, NY, USA

  58. Zhao J, Mathieu M, LeCun Y (2016) Energy-based generative adversarial network. arXiv preprint arXiv:1609.03126

Download references

Author information

Authors and Affiliations

  1. School of Computer Science and Engineering, Southeast University, Nanjing, China

    Zafar Ali, Guilin Qi & Waheed Abro

  2. Visual Analytics for Knowledge Laboratory (VIS2KNOW Lab), Department of Software, Sejong University, Seoul, 143-747, Republic of Korea

    Khan Muhammad

  3. Rajnagar Mahavidyalaya, Birbhum, India

    Siddhartha Bhattacharyya

  4. Department of Computer Science, Shaheed Benazir Bhutto University, Sheringal, Pakistan

    Irfan Ullah

Authors
  1. Zafar Ali
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Guilin Qi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Khan Muhammad
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Siddhartha Bhattacharyya
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Irfan Ullah
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Waheed Abro
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Zafar Ali or Khan Muhammad.

Ethics declarations

Conflict of interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ali, Z., Qi, G., Muhammad, K. et al. Citation recommendation employing heterogeneous bibliographic network embedding. Neural Comput & Applic 34, 10229–10242 (2022). https://doi.org/10.1007/s00521-021-06135-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-021-06135-y

Keywords

Search

Navigation