Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Authors: Catarina Pires 1 ; Pedro Gonçalo Correia 1 ; Pedro Silva 1 and Liliana Ferreira 1 ; 2

Affiliations: 1 Faculty of Engineering, University of Porto, R. Dr. Roberto Frias, Porto, Portugal ; 2 Fraunhofer Portugal AICOS, Rua Alfredo Allen 455/461, Porto, 4200-135, Portugal

Keyword(s): Knowledge Graphs, Large Language Models, Knowledge Graph Augmented LLMs, Academic Literature Retrieval, Natural Language Generation, Hallucination, Prompt Engineering.

Abstract: While Large Language Models have demonstrated significant advancements in Natural Language Generation, they frequently produce erroneous or nonsensical texts. This phenomenon, known as hallucination, raises concerns about the reliability of Large Language Models, particularly when users seek accurate information, such as in academic literature retrieval. This paper addresses the challenge of hallucination in Large Language Models by integrating them with Knowledge Graphs using prompt engineering. We introduce GPTscholar, an initial study designed to enhance Large Language Models responses in the field of computer science academic literature retrieval. The authors manually evaluated the quality of responses and frequency of hallucinations on 40 prompts across 4 different use cases. We conclude that the approach is promising, as the system outperforms the results we obtained with gpt-3.5-turbo without Knowledge Graphs.

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 52.14.35.155

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Pires, C., Correia, P. G., Silva, P. and Ferreira, L. (2024). Enhancing LLMs with Knowledge Graphs for Academic Literature Retrieval. In Proceedings of the 16th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - KDIR; ISBN 978-989-758-716-0; ISSN 2184-3228, SciTePress, pages 343-347. DOI: 10.5220/0012990500003838

@conference{kdir24,
author={Catarina Pires and Pedro Gon\c{c}alo Correia and Pedro Silva and Liliana Ferreira},
title={Enhancing LLMs with Knowledge Graphs for Academic Literature Retrieval},
booktitle={Proceedings of the 16th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - KDIR},
year={2024},
pages={343-347},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012990500003838},
isbn={978-989-758-716-0},
issn={2184-3228},
}

TY - CONF

JO - Proceedings of the 16th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - KDIR
TI - Enhancing LLMs with Knowledge Graphs for Academic Literature Retrieval
SN - 978-989-758-716-0
IS - 2184-3228
AU - Pires, C.
AU - Correia, P.
AU - Silva, P.
AU - Ferreira, L.
PY - 2024
SP - 343
EP - 347
DO - 10.5220/0012990500003838
PB - SciTePress