Loading [a11y]/accessibility-menu.js
Exploiting Pairwise Mutual Information for Knowledge-Grounded Dialogue | IEEE Journals & Magazine | IEEE Xplore

Exploiting Pairwise Mutual Information for Knowledge-Grounded Dialogue


Abstract:

External document knowledge is helpful for dialogue systems to generate high-quality responses. Although several knowledge-grounded dialogue models have been designed, ex...Show More

Abstract:

External document knowledge is helpful for dialogue systems to generate high-quality responses. Although several knowledge-grounded dialogue models have been designed, external knowledge cannot be comprehensively exploited due to the complex relationships among dialogue context, knowledge, and responses. To this end, we propose a novel transformer-based model, named TransIKG, which incorporates external document knowledge for dialogue generation. TransIKG comprises a two-step integration mechanism, including correlation integration and overall integration. Correlation integration is designed to fully exploit the pairwise mutual information among dialogue context, knowledge, and responses, while overall integration adopts an integration gate to capture global information. Furthermore, we utilize the positional information of dialogue turns to better represent the dialogue context and enhance the generalization ability of our model on out-of-domain documents. Finally, we propose a novel knowledge-aware pointer network to generate knowledge-enhanced response tokens. Experimental results on two benchmark datasets demonstrate that our model outperforms state-of-the-art models on both open-domain and domain-specific dialogues.
Page(s): 2231 - 2240
Date of Publication: 22 March 2022

ISSN Information:

Funding Agency:


References

References is not available for this document.