Skeleton-to-Response: Dialogue Generation Guided by Retrieval Memory
Deng Cai The Chinese University of Hong Kong、Yan Wang Tencent AI Lab、Victoria Bi Tencent AI Lab \ANDZhaopeng Tu Tencent AI Lab、Xiaojiang Liu Tencent AI Lab、Wai Lam The Chinese University of Hong Kong、Shuming Shi Tencent AI Lab Work done while DC was interning at Tencent AI Lab.
Abstract
Traditional generative dialogue models generate responses solely from input queries. Such information is insufficient for generating a specific response since a certain query could be answered in multiple ways. Recently, researchers have attempted to fill the information gap by exploiting information retrieval techniques. For a given query, similar dialogues are retrieved from the entire training data and considered as an additional knowledge source. While the use of retrieval may harvest extensive information, the generative models could be overwhelmed, leading to unsatisfactory performance. In this paper, we propose a new framework which exploits retrieval results via a skeleton-to-response paradigm. At first, a skeleton is extracted from the retrieved dialogues. Then, both the generated skeleton and the original query are used for response generation via a novel response generator. Experimental results show that our approach significantly improves the informativeness of the generated responses.
原文 arXiv:1809.05296;中英对照 + 大白话阅读 https://aha.fim.ai/paper/1809.05296v5