Abstract

This document presents a detailed description of the challenge on clarifying questions for dialogue systems (ClariQ) [pronounce as Claire-ee-que]. The challenge is organized as part of the Conversational AI challenge series (ConvAI3)111http://convai.io/ at Search-oriented Conversational AI (SCAI) EMNLP workshop in 2020.222https://scai.info. The main aim of the conversational systems is to return an appropriate answer in response to the user requests. However, some user requests might be ambiguous. In IR settings such a situation is handled mainly thought the diversification of search result page [Radlinski and Dumais, 2006]. It is however much more challenging in dialogue settings. Hence, we aim to study the following situation for dialogue settings: