DSTC9
The Ninth Dialog System Technology Challenge
News
January 22, 2021 - Workshop Program is now online.
December 14, 2020 - Call for DSTC10 Track Proposals is now online.
November 13, 2020 - DSTC9 overview paper is now online.
October 26, 2020 - 'SIMMC: Situated Interactive Multi-Modal Conversational AI' track results are available here.
October 23, 2020 - 'Interactive Evaluation of Dialog' track results are available here.
October 23, 2020 - 'Multi-domain Task-oriented Dialog Challenge II' track results are available here.
October 23, 2020 - 'Beyond Domain APIs: Task-oriented Conversational Modeling with Unstructured Knowledge Access' track results are available here.
September 17, 2020 - DSTC9 workshop will be held on February 8-9, 2021 at AAAI-21.
June 22, 2020 - 'SIMMC: Situated Interactive Multi-Modal Conversational AI' track resources are available here.
June 15, 2020 - 'Beyond Domain APIs: Task-oriented Conversational Modeling with Unstructured Knowledge Access' track resources are available here.
June 14, 2020 - 'Interactive Evaluation of Dialog ' track resources are available here.
June 12, 2020 - 'Multi-Domain Task-Completion Dialog Challenge II' track resources are available here.
June 4, 2020 - Challenge registration has opened! Please fill out this form.
March 10, 2020 - DSTC9 website launched
Background and Motivation
Starting as an initiative to provide a common testbed for the task of Dialog State Tracking, the first Dialog State Tracking Challenge (DSTC) was organized in 2013, followed by DSTC2&3 in 2014, DSTC4 in 2015, and DSTC5 in 2016. Given the remarkable success of the first five editions, and understanding both, the complexity of the dialog phenomenon and the interest of the research community in a wider variety of dialog related problems, the DSTC rebranded itself as "Dialog System Technology Challenges" for its sixth edition. Then, DSTC6, DSTC7, and DSTC8 have been completed in 2017, 2018, and 2019 respectively.
In this ninth challenge, the call for task proposals has resulted into the following four different tracks: (1) Beyond Domain APIs: Task-oriented Conversational Modeling with Unstructured Knowledge Access, (2) Multi-domain Task-oriented Dialog Challenge II, (3) Interactive Evaluation of Dialog, and (4) SIMMC: Situated Interactive Multi-Modal Conversational AI. The objective of these tracks is to invite interested organizations conduct dialog related challenges in specific areas of research and under the umbrella of the DSTC.
DSTC9 Organizations
The 9th Dialog System Technology Challenge (DSTC9) is supported by IBM Research, Google Research, Universidad Politécnica de Madrid, National Taiwan University and Amazon Alexa AI.