Please note: This master’s thesis presentation will be given online.
Kashif
Khan, Master’s
candidate
David
R.
Cheriton
School
of
Computer
Science
Dialog response generation is the task of generating response utterance given a query utterance. Apart from generating relevant and coherent responses, one would like the dialog generation model to generate diverse and informative sentences.
In this work, we propose and explore a novel multi-stage dialog response generation approach. In the first stage of our proposed multi-stage approach, we construct a variational latent space on the bag-of-words representation of the query and response utterances. In the second stage, transformation from query latent code to response latent code is learned using an adversarial process. The final stage involves fine-tuning a pretrained transformer based model called text-to-text transfer (T5) (Raffel et al., 2019) using a novel training regimen to generate the response utterances by conditioning on the query utterance and the response word learned in the previous stage.
We evaluate our proposed approach on two popular dialog datasets. We show using quantitative metrics that our proposed approach outperforms the state of the art approaches in generating diverse responses while still performing competitively on other quantitative metrics.
To join this master’s thesis presentation on Zoom, please go to https://us02web.zoom.us/j/83677626723?pwd=WElYWWc2ZWQ2eE1VR3BsWERScFczZz09
Meeting
ID:
836
7762
6723
Passcode:
047655