Master’s Thesis Presentation • Human-Computer Interaction — Towards the Learning, Perception, and Effectiveness of Teachable Conversational AgentsExport this event to calendar

Tuesday, December 17, 2019 — 10:00 AM EST

Nalin Chhibber, Master’s candidate
David R. Cheriton School of Computer Science

The traditional process of building interactive machine learning systems can be viewed as a teacher-learner interaction scenario where the machine-learners are trained by one or more human-teachers. In this work, we explore if teachable AI agents can reliably learn from human-teachers through conversational interactions, how this teaching process affects teacher’s performance in the task, and their trust on the agent. We introduce a teachable agent, named Kai, that learns to classify news articles while also guiding the teaching process through conversational interventions. 

In a three-part study, where several crowdworkers individually teach Kai, we investigate whether this Learning by Teaching approach creates reliable machine learners, improves Turkers’ performance and leads to trustable AI agents that crowdworkers would use. We present and discuss the results of the underlying classifier built after conversational interactions with other text classification algorithms. We also provide an evaluation of how crowdworkers perform a text classification before and after interacting with a teachable agent. Finally, we investigate the notion of trust that crowdworkers would put on teachable agents in terms of delegating the work involving monetary compensation. Together, our results demonstrate the benefits of Learning by Teaching approach, in terms of the performance of the AI agent, the crowdworkers, and the dynamics of trust built from the teacher-learner interaction.

Location 
DC - William G. Davis Computer Research Centre
2306C
200 University Avenue West

Waterloo, ON N2L 3G1
Canada

S M T W T F S
27
28
29
30
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
  1. 2020 (188)
    1. November (1)
    2. October (7)
    3. September (21)
    4. August (28)
    5. July (14)
    6. June (18)
    7. May (16)
    8. April (20)
    9. March (16)
    10. February (25)
    11. January (22)
  2. 2019 (255)
    1. December (21)
    2. November (25)
    3. October (16)
    4. September (20)
    5. August (18)
    6. July (12)
    7. June (23)
    8. May (23)
    9. April (32)
    10. March (25)
    11. February (16)
    12. January (24)
  3. 2018 (217)
  4. 2017 (36)
  5. 2016 (21)
  6. 2015 (36)
  7. 2014 (33)
  8. 2013 (23)
  9. 2012 (4)
  10. 2011 (1)
  11. 2010 (1)
  12. 2009 (1)
  13. 2008 (1)