Loading [MathJax]/extensions/MathMenu.js
Challenges to decoding the intention behind natural instruction | IEEE Conference Publication | IEEE Xplore

Challenges to decoding the intention behind natural instruction


Abstract:

Currently, most systems for human-robot teaching allow only one mode of teacher-student interaction (e.g., teaching by demonstration or feedback), and teaching episodes h...Show More

Abstract:

Currently, most systems for human-robot teaching allow only one mode of teacher-student interaction (e.g., teaching by demonstration or feedback), and teaching episodes have to be carefully set-up by an expert. To understand how we might integrate multiple, interleaved forms of human instruction into a robot learner, we performed a behavioral study in which 44 untrained humans were allowed to freely mix interaction modes to teach a simulated robot (secretly controlled by a human) a complex task. Analysis of transcripts showed that human teachers often give instructions that are nontrivial to interpret and not easily translated into a form useable by machine learning algorithms. In particular, humans often use implicit instructions, fail to clearly indicate the boundaries of procedures, and tightly interleave testing, feedback, and new instruction. In this paper, we detail these teaching patterns and discuss the challenges they pose to automatic teaching interpretation as well as the machine-learning algorithms that must ultimately process these instructions. We highlight the challenges by demonstrating the difficulties of an initial automatic teacher interpretation system.
Published in: 2011 RO-MAN
Date of Conference: 31 July 2011 - 03 August 2011
Date Added to IEEE Xplore: 29 August 2011
ISBN Information:

ISSN Information:

Conference Location: Atlanta, GA, USA

Contact IEEE to Subscribe

References

References is not available for this document.