Julian Hough
ABSTRACT
For effective HRI, robots must go beyond having good legibility of their intentions shown by their actions, but also ground the degree of uncertainty they have. We show how in simple robots which have spoken language understanding capacities, uncertainty can be communicated to users by principles of grounding in dialogue interaction even without natural language generation. We present a model which makes this possible for robots with limited communication channels beyond the execution of task actions themselves. We implement our model in a pick-and-place robot, and experiment with two strategies for grounding uncertainty. In an observer study, we show that participants observing interactions with the robot run by the two different strategies were able to infer the degree of understanding the robot had internally, and in the more uncertainty-expressive system, were also able to perceive the degree of internal uncertainty the robot had reliably.
- T. Baumann and D. Schlangen. The inprotk 2012 release. In NAACL-HLT Workshop on Future Directions and Needs in the Spoken Dialog Community: Tools and Data. ACL, 2012. Google Scholar
Digital Library
- T. Brick and M. Scheutz. Incremental natural language processing for hri. In Proceedings of the ACM/IEEE international conference on Human-robot interaction, pages 263--270. ACM, 2007. Google ScholarDigital Library
- H. H. Clark. Using language. Cambridge university press, 1996.Google Scholar
- H. H. Clark and S. E. Brennan. Grounding in communication. Perspectives on socially shared cognition, 13(1991), 1991.Google Scholar
- A. D. Dragan, S. Bauman, J. Forlizzi, and S. S. Srinivasa. Effects of robot motion on human-robot collaboration. In Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction, pages 51--58. ACM, 2015. Google ScholarDigital Library
- A. D. Dragan, K. C. Lee, and S. S. Srinivasa. Legibility and predictability of robot motion. In 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pages 301--308. IEEE, 2013. Google ScholarDigital Library
- A. Eshghi, C. Howes, E. Gregoromichelaki, J. Hough, and M. Purver. Feedback in conversation as incremental semantic update. In Proceedings of the 11th International Conference on Computational Semantics, London, UK, 2015. ACL.Google Scholar
- J. Ginzburg, R. Fernández, and D. Schlangen. Disfluencies as intra-utterance dialogue moves. Semantics and Pragmatics, 7(9), 2014.Google Scholar
- D. Harel. Statecharts: A visual formalism for complex systems. Science of computer programming, 8(3), 1987. Google ScholarDigital Library
- J. Hough and D. Schlangen. Investigating fluidity for human-robot interaction with real-time, real-world grounding strategies. In Proceedings of the 17th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 288--298, Los Angeles, September 2016. Association for Computational Linguistics.Google ScholarCross Ref
- C. Kennington, S. Kousidis, T. Baumann, H. Buschmeier, S. Kopp, and D. Schlangen. Better driving and recall when in-car information presentation uses situationally-aware incremental speech output generation. In Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, 2014. Google ScholarDigital Library
- C. Kennington and D. Schlangen. Simple learning and compositional application of perceptually grounded word meanings for incremental reference resolution. Proceedings of the Conference for the Association for Computational Linguistics (ACL). ACL, 2015.Google ScholarCross Ref
- T. Kollar, S. Tellex, D. Roy, and N. Roy. Toward understanding natural language directions. In Human-Robot Interaction (HRI), 2010 5th ACM/IEEE International Conference on. IEEE, 2010. Google ScholarDigital Library
- G.-J. M. Kruijff. There is no common ground in human-robot interaction. In Proceedings of SemDial 2012 (SeineDial): The 16th Workshop on the Semantics and Pragmatics of Dialogue, 2012.Google Scholar
- G.-J. M. Kruijff, P. Lison, T. Benjamin, H. Jacobsson, and N. Hawes. Incremental, multi-level processing for comprehending situated dialogue in human-robot interaction. In Symposium on Language and Robots, 2007.Google Scholar
- C. Liu, R. Fang, and J. Y. Chai. Towards mediating shared perceptual basis in situated dialogue. In Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue. ACL, 2012. Google ScholarDigital Library
- C. Liu, J. Walker, and J. Y. Chai. Ambiguities in spatial language understanding in situated human robot dialogue. In AAAI Fall Symposium: Dialog with Robots, 2010.Google Scholar
- M. Marge and A. I. Rudnicky. Towards overcoming miscommunication in situated dialogue by asking questions. In AAAI Fall Symposium: Building Representations of Common Ground with Intelligent Agents, 2011.Google Scholar
- J. Miura, Y. Negishi, and Y. Shirai. Adaptive robot speed control by considering map and motion uncertainty. Robotics and Autonomous Systems, 54(2):110--117, 2006.Google ScholarCross Ref
- A. Moon, B. Panton, H. Van der Loos, and E. Croft. Using hesitation gestures for safe and ethical human-robot interaction. In Proceedings of the ICRA, pages 11--13, 2010.Google Scholar
- T. Paek and E. Horvitz. Grounding criterion: Toward a formal theory of grounding. Technical report, MSR Technical Report, 2000.Google Scholar
- J. Peltason and B. Wrede. Pamini: A framework for assembling mixed-initiative human-robot interaction from generic interaction patterns. In Proceedings of the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue. ACL, 2010. Google ScholarDigital Library
- M. Saerbeck, T. Schut, C. Bartneck, and M. D. Janse. Expressive robots in education: varying the degree of social supportive behavior of a robotic tutor. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 1613--1622. ACM, 2010. Google ScholarDigital Library
- J. Schalkwyk, D. Beeferman, F. Beaufays, B. Byrne, C. Chelba, M. Cohen, M. Kamvar, and B. Strope. Your Word is my Command: Google Search by Voice: A Case Study. In Advances in Speech Recognition. Springer, 2010.Google ScholarCross Ref
- D. Schlangen and G. Skantze. A General, Abstract Model of Incremental Dialogue Processing. Dialoge & Discourse, 2(1), 2011.Google Scholar
- G. Skantze and S. Al Moubayed. Iristk: a statechart-based toolkit for multi-party face-to-face interaction. In Proceedings of the 14th ACM international conference on Multimodal interaction. ACM, 2012. Google ScholarDigital Library
- D. R. Traum. A computational theory of grounding in natural language conversation. Technical report, DTIC Document, 1994. Google ScholarDigital Library
- J. D. Williams. A belief tracking challenge task for spoken dialog systems. In NAACL-HLT Workshop on Future Directions and Needs in the Spoken Dialog Community: Tools and Data. ACL, 2012. Google ScholarDigital Library
Index Terms
- It's Not What You Do, It's How You Do It: Grounding Uncertainty for a Simple Robot
Recommendations
Natural Communication about Uncertainties in Situated Interaction
ICMI '14: Proceedings of the 16th International Conference on Multimodal InteractionPhysically situated, multimodal interactive systems must often grapple with uncertainties about properties of the world, people, and their intentions and actions. We present methods for estimating and communicating about different uncertainties in ...
Responding to Student Uncertainty in Spoken Tutorial Dialogue Systems
In designing and building tutorial dialogue systems it is important not only to understand the tactics employed by human tutors but also to understand how tutors decide when to use various tactics. We argue that these decisions are based not only on ...
Modeling facial expression of uncertainty in conversational animation
ZiF'06: Proceedings of the Embodied communication in humans and machines, 2nd ZiF research group international conference on Modeling communication with robots and virtual humansBuilding animated conversational agents requires developing a fine-grained analysis of the motions and meanings available to interlocutors in face-to-face conversation and implementing strategies for using these motions and meanings to communicate ...
Comments