Summary
Robotic systems that collaborate with humans must respond flexibly to the beliefs, desires, and intentions of their human teammates. Dynamic environments require robots to infer and respond intelligently to the intentions of humans holding potentially false beliefs and invalid plans about the situation at hand. We present a novel integrated architecture that incorporates simulation-theoretic mechanisms that enables our robot to infer the task-related beliefs, desires, and intentions of its human partner(s) based on their observable real-time behavior and visual perspective. Using a novel task suite tested on human subjects and our robot, we demonstrate the first robot system that can successfully handle counterfactual situations in the physical world to appropriately assist its human partners even when their beliefs are false or their plan is invalid for their desired goal.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Berlin, M., Gray, J., Thomaz, A., Breazeal, C.: Perspective taking: An organizing principle for learning in human-robot interaction. In: Twenty-First National Conference on Artificial Intelligence, AAAI 2006 (2006)
Carberry, S.: Techniques for plan recognition. User Modeling and User-Adapted Interaction 11(1-2), 31–48 (2001)
Gallese, V., Goldman, A.: Mirror neurons and the simulation theory of mind-reading. Trends in Cognitive Sciences 2(12), 493–501 (1998)
Gray, J., Breazeal, C., Berlin, M., Brooks, A., Lieberman, J.: Action parsing and goal inference using self as simulator. In: 14th IEEE International Workshop on Robot and Human Interactive Communication (ROMAN), Nashville, Tennessee. IEEE, Los Alamitos (2005)
Huber, M.J., Durfee, E.H., Wellman, M.P.: The automated mapping of plans for plan recognition. In: de Mantaras, R.L., Poole, D. (eds.) Proceedings of the 10th Conference on Uncertainty in Artificial Intelligence, San Francisco, CA, USA, pp. 344–351. Morgan Kaufmann publishers Inc., San Mateo (1994)
Intille, S.S., Bobick, A.F.: A framework for recognizing multi-agent action from visual evidence. In: AAAI/IAAI, pp. 518–525 (1999)
Johnson, M., Demiris, Y.: Perceptual perspective taking and action recognition. International Journal of Advanced Robotic Systems 2(4), 301–308 (2005)
Needham, C.J., Santos, P.E., Magee, D.R., Devin, V., Hogg, D.C., Cohn, A.G.: Protocols from perceptual observations. Artif. Intell. 167(1-2), 103–136 (2005)
Pollack, M.: Plans as complex mental attitudes. In: Cohen, P.R., Morgan, J., Pollack, M. (eds.) Intentions in Communication, pp. 77–103. MIT Press, Cambridge (1990)
Rao, A.S., Murray, G.: Multi-agent mental-state recognition and its application to air-combat modeling. In: Proceedings of the 13th International Workshop on Distributed Artificial Intelligence (DAI-94), Seattle, WA, USA, pp. 283–304 (1994)
Ronnie, L., Johansson, M., Suzic, R.: Particle filter-based information acquisition for robust plan recognition. In: Eighth International Conference on Information Fusion (2005)
Thomaz, A.L., Berlin, M., Breazeal, C.: An embodied computational model of social referencing. In: 14th IEEE International Workshop on Robot and Human Interactive Communication (ROMAN), Nashville, Tennessee. IEEE, Los Alamitos (2005)
Scassellati, B.: Theory of mind for a humanoid robot. Autonomous Robots 12, 13–24 (2002)
Trafton, J.G., Cassimatis, N.L., Bugajska, M.D., Brock, D.P., Mintz, F.E., Schultz, A.C.: Enabling effective human-robot interaction using perspective-taking in robots. IEEE Transactions on Systems, Man, and Cybernetics 35(4), 460–470 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Breazeal, C., Gray, J., Berin, M. (2010). Mindreading as a Foundational Skill for Socially Intelligent Robots. In: Kaneko, M., Nakamura, Y. (eds) Robotics Research. Springer Tracts in Advanced Robotics, vol 66. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-14743-2_32
Download citation
DOI: https://doi.org/10.1007/978-3-642-14743-2_32
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-14742-5
Online ISBN: 978-3-642-14743-2
eBook Packages: EngineeringEngineering (R0)