Abstract
In human-agent interactions, attention sharing plays a key role in understanding other’s intention without explicit verbal explanation. Deep learning algorithms are recently used to model these interactions in a complex real world environment. In this paper we propose a deep learning based intention estimation and recommendation system by understanding humans attention based on their gestures. Action-object affordances are modeled using stacked auto-encoder, which represents the relationships between actions and objects. Intention estimation and object recommendation system according to human intention is implemented based on an affordance model. Experimental result demonstrates meaningful intention estimation and recommendation performance in the real-world scenarios.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Duncan, J.: Selective attention and the organization of visual information. Journal of Experimental Psychology. General 113, 501–517 (1984)
Treisman, A.M.: Strategies and models of selective attention. Psychological Review 76 (1969)
Ban, S.-W., Jang, Y.-M., Lee, M.: Affective saliency map considering psychological distance. Neurocomputing 74, 1916–1925 (2011)
Kozima, H.: Attention-sharing and behavior-sharing in human-robot communication. In: IEEE International Workshop on Robot and Human Communication (1998)
Moore, C.E., Dunham. P.J.: Joint attention: Its origins and role in development. Lawrence Erlbaum Associates, Inc. (1995)
Gibson, J.J.: The ecological approach to visual perception. Psychology Press (1986)
Kjellström, H., Romero, J., Kragić, D.: Visual object-action recognition: Inferring object affordances from human demonstration. Computer Vision and Image Understanding 115, 81–90 (2011)
Montesano, L., et al.: Learning Object Affordances: From Sensory-Motor Coordination to Imitation. IEEE Transactions on Robotics 24, 15–26 (2008)
Zhu, C., Cheng, Q., Sheng, W.: Human intention recognition in smart assisted living systems using a hierarchical hidden Markov model. In: IEEE International Conference on Automation Science and Engineering, pp. 253–258 (2008)
Schrempf, O.C., Hanebeck, U.D.: A generic model for estimating user-intentions in human-robot cooperation. In: Proceedings of the 2nd International Conference on Informatics in Control, Automation and Robotics, vol. 5 (2005)
Kelley, R., Wigand, L., Hamilton, B., Browne, K., Nicolescu, M., Nicolescu, M.: Deep networks for predicting human intent with respect to objects. In: Proceedings of the Seventh Annual ACM/IEEE International Conference on Human-Robot Interaction, pp. 171–172 (2012)
Hwang, B., Jang, Y.-M., Mallipeddi, R., Lee, M.: Probabilistic human intention modeling for cognitive augmentation. In: IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 2580–2584 (2012)
Rish, I.: An empirical study of the naive Bayes classifier. In: IJCAI 2001 Workshop on Empirical Methods in Artificial Intelligence, pp. 41–46 (2001)
Shotton, J., Sharp, T., Kipman, A., Fitzgibbon, A., Finocchio, M., Blake, A., Cook, M., Moore, R.: Real-time human pose recognition in parts from single depth images. Communications of the ACM 56, 116–124 (2013)
Vincent, P., Larochelle, H., Lajoie, I., Bengio, Y., Manzagol, P.A.: Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. The Journal of Machine Learning Research 9999, 3371–3408 (2010)
Hinton, G.E., Osindero, S., Teh, Y.-W.: A fast learning algorithm for deep belief nets. Neural Computation 18, 1527–1554 (2006)
Hinton, G.E., Salakhutdinov, R.R.: Reducing the dimensionality of data with neural networks. Science 313(5786), 504–507 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kim, S., Jung, J., Kavuri, S., Lee, M. (2013). Intention Estimation and Recommendation System Based on Attention Sharing. In: Lee, M., Hirose, A., Hou, ZG., Kil, R.M. (eds) Neural Information Processing. ICONIP 2013. Lecture Notes in Computer Science, vol 8226. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-42054-2_49
Download citation
DOI: https://doi.org/10.1007/978-3-642-42054-2_49
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-42053-5
Online ISBN: 978-3-642-42054-2
eBook Packages: Computer ScienceComputer Science (R0)