Hanchen Xiong
ABSTRACT
Modeling and learning object-action relations has been an active topic of robotic study since it can enable an agent to discover manipulation knowledge from empirical data, based on which, for instance, the effects of different actions on an unseen object can be inferred in a data-driven way. This paper introduces a novel object-action relational model, in which objects are represented in a multi-layer, action-oriented space, and actions are represented in an object-oriented space. Model learning is based on homogeneity analysis, with extra dependency learning and decomposition of unique object scores into different action layers. The model is evaluated on a dataset of objects and actions in a kitchen scenario, and the experimental results illustrate that the proposed model yields semantically reasonable interpretation of object-action relations. The learned object-action relation model is also tested in various practical tasks (e.g. action effect prediction, object selection), and it displays high accuracy and robustness to noise and missing data.
- www-roc.inria.fr/gamma/download/.Google Scholar
- J. de Leeuw and P. Mair. Homogeneity Analysis in R: The Package homals.. Technical report, Department of Statistics, UCLA, 2007.Google Scholar
- R. Detry, C. H. Ek, M. Madry, J. Piater, and D. Kragić. Generalizing Grasps Across Partly Similar Objects. In International Conference on Robotics and Automation, pages 3791--3797. IEEE, 2012.Google Scholar
- R. Detry, D. Kraft, O. Kroemer, L. Bodenhagen, J. Peters, N. Krüger, and J. Piater. Learning Grasp Affordance Densities. Paladyn Journal of Behavioral Robotics, 2(1):1--17, 2011.Google ScholarCross Ref
- J. J. Gibson. The Ecological Approach to Visual Perception. Houghton Mifflin, 1979.Google Scholar
- G. Michailidis and J. de Leeuw. The Gifi System of Descriptive Multivariate Analysis. Statistical Science, 13:307--336, 1998.Google ScholarCross Ref
- B. Moldovan, P. Moreno, M. van Otterlo, J. Santos-Victor, and L. De Raedt. Learning relational affordance models for robots in multi-object manipulation tasks. In IEEE International Conference on Robotics and Automation, ICRA 2012, pages 4373--4378, May 2012.Google ScholarCross Ref
- L. Montesano and M. Lopes. Learning grasping affordances from local visual descriptors. In IEEE 8TH International Conference on Development and Learning, China, 2009. Google ScholarDigital Library
- L. Montesano, M. Lopes, A. Bernardino, and J. Santos-Victor. Learning object affordances: From sensory--motor coordination to imitation. IEEE Transactions on Robotics, 24(1):15--26, Feb 2008. Google ScholarDigital Library
- E. Oztop, N. Bradley, and M. Arbib. Infant grasp learning: a computational model. Experimental Brain Research, 158(4):480--503, 2004.Google ScholarCross Ref
Index Terms
- Homogeneity analysis for object-action relation reasoning in kitchen scenarios
Recommendations
Visual object-action recognition: Inferring object affordances from human demonstration
This paper investigates object categorization according to function, i.e., learning the affordances of objects from human demonstration. Object affordances (functionality) are inferred from observations of humans using the objects in different types of ...
Pair-based object-driven action rules
NFMCP'12: Proceedings of the First International Conference on New Frontiers in Mining Complex PatternsAction rules, as proposed by Raś and Wieczorkowska in [11], can be defined as actionable tasks that describe possible transitions of objects from one state to another with respect to a distinguished attribute. Recently, a new specialized case of action ...
Event Relation Reasoning Based on Event Knowledge Graph
Knowledge Science, Engineering and ManagementAbstractNatural language text contains numerous event-based, and a large number of semantic relations exist between events. Event relations express the event rationality logic and reveal the evolution process of events, which is of great significance for ...
Comments