Interactive Object Recognition System for a Helper Robot Using Photometric Invariance

Md. Altab HOSSAIN
Rahmadi KURNIA
Akio NAKAMURA
Yoshinori KUNO

Publication
IEICE TRANSACTIONS on Information and Systems   Vol.E88-D    No.11    pp.2500-2508
Publication Date: 2005/11/01
Online ISSN: 
DOI: 10.1093/ietisy/e88-d.11.2500
Print ISSN: 0916-8532
Type of Manuscript: Special Section PAPER (Special Section on Life-like Agent and its Communication)
Category: 
Keyword: 
segmentation,  object recognition,  human robot interaction,  multimodal interface,  interactive object recognition,  

Full Text: PDF(755.6KB)>>
Buy this Article



Summary: 
We are developing a helper robot that carries out tasks ordered by the user through speech. The robot needs a vision system to recognize the objects appearing in the orders. It is, however, difficult to realize vision systems that can work in various conditions. Thus, we have proposed to use the human user's assistance through speech. When the vision system cannot achieve a task, the robot makes a speech to the user so that the natural response by the user can give helpful information for its vision system. Our previous system assumes that it can segment images without failure. However, if there are occluded objects and/or objects composed of multicolor parts, segmentation failures cannot be avoided. This paper presents an extended system that tries to recover from segmentation failures using photometric invariance. If the system is not sure about segmentation results, the system asks the user by appropriate expressions depending on the invariant values. Experimental results show the usefulness of the system.


open access publishing via