Modeling Attention and Perceptual Grouping to Salient Objects

Abstract

In this paper, we propose a biologically inspired model of the middle stages of attention, with specific algorithmic details. Existing computational models of attention concentrate on their role in visual feature extraction and the selection of spatial regions. However, these methods ignore the role of attention in other stages. Extension of these models has been proposed by augmenting the unit of attentional selection to “proto-objects”. In our approach, we extend attention to the middle stages and integrate the selection process with the perceptual grouping process. Integration is achieved by our innovative saliency driven perceptual grouping strategy, extending the traditional pixel-based saliency map to salient proto-objects. The proposed selective attention is made in two stages. Firstly, to achieve salient region localization, our method enhances the saliency map with region information from image segmentation and selects the most salient region (proto-object). Then, regions are organized using perceptual groupings, and their pop-out sequence is determined. Compared with traditional attention models our model provides saliency maps with meaningful region information, by eliminating misleading high-contrast edges, and focus of attention shifts in unit of perceptual object rather than spatial region. These two improvements fit to high stage vision information processing such as object recognition. Experiments in a reduced set of images show that our proposed model is able to automatically detect meaningful proto-objects.