skip to main content
10.1145/2330784.2330839acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
research-article

Empirical mode decomposition for saliency detection

Published: 07 July 2012 Publication History

Abstract

We propose a novel method for saliency detection and attention selection inspired by processes in the human visual cortex. To mimic the varying spatial resolution of the human eye as well as the constant eye movements (saccades) and to model the effect of temporal adaptiveness, we use empirical mode decomposition and corresponding intrinsic mode functions (IMFs), instead of applying standard multi-scale framework as suggested in the state of the art. We derive IMFs between scales to calculate data driven center surround maps which locally reflect amount of information in the scene and we combine opposition color channels, luminosity information and orientation maps into a single saliency map calculated on IMFs. To equalize influence of different components contributing to the final saliency map, normalization steps are proposed. Finally, the MSER regions are calculated directly on the saliency map in order to obtain the most dominant points. We present results on both artificially generated images used in psychological experiments, natural images and application of our method for unknown object detection in robotics.

References

[1]
R. Achanta, S. S. Hemami, F. J. Estrada, and S. Susstrunk. Frequency-tuned salient region detection. In 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2009), 20--25 June 2009, Miami, Florida, USA, pages 1597--1604, 2009.
[2]
P. Flandrin, P. Goncalves, and G. Rilling. Emd equivalent filter banks, from interpretation to applications. In N. Huang and S. Shen, editors, The Hilbert-Huang Transform and Its Applications}, pages 55--74. Interdisciplinary Mathematical Sciences, 2005.
[3]
N. E. Huang, Z. Shen, S. R. Long, M. C. Wu, H. H. Shih, Q. Zheng, N.-C. Yen, C. C. Tung, and H. H. Liu. The empirical mode decomposition and the hilbert spectrum for nonlinear and non-stationary time series analysis. Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences}, 454(1971):903--995, March 1998.
[4]
L. Itti, C. Koch, and E. Niebur. A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(11):1254--1259, 1998.
[5]
E. I. Knudsen. Fundamental components of attention. Annual Review of Neuroscience}, 30:57--78, 2007.
[6]
H. Knutsson and C.-F. Westin. Normalized and differential convolution: Methods for interpolation and filtering of incomplete and uncertain data. In IEEE Computer Vision and Pattern Recognition (CVPR), pages 515--523, New York City, USA, June 1993.
[7]
B. Lenseigne and P. Jonker. Empirical mode decomposition using normalized convolution. IEEE transactions on image processing, (Submitted), 2012.
[8]
J. Matas, O. Chum, M. Urban, and T. Pajdla. Robust side-baseline stereo from maximally stable extremal regions. Image and Vision Computing, 22(10):761--767, 2004.
[9]
J. C. Nunes, Y. Bouaoune, E. Delechelle, O. Niang, and P. Bunel. Image analysis by bidimensional empirical mode decomposition. Image and Vision Computing, 21(12):1019 -- 1026, 2003.
[10]
S.-J. Park, J.-K. Shin, and M. Lee. Biologically Inspired Saliency Map Model for Bottom-up Visual Attention, volume 2525, pages 113--145. Springer Berlin / Heidelberg, 2002.
[11]
M. Rudinac and P. P. Jonker. Saliency detection and object localization in indoor environments. In Proceedings of the International Conference on Pattern Recognition (ICPR), pages 404--407. IEEE, 2010.

Cited By

View all
  • (2018)Image Saliency Detection Algorithm Based on Spatial and Frequency DomainProceedings of the 4th International Conference on Virtual Reality10.1145/3198910.3234657(89-94)Online publication date: 24-Feb-2018

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
GECCO '12: Proceedings of the 14th annual conference companion on Genetic and evolutionary computation
July 2012
1586 pages
ISBN:9781450311786
DOI:10.1145/2330784
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 July 2012

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. empirical mode decomposition
  2. robotic application
  3. saliency detection
  4. visual attention selection

Qualifiers

  • Research-article

Conference

GECCO '12
Sponsor:
GECCO '12: Genetic and Evolutionary Computation Conference
July 7 - 11, 2012
Pennsylvania, Philadelphia, USA

Acceptance Rates

Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 03 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2018)Image Saliency Detection Algorithm Based on Spatial and Frequency DomainProceedings of the 4th International Conference on Virtual Reality10.1145/3198910.3234657(89-94)Online publication date: 24-Feb-2018

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media