Abstract
In the last decades, a wide body of literature has been devoted to study different saliency detection methods. These methods are typically devised on the basis of different image analysis paradigms, which leads to different performances that are not always rankable, but rather complementary. In this paper, a network design-based framework for multicriteria robust saliency detection is proposed. The key idea is that a suitable blending of the salient regions obtained by different methods leads to a salient region that outperforms the results obtained, individually, by these methods. Moreover, besides of considering state-of-the-art saliency detection approaches, a new method, which incorporates a novel tool for image contour detection, is designed. Results obtained on different sets of benchmark instances show that the proposed multicriteria robust framework exhibits high accuracy in the detection of salience objects; i.e., the pixels comprising the blended salient object are likely to be part of the actual salient object. This work aims at building further bridges between the areas of image processing and the areas of operations research.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Notes
CIELab is a color space specified by the International Commission on Illumination. It describes all the colors visible to the human eye and was created to serve as a device-independent model to be used as a reference.
Mahalanobis distance can be defined as a dissimilarity measure between two random vectors \(\mathbf {u}\) and \(\mathbf {v}\) of the same distribution with the covariance matrix S.
References
Achanta, R., Hemami, S., Estrada, F., & Süsstrunk, S. (2009). Frequency-tuned salient region detection. In 2009 IEEE conference on computer vision and pattern recognition (pp. 1597–1604).
Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., & Susstrunk, S. (2010). SLIC superpixels compared to state-of-the-art superpixel methods. Technical report, EPFL, Switzerland.
Adams, A., Baek, J., & Davis, M. (2010). Fast high-dimensional filtering using the permutohedral lattice. Computer Graphics Forum, 26(9), 753–762.
Álvarez-Miranda, E., Ljubić, I., & Mutzel, P. (2013a). The maximum weight connected subgraph problem. In M. Jünger & G. Reinelt (Eds.), Facets of combinatorial optimization: Festschrift for Martin Grötschel (pp. 245–270). New York: Springer.
Álvarez-Miranda, E., Ljubić, I., & Mutzel, P. (2013b). The rooted maximum node-weight connected subgraph problem. In C. Gomes & M. Sellmann (Eds.), CPAIOR 2013, LNCS (Vol. 7874, pp. 300–315). New York: Springer
Arbelaez, P., Maire, M., Fowlkes, C., & Malik, J. (2011). Contour detection and hierarchical image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(5), 898–916.
Batra, D., Kowdle, A., Parikh, D., Luo, J., & Chen, T. (2010). icoseg: Interactive co-segmentation with intelligent scribble guidance. In 2010 IEEE conference on computer vision and pattern recognition (pp. 3169–3176).
Bay, H., Tuytelaars, T., & Van Gool, L. (2006). SURF: Speeded up robust features. In A. Leonardis, H. Bischof, & A. Pinz (Eds.), ECCV 2006, LNCS (Vol. 3951, pp. 404–417). New York: Springer.
Borji, A., & Itti, L. (2013). State-of-the-art in visual attention modeling. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(1), 185–207.
Borji, A., Sihite, D., & Itti, L. (2012). Salient object detection: A benchmark. In A. Fitzgibbon, S. Lazebnik, P. Perona, Y. Sato, & C. Schmid (Eds.), ECCV 2012, LNCS (Vol. 7573, pp. 414–429).
Bruce, N., Kornprobst, P.(2009). On the role of context in probabilistic models of visual saliency. In 16th IEEE international conference on image processing (pp. 3089–3092).
Cheng, M., Zhang, G., Mitra, N., Huang, X., & Hu, S. (2011). Global contrast based salient region detection. In 2011 IEEE conference on computer vision and pattern recognition (pp. 409–416).
Criminisi, A. (2004). Microsoft research Cambridge object recognition image database. http://research.microsoft.com/vision/cambridge/recognition/. Accessed March 2016.
Doumpos, M., Zopounidis, C., & Galariotis, E. (2014). Inferring robust decision models in multicriteria classification problems: An experimental analysis. European Journal of Operational Research, 236(2), 601–611.
Ehrgott, M., & Gandibleux, X. (2000). A survey and annotated bibliography of multiobjective combinatorial optimization. OR Spektrum, 22(4), 425–460.
Ehrgott, M., & Wiecek, M.(2005) Mutiobjective programming. In Multiple criteria decision analysis: State of the art surveys (pp. 667–708). New York: Springer.
Guo, Y., Wang, X., Yang, Z., Wang, D., & Ma, Y. (2016). Improved saliency detection for abnormalities in mammograms. In International conference on computational science and computational intelligence (pp. 786–791).
Harel, J., Koch, C., & Perona, P. (2007). Graph-based visual saliency. Advances in Neural Information Processing Systems, 19, 545–552.
Joshi, T., Dey, S., & Samanta, D. (2009). Multimodal biometrics: State of the art in fusion techniques. International Journal of Biometrics, 1(4), 393–417.
Kouvelis, P., & Yu, G. (Eds.). (1997). Robust discrete optimization and its applications (1st ed.). Dordrecht: Kluwer Academic Publishers.
Li, J., Levine, X., An, M., & He, H. (2011) Saliency detection based on frequency and spatial domain analyses. In J. Hoey, S. McKenna & E. Trucco (Eds.), 2011 British machine vision conference (pp. 86.1–86.11).
Li, Y., Hou, X., Koch, C., Rehg, J., & Yuille, A. (2010). The secrets of salient object segmentation. http://cbi.gatech.edu/salobj/. Accessed March 2016.
Marchesotti, L., Cifarelli, C., & Csurka, G. (2009). A framework for visual saliency detection with applications to image thumbnailing. In 12th IEEE international conference on computer vision (pp. 2232–2239).
Mishra, A. (2010). Multimodal biometrics it is: Need for future systems. International Journal of Computer Applications, 3(4), 28–33.
Ogryczak, W., & Vetschera, R. (2004). Methodological foundations of multi-criteria decision making. European Journal of Operational Research, 158(2), 267–270.
Perazzi, F., Krähenbühl, P., Pritch, Y., & Hornung, A. (2012). Saliency filters: Contrast based filtering for salient region detection. In 2012 IEEE conference on computer vision and pattern recognition (pp. 733–740).
Roy, S., & Das, S. (2014). Saliency detection in images using graph-based rarity, spatial compactness and background prior. In 2014 conference on computer vision theory and applications (pp. 523–530).
Russakovsky, O., Deng, J., Huang, Z., Berg, A., & Fei-Fei, L. (2013). Detecting avocados to zucchinis: What have we done, and where are we going? In 2013 IEEE international conference on computer vision (pp. 2064–2071)
Vijayanarasimhan, S., & Grauman, K. (2011). Efficient region search for object detection. In 2011 IEEE conference on computer vision and pattern recognition (pp. 1401–1408).
Yang, C., Zhang, L., Lu, H., Ruan, X., & Yang, M.(2013). Saliency detection via graph-based manifold ranking. In 2013 IEEE conference on computer vision and pattern recognition (pp. 3166–3173).
Zhou, X., Liu, Z., Sun, G., Ye, L., & Wang, X. (2016). Improving saliency detection via multiple kernel boosting and adaptive fusion. IEEE Signal Processing Letters, 23(4), 517–521.
Acknowledgements
E. Álvarez-Miranda acknowledges the support of the Chilean Council of Scientific and Technological Research, CONICYT, through the Grant FONDECYT N.11140060 and through the Complex Engineering Systems Institute (ICM:P-05-004-F, CONICYT:FB0816).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Álvarez-Miranda, E., Díaz-Guerrero, J. Multicriteria saliency detection: a (exact) robust network design approach. Ann Oper Res 286, 649–668 (2020). https://doi.org/10.1007/s10479-018-2801-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10479-018-2801-7