Abstract
Various methods have been performed for the purpose of Low Dynamic Range (LDR) image retrieval. However, no major work concerning the High Dynamic Range (HDR) image indexing has been widely diffused yet. We therefore propose a method that tackles the problem of efficiently and accurately retrieving HDR images. The proposed system is based on a hybrid descriptor which combines two color features. The first one is histogram based on the hue–saturation–value (HSV) color space that approaches the perception of human vision, whereas the second comprises the first- and second-order moments of the color bands. As a dissimilarity measure, we retained the Manhattan distance. In the second part of our work, we proposed an automatic tone mapping operator (TMO) to get an overview on the result images by using Standard Dynamic Range (SDR) devices. Comparisons with recent state-of-the-art TMOs have shown that our TM method produces LDR images with adequate quality while maintaining low complexity. Finally, to test our retrieval system, we have created two databases. Experimental evaluation showed that our system supports HDR images while achieving satisfying results in terms of accuracy and computational cost.
Similar content being viewed by others
References
Banterle, F., Artusi, A., Debattista, K., Chalmers, A.: Advanced High Dynamic Range Imaging: Theory and Practice. AK Peters (CRC Press), Natrick (2011)
Banterle, F., Debattista, K., Artusi, A., Pattanaik, S., Myszkowski, K., Ledda, P., Chalmers, A.: High dynamic range imaging and low dynamic range expansion for generating HDR content. Comput. Graph. Forum 28(8), 2343–2367 (2009)
Debevec, P.E., Malik, J.: Recovering high dynamic range radiance maps from photographs. In: Proceedings of SIGGRAPH, pp. 369–378 (1997)
Mitsunaga, T., Nayar, S.K.: Radiometric self calibration. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 374–380 (1999)
Ward, G.: Real pixels. Graph. Gems 2, 15–31 (1991)
Larson, G.W.: Logluv encoding for full-gamut, high-dynamic range images. J. Graph. Tools 3(1), 15–31 (1998)
Industrial Light & Magic. OpenEXR (2003). http://www.openexr.org. Accessed Jan 2018
Debattista, K., Bashford-Rogers, T., Selmanović, E., Mukherjee, R., Chalmers, A.: Optimal exposure compression for high dynamic range content. Vis. Comput. 31(6), 1089–1099 (2015)
Xu, R., Pattanaik, S., Hughes, C.: High-dynamic-range still-image encoding in jpeg 2000. IEEE Comput. Graph. Appl. 25(6), 57–64 (2005)
Ward, G., Simmons, M.: Jpeg-hdr: a backwards-compatible, high dynamic range extension to jpeg. In: SIGGRAPH 05: ACM SIGGRAPH, Courses p. 2 (2005)
Korshunov, P., Ebrahimi, T.: A JPEG backward-compatible HDR image compression. In: Proceedings of SPIE: Applications of Digital Image Processing XXXV. 8499 (2012)
Drago, F., Myszkowski, K., Annen, T., Chiba, N.: Adaptive logarithmic mapping for displaying high contrast scenes. Comput. Graph. Forum 22(3), 419–426 (2003)
Reinhard, E., Stark, M., Shirley, P., Ferwerda, J.: Photographic tone reproduction for digital images. ACM Trans. Graph. 21(3), 267–276 (2002)
Durand, F., Dorsey, J.: Fast bilateral filtering for the display of high-dynamic-range images. In: ACM Transactions on Graphics (TOG) Proceedings of ACM SIGGRAPH, vol. 21, no. 3, pp. 257–266 (2002)
Reinhard, E., Devlin, K.: Dynamic range reduction inspired by photoreceptor physiology. Comput. Graph. Forum 11(1), 13–24 (2005)
Mertens, T., Kautz, J., Reeth, F.V.: Exposure fusion. In: Pacific Conference on Computer Graphics and Applications, pp. 382–90 (2007)
Krawczyk, G., Myszkowski, K., Seidel, H.P.: Lightness perception in tone reproduction for high dynamic range images. Comput. Graph. Forum 24(3), 635–645 (2005)
Banterle, F., Artus, A., Sikudova, E., Edward, T., Bashford-Rogers, W., Ledda, P., Bloj, M., Chalmers, A.: Dynamic range compression by differential zone mapping based on psychophysical experiments. In: ACM Symposium on Applied Perception, pp. 39–46 (2012)
Bruce, N.D.: Expoblend: information preserving exposure blending based on normalized log domain entropy. Comput. Graph. 39, 12–23 (2014)
Banterle, F., Ledda, P., Debattista, K., Chalmers, A., Bloj, M.: A framework for inverse tone mapping. Vis. Comput. 23(7), 467–478 (2007)
Masia, B., Agustin, S., Fleming, R.W., Sorkine, O., Gutierrez, D.: Evaluation of reverse tone mapping through varying exposure conditions. ACM Trans. Graph. 28(5), 1 (2009)
Masia, B., Serrano, A., Gutierrez, D.: Dynamic range expansion based on image statistics. Multimed. Tools Appl. 76(1), 631–648 (2017)
Kovaleski, R.P., Oliveira, M.M.: High-quality brightness enhancement functions for real-time reverse tone mapping. Vis. Comput. 25(5), 539–547 (2009)
Kovaleski, R.P., Oliveira, M.M.: High-Quality Reverse Tone Mapping for a Wide Range of Exposures. In: Conference on Graphics, Patterns and Images, pp. 49–56 (2014)
Hristova, H., Le Meur, O., Cozot, R., Bouatouch, K.: High-dynamic-range image recovery from flash and non-flash image pairs. Vis. Comput. 33(6), 725–735 (2017)
Kabbai, L., Abdellaoui, M., Douik, A.: Image classification by combining local and global features. Vis. Comput. 35, 679–693 (2018)
Raj Singh, S., Kohli, S.: Enhanced CBIR using color moments, HSV histogram, color auto correlogram, and gabor texture. Int. J. Comput. Syst. 2, 161–165 (2015)
Shrivastava, N., Tyagi, V.: An efficient technique for retrieval of color images in large databases. Comput. Electr. Eng. 46, 314–327 (2015)
Swain, M.J., Ballard, D.H.: Colour indexing. Int. J. Comput. Vis. 7(1), 1–2 (1991)
Liu, G.H., Yang, J.Y.: Content-based image retrieval using color difference histogram. Pattern Recognit. 46(1), 188–198 (2013)
Stricker, M.A., Orengo, M.: Similarity of Color Images. In: Storage and Retrieval for Image and Video Databases (SPIE), pp. 381–392 (1995)
Pass, G., Zabih, R., Miller, J.: Comparing images using color coherence vectors. In: Proceedings of the Fourth ACM International Conference on Multimedia, pp. 65–73 (1996)
Huang, J., Kumar, S., Mitra, M., Zhu, W., Zabih, R.: Image indexing using color correlograms. In: IEEE International Conference on Computer Vision and Pattern Recognition, pp. 762–768 (1997)
Eidenberger, H.: How good are the visual MPEG-7 features? In: Visual Communications and Image Processing (2003)
Lin, C.H., Chen, C.C., Lee, H.L., Liao, J.R.: Fast K-means algorithm based on a level histogram for image retrieval. Expert Syst. Appl. 41(7), 3276–3283 (2014)
Vailaya, A., Figueiredo, M.A.T., Jain, A.K., Zhang, H.J.: Image classification for content-based indexing. IEEE Trans. Image Process. 10(1), 117–130 (2001)
Qi, X., Han, Y.: Incorporating multiple SVMs for automatic image annotation. Pattern Recognit. 40(2), 728–741 (2007)
Adams, A.: The Print. The Ansel Adams Photography series. Little, Brown and Company, Boston (1981)
Burger, W., Burge, M.J.: Principles of Digital Image Processing: Fundamental Techniques. Springer Undergraduate Topics in Computer Science. Springer, Berlin (2009)
Poularakis, A.: The Transforms and Applications Handbook. Electrical Engineering Handbook Series. CRC Press, Boca Raton (2000)
Zhu, X., Milanfar, P.: Automatic parameter selection for denoising algorithms using a no reference measure of image content. IEEE Trans. Image Process. 19(12), 3116–3132 (2010)
Yeganeh, V., Wang, Z.: Objective quality assessment of tone-mapped images. IEEE Trans. Image Process. 22(2), 657–667 (2013)
Khwildi, R., Hachani, M., Ouled Zaid, A.: New indexing method of HDR images using color histograms. In: International conference on machine vision (2016)
Khwildi, R., Ouled Zaid, A.: A new retrieval system based on low dynamic range expansion and SIFT descriptor. In: International Workshop on Multimedia Signal Processing (2018)
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Khwildi, R., Ouled Zaid, A. HDR image retrieval by using color-based descriptor and tone mapping operator. Vis Comput 36, 1111–1126 (2020). https://doi.org/10.1007/s00371-019-01719-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-019-01719-1