Abstract
This paper considers the notion of the “semantic gap” problem – i.e. how to enable a machine to recognize the semantic properties of an image – as it is commonly formulated in the domain of content-based image retrieval. Drawing on ethnographic studies of design professionals who routinely engage in image search tasks we seek to demonstrate the means by which aesthetic and affective concepts become associated with images and elements of images within a cooperative design process of selection, discussion and refinement and how these often do not correspond to the unused semantic tags provided in image libraries. We discuss how we believe the problem of the semantic gap is misconstrued and discuss some of the technology implications of this.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
We would like to point out that we refer to Getty Images as a good example of a site that employs the principle of semantic tagging and browsing and that our argument is around how these types of technologies work. Our criticism is not of Getty Images per se – it is a popular site which enjoys good reputation among professionals for its high quality images.
References
Bennet, M.R., Hacker, P.M.S.: Philosophical Foundations of Neuroscience. Blackwell, Oxford (2003)
Coulter, J., Parsons, E.D.: The Praxiology of Perception: Visual Orientations and Practical Actions. Inquiry, Vol. 33, pp. 251–272 (1990)
Datta, R., Joshi, D., Li, J., Wang, J.Z.: Image Retrieval: Ideas, Influences, and Trends of the New Age. ACM Computing Surveys. Vol. 4, No. 2, Article 5 (2008)
Dorai, C., Venkatesh, S.: Bridging the Semantic Gap in Content Management Systems: Computational Media Aesthetics. COSIGN 2001, pp. 94–99 (2001)
Getty Images, http://www.gettyimages.com, accessed 21/09/2009
Martin, D., O’Neill, J., Randall, D. ‘Talking about (my) Generation’: Creativity, Practice, Technology, and Talk. ECSCW 2009, pp. 171–190 (2009)
Shutterstock, www.shutterstock.com, accessed 21/09/2009
Smeulders, A.W.M, Worring, M., Santini, S., Gupta, A., Jain, R.: Content-Based Image Retrieval at the End of the Early Years. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 22, No. 12, pp. 1–32 (2000)
Wittgenstein, L. (1966), Lectures and Conversations on Aesthetics, Psychology, and Religious Belief, ed. Cyril Barrett. Oxford: Basil Blackwell
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer London
About this paper
Cite this paper
Colombino, T., Martin, D., Grasso, A., Marchesotti, L. (2010). A Reformulation of the Semantic Gap Problem in Content-Based Image Retrieval Scenarios. In: Lewkowicz, M., Hassanaly, P., Wulf, V., Rohde, M. (eds) Proceedings of COOP 2010. Springer, London. https://doi.org/10.1007/978-1-84996-211-7_4
Download citation
DOI: https://doi.org/10.1007/978-1-84996-211-7_4
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-84996-210-0
Online ISBN: 978-1-84996-211-7
eBook Packages: Computer ScienceComputer Science (R0)