Abstract
This article describes SR-Sketch, a sketch creation tool that can act both as a front-end visual query module to visual information retrieval systems and as an aid tool for fast image composition. The system allows the user to draw shapes on the computer screen using the mouse cursor. At any time during this process the user can query a shape database for similar shapes and then select the ones s/he thinks are more relevant. The system can then automatically align and replace user-drawn objects with the chosen database shapes in the user sketch. For any match between a sketch shape and a database shape, the application can provide a visual explanation of how and why two shapes are considered similar. Evaluation results show that the system achieves favorable results with respect to noise tolerance, speed and reliability. SR-Sketch is freely available for download and experimentation.
Similar content being viewed by others
References
Agouris P, Stefanidis A (1998) Sketch-based image retrieval in an integrated GIS environment. Int Arch Photogramm Remote Sens 32, Part IV:597–604 (September)
Andreou I, Sgouros NM (2003) Sketch creation utilizing shape matching techniques. IEEE Int. Conf. Multimedia and Expo (ICME), vol.1. Baltimore, USA, pp 153–156 (July)
Ashley J, et al. (1995) Query by image and video content: the QBIC system. IEEE Computer 28(9):23–32 (September)
Bach JR, Fuller C, Gupta A, Hampapur A, Horowitz B, Jain R, Shu CF (1996) Virage image search engine: an open framework for image management. In: Jain R(ed) Symposium on electronic imaging: science and technology—storage and retrieval for image and video databases IV, pp 76–87
Barton J, Love D (2003) Retrieving Designs from a Sketch using an Automated GT Coding & Classification System. IEPM2003, Porto
Belongie S, Malik J, Puzicha J (2002) Shape matching and object recognition using shape contexts. IEEE Trans Pattern Anal Mach Intell 24(24):509–522 (April)
Bimbo AD, Pala P (1997) Visual image retrieval by elastic matching of user sketches. IEEE Trans Pattern Anal Mach Intell 19(2):121–132
Di Sciascio E, Mongiello M (1999) Query by sketch and relevance feedback for content-based image retrieval over the web. J Vis Lang Comput, special issue on Distributed Multimedia Systems 10(6)
Essert-Villard C, Mathis P (2001) Interactive handling of a construction plan in CAD. Fifth International Conference on Information Visualization, pp 124–129, London, England, July 25–27, 2001
Faloutsos C, et al (1994) Efficient and effective querying by image content. Journal of Intelligent Information Systems 3(1)
Henrich A, Robbert G (2000) MARS: a retrieval service for multimedia authoring environments, ADBIS–DASFAA Symposium 2000, pp 88–98
Hirata K, Kato T (1992). Query by visual example, content based image retrieval. In Lecture Notes in Computer Science 580
Hirata K, Kato T (1993) Rough sketch-based image information retrieval. NEC Res Dev 34(2):263–273
Landay JA, Myers BA (2001) Sketching interfaces: toward more human interface design. IEEE Computer 34(3):56–64 (March)
Ma WY, Manjunath B (1997) NeTra: a toolbox for navigating large image databases. Proc. IEEE Int’l Conf Image Processing 568–571
Mallat S (1989) A theory for multiresolution signal decomposition: the wavelet representation. IEEE Trans Pattern Anal Mach Intell 11:674–693 (July)
Mehrotra R, Gary J E (1995) Similar shape retrieval in shape data management. IEEE Computer Magazine 28(9):57–62 (September)
Mokhtarian F (1995) Silhouette-based isolated object recognition through curvature scale space. IEEE Trans Pattern Anal Mach Intell 17(5):539–544
Niblak W, et al. (1993) The QBIC project: querying images by content using color, texture, and shape. In Storage and Retrieval for Image and Video Databases, SPIE 1908:173–182
Pentland A, Picard RW, Sclaroff S (1994) Photobook: tools for content-based manipulation of databases. In Proc Storage and Retrieval for Image and Video Databases II, SPIE 185:34–47
Rui Y, She AC, Huang TS (1996) Modified Fourier descriptors for shape representation—a practical approach. In Proc. of 1 workshop on image databases and multimedia search
Shum H-Y, Chen H, Zheng N-N, Zhu S-C, Xu Y-Q (2001) Example-based facial sketch generation with non-parametric sampling. 8th IEEE Int. Conf Comput Vision (ICCV 2001) 2:433–438
Smith JR, Chang SF (1996) VisualSEEK: a fully automated content-based image query system. In: Proc. of ACM Multimedia’96
The gcv library page: [http://www.thalis.cs.unipi.gr/~gandreou/gcv/]
The Python language web site: [http://www.python.org/]
The SR-Sketch page: [http://www.thalis.cs.unipi.gr/~gandreou/sr_sketch/]
The Tcl developer web site: [http://www.tcl.tk/]
Wolfson H, Rigoutsos, I (1997) Geometric hashing: an overview. IEEE Comput Sci Eng, 4(4):10–21 (October–December)
Zhang DS, Lu G (2001) A comparative study on shape retrieval using fourier descriptors with different shape signatures. Int. Conf. on Intelligent Multimedia and Distance Education (ICIMADE01), pp 1–9, Fargo, ND, USA, June 1–3
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Andreou, I., Sgouros, N.M. Utilizing shape retrieval in sketch synthesis. Multimed Tools Appl 32, 275–291 (2007). https://doi.org/10.1007/s11042-006-0053-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-006-0053-z