Skip to main content
Log in

Utilizing shape retrieval in sketch synthesis

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This article describes SR-Sketch, a sketch creation tool that can act both as a front-end visual query module to visual information retrieval systems and as an aid tool for fast image composition. The system allows the user to draw shapes on the computer screen using the mouse cursor. At any time during this process the user can query a shape database for similar shapes and then select the ones s/he thinks are more relevant. The system can then automatically align and replace user-drawn objects with the chosen database shapes in the user sketch. For any match between a sketch shape and a database shape, the application can provide a visual explanation of how and why two shapes are considered similar. Evaluation results show that the system achieves favorable results with respect to noise tolerance, speed and reliability. SR-Sketch is freely available for download and experimentation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Agouris P, Stefanidis A (1998) Sketch-based image retrieval in an integrated GIS environment. Int Arch Photogramm Remote Sens 32, Part IV:597–604 (September)

    Google Scholar 

  2. Andreou I, Sgouros NM (2003) Sketch creation utilizing shape matching techniques. IEEE Int. Conf. Multimedia and Expo (ICME), vol.1. Baltimore, USA, pp 153–156 (July)

  3. Ashley J, et al. (1995) Query by image and video content: the QBIC system. IEEE Computer 28(9):23–32 (September)

    Google Scholar 

  4. Bach JR, Fuller C, Gupta A, Hampapur A, Horowitz B, Jain R, Shu CF (1996) Virage image search engine: an open framework for image management. In: Jain R(ed) Symposium on electronic imaging: science and technology—storage and retrieval for image and video databases IV, pp 76–87

  5. Barton J, Love D (2003) Retrieving Designs from a Sketch using an Automated GT Coding & Classification System. IEPM2003, Porto

  6. Belongie S, Malik J, Puzicha J (2002) Shape matching and object recognition using shape contexts. IEEE Trans Pattern Anal Mach Intell 24(24):509–522 (April)

    Article  Google Scholar 

  7. Bimbo AD, Pala P (1997) Visual image retrieval by elastic matching of user sketches. IEEE Trans Pattern Anal Mach Intell 19(2):121–132

    Article  Google Scholar 

  8. Di Sciascio E, Mongiello M (1999) Query by sketch and relevance feedback for content-based image retrieval over the web. J Vis Lang Comput, special issue on Distributed Multimedia Systems 10(6)

  9. Essert-Villard C, Mathis P (2001) Interactive handling of a construction plan in CAD. Fifth International Conference on Information Visualization, pp 124–129, London, England, July 25–27, 2001

  10. Faloutsos C, et al (1994) Efficient and effective querying by image content. Journal of Intelligent Information Systems 3(1)

  11. Henrich A, Robbert G (2000) MARS: a retrieval service for multimedia authoring environments, ADBIS–DASFAA Symposium 2000, pp 88–98

  12. Hirata K, Kato T (1992). Query by visual example, content based image retrieval. In Lecture Notes in Computer Science 580

  13. Hirata K, Kato T (1993) Rough sketch-based image information retrieval. NEC Res Dev 34(2):263–273

    Google Scholar 

  14. Landay JA, Myers BA (2001) Sketching interfaces: toward more human interface design. IEEE Computer 34(3):56–64 (March)

    Google Scholar 

  15. Ma WY, Manjunath B (1997) NeTra: a toolbox for navigating large image databases. Proc. IEEE Int’l Conf Image Processing 568–571

  16. Mallat S (1989) A theory for multiresolution signal decomposition: the wavelet representation. IEEE Trans Pattern Anal Mach Intell 11:674–693 (July)

    Article  MATH  Google Scholar 

  17. Mehrotra R, Gary J E (1995) Similar shape retrieval in shape data management. IEEE Computer Magazine 28(9):57–62 (September)

    Google Scholar 

  18. Mokhtarian F (1995) Silhouette-based isolated object recognition through curvature scale space. IEEE Trans Pattern Anal Mach Intell 17(5):539–544

    Article  Google Scholar 

  19. Niblak W, et al. (1993) The QBIC project: querying images by content using color, texture, and shape. In Storage and Retrieval for Image and Video Databases, SPIE 1908:173–182

  20. Pentland A, Picard RW, Sclaroff S (1994) Photobook: tools for content-based manipulation of databases. In Proc Storage and Retrieval for Image and Video Databases II, SPIE 185:34–47

  21. Rui Y, She AC, Huang TS (1996) Modified Fourier descriptors for shape representation—a practical approach. In Proc. of 1 workshop on image databases and multimedia search

  22. Shum H-Y, Chen H, Zheng N-N, Zhu S-C, Xu Y-Q (2001) Example-based facial sketch generation with non-parametric sampling. 8th IEEE Int. Conf Comput Vision (ICCV 2001) 2:433–438

    Article  Google Scholar 

  23. Smith JR, Chang SF (1996) VisualSEEK: a fully automated content-based image query system. In: Proc. of ACM Multimedia’96

  24. The gcv library page: [http://www.thalis.cs.unipi.gr/~gandreou/gcv/]

  25. The Python language web site: [http://www.python.org/]

  26. The SR-Sketch page: [http://www.thalis.cs.unipi.gr/~gandreou/sr_sketch/]

  27. The Tcl developer web site: [http://www.tcl.tk/]

  28. Wolfson H, Rigoutsos, I (1997) Geometric hashing: an overview. IEEE Comput Sci Eng, 4(4):10–21 (October–December)

    Article  Google Scholar 

  29. Zhang DS, Lu G (2001) A comparative study on shape retrieval using fourier descriptors with different shape signatures. Int. Conf. on Intelligent Multimedia and Distance Education (ICIMADE01), pp 1–9, Fargo, ND, USA, June 1–3

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Nikitas M. Sgouros.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Andreou, I., Sgouros, N.M. Utilizing shape retrieval in sketch synthesis. Multimed Tools Appl 32, 275–291 (2007). https://doi.org/10.1007/s11042-006-0053-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-006-0053-z

Keywords

Navigation