Abstract
We propose an interactive sketching tool called SKIT to explore image database. The aim is to achieve fast result convergence according to the visual user query. Our main contribution is a new interactive image exploration approach which dynamically adapts to user sketches and provides feedback. The novel user interface is suitable for a range of interactive image-database access applications. In addition, we propose a position-aware matching approach for SKIT to support translation-free sketch searching. Experimental results demonstrate that our method outperforms state-of-the-art approaches with respect to the superior user interface and matching results.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Arvo, J., Novins, K.: Fluid sketches: continuous recognition and morphing of simple hand-drawn shapes. In: UIST, pp. 73–80 (2000)
Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8(6), 679–698 (1986)
Eitz, M., Hildebrand, K., Boubekeur, T., Alexa, M.: A descriptor for large scale image retrieval based on sketched feature lines. In: ACM Sketch Based Modeling, pp. 29–36 (2009)
Eitz, M., Richter, R., Boubekeur, T., Hildebrand, K., Alexa, M.: Sketch-based shape retrieval. ACM Trans. Graph. 31(4), 31 (2012a)
Fry, B., Reas, C.: A port of the processing visualization language (2014). http://processingjs.org/
von Gioi, R.G., Jakubowicz, J., Morel, J.M., Randall, G.: LSD: a fast line segment detector with a false detection control. IEEE Trans. Pattern Anal. Mach. Intell. 32(4), 722–732 (2010)
Hu, R., Collomosse, J.P.: A performance evaluation of gradient field hog descriptor for sketch based image retrieval. Comput. Vis. Image Underst. 117(7), 790–806 (2013)
Igarashi, T., Hughes, J.F.: A suggestive interface for 3D drawing. In: UIST, pp. 173–181 (2001)
Igarashi, T., Matsuoka, S., Tanaka, H.: Teddy: a sketching interface for 3D freeform design. In: SIGGRAPH, pp. 409–416 (1999)
Lee, Y.J., Zitnick, C.L., Cohen, M.F.: ShadowDraw: real-time user guidance for freehand drawing. ACM Trans. Graph. 30(4), 27 (2011)
Eitz, M., Hays, J., Alexa, M.: How do humans sketch objects? ACM Trans. Graph. 31(4), 44 (2012b)
Thomee, B., Lew, M.S.: A performance evaluation of gradient field hog descriptor for sketch based image retrieval: a survey. Indian J. Med. Res. 1(2), 71–86 (2012)
Yang, C., Changhu, W., Liqing, Z., Lei, Z.: Edgel index for large-scale sketch-based image search. In: CVPR, pp. 761–768 (2011)
Yang, C., Hai, W., Changhu, W., Zhiwei, L., Liqing, Z., Lei, Z.: Mindfinder: interactive sketch-based image search on millions of images. ACM Multimedia, pp. 1605–1608 (2010)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: NIPS 2012, pp. 1106–1114 (2012)
Acknowledgement
This work was supported in part by the Key Natural Science Foundation of Zhejiang Province, China through grant LZ12F02002 and the Science and Technology Program of Zhejiang Province (2016C33139).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Hu, S., Zhang, H., Zhang, S., Fang, Z., Huang, Q. (2016). Sketch-Based Retrieval in Large-Scale Image Database via Position-Aware Silhouette Matching. In: El Rhalibi, A., Tian, F., Pan, Z., Liu, B. (eds) E-Learning and Games. Edutainment 2016. Lecture Notes in Computer Science(), vol 9654. Springer, Cham. https://doi.org/10.1007/978-3-319-40259-8_22
Download citation
DOI: https://doi.org/10.1007/978-3-319-40259-8_22
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-40258-1
Online ISBN: 978-3-319-40259-8
eBook Packages: Computer ScienceComputer Science (R0)