Skip to main content
SpringerLink
Log in

3D content-based search using sketches

  • Original Article
  • Published:
Personal and Ubiquitous Computing Aims and scope Submit manuscript

Abstract

This paper presents a novel interactive framework for 3D content-based search and retrieval using as query model an object that is dynamically sketched by the user. In particular, two approaches are presented for generating the query model. The first approach uses 2D sketching and symbolic representation of the resulting gestures. The second utilizes non-linear least squares minimization to model the 3D point cloud that is generated by the 3D tracking of the user’s hands, using superquadrics. In the context of the proposed framework, three interfaces were integrated to the sketch-based 3D search system including (a) an unobtrusive interface that utilizes pointing gesture recognition to allow the user manipulate objects in 3D, (b) a haptic–VR interface composed by 3D data gloves and a force feedback device, and (c) a simple air–mouse. These interfaces were tested and comparative results were extracted according to usability and efficiency criteria.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Berchtold S, Kriegel HP (1997) S3: similarity search in CAD database systems. In: Peckham J (ed) Proceedings of the SIGMOD. ACM, New York, pp 564–567

  2. Paquet E, Rioux M (2000) Nefertiti: a tool for 3-D shape databases management. SAE Trans: J Aerosp 108:387–393

    Google Scholar 

  3. Loffler J (2000) Content-based retrieval of 3D models in distributed web databases by visual shape information. In: Proceedings of the international conference on information visualisation (IV2000), London, pp 82–87

  4. Johnson AE, Hebert M (1999) Using spin-images for efficient multiple model recognition in cluttered 3-D scenes. IEEE Trans Pattern Anal Mach Intell 21(5):433–449

    Article  Google Scholar 

  5. Blais G, Levine M (1993) Registering multiview range data to create 3D computer objects. IEEE Trans Pattern Anal Mach Intell 17(8):820–824

    Article  Google Scholar 

  6. Chua CS, Jarvis R (1996) 3D Free-form surface registration and object recognition. Int J Comput Vis 17(1):77–99

    Article  Google Scholar 

  7. Daras P, Zarpalas D, Tzovaras D, Strintzis MG (2004) 3D model search and retrieval based on the spherical trace transform. In: Proceedings of the IEEE intl workshop on multimedia signal processing, Sienna, Italy

  8. Vranic DV, Saupe D (2002) Description of 3D-shape using a complex function on the sphere. In: Proceedings of the IEEE international conference on multimedia and expo, Lausanne, pp 177–180

  9. Schwartz R, Chow YL (1990) The N-best algorithm: an efficient and exact procedure for finding the N most likely sentence hypothesis. In: Proceedings of the ICASSP 1990, Albuquerque, pp 81–84

  10. Moustakas K, Tzovaras D, Carbini S, Bernier O, Viallet JE, Raidt S, Mancas M, Dimiccoli M, Yagci E, Balci S, Leon EI (2005) MASTER-PIECE: a multimodal (Ges-ture+Speech) interface for 3D model search and retrieval integrated in a virtual assembly application. In: Proceedings of the eNTERFACE 2005, Mons, pp 62–75

  11. Marquardt DW (1963) An algorithm for the least-squares estimation of nonlinear parameters. SIAM J Appl Math 11(2):431–441

    Article  MATH  MathSciNet  Google Scholar 

  12. Oliveira M, Colaço V, Jorge J, Fonseca M (2001) Modeling solids and surfaces with sketches: an empirical evaluation. In: Proceedings of the winter school of computer graphics, (WSCG 2001), Plzen, pp 28–31

  13. Chevalier L, Jaillet F, Baskurt A (2003) Segmentation and superquadric modeling of 3d objects. J WSCG 11(3):232–240

    Google Scholar 

  14. Solina F, Bajcsy R (1990) Recovery of parametric models from range images: the case for superquadrics with global deformations. IEEE Trans Pattern Anal Mach Intell 12(2):131–147

    Article  Google Scholar 

  15. Carbini S, Viallet JE, Delphin-Poulat L (2005) Context dependent interpretation of multimodal speech-pointing gesture interface. In: Proceedings of the international conference on multimodal interfaces, Trento, Italy

  16. Immersion Technologies Inc. (2000) Virtual hand suite: user and programmer guides. http://www.immersion.com/3d/products/virtualhand_sdk.php

  17. Gyration Inc., http://www.gyration.com/go24airmouse.htm

Download references

Acknowledgments

This work has been conducted in conjunction with the “SIMILAR” European Network of Excellence on Multimodal Interfaces of the IST Program of the European Union (http://www.similar.cc) and the “INTUITION” European Network of Excellence on Virtual Reality and Virtual Environment Applications for Future Workspaces.

Author information

Authors and Affiliations

  1. Informatics and Telematics Instiutte, 1st Km Thermi-Panorama Road, 57001, Thermi-Thessaloniki, Greece

    Konstantinos Moustakas, Georgios Nikolakis & Dimitrios Tzovaras

  2. Electrical and Computer Engineering Department, Aristotle University of Thessaloniki, 54006, Thessaloniki, Greece

    Konstantinos Moustakas

  3. France Telecom R&D, Lannion, 22307, France

    Sebastien Carbini, Olivier Bernier & Jean Emmanuel Viallet

Authors
  1. Konstantinos Moustakas
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Georgios Nikolakis
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dimitrios Tzovaras
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Sebastien Carbini
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Olivier Bernier
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jean Emmanuel Viallet
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Konstantinos Moustakas.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Moustakas, K., Nikolakis, G., Tzovaras, D. et al. 3D content-based search using sketches. Pers Ubiquit Comput 13, 59–67 (2009). https://doi.org/10.1007/s00779-007-0166-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00779-007-0166-z

Keywords

Search

Navigation