Skip to main content

GestAction3D: A Platform for Studying Displacements and Deformations of 3D Objects Using Hands

  • Conference paper
Computer-Aided Design of User Interfaces V

Abstract

We present a low-cost hand-based device coupled with a 3D motion recovery engine and 3D visualization. This platform aims at studying ergonomic 3D interactions in order to manipulate and deform 3D models by interacting with hands on 3D meshes. Deformations are done using different modes of interaction that we will detail in the paper. Finger extremities are attached to vertices, edges or facets. Switching from one mode to another or changing the point of view is done using gestures. The determination of the more adequate gestures is part of the work

*: now at CSTB Sophia Antipolis

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bérard, F., The Magic Table: Computer-Vision Based Augmentation of a Whiteboard for Creative Meetings, in Proc. of IEEE Workshop on Projector-Camera Systems PROCAM’2003, in conj. with 9th Int. Conf. on Computer Vision, Nice, 11–17 October 2003, accessible at http://iihm.imag.fr/publs/2003/PROCAM03_MagicTable_Berard.pdf.

  2. Bowman, D.A., Kruijff, E., LaViola, J.J., and Poupyrev, I., 3D User Interfaces: Theory and Practice, Addison-Wesley, Reading, 2004.

    Google Scholar 

  3. Cao, X., and Balakrishnan, R., VisionWand: Interaction Techniques for Large Displays Using a Passive Wand Tracked in 3D, in Proc. of 16th ACM Symposium on User Interface Software and Technology UIST’2003 (Vancouver, 2–5 November 2003), ACM Press, New York, 2003, pp. 173–182.

    Google Scholar 

  4. Corso, J.J., Ye, G., and Hager, G.D., Analysis of Multi-Modal Gestures with a Coherent Probabilistic Graphical Model, Virtual Reality, Vol. 8, No. 4, Dec. 2005, pp. 242–252.

    Article  Google Scholar 

  5. Derpanis, K.G., A Review of Vision-Based Hand Gestures, Internal report, Centre for Vision Research, York University, Canada, 2004.

    Google Scholar 

  6. Derpanis, K.G., Wildes, R.P., and Tsotsos, J.K., Hand Gesture Recognition within a Linguistics-Based Framework, in T. Pajdla, J. Matas (eds.), Proc. European Conference on Computer Vision (Prague, May 2004), Lecture Notes in Computer Science, Vol. 3021, Springer-Verlag, Berlin, 2004, pp. 282–296.

    Google Scholar 

  7. Fabri, A., Giezeman, G.-J., Kettner, L., Schirra, S., and Schöonherr, S., On the Design of CGAL a Computational Geometry Algorithms Library, Software Practice and Experience, Vol. 11, No. 30, 2000, pp. 1167–1202.

    Article  Google Scholar 

  8. Faugeras, O., Three-Dimensional Computer Vision: a Geometric Viewpoint, The MIT Press, Cambridge, 1993.

    Google Scholar 

  9. Jaimes, A., and Sebe, N., Multimodal Human Computer Interaction: A Survey, in Proc. of IEEE Int. Workshop on Human Computer Interaction, in conjunction with 9th Int. Conf. on Computer Vision, Nice, 11–17 October 2003.

    Google Scholar 

  10. Moeslund, T.B., and Nørgaard, L., A Brief Overview of Hand Gestures used in Wearable Human Computer Interfaces, Technical Report CVMT 03-02, Laboratory of Computer Vision and Media Technology, Aalborg (Denmark), 2003.

    Google Scholar 

  11. Moeslund, T.B., Störring, M., and Granum, E., A Natural Interface to a Virtual Environment through Computer Vision-estimated Pointing Gestures, in Proc. of Int. Workshop on Gesture and Sign Language based Human-Computer Interaction GW’2001 (London, 18–20 April 2001), Lecture Notes in Computer Science, Vol. 2298, Springer-Verlag, Berin, 2001, pp. 59–63.

    Google Scholar 

  12. Montagnat, J., and Delingette, H., A Review of Deformable Surfaces: Topology, Geometry, and Deformation, Image and Vision Computer, Vol. 19, No. 14, Dec. 2001, pp. 1023–1040.

    Article  Google Scholar 

  13. Segen, J., and Kumar, S., Gesture VR: Vision-Based 3D Hand Interface for Spatial Interaction, in Proc. of ACM Int. Conf. on Multimedia Multimedia’98 (Bristol, 13–16 September 1998), ACM Press, New York, 1998, pp. 455–464.

    Google Scholar 

  14. Smith, G., Salzman, T., and Stürzlinger, W., 3D Scene Manipulation with 2D Devices and Constraints, in Proc. of Graphics Interface’2001 (Ottawa, 7–9 June 2001), Canadian Information Processing Society, Toronto, 2001, pp. 135–142.

    Google Scholar 

  15. Starner, T., Leibe, B., Minnen, D., Westyn, T., Hurst, A., and Weeks, J., The Perceptive Workbench: Computer-Vision-Based Gesture Tracking, Object Tracking, and 3D Reconstruction for Augmented Desks, Machine Vision and Applications, Vol. 14, No. 1, April 2003, pp. 59–71.

    Article  Google Scholar 

  16. Taylor, R.M., Hudson, T., Seeger, A., Weber, H., Juliano, J., and Helser, A., VRPN: A Device-Independent, Network-Transparent VR Peripheral System, in Proc. of ACM Symposium on Virtual Reality Software & Technology VRST’2001 (Banff, 15–17 November 2001), ACM Press, New York, 2001, pp. 55–61.

    Google Scholar 

  17. Ye, G., Corso, J.J., and Hager, G.D., Gesture Recognition Using 3D Appearance and Motion Features, in Proc. of IEEE Workshop on Real-Time Vision for Human-Computer Interaction (Washington, June 2004), in conj. with Conf. on Computer Vision and Pattern Recognition Workshop CVPRW’04, Vol. 10, 2004, p. 160.

    Google Scholar 

  18. Zhang, Z., Deriche, R., Faugeras, O., and Luong, Q.-T., A Robust Technique for Matching Two Uncalibrated Images through the Recovery of the Unknown Epipolar Geometry, Artificial Intelligence Journal, Vol. 78, Nos. 1–2, 1994, pp. 87–119. Appeared also as INRIA Research Report No. 2273, May 1994.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Diane Lingrand .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer

About this paper

Cite this paper

Lingrand, D. et al. (2007). GestAction3D: A Platform for Studying Displacements and Deformations of 3D Objects Using Hands. In: Calvary, G., Pribeanu, C., Santucci, G., Vanderdonckt, J. (eds) Computer-Aided Design of User Interfaces V. Springer, Dordrecht. https://doi.org/10.1007/978-1-4020-5820-2_8

Download citation

  • DOI: https://doi.org/10.1007/978-1-4020-5820-2_8

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-1-4020-5819-6

  • Online ISBN: 978-1-4020-5820-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics