Abstract
We present a low-cost hand-based device coupled with a 3D motion recovery engine and 3D visualization. This platform aims at studying ergonomic 3D interactions in order to manipulate and deform 3D models by interacting with hands on 3D meshes. Deformations are done using different modes of interaction that we will detail in the paper. Finger extremities are attached to vertices, edges or facets. Switching from one mode to another or changing the point of view is done using gestures. The determination of the more adequate gestures is part of the work
*: now at CSTB Sophia Antipolis
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bérard, F., The Magic Table: Computer-Vision Based Augmentation of a Whiteboard for Creative Meetings, in Proc. of IEEE Workshop on Projector-Camera Systems PROCAM’2003, in conj. with 9th Int. Conf. on Computer Vision, Nice, 11–17 October 2003, accessible at http://iihm.imag.fr/publs/2003/PROCAM03_MagicTable_Berard.pdf.
Bowman, D.A., Kruijff, E., LaViola, J.J., and Poupyrev, I., 3D User Interfaces: Theory and Practice, Addison-Wesley, Reading, 2004.
Cao, X., and Balakrishnan, R., VisionWand: Interaction Techniques for Large Displays Using a Passive Wand Tracked in 3D, in Proc. of 16th ACM Symposium on User Interface Software and Technology UIST’2003 (Vancouver, 2–5 November 2003), ACM Press, New York, 2003, pp. 173–182.
Corso, J.J., Ye, G., and Hager, G.D., Analysis of Multi-Modal Gestures with a Coherent Probabilistic Graphical Model, Virtual Reality, Vol. 8, No. 4, Dec. 2005, pp. 242–252.
Derpanis, K.G., A Review of Vision-Based Hand Gestures, Internal report, Centre for Vision Research, York University, Canada, 2004.
Derpanis, K.G., Wildes, R.P., and Tsotsos, J.K., Hand Gesture Recognition within a Linguistics-Based Framework, in T. Pajdla, J. Matas (eds.), Proc. European Conference on Computer Vision (Prague, May 2004), Lecture Notes in Computer Science, Vol. 3021, Springer-Verlag, Berlin, 2004, pp. 282–296.
Fabri, A., Giezeman, G.-J., Kettner, L., Schirra, S., and Schöonherr, S., On the Design of CGAL a Computational Geometry Algorithms Library, Software Practice and Experience, Vol. 11, No. 30, 2000, pp. 1167–1202.
Faugeras, O., Three-Dimensional Computer Vision: a Geometric Viewpoint, The MIT Press, Cambridge, 1993.
Jaimes, A., and Sebe, N., Multimodal Human Computer Interaction: A Survey, in Proc. of IEEE Int. Workshop on Human Computer Interaction, in conjunction with 9th Int. Conf. on Computer Vision, Nice, 11–17 October 2003.
Moeslund, T.B., and Nørgaard, L., A Brief Overview of Hand Gestures used in Wearable Human Computer Interfaces, Technical Report CVMT 03-02, Laboratory of Computer Vision and Media Technology, Aalborg (Denmark), 2003.
Moeslund, T.B., Störring, M., and Granum, E., A Natural Interface to a Virtual Environment through Computer Vision-estimated Pointing Gestures, in Proc. of Int. Workshop on Gesture and Sign Language based Human-Computer Interaction GW’2001 (London, 18–20 April 2001), Lecture Notes in Computer Science, Vol. 2298, Springer-Verlag, Berin, 2001, pp. 59–63.
Montagnat, J., and Delingette, H., A Review of Deformable Surfaces: Topology, Geometry, and Deformation, Image and Vision Computer, Vol. 19, No. 14, Dec. 2001, pp. 1023–1040.
Segen, J., and Kumar, S., Gesture VR: Vision-Based 3D Hand Interface for Spatial Interaction, in Proc. of ACM Int. Conf. on Multimedia Multimedia’98 (Bristol, 13–16 September 1998), ACM Press, New York, 1998, pp. 455–464.
Smith, G., Salzman, T., and Stürzlinger, W., 3D Scene Manipulation with 2D Devices and Constraints, in Proc. of Graphics Interface’2001 (Ottawa, 7–9 June 2001), Canadian Information Processing Society, Toronto, 2001, pp. 135–142.
Starner, T., Leibe, B., Minnen, D., Westyn, T., Hurst, A., and Weeks, J., The Perceptive Workbench: Computer-Vision-Based Gesture Tracking, Object Tracking, and 3D Reconstruction for Augmented Desks, Machine Vision and Applications, Vol. 14, No. 1, April 2003, pp. 59–71.
Taylor, R.M., Hudson, T., Seeger, A., Weber, H., Juliano, J., and Helser, A., VRPN: A Device-Independent, Network-Transparent VR Peripheral System, in Proc. of ACM Symposium on Virtual Reality Software & Technology VRST’2001 (Banff, 15–17 November 2001), ACM Press, New York, 2001, pp. 55–61.
Ye, G., Corso, J.J., and Hager, G.D., Gesture Recognition Using 3D Appearance and Motion Features, in Proc. of IEEE Workshop on Real-Time Vision for Human-Computer Interaction (Washington, June 2004), in conj. with Conf. on Computer Vision and Pattern Recognition Workshop CVPRW’04, Vol. 10, 2004, p. 160.
Zhang, Z., Deriche, R., Faugeras, O., and Luong, Q.-T., A Robust Technique for Matching Two Uncalibrated Images through the Recovery of the Unknown Epipolar Geometry, Artificial Intelligence Journal, Vol. 78, Nos. 1–2, 1994, pp. 87–119. Appeared also as INRIA Research Report No. 2273, May 1994.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2007 Springer
About this paper
Cite this paper
Lingrand, D. et al. (2007). GestAction3D: A Platform for Studying Displacements and Deformations of 3D Objects Using Hands. In: Calvary, G., Pribeanu, C., Santucci, G., Vanderdonckt, J. (eds) Computer-Aided Design of User Interfaces V. Springer, Dordrecht. https://doi.org/10.1007/978-1-4020-5820-2_8
Download citation
DOI: https://doi.org/10.1007/978-1-4020-5820-2_8
Publisher Name: Springer, Dordrecht
Print ISBN: 978-1-4020-5819-6
Online ISBN: 978-1-4020-5820-2
eBook Packages: Computer ScienceComputer Science (R0)