Abstract.
Model-based hand posture analysis systems fall into two categories: hand without markers and hand with markers methods. The hand model fitting method proposed in this paper belongs to the second category. However, the main problems that make conventional marker-based hand posture analysis systems inapplicable are their inefficient calculation of the inverse kinematics, their inability to scale the size of the hand model, and their inability to analyze hand posture when some markers are occluded. In this paper, a scalable hand posture analysis system is proposed to overcome these problems. The proposed system consists of three new techniques: (1) the generation of scalable inverse kinematics solutions for the finger-positioning process, (2) a scale calibration process for the 3D hand model, and (3) a 3D marker position prediction method for occluded markers. The experimental results illustrate that the scalable hand posture analysis system outperforms conventional marker-based hand posture analysis systems.
Similar content being viewed by others
References
Shimada N, Shirai Y, Kuno Y, Miura J (1998) Hand gesture estimation and model refinement using monocular camera - ambiguity limitation by inequality constraints. In: Proc. 3rd international conference on automatic face and gesture recognition, pp 268-273
Shimada N, Shirai Y, Kuno Y (2000) Model adaptation and posture estimation of moving articulated objects using monocular camera. In: Proc. international workshop on articulated motion and deformable objects, pp 159-172
Wang F, Ngo CW, Pong TC (2004) Gesture tracking and recognition for lecture video editing. In: Proc. 17th ICPR, 3:934-937
Sturman DJ, Zeltzer D (1994) A survey of glove-based input. IEEE Comput Graph Appl 14(1):30-39
Chen FS, Fu CM, Huang CL(2003) Hand gesture recognition using a real-time tracking method and hidden Markov models. Image Vis Comput 21:745-758
Darrell TJ, Pentland AP (1993) Recognition of space-time gestures using a distributed representation. MIT media laboratory vision and modeling group technical report, No. 197
Cui Y, Weng JJ (1996) Hand sign recognition from intensity image sequences with complex backgrounds. In: IEEE Proc. 2nd international conference on automatic face and gesture recognition, Killington, VT, October 1996, pp 259-264
Rehg JM, Kanade T (1994) Digiteyes: vision-based hand tracking for human-computer interaction. In: IEEE workshop on motion of non-rigid and articulated objects, Austin, TX, November 1994, pp 16-22
Rehg JM, Kanade T (1994) Visual tracking of high DOF articulated structures: an application to human tracking. In: Eklundh J-O (ed) Proc. 3rd European conference on computer vision, Sweden, May 1994. Lecture notes in computer science, vol 801. Springer, Berlin Heidelberg New York, 2:35-46
Kuch JJ, Huang TS (1995) Vision based hand modeling and tracking for virtual teleconference and telecollaboration. In: Proc. ICCV, Cambridge, MA, June 1995, pp 666-671
Heap T, Hogg D (1996) Towards 3D tracking using deformable model. In: Proc. 2nd IEEE international conference on automatic face and gesture recognition, Killington, VT, October 1996, pp 140-145
Lee J, Kunii TL (1995) Model-based analysis of hand posture. IEEE computer Graph Appl 15(5):77-86
Lee J, Kunii TL (1993) Constraint-based hand animation. In: Magnenat Thalmann N, Thalmann D (eds) Models and techniques in computer animation world (Proc. Computer Animation 93). Springer, Berlin Heidelberg New York, pp 110-127
Dorner B (1993) Hand shape identification and tracking for sign language interpretation. In: Looking at People Workshop, Chambery, France
Rijpkema H, Girard M (1991) Computer animation of knowledge-based human grasping. In: Computer Graphics (Proc. SIGGRAPH) 25(4):339-347
Koivo AJ (1989) Fundamentals for control of robotics manipulators. Wiley, Chichester, UK
Lancaster P, Salkauskas K (1986) Curve and surface fitting. Academic, London
Badler NI, Manoochehri KH, Walters G (1987) Articulated finger positioning by multiple constraints. IEEE Comput Graph Application 7(6):28-38
Thomopoulos SCA, TAM RYJ (1991) An interactive solution to the inverse kinematics of robotics manipulators. Mech Mach Theory 26(4):359-373
Michalewicz Z (1992) Genetic algorithms + data structures = evolution programs. Springer, Berlin Heidelberg New York
Lien CC, Huang CL (1999) The model-based dynamic hand posture identification using genetic algorithm. J Mach Vis Appl 11:107-121
Shih SW, Hung YP, Lin WS (1996) Calibration of an active binocular head. In: Chou IC (eds) Proc. IPPR conference on computer vision, graphics, and image processing, Tai-Chung, Taiwan, pp 411-418
Huang CL, Wu CH (1992) Dynamic scene analysis using path and shape coherence constraint. Pattern Recog 25(5):445-461
Author information
Authors and Affiliations
Corresponding author
Additional information
Received: 26 January 2003, Accepted: 19 July 2004, Published online: 10 February 2005
Rights and permissions
About this article
Cite this article
Lien, CC. A scalable model-based hand posture analysis system. Machine Vision and Applications 16, 157–169 (2005). https://doi.org/10.1007/s00138-004-0167-0
Issue Date:
DOI: https://doi.org/10.1007/s00138-004-0167-0