We present a data-driven dynamic coupling between discrete and continuous methods for tracking objects of high dofs, which overcomes the limitations of previous techniques. In our approach, two trackers work in parallel, and the coupling between them is based on the tracking error. We use a model-based continuous method to achieve accurate results and, in cases of failure, we reinitialize the model using our discrete tracker. This method maintains the accuracy of a more tightly coupled system, while increasing its efficiency. At any given frame, our discrete tracker uses the current and several previous frames to search into a database for the best matching solution. For improved robustness, object configuration sequences, rather than single configurations, are stored in the database. We apply our framework to the problem of 3D hand tracking from image sequences and the discrimination between fingerspelling and continuous signs in American Sign Language.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Abbasi S., Mokhtarian F. and Kittler J., Curvature Scale Space Image in Shape Similarity Retrieval, Multimedia Systems, 7(6):467-476, 1999.
Athitsos V., Wang J., Sclaroff S., and Betke M., Detecting Instances of Shape Classes That Exhibit Variable Structure, Boston University Computer Science Tech. Report, No. 2005-021, June 13, 2005.
Athitsos V. and Sclaroff S., Database Indexing Methods for 3D Hand Pose Estimation, Gesture Workshop, Genova, Italy, April 2003.
Athitsos V. and Sclaroff S., Estimating 3D Hand Pose from a Cluttered Image, IEEE Conference on Computer Vision and Pattern Recognition, Wisconsin, June 2003.
Grobel K. and Hienz H., Video-based recognition of fingerspelling in real time, Workshops Bildverarbeitung fuer die Medizin, Aachen, 1996.
Jerde T. E., Soechting J. F., and Flanders M., Coarticulation in Fluent Finger-spelling, The Journal of Neuroscience, 23(6):2383, March 2003. 7. Kuhn H.W. and Tucker A.W., Nonlinear Programming, 2nd Berkeley Sympo-sium on Mathematical Statistics and Probabilistics, pp. 481-492, University of California Press, 1951.
Lee J. and Kunii T., Model-based Analysis of Hand Posture, IEEE Computer Graphics and Applications, 15, pp. 77-86, 1995.
Lin J., Wu Y., and Huang T.S., modelling the Constraints of Human Hand Motion, 5th Annual Federated Laboratory Symposium (ARL2001), Maryland, 2001.
Lu S., Metaxas D., Samaras D., and Oliensis J., Using Multiple Cues for Hand Tracking and Model Refinement, IEEE Conference on Computer Vision and Pattern Recognition, Wisconsin, June 2003.
Mokhtarian F. and Mackworth A., A Theory of Multiscale, Curvature-based Shape Representation for Planar Curves, Pattern Analysis and Machine Intel-ligence, 14(8), pp. 789-805, 1992.
Rehg J. and Kanade T., Model-based Tracking of Self-occluding Articulated Objects, IEEE International Conference on Computer Vision, Cambridge, MA, June 1995.
Rosales R., Athitsos V., Sigal L., and Sclaroff S., 3D Hand Pose Reconstruc-tion Using Specialized Mappings, IEEE International Conference on Computer Vision, Vancouver, Canada, July 2001.
Shimada N., Kimura K., and Shirai Y., Real-time 3D Hand Posture Estima-tion based on 2D Appearance Retrieval Using Monocular Camera, IEEE ICCV Workshop on Recognition, Analysis and Tracking of Faces and Gestures in Real-time Systems, Vancouver, Canada, July 2001.
de Silva V. and Tenenbaum J.B., Global versus Local Methods in Nonlinear Dimensionality Reduction, Advances in Neural Information Processing Systems 15, (eds.) M.S. Baker, S. Thrun, and K. Obermayer, Cambridge, MIT Press, pp. 705-712, 2002.
Stenger B., Mendonca P.R.S., and Cipolla R., Model-based 3D Tracking of an Articulated Hand, IEEE Conference on Computer Vision and Pattern Recogni-tion, Kauai, December 2001.
Stenger B., Thayananthan A., Torr P.H.S., and Cipolla R., Hand Pose Estima-tion Using Hierarchical Detection, International Workshop on Human-Computer Interaction, Prague, Czech Republic, May 2004.
Tenenbaum J.B., de Silva V., and Langford J.C., A Global Geometric Framework for Nonlinear Dimensionality Reduction, Science Magazine, 290, pp. 2319-2323, 2000.
Thayananthan A., Stenger B., Torr P. H. S., and Cipolla R., Shape Context and Chamfer Matching in Cluttered Scenes, IEEE Conference on Computer Vision and Pattern Recognition, Madison, June 2003.
Tomasi C., Petrov S., and Sastry A., “3D Tracking = Classification + Inter-polation,” IEEE International Conference on Computer Vision, Nice, France, October 2003.
Triesch J. and von der Malsburg C., A System for Person-Independent Hand Posture Recognition against Complex Backgrounds, Pattern Analysis and Ma-chine Intelligence, 23(12), December, 1999.
Vapnik V., Statistical Learning Theory, Wiley, New York, 1998.
Viola P. and Jones M., Rapid Object Detection using a Boosted Cascade of Sim-ple Features, IEEE Conference on Computer Vision and Pattern Recognition, Hawaii, December, 2001.
Vogler C. and Metaxas D., A Framework for Recognizing the Simultaneous Aspects of American Sign Language, Computer Vision and Image Understand-ing, 81, pp. 358-384, 2001.
Vogler C., Sun H., and Metaxas D., A Framework for Motion Recognition with Applications to American Sign Language and Gait Recognition, Workshop on Human Motion, Austin, TX, December 2000.
Wilcox S., The Phonetics of Fingerspelling, Studies in Speech Pathology and Clinical Linguistics, 4, Amsterdam and Philadelphia, John Benjamins, 1992.
Zhou H. and Huang T.S., Tracking Articulated Hand Motion with Eigen Dynamics Analysis, IEEE International Conference on Computer Vision, Nice, France, October 2003.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer
About this chapter
Cite this chapter
Tsechpenakis, G., Metaxas, D., Neidle, C. (2008). Combining Discrete and Continuous 3D Trackers. In: Rosenhahn, B., Klette, R., Metaxas, D. (eds) Human Motion. Computational Imaging and Vision, vol 36. Springer, Dordrecht. https://doi.org/10.1007/978-1-4020-6693-1_6
Download citation
DOI: https://doi.org/10.1007/978-1-4020-6693-1_6
Publisher Name: Springer, Dordrecht
Print ISBN: 978-1-4020-6692-4
Online ISBN: 978-1-4020-6693-1
eBook Packages: Computer ScienceComputer Science (R0)