Matheen Siddiqui
ABSTRACT
We describe an efficient and robust system to detect and track the limbs of a human. Of special consideration in the design of this system are real-time and robustness issues. We thus utilize a detection/tracking scheme in which we detect the face and limbs of a user and then track the forearms of the found limbs. Detection occurs by first finding the face of a user. The location and color information from the face can then be used to find limbs. As skin color is a key visual feature in this system, we continuously search for faces and use them to update skin color information. Along with edge information, this is used in the subsequent forearm tracking. Robustness is implicit in this design, as the system automatically re-detects a limbs when its corresponding forearms is lost. This design is also conducive to real-time processing because while detection of the limbs can take up to seconds, tracking is on the order of milliseconds. Thus reasonable frame rates can be achieved with a short latency. Also, in this system we make use of multiple 2D limb tracking models to enhance tracking of the underlying 3D structure. This includes models for lateral forearm views (waving) as well as for pointing gestures. Experiments on test sequences demonstrate the efficacy of this approach.
- G. R. Bradski. The OpenCV Library. Dr. Dobb's Software Tools for the Professional Programmer, November 2000.Google Scholar
- C. Breazeal. Socially intelligent robots. ACM Interactions, 12(2):19--22, 2005. Google ScholarDigital Library
- C. Bregler and J. Malik. Tracking people with twists and exponential maps. In CVPR, Washington, DC, USA, June 1998. Google ScholarDigital Library
- I. Cohen and H. Li. Inference of human postures by classification of 3d human body shape. In IEEE Workshop on Analysis and Modeling of Faces and Gestures, pages 74--81, Nice, France, 2003. Google ScholarDigital Library
- D. Comaniciu, V. Ramesh, and P. Meer. Kernel-based object tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(5):564--577, May 2003. Google ScholarDigital Library
- D. J. Feil-Seifer and M. J. Matarić. Socially assistive robotics. In Proceedings of the International Conference on Rehabilitation Robotics, Chicago, Il, July 2005.Google ScholarCross Ref
- P. F. Felzenszwalb and D. P. Huttenlocher. Pictorial structures for object recognition. International Journal of Computer Vision, 61(1):55--79, 2005. Google ScholarDigital Library
- T. Fong, I. Nourbakhsh, and K. Dautenhahn. A survey of socially interactive robots. Robotics and Autonomous Systems, Special issue on Socially Interactive Robots, 42(3-4):143--166, 2003.Google Scholar
- A.R. François. Software architecture for computer vision. In G. Medioni and S. Kang, editors, Emerging Topics in Computer Vision, pages 585--654. Prentice Hall, 2004. Google ScholarDigital Library
- S. Ioffe and D. A. Forsyth. Probabilistic methods for finding people. International Journal of Computer Vision, 43(1):45--68, June 2001. Google ScholarDigital Library
- M. W. Lee and I. Cohen. Human upper body pose estimation in static images. In ECCV, pages II: 126--138, 2004.Google ScholarCross Ref
- D. P. Miller. Assistive robotics: An overview. In Assistive Technology and Artificial Intelligence, Applications in Robotics, User Interfaces and Natural Language Processing, pages 126--136, London, UK, 1998. Springer-Verlag. Google ScholarDigital Library
- D. D. Morris and J. M. Rehg. Singularity analysis for articulated object tracking. In CVPR, Santa Barbara, CA, June 1998. Google ScholarDigital Library
- W. H. Press, S. A. Teukolsky, W. T. Vetterling, and B. P. Flannery. Numerical Recipes in C: The Art of Scientific Computing. Cambridge University Press, New York, NY, USA, 1992. Google ScholarDigital Library
- D. Ramanan and D. A. Forsyth. Finding and tracking people from the bottom up. In CVPR, pages II: 467--474, 2003.Google ScholarCross Ref
- L. Sigal, S. Bhatia, S. Roth, M. J. Black, and M. Isard. Tracking loose-limbed people. In CVPR, pages I: 421--428, 2004.Google Scholar
- C. Sminchisescu and B. Triggs. Covariance scaled sampling for monocular 3d body tracking. In CVPR, Kauai Marriott, Hawaii, December 2001.Google Scholar
- H. Zhang, W. Huang, Z. Huang, and L. Li. Affine object tracking with kernel-based spatial-color representation. In CVPR, pages I: 293--300, 2005. Google ScholarDigital Library
Index Terms
- Robust real-time upper body limb detection and tracking
Recommendations
Real-time visuomotor update of an active binocular head
In order for a binocular head to perform optimal 3D tracking, it should be able to verge its cameras actively, while maintaining geometric calibration. In this work we introduce a calibration update procedure, which allows a robotic head to ...
Real-Time Bayesian 3-D Pose Tracking
In this paper, we propose a novel approach for real-time 3-D tracking of object pose from a single camera. We formulate the 3-D pose tracking task in a Bayesian framework which fuses feature correspondence information from both previous frame and some ...
EMG onset detection and upper limb movements identification algorithm
Electromyography (EMG) consists of the measurement and recording of the electrical potential generated by the activation of muscle fibers when performing voluntary or involuntary movements. Therefore, electromyography signals (EMGs) are directly linked ...
Comments