Abstract
In this paper, we propose a new integrated robot vision system designed for multiple human tracking and silhouette extraction using an active stereo camera. The proposed system focuses on robustness to camera movement. Human detection is performed by camera egomotion compensation and disparity segmentation. A fast histogram based tracking algorithm is presented by using the mean shift principle. Color and disparity values are combined by the weighted kernel for the tracking feature. The human silhouette extraction is based on graph cut segmentation. A trimap is estimated in advance and this is effectively incorporated into the graph cut framework.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Bennewitz, M., Burgard, W., Thrun, S.: Using EM to learn motion behaviors of persons with mobile robots. In: Int. Conf. on Intelligent Robots and Systems, pp. 502–507 (2002)
Boykov, Y., Jolly, M.: Interactive graph cuts for optimal boundary and region segmentation of objects in N-D images. In: Int. Conf. on Computer Vision, CD-ROM (2001)
Boykov, Y., Kolmogorov, V.: An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE PAMI 26(9), 1124–1137 (2004)
Collins, R.T., Lipton, A.J., Kanade, T., Fujiyoshi, H., Duggins, D., Tsin, Y., Tolliver, D., Enomoto, N., Hasegawa, O., Burt, P., Wixson, L.: A system for video surveillance and monitoring. CMU-RI-TR-00-12 (2000)
Comaniciu, D., Meer, P.: Mean Shift: a robust approach toward feature space analysis. IEEE Trans. on Pattern Analysis and Machine Intelligence 24(5), 603–619 (2002)
Comaniciu, D., Ramesh, V.: Kernel-Based Object Tracking. IEEE Trans. Pattern Anal. Mach. Intell. 25, 564–577 (2003)
Hampapur, A., Brown, L.M., Connell, J., Lu, M., Merkl, H., Pankanti, S., Senior, A.W., Shu, C.F., Tian, Y.L.: Multi-scale tracking for smart video surveillance. IEEE Tran. on Signal Processing 22(2), 38–51 (2005)
Haritaoglu, I., Harwood, D., Davis, L.S.: W4:Real-time surveillance of people and their activities: IEEE Trans. Pattern Anal. IEEE Trans. Pattern Anal. Mach. Intell. 22(8), 809–830 (2000)
Jung, B., Sukhatme, G.S.: Detecting Moving Objects using a Single Camera on a Mobile Robot in an Outdoor Environment. In: Int. Conf. on Intell. Auto. Sys., pp. 980–987 (2004)
Konolige, K.: Small Vision Systems: Hardware and Implementation. In: Eighth International Symposium on Robotics Research, pp. 111–116 (1997)
Cruz-Neira, C., Sandin, D.J., DeFanti, T.A.: Surround-screen projection-based virtual Reality: The Design and Implementation of the CAVE. In: Computer Graphics ACM SIGGRAPH, pp. 135–142 (1993)
Pavlovic, V., Sharma, R., Huang, T.: Gestural interface to a visual computing environment for molecular biologists. In: Proc. Int’l Conf. Automatic Face and Gesture Recognition (1996)
Shafer, S., Krumm, J., Brumitt, B., Meyers, B., Czewinski, M., Robbins, D.: The new easyLiving project at Microsoft Research. In: Proc. Joint DARPA/NIST Smart Space Workshop (1998)
Kruger, W., Bohn, C.A., Frohlich, B., Schuth, H., Strauss, W., Weche, G.: The responsive workbench: A virtual work environment. IEEE Computer 28(7), 42–48 (1995)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ahn, JH., Kwak, S., Choi, C., Kim, K., Byun, H. (2006). An Integrated Robot Vision System for Multiple Human Tracking and Silhouette Extraction. In: Pan, Z., Cheok, A., Haller, M., Lau, R.W.H., Saito, H., Liang, R. (eds) Advances in Artificial Reality and Tele-Existence. ICAT 2006. Lecture Notes in Computer Science, vol 4282. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11941354_59
Download citation
DOI: https://doi.org/10.1007/11941354_59
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-49776-9
Online ISBN: 978-3-540-49779-0
eBook Packages: Computer ScienceComputer Science (R0)