Abstract
The study of collaborative, distributed, real-time sensor networks is an emerging research area. Such networks are expected to play an essential role in a number of applications such as, surveillance and tracking of vehicles in the battlefield of the future. This paper proposes an approach to detect and classify multiple targets, and collaboratively track their position and velocity utilizing video cameras. Arbitrarily placed cameras collaboratively perform self-calibration and provide complete battlefield coverage. If some of the cameras are equipped with a GPS system, they are able to metrically reconstruct the scene and determine the absolute coordinates of the tracked targets. A background subtraction scheme combined with a Markov random field based approach is used to detect the target even when it becomes stationary. Targets are continuously tracked using a distributed Kalman filter approach. As the targets move the coverage is handed over to the “best” neighboring cluster of sensors. This paper demonstrates the potential for the development of distributed optical sensor networks and addresses problems and tradeoffs associated with this particular implementation.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
G. D. Sullivan, “Visual Interpretation of Known Objects in Constrained Scenes,” Philosophical Transactions B of the Royal Society, vol. 337, pp. 361–370, 1992.
D. Koller, K. Daniilidis, and H.-H. Nagel, “Model-based Object Tracking in Monocular Image Sequences of Road Traffic Scenes,” International Journal of Computer Vision, vol. 10, pp. 257–281, 1993.
J. M. Ferryman, S. J. Maybank, and A. D. Worall, “Visual Surveillance for Moving Vehicles,” International Journal of Computer Vision, vol. 37, no. 2, pp. 187–197, 2000.
D. Koller, J. Weber, and J. Malik, “Robust Multiple Car Tracking with Occlusion Reasoning,” Proceedings of the European Conference on Computer Vision, vol. 1, pp. 189–196, 1994.
D. Koller, J. Weber, T. Huang, J. Malik, G. Ogasawara, B. Rao, and S. Russell, “Towards Robust Automatic Traffic Scene Analysis in Real-Time,” Proceedings of the 12 th International Conference on Pattern Recognition, pp. 126–131, 1994.
D. Beymer, P. McLauchlan, B. Coifmann, J. Malik, “A Real-Time Computer Vision System for Measuring Traffic Parameters,” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 495–501, 1997.
T. Aach and A. Kaup, “Statistical Model-based Change Detection in Moving Video,” Signal Processing, vol. 31, pp. 165–180, 1993.
C. Stauffer and W. E. L. Grimson, “Adaptive Background Mixture Models for Real-Time Tracking,” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 22–29, 1999.
A. Elgammal, R. Duraiswamy, D. Harwood, and L. Davis, “Background and Foreground Modeling Using Nonparametric Kernel Density Estimation for Visual Surveillance,” Proceedings of the IEEE, vol. 90, no. 7, pp. 1151–1163, July 2002.
D. G. Lowe, “Object Recognition from Scale Invariant Features,” Proceedings of the International Conference on Computer Vision, pp. 1150–1157, 1999.
K. Mikolajczyk, and C. Schmid, “Indexing Based on Scale Invariant Interest Points,” Proceedings of the 8 th International Conference on Computer Vision, pp. 525–531, 2001.
C. Harris, and M. Stephens, “A Combined Corner and Edge Detector,” Proceedings of the Alvey Vision Conference, pp. 147–151, 1988.
T. Lindeberg, and J. Gårding, “Shape-Adapted Smoothing in Estimation of 3-D Shape Cues from Affine Distortions of Local 2-D Brightness Structure,” Image and Vision Computing, vol. 15, no. 6, pp. 415–434, 1997.
A. Baumberg, “Reliable Feature Matching Across Widely Separated Views,” Proceedings of the Conference on Computer Vision and Pattern Recognition, pp. 774–781, 2000.
Z. Zhang, “A Flexible New Technique for Camera Calibration,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 11, November 2000.
M. Pollefeys, R. Kock, and L. Van Gool, “Self-Calibration and Metric Reconstruction in spite of Varying and Unknown Intrinsic Camera Parameters,” International Journal of Computer Vision, vol. 32, no. 1, pp. 7–25, Aug 1999.
T. Pappas, “An Adaptive Clustering Algorithm for Image Segmentation,” IEEE Transactions on Signal Processing, vol. 40, no. 4, April 1992.
R. O. Hinds, T. N. Pappas, “An Adaptive Clustering Algorithm for Segmentation of Video Sequences,” Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP), vol. 4, pp. 2427–2430, May 1995.
A. P. Witkin, “Scale-Space Filtering,” Proceedings of the 8 th International Joint Conference on Artificial Intelligence, pp. 1019–1022, 1983.
Q.T. Luong, O. Faugeras, “The Fundamental Matrix: Theory, Algorithms and Stability Analysis,” The International Journal of Computer Vision, vol. 17, pp 43–76, 1996.
M. A. Fischler, R. C. Bolles. “Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography,” Comm. of the ACM, Vol 24, pp 381–395, 1981.
R. Hartley, “In Defence of the 8-Point Algorithm,” ICCV, pp. 1064–1070, 1996.
O. Faugeras, Q. T. Luong, “The Geometry of Multiple Images,” The MIT Press, 2001.
R. Hartly, A. Zissereman, “Multiple View geometry”, Cambridge University Press, 2000.
Z. Zhang, Q.-T. Luong, and O. Faugeras, “Motion of an Uncalibrated Stereo Rig: Self-Calibration and Metric Reconstruction,” IEEE Trans. on Robotics and Automation, vol. 12, no. 1, pp. 103–113, 1996.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Pahalawatta, P.V., Depalov, D., Pappas, T.N., Katsaggelos, A.K. (2003). Detection, Classification, and Collaborative Tracking of Multiple Targets Using Video Sensors. In: Zhao, F., Guibas, L. (eds) Information Processing in Sensor Networks. IPSN 2003. Lecture Notes in Computer Science, vol 2634. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-36978-3_36
Download citation
DOI: https://doi.org/10.1007/3-540-36978-3_36
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-02111-7
Online ISBN: 978-3-540-36978-3
eBook Packages: Springer Book Archive