Abstract
This paper presents a novel multi-view camera system that produces real-time single view scene video which sees through the static objects to observe the dynamic objects. The system employs a training phase to recover the correspondences and occlusions between the views to determine the image positions where seeing through would be necessary. During the runtime phase, each dynamic object is detected and automatically registered between the views. The registered objects are learned using an appearance based method and they are later used to superimpose the occluded dynamic objects on the desired view. The occlusion detection is done using a very efficient and effective method. The system is very practical and can be used in real life applications including video surveillance, communication, activity analysis, and entertainment. We validated the system by running various tests in office and outdoor environments.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bitner, J.R., Erlich, G., Reingold, E.M.: Efficient Generation of the Binary Reflected Gray Code and its Applications. Communications of the ACM 19, 9 (1976)
Davies, C., Nixon, M.: Sensing Surface Discontinuities via Colored Spot. In: Proc. IEEE International Workshop on Image and Signal Processing, IEEE Computer Society Press, Los Alamitos (1996)
Haritaoglu, I., Harwood, D., Davis, L.S.: W4: Real-time surveillance of people and their activities. IEEE Trans. Pattern Anal. Mach. Intell. 22(8), 809–830 (2000)
Isaksen, A., McMillan, L., Gortler, S.J.: Dynamically reparameterized light fields. In: SIGGRAPH, pp. 297–306 (2000)
MacCormick, J., Blake, A.: A probabilistic exclusion principle for tracking multiple objects. International Journal of Computer Vision 39(1), 57–71 (2000)
Rioux, M.: Digital 3-d imaging: Theory and applications. In: Symposium on Photonic and Sensors and Controls for Commercial Applications, Boston, pp. 2–15 (1994)
Scharstein, D., Szeliski, R.: High-accuracy stereo depth maps using structured light. IEEE Computer Vision and Pattern Recognition (1), 195–202 (2003)
Vaish, V., Levoy, M., Szeliski, R., Zitnick, C.L., Kang, S.B.: Reconstructing occluded surfaces using synthetic apertures: Stereo, focus and robust measures. IEEE Computer Vision and Pattern Recognition (2), 2331–2338 (2006)
Wu, Y., Yu, T., Hua, G.: Tracking appearances with occlusions. IEEE Computer Vision and Pattern Recognition (1), 789–795 (2003)
Zitnick, C.L., Kanade, T.: A cooperative algorithm for stereo matching and occlusion detection. IEEE Trans. Pattern Anal. Mach. Intell. 22(7), 675–684 (2000)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yildiz, A., Akgul, Y.S. (2007). A Multi-view Camera System for the Generation of Real-Time Occlusion-Free Scene Video. In: Hamprecht, F.A., Schnörr, C., Jähne, B. (eds) Pattern Recognition. DAGM 2007. Lecture Notes in Computer Science, vol 4713. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74936-3_7
Download citation
DOI: https://doi.org/10.1007/978-3-540-74936-3_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74933-2
Online ISBN: 978-3-540-74936-3
eBook Packages: Computer ScienceComputer Science (R0)