Abstract
In this work, we present a combined approach to tracking and reconstruction. An implicit feedback of 3d information to the tracking process is achieved by optimizing a single error function, instead of two separate steps. No assumptions about the error distribution of the tracker are needed in the reconstruction step either. This results in higher reconstruction accuracy and improved tracking robustness in our experimental evaluations. The approach is suited for online reconstruction and has a close to real-time performance on current computing hardware.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Kähler, O., Denzler, J.: Rigid motion constraints for tracking planar objects. In: Hamprecht, F.A., Schnörr, C., Jähne, B. (eds.) DAGM 2007. LNCS, vol. 4713, pp. 102–111. Springer, Heidelberg (2007)
Ladikos, A., Benhimane, S., Navab, N.: A real-time tracking system combining template-based and feature-based approaches. In: Proceedings VISAPP 2007, March 2007, vol. 2, pp. 325–332 (2007)
Koeser, K., Bartczak, B., Koch, R.: Robust gpu-assisted camera tracking using free-form surface models. Journal of Real-Time Image Processing 2(2-3), 133–147 (2007)
Habbecke, M., Kobbelt, L.: Iterative multi-view plane fitting. In: Proc. Vision, Modeling, and Visualization Conference, November 2006, pp. 73–80 (2006)
Triggs, B., McLauchlan, P.F., Hartley, R.I., Fitzgibbon, A.W.: Bundle adjustment – a modern synthesis. In: Vision Algorithms: Theory and Practice, pp. 298–372. Springer, Heidelberg (2000)
Pollefeys, M., Gool, L.V., Vergauwen, M., Verbiest, F., Cornelis, K., Tops, J., Koch, R.: Visual modeling with a hand-held camera. International Journal of Computer Vision 59(3), 207–232 (2004)
Irani, M., Anandan, P.: About direct methods. In: Vision Algorithms: Theory and Practice, pp. 267–277. Springer, Heidelberg (2000)
Jin, H., Favaro, P., Soatto, S.: A semi-direct approach to structure from motion. The Visual Computer 19(6), 377–394 (2003)
Shi, J., Tomasi, C.: Good features to track. In: IEEE Conference on Computer Vision and Pattern Recognition CVPR, June 1994, pp. 593–600 (1994)
Hager, G.D., Belhumeur, P.N.: Efficient region tracking with parametric models of geometry and illumination. IEEE Transactions on Pattern Analysis and Machine Intelligence 20(10), 1025–1039 (1998)
Baker, S., Matthews, I.: Lucas-kanade 20 years on: A unifying framework. International Journal of Computer Vision 56(3), 221–255 (2004)
Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, Cambridge (2003)
Rother, C., Carlsson, S., Tell, D.: Projective factorization of planes and cameras in multiple views. In: Proceedings ICPR 2002, August 2002, pp. 737–740 (2002)
Engels, C., Stewenius, H., Nister, D.: Bundle adjustment rules. In: Proceedings Photogrammetric Computer Vision 2006, ISPRS, September 2006, pp. 266–271 (2006)
Kähler, O., Denzler, J.: Detecting coplanar feature points in handheld image sequences. In: Proceedings VISAPP 2007, March 2007, vol. 2, pp. 447–452 (2007)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kähler, O., Denzler, J. (2008). Implicit Feedback between Reconstruction and Tracking in a Combined Optimization Approach. In: Rigoll, G. (eds) Pattern Recognition. DAGM 2008. Lecture Notes in Computer Science, vol 5096. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-69321-5_28
Download citation
DOI: https://doi.org/10.1007/978-3-540-69321-5_28
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-69320-8
Online ISBN: 978-3-540-69321-5
eBook Packages: Computer ScienceComputer Science (R0)