Abstract
This paper addresses the problem of registering high-resolution, small FOV images with low-resolution panoramic images provided by an omnidirectional catadioptric video sensor. Such systems may find application in surveillance and telepresence systems that require a large FOV and high resolution at selected locations. Although image registration has been studied in more conventional applications, the problem of registering omnidirectional and conventional video has not previously been addressed, and this problem presents unique challenges due to (i) the extreme differences in resolution between the sensors (more than a 16:1 linear resolution ratio in our application), and (ii) the resolution inhomogeneity of omnidirectional images. In this paper we show how a coarse registration can be computed from raw images using parametric template matching techniques. Further, we develop and evaluate robust feature-based and featureless methods for computing the full 2D projective transforms between the two images. We find that our novel featureless approach yields superior performance for this application.
Chapter PDF
Similar content being viewed by others
Keywords
References
L. G. Brown. A survey of image registration techniques. ACM Computing Surveys, 24(4):325–376, October 1992.
T. L. Conroy and J. B. Moore. Resolution invariant surfaces for panoramic vision systems. In IEEE Conference on Computer Vision, September 1999.
K. Danilidis and C. Geyer. Omnidirectional vision: Theory and algorithms. In IEEE International Conference on Patter Recognition, 2000.
Y. Dufourneau, C. Schmid, and R. Horaud. Matching images with different resolutions. In IEEE Conference on Computer Vision and Pattern Recognition, 2000.
F. Ferrari, J. Nielsen, P. Questa, and G. Sandini. Space variant imaging. Sensor Review, 15(2):17–20, 1995.
M. A. Fischler and R. C. Bolles. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communication ACM, 24(6):381–395, 1981.
R. Fletcher. Practical Methods of Optimization. Wiley, New York, 1990.
B. B. Hansen and B. S. Morse. Multiscale image registrartion using scale trace correlation. In IEEE Conference on Computer Vision and Pattern Recognition, 1999.
I. Haritaoglu, D. Harwood, and L. Davis. Who, when, where, what: A real time system for detecting and tracking people. In Proceedings of the Third Face and Gesture Recognition Conference, 1998.
C. Harris and M. Stephens. A combined corner and edge detector. In Alvey Vision Conference, 1988.
R. A. Hicks and R. Bajcsy. Catadioptric sensors that approximate wide-angle perspective projections. In IEEE Conference on Computer Vision and Pattern Recognition, 2000.
H. Ishiguro, M. Yamamoto, and S. Tsuji. Omni-directional stereo. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2):257–262, 1992.
J. Jolion and A. Rosenfeld. A Pyramid Framework For Early Vision. Kluwer Academic Publishers, 1994.
R. Kumar, P. Anandan, M. Irani, J. Bergen, and K. Hanna. Representations of scenes from collections of images. In ICCV Workshop on the Representation of Visual Scenes, 1995.
S. Mann and R. W. Picard. Video orbits of the projective group: A simple approach to featureless estimation of parameters. IEEE Transactions on Image Processing, 6(9):1281–1295, 1997.
P. Meer, D. Mintz, A. Rosenfeld, and D. W. Kim. Robust regression methods for computer vision: a review. International Journal of Computer Vision, 6(1):59–70, 1990.
S. Nayar. Catadioptric omnidirectional camera. In IEEE Conference on Computer Vision and Pattern Recognition, 1997.
F. Pardo, B. Dierickx, and D. Scheffer. CMOS foveated image sensor: Signal scaling and small geometry effects. IEEE Transactions on Electron Devices, 44(10):1731–1737, 1997.
W. H. Press, S. A. Teukolsky, W. T. Wetterling, and B. P. Flannery. Numerical Recipes, The Art of Scientific Computing. Cambridge University Press, New York, 1992.
C. Schmid and R. Mohr. Local greyvalue invariants for image retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(5):530–534, 1997.
C. Schmid, R. Mohr, and C. Bauckhage. Comparing and evaluating interest points. In IEEE International Conference on Computer Vision, 1998.
H. Stark and F. B. Tuteur. Modern Electrical Communications: Theory and Systems. Prentice-Hall, 1979.
T. Svoboda, T. Pajdla, and V. Hlavac. Epipolar geometry for panoramic cameras. In European Conference on Computer Vision, 1998.
R. Szeliski. Image mosaicking for tele-reality applications. In IEEE Workshop on Applications of Computer Vision, 1994.
K. Tanaka, M. Sano, S. Ohara, and M. Okudaira. A parametric template method and its application to robust matching. In IEEE Conference on Computer Vision and Pattern Recognition, 2000.
Y. Wu, T. Kanade, C.C. Li, and J. Cohn. Image registration using wavelet-based motion model. International Journal of Computer Vision, 38(2), 2000.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Dornaika, F., Elder, J. (2002). Image Registration for Foveated Omnidirectional Sensing. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds) Computer Vision — ECCV 2002. ECCV 2002. Lecture Notes in Computer Science, vol 2353. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-47979-1_41
Download citation
DOI: https://doi.org/10.1007/3-540-47979-1_41
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-43748-2
Online ISBN: 978-3-540-47979-6
eBook Packages: Springer Book Archive