Abstract
Real-time three-dimensional vision would support various applications including a passive system for collision avoidance. It is a good alternative of active systems, which are subject to interference in noisy environments. In this paper, we investigate the optimization of real-time stereo vision with respect to resource usage. Correlation techniques using a simple sum of absolute differences(SAD) is popular having good performance. However, processing even a small image takes seconds. In order to provide depth maps at frame rate around 30fps, which typical cameras can provide, hardware accelerations are necessary. Regular structures, linear data flow and abundant parallelism make the correlation algorithm a good candidate for reconfigurable hardware. We implemented versions of SAD algorithms in VHDL and synthesized them to determine resource requirements and performance. By decomposing a SAD correlator into column SAD calculator and row SAD calculator with buffers in between we showed around 50% savings in resource usage. By altering the shape of correlation windows we found that a ‘short and wide’ rectangular window reduced storage requirements without sacrificing quality compared to a square one.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Olson, C.F.: Maximum-likelihood image matching. IEEE Trans. Pattern Anal. Mach. Intell. 24, 853–857 (2002)
Sebe, N., Lew, M.S.: Maximum likelihood stereo matching. In: ICPR 2000: Proceedings of the International Conference on Pattern Recognition (ICPR 2000), Washington, DC, USA, vol. 1, p. 1900. IEEE Computer Society Press, Los Alamitos (2000)
Scharstein, D., Szeliski, R.: A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. J. Comput. Vision 47, 7–42 (2002)
Leclercq, P., Morris, J.: Assessing stereo algorithm accuracy. In: IVCNZ 2002: Proceedings of Image and Vision Computing 2002, pp. 89–93. University of Auckland, Auckland (2002)
Yi, J., Kim, J., Li, L., Morris, J., Lee, G., Leclercq, P.: Real-time three dimensional vision. In: Yew, P.-C., Xue, J. (eds.) ACSAC 2004. LNCS, vol. 3189, pp. 309–320. Springer, Heidelberg (2004)
Barnard, S.T., Fischler, M.A.: Computational stereo. ACM Comput. Surv. 14, 553–572 (1982)
Brown, M.Z., Burschka, D., Hager, G.D.: Advances in computational stereo. IEEE Trans. Pattern Anal. Mach. Intell. 25, 993–1008 (2003)
Leclercq, P., Morris, J.: Robustness to noise of stereo matching. In: ICIAP 2003: Proceedings of the 12th International Conference on Image Analysis and Processing, Washington, DC, USA, p. 606. IEEE Computer Society Press, Los Alamitos (2003)
Grimson, E.L.: Computatoinal experiments with a feature based stereo algorithm. IEEE Trans. Pattern Anal. Mach. Intell. PAMI-7(1), 17–33 (1985)
Virte platform fpgas: Complete data sheet (2002), http://www.xilinx.com
Middlebury stereo vision page (2005), http://www.middlebury.edu/stereo
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lee, S., Yi, J., Kim, J. (2005). Real-Time Stereo Vision on a Reconfigurable System. In: Hämäläinen, T.D., Pimentel, A.D., Takala, J., Vassiliadis, S. (eds) Embedded Computer Systems: Architectures, Modeling, and Simulation. SAMOS 2005. Lecture Notes in Computer Science, vol 3553. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11512622_32
Download citation
DOI: https://doi.org/10.1007/11512622_32
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26969-4
Online ISBN: 978-3-540-31664-0
eBook Packages: Computer ScienceComputer Science (R0)