Abstract
The calculation of the motion observed between two images of the same scene is required for many applications such as video compression, panoramic stitching and optic flow algorithms for vehicle navigation. The particular application that we focus on in this paper is the need for small light-weight vehicles, such as unmanned ground or air vehicles, to sense their own motion for use in autonomous navigation algorithms. As the processing is ideally performed on-board these vehicles, there are severe restrictions on the processing environment available to perform the optic flow calculations. This has led to the development of FPGA solutions to calculate optic flow. However the most recent approaches still have extensive on-board memory requirements and make use of complex processing operations such as multiplication and matrix inversion. We present an FPGA implementation of a low complexity version of the Lucas–Kanade registration algorithm. This algorithm operates on one-bit images instead of the standard eight-bit approach and consequently can utilize simple logic operations such as exclusive-or rather than multiplications and also makes very efficient use of the available internal memory and resources.
Similar content being viewed by others
References
Alzoubi, H., Pan, W.D.: Very fast global motion estimation using partial data. In: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), vol. 1, pp. 1–1189. IEEE Press, New York (2007)
Angelopoulou, M., Bouganis, C.: Vision-based egomotion estimation on FPGA for unmanned aerial vehicle navigation (2014)
Arribas, P.C.: Real time hardware vision system applications: optical flow and time to contact detector units. In: Proceedings of the Fifth IEEE International Caracas Conference on Devices, Circuits and Systems, vol. 1, pp. 281–288. IEEE Press, New York (2004)
Ayuso, F., Botella, G., Garcia, C., Prieto, M., Tirado, F.: GPU-based acceleration of bio-inspired motion estimation model. Concurr. Comput. Pract. Exp. 25(8), 1037–1056 (2013)
Baker, S., Matthews, I.: Equivalence and efficiency of image alignment algorithms. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, vol. 1, pp. 1–1090. IEEE Press, New York (2001)
Barranco, F., Tomasi, M., Diaz, J., Vanegas, M., Ros. E.: Parallel architecture for hierarchical optical flow estimation based on FPGA. IEEE Trans. VLSI Syst. 20(6), 1058–1067 (2012)
Barron, J.L., Fleet, D.J., Beauchemin, S.S.: Performance of optical flow techniques. Int. J. Comput. Vis. 12(1), 43–77 (1994)
Botella, G., García, A., Rodríguez-Álvarez, M., Ros, E., Meyer-Baese, U., Molina, M.C.: Robust bio-inspired architecture for optical-flow computation. IEEE Trans. VLSI Syst. 18(4), 616–629 (2010)
Botella, G., Meyer-Baese, U., García, A., Rodríguez, M.: Quantization analysis and enhancement of a VLSI gradient-based motion estimation architecture. Digit. Signal Process. 22(6), 1174–1187 (2012)
Chase, J., Nelson, B., Bodily, J., Wei, Z., Lee, D.J.: Real-time optical flow calculations on FPGA and GPU architectures: a comparison study. In: FCCM’08 16th International Symposium on Field-Programmable Custom Computing Machines, pp. 173–182. IEEE Press, New York (2008)
Chen, L., Yang, H., Takaki, T., Ishii, I.: Real-time frame-straddling-based optical flow detection. In: 2011 IEEE International Conference on Robotics and Biomimetics (ROBIO), pp. 2447–2452. IEEE Press, New York (2011)
Díaz, J., Ros, E., Pelayo, F., Ortigosa, E.M., Mota, S.: FPGA-based real-time optical-flow system. IEEE Trans. Circuit. Syst. Video Technol. 16(2), 274–279 (2006)
Dufaux, F., Konrad, J.: Efficient, robust, and fast global motion estimation for video coding. IEEE Trans. Image Process. 9(3), 497–501 (2000)
Erturk, S.: Multiplication-free one-bit transform for low-complexity block-based motion estimation. IEEE Signal Process. Lett. 14(2), 109–112 (2007)
Garcia, C., Botella, G., Ayuso, F., Prieto, M., Tirado, F.: Multi-GPU based on multicriteria optimization for motion estimation system. EURASIP J. Adv. Signal Process. 1, 1–12 (2013)
Garratt, M., Lambert, A., Guillemette, T.: FPGA implementation of an optic flow sensor using the image interpolation algorithm. In: Proceedings of the Australian Conference on Robotics and Automation (2009)
Garratt, M.A., Chahl, J.S.: Vision-based terrain following for an unmanned rotorcraft. J. Field Robot. 25(4–5), 284–301 (2008)
Haque, M.N., Biswas, M., Pickering, M.R., Frater, M.R.: An adaptive low-complexity global motion estimation algorithm. In: Picture Coding Symposium (PCS), pp. 598–601 (2010)
Horn, B.K., Schunck, B.G.: Determining optical flow. Artif. Intell. 17(1), 185–203 (1981)
Johnston, A., McOwan, P.W., Benton, C.P.: Robust velocity computation from a biologically motivated model of motion perception. In: Proceedings of the Royal Society of London Series B: Biological Sciences, vol. 266, No. 1418, pp. 509–518 (1999)
Keller, Y., Averbuch, A.: Fast gradient methods based on global motion estimation for video compression. IEEE Trans. Circuit. Syst. Video Technol. 13(4), 300–309 (2003)
Lucas, B.D., Kanade, T., et al.: An iterative image registration technique with an application to stereo vision. IJCAI 81, 674–679 (1981)
Mahalingam, V., Bhattacharya, K., Ranganathan, N., Chakravarthula, H., Murphy. R.R., Pratt, K.S.: A VLSI architecture and algorithm for lucas-kanade-based optical flow computation. IEEE Trans. VLSI Syst. 18(1), 29–38 (2010)
Nguyen, A.H., Pickering, M.R., Garratt, M.A.: Fast image registration using a multi-pass image interpolation approach. In: International Conference on Information and Technology Applications (2011)
Pauwels, K., Tomasi, M., Ros, E., Van Hulle, M.M.: A comparison of FPGA and GPU for real-time phase-based optical flow, stereo, and local image features. IEEE Trans. Comput. 61(7), 999–1012 (2012)
Srinivasan, M.V.: An image-interpolation technique for the computation of optic flow and egomotion. Biol. Cybern. 71(5), 401–415 (1994)
Yang, K., Frater, M.R., Huntington, E., Pickering, M.R., Arnold, J.F.: Generalized framework for reduced precision global motion estimation between digital images. In: 2008 IEEE 10th Workshop on Multimedia Signal Processing, pp. 76–81. IEEE Press, New York (2008)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Nguyen, A.H., Pickering, M.R. & Lambert, A. The FPGA implementation of a one-bit-per-pixel image registration algorithm. J Real-Time Image Proc 11, 799–815 (2016). https://doi.org/10.1007/s11554-014-0420-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11554-014-0420-3