Skip to main content
SpringerLink
Log in

Efficient FPGA implementation of homodyne-based time-of-flight range imaging

  • Special Issue
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

Time-of-flight range imaging systems illuminate a scene with an amplitude-modulated light source, the light is reflected from objects in the scene, and measurement of the phase of the modulation envelope is performed to determine the object’s distance. As the image sensor is capable of performing this task for every pixel simultaneously, acquisition of the entire scene can be performed at rapid (video) update rates, making the technology ideal for real-time applications. In this paper we present an efficient real-time FPGA algorithm for determining phase, and hence distance, from the raw image sensor output. The algorithm has been implemented on a range imaging system based on the PMD19k-2 image sensor, with range processing performed in real time by a Stratix III FPGA. The scarcest resource in this implementation is RAM, and an analysis is presented to maximise the efficiency of this resource whilst maintaining acceptable processing accuracy. The algorithm can be extended for processing multiple simultaneous modulation frequencies. An efficient method for combining these results to determine unambiguous range, based on the Chinese remainder theorem, is also presented.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Gulden, G., Becker, D., Vossiek, M.: Novel optical distance sensor based on MSM technology. IEEE Sens J 4(5), 612–618 (2004)

    Article  Google Scholar 

  2. Büttgen, B., Seitz, P.: Robust optical time-of-flight range imaging based on smart pixel structures. IEEE Trans Circuits Syst I Regul Pap 55, 1512–1525 (2008)

    Article  MathSciNet  Google Scholar 

  3. Kawahito, S., Halin, I.A., Ushinaga, T., Sawada, T., Homma, M., Maeda, Y.: A CMOS time-of-flight range image sensor with gates-on-field-oxide structure. IEEE Sens J 7(12), 1578–1586 (2007)

    Article  Google Scholar 

  4. Gokturk, S.B., Yalcin, H., Bamji, C.: A time-of-flight depth sensor—system description, issues, and solutions. In: Proceedings of Computer Vision and Pattern Recognition Workshop. http://canesta.com/products-and-technology/products/technical-papers (2004)

  5. Dorrington, A.A., Cree, M.J., Carnegie, D.A., Payne, A.D., Conroy, R.M., Godbaz, J.P., Jongenelen, A.P.P.: Video-rate or high-precision: a flexible range imaging camera. Image processing: machine vision applications. In: Proceedings of the SPIE, 6813, 681307 (2008)

  6. Hussmann, S., Schauer, D., Macdonald, B.: Integration of a 3D-TOF camera into an autonomous mobile robot system. In: 26th International Conference on Instrumentation and Measurement Technology, Singapore, 5–7 May, pp. 547–552 (2009)

  7. Carnegie, D.A., Cree, M.J., Dorrington, A.A., Payne, A.D.: A high resolution full-field range imaging system for robotic devices. In: Proceedings of the Sixth IASTED International Conference on Robotics and Applications, Boston, USA, pp. 306–311, 31 October–2 November (2005)

  8. Yahav, G., Iddan, G., Mandelbaum, D.: 3D imaging camera for gaming application. In: International Conference on Consumer Electronics, pp. 1–2. http://www.3dvsystems.com (2007)

  9. Jongenelen, A.P.P., Carnegie, D.A., Payne A.D., Dorrington, A.A.: Maximising precision over extended unambiguous range for TOF range imaging systems. In: Proceedings of International Instrumentation and Measurement Technology Conference, Austin, Texas, pp. 1575–1580 (2010)

  10. Payne, A.D., Jongenelen, A.P.P., Dorrington, A.A., Cree, M.J., Carnegie, D.A.: Multiple frequency range imaging to remove measurement ambiguity. In: Optical 3-D Measurement Techniques IX, vol. 2, pp. 139–148 (2009)

  11. Bellis, S.J., Marnane, W.P.: A CORDIC arctangent FPGA implementation for a high-speed 3D-camera system. In: Proceedings of the Roadmap to Reconfigurable Computing, 10th International Workshop on Field-Programmable Logic and Applications, Lecture Notes in Computer Science, vol. 1896, pp. 485–494 (2000)

  12. Jongenelen, A.P.P., Carnegie, D.A., Dorrington, A.A., Payne, A.D.: Heterodyne range imaging in real-time. In: Proceedings of International Conference on Sensing Technology, Tainan, pp. 57–62 (2008)

  13. Bailey, D.G.: Space efficient division on FPGAs. In: Electronics New Zealand Conference (ENZCon’06), Christchurch, New Zealand, pp. 206–211, 13–14 November (2006)

  14. Walther, J.S.: A unified algorithm for elementary functions. In: AFIPS Conference Proceedings, vol. 38, pp. 379–385 (1971)

  15. Lange, R.: 3D time-of-flight distance measurement with custom solid-state image sensors in CMOS/CCD-technology. PhD dissertation, University of Siegen (2000)

  16. Dorrington, A.A., Cree, M.J., Payne, A.D., Conroy, R.M., Carnegie, D.A.: Achieving sub-millimetre precision with a solid-state full-field heterodyning range imaging camera. Meas Sci Technol 18, 2809–2816 (2007)

    Article  Google Scholar 

  17. Payne, A.D., Dorrington, A.A., Cree, M.J., Carnegie, D.A.: Improved linearity using harmonic error rejection in a full-field range imaging system. In: Proceedings of SPIE 3D Image Capture and Applications VII, vol. 6805, pp. 68050D (2008)

  18. Altera Corporation. Stratix III Device Handbook, v1.7 edition. http://www.altera.com (2008)

  19. PMD Technologies GmbH. Photonics PMD 19K-2 high resolution 3D video sensor array 160 × 120 pixels datasheet, Revision 1.0. http://www.pmdtec.com (2008)

  20. Jongenelen, A.P.P., Carnegie, D.A., Payne, A.P., Dorrington, A.A.: Development and characterisation of an easily configurable range imaging system. In: Proceedings of Image and Vision Computing New Zealand, pp. 79–84 (2009)

  21. Wang, Y.: New Chinese remainder theorems. In: Proceedings of 32nd Asilomar Conference on Signals, Systems and Computers, pp. 165–171 (1998)

Download references

Author information

Authors and Affiliations

  1. School of Engineering and Computer Science, Victoria University of Wellington, Wellington, New Zealand

    Adrian Peter Paul Jongenelen & D. A. Carnegie

  2. School of Engineering and Advanced Technology, Massey University, Palmerston North, New Zealand

    D. G. Bailey

  3. School of Engineering, University of Waikato, Hamilton, New Zealand

    A. D. Payne & A. A. Dorrington

Authors
  1. Adrian Peter Paul Jongenelen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. D. G. Bailey
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. A. D. Payne
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. D. A. Carnegie
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. A. A. Dorrington
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Adrian Peter Paul Jongenelen.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Jongenelen, A.P.P., Bailey, D.G., Payne, A.D. et al. Efficient FPGA implementation of homodyne-based time-of-flight range imaging. J Real-Time Image Proc 7, 21–29 (2012). https://doi.org/10.1007/s11554-010-0173-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-010-0173-6

Keywords

Search

Navigation