Abstract
The use of artificial vision in control loops as a feedback element or a reference signal for the control of automation systems requires low latency. Several artificial vision system realizations are compared in terms of latency of novel event detection. The target application is a semi-automated foosball table. Novel event detection latency ranged from 26.4 to 260.7 ms. The system with the lowest latency has a camera connected directly to an FPGA SoC (System on Chip), where streamed vision preprocessing is performed in hardware. Finally, an SoC based control platform with low overall latency is briefly discussed.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Franklin, G.F., Powell, J.D., Emami-Naeini, A.: Feedback Control of Dynamic Systems, 7th edn. Pearson, New Jersey (2015)
Engelberg, S.: A Mathematical Introduction to Control Theory, 2nd edn., vol. IV. Imperial College Press, London (2015)
Janssen, R., Verrijt, M., de Best, J., van de Molengraft, R.: Ball localization and tracking in a highly dynamic table soccer environment. Mechatronics 22, 503–514 (2012)
Cizek, P., Faigl, J., Masri, D.: Low-latency image processing for vision-based navigation systems. In: International Conference on Robotics and Automation, Stockholm, pp. 781–786 (2016)
Barry, A.J., Oleynikova, H., Honegger, D., Pollefeys, M., Tedrake, R.: Fast onboard stereo vision for UAVs. In: Vision-Based Control and Navigation of Small Lightweight UAVs, IROS Workshop (2015)
Anderson, R.L.: A low-latency 60 Hz stereo vision system for real-time visual control. In: International Symposium on Intelligent Control, Philadelphia, pp. 165–170 (1990)
de la Malla, C., Lopez-Moliner, J.: Predictive plus online visual information optimizes temporal precision in interception. J. Exp. Psychol.: Hum. Percep. Perf. 41(5), 1271–1280 (2015)
Cigliano, P., Lippiello, V., Ruggiero, F., Siciliano, B.: Robotic ball catching with an eye-in-hand single camera system. IEEE Trans. Control Syst. Technol. 23(5), 1657–1671 (2015)
Berner, R., Brandli, C., Yang, M., Liu, S.-C., Delbruck, T.: A 240 × 180 10 mW 12 μs latency sparse-output vision sensor for mobile applications. In: Symposium on VLSI Circuits, Kyoto, pp. C186–C187 (2013)
Conradt, J., Berner, R., Cook, M., Delbruck, T.: An embedded AER dynamic vision sensor for low-latency pole balancing. In: International Conference on Computer Vision Workshops, Kyoto, pp. 780–785 (2009)
Mueller, E., Censi, A., Frazzoli, E.: Low-latency heading feedback control with neuromorphic vision sensors using efficient approximated incremental inference. In: Annual Conference on Decision and Control, Osaka, pp. 992–999 (2015)
Censi, A., Strubel, J., Brandli, C., Delbruck, T., Scaramuzza, D.: Low-latency localization by active LED markers tracking using a dynamic vision sensor. In: International Conference on Intelligent Robots and Systems, Tokyo, pp. 891–898 (2013)
Honegger, D., Oleynikova, H., Pollefeys, M.: Real-time and low latency embedded computer vision hardware based on a combination of FPGA and mobile CPU. In: International Conference on Intelligent Robots and Systems, Chicago, pp. 4930–4935 (2014)
Wolpert, D.W., Flanagan, J.R.: Motor prediction. Curr. Biol. 11(18), pp. R729–R732 (2001)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Lues, J., Gupta, G.S., Bailey, D. (2019). Evaluation of High-Speed Image Processing for Low Latency Control of a Mechatronic System. In: Kim, JH., et al. Robot Intelligence Technology and Applications 5. RiTA 2017. Advances in Intelligent Systems and Computing, vol 751. Springer, Cham. https://doi.org/10.1007/978-3-319-78452-6_46
Download citation
DOI: https://doi.org/10.1007/978-3-319-78452-6_46
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-78451-9
Online ISBN: 978-3-319-78452-6
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)