Abstract
In this paper, we present an algorithm for providing visually-guided unmanned aerial vehicle (UAV) control using visual information that is processed on a mobile graphic processing unit (GPU). Most real-time machine vision applications for UAVs exploit low-resolution images because the shortage of computational resources comes from size, weight and power issue. This leads to the limitation that the data are insufficient to provide the UAV with intelligent behavior. However, GPUs have emerged as inexpensive parallel processors that are capable of providing high computational power in mobile environments. We present an approach for detecting and tracking lines that use a mobile GPU. Hough transform and clustering techniques were used for robust and fast tracking. We achieved accurate line detection and faster tracking performance using the mobile GPU as compared with an x86 i5 CPU. Moreover, the average results showed that the GPU provided approximately five times speedup as compared to an ARM quad-core Cortex-A15. We conducted a detailed analysis of the performance of proposed tracking and detection algorithm and obtained meaningful results that could be utilized in real flight.
Access this article
Rent this article via DeepDyve
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00500-015-1656-y/MediaObjects/500_2015_1656_Fig1_HTML.gif)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00500-015-1656-y/MediaObjects/500_2015_1656_Fig2_HTML.jpg)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00500-015-1656-y/MediaObjects/500_2015_1656_Fig3_HTML.gif)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00500-015-1656-y/MediaObjects/500_2015_1656_Fig4_HTML.gif)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00500-015-1656-y/MediaObjects/500_2015_1656_Fig5_HTML.jpg)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00500-015-1656-y/MediaObjects/500_2015_1656_Fig6_HTML.gif)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00500-015-1656-y/MediaObjects/500_2015_1656_Fig7_HTML.gif)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00500-015-1656-y/MediaObjects/500_2015_1656_Fig8_HTML.gif)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00500-015-1656-y/MediaObjects/500_2015_1656_Fig9_HTML.gif)
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Braak van den GJ, Nugteren C, Mesman B, Corporaal H (2011) Advances concepts for intelligent vision systems. Fast Hough transform on GPUs: exploration of algorithm trade-offs. Springer, Berlin Heidelberg
Campoy P, Correa J, Mondragon I, Martnez C, Olivares M, Mejas L, Artieda J (2009) Computer vision onboard UAVs for civilian tasks. J Intell Robotic Syst 54(1–3):105–135
Chen S, Jiang H (2011) Accelerating the Hough transform with CUDA on graphics processing units. In: Department of Computer Science, Arkansas State University
Duda R, Hart P (1972) Use of the Hough transformation to detect lines and curves in pictures. Commun ACM 15(1):11–15
Engel J, Sturm J, Cremers D (2012) Camera-based navigation of a low-cost quadrocopter. In: Intelligent robots and systems (IROS), 2012 IEEE/RSJ international conference on, pp 2815–2821
Feng L, Xiangxu D, Chen BM, Lee Kai-Yew LT (2012) A robust real-time embedded vision system on an unmanned rotorcraft for ground target following. Ind Electron IEEE Trans 59(2):1038–1049
Gmez-Luna1a J, Gonzlez-Linaresb J, Benavidesa J, Zapatab E, Guilb N (2011) Parallelization of the generalized Hough transform on GPU. In: Computer Architecture and Electronics Department, University of Crdoba, Spain
Kaiser M, Gans N, Dixon W (2010) Vision-based estimation for guidance, navigation, and control of an aerial vehicle. Aerosp Electron Syst IEEE Trans 46(3):1064–1077
Kalman RE (1960) A new approach to linear filtering and prediction problems. J Fluids Eng 82(1):35–45
Lange S, Sunderhauf N, Protzel P (2009) A vision based onboard approach for landing and position control of an autonomous multirotor UAV in GPS-denied environments. In: Advanced robotics, ICAR 2009, international conference on, pp 22–26
Mejias L, McNamara S, Lai J, Ford J (2010) Vision-based detection and tracking of aerial targets for UAV collision avoidance. In: Intelligent robots and systems (IROS), 2010 IEEE/RSJ international conference on, pp 87–92
Mills S, Pridmore T, Hills M (2003) Tracking in a Hough space with the extended Kalman filter. In: Proceedings of the British machine conference. BMVA Press, pp 1–10
Olivares-Mendez M (2010) Fuzzy controller for UAV-landing task using 3D-position visual estimation. In: Comput. Vision Group, Univ. Politec. de Madrid, Madrid, Barcelona, Spain, pp 1–8
Oppenheim A, Schafer R, Buck J (1989) Discrete-time signal processing. Prentice-hall, Englewood Cliffs
Otsu N (1979) A threshold selection method from gray-level histogram. IEEE Trans Syst Man Cybern SMC–9(1):62–66
Sural S, Qian G, Pramanik S (2002) Segmentation and histogram generation using the HSV color space for image retrieval. In: Image processing proceedings, international conference on, IEEE, Vol. 2, pp II-589
Tyan V, Jeon D (2014) Fast multi-line detection and tracking with CUDA for vision-based UAV autopilot. In: IMIS 2014. United Kingdom
Zhihai H, Iyer R, Chandler P (2006) Vision-based UAV flight control and obstacle avoidance. In: American control conference, pp 14–16
Acknowledgments
This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education, Science and Technology. (Grant Number: 2012006817).
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by A. Jara, M.R. Ogiela, I. You and F.-Y. Leu.
Rights and permissions
About this article
Cite this article
Jeon, D., Kim, DH., Ha, YG. et al. Image processing acceleration for intelligent unmanned aerial vehicle on mobile GPU. Soft Comput 20, 1713–1720 (2016). https://doi.org/10.1007/s00500-015-1656-y
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-015-1656-y