Abstract
We propose an efficient real-time automatic license plate recognition (ALPR) framework, particularly designed to work on CCTV video footage obtained from cameras that are not dedicated to the use in ALPR. At present, in license plate detection, tracking and recognition are reasonably well-tackled problems with many successful commercial solutions being available. However, the existing ALPR algorithms are based on the assumption that the input video will be obtained via a dedicated, high-resolution, high-speed camera and is/or supported by a controlled capture environment, with appropriate camera height, focus, exposure/shutter speed and lighting settings. However, typical video forensic applications may require searching for a vehicle having a particular number plate on noisy CCTV video footage obtained via non-dedicated, medium-to-low resolution cameras, working under poor illumination conditions. ALPR in such video content faces severe challenges in license plate localization, tracking and recognition stages. This paper proposes a novel approach for efficient localization of license plates in video sequence and the use of a revised version of an existing technique for tracking and recognition. A special feature of the proposed approach is that it is intelligent enough to automatically adjust for varying camera distances and diverse lighting conditions, a requirement for a video forensic tool that may operate on videos obtained by a diverse set of unspecified, distributed CCTV cameras.
Similar content being viewed by others
References
Arth, C., Limberger, F., Bishof, H.: Real-time license plate recognition on an embedded DSP-platform. Institute for Computer Graphics and Vision, Graz University, Austria (2006)
Baker, S., Matthews, I.: Lucas–Kanade 20 years on: a unifying framework. Int. J. Comp. Vis. 56, 3221–3255 (2004)
Chang, S.L., et al.: Automatic license plate recognition. IEEE Transact. Intell. Transp. Sys. 5(1), 42–53 (2004)
Chateau, T., Lapreste, J.: Robust real time tracking of a vehicle by image processing. IEEE Intell. Vehicles Symp. 315–318 (2004). doi:10.1109/IVS.2004.1336401
Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. CVPR IEEE Comp. Soc. Conf. 1, 886–893 (2005)
Deb, K., Chae, H.U., Jo, K.H.: Vehicle licence plate detection method based on sliding concentric windows and histogram. Int. J. Comp. 4(8), 771–777 (2009)
Dellaert, F., Thorpe, C.: Robust car tracking using Kalman filtering and Bayesian templates. Conference on Intelligent Transportation Systems (1997)
Dlagnekov, L., Belongie, S.: Recognizing cars. Technical Report CS2005–0833. UCSD University of California, San Diego (2005). Accessed 19 June 2010
Dlagnekov, L.: license plate detection using AdaBoost, computer science & engineering dpt., La Jolla, San Diego. http://www.cse.ucsd.edu/classes/fa04/cse252c/projects/louka.pdf
Donoser, M., Arth, C., Bischof, H.: Detecting, tracking and recognizing license plates ACCV 2007, Part II. LNCS 4844, 447–456 (2007)
Kamat, V., Ganesan, S.: An efficient implementation of the hough transform for detecting vehicle license plates using DSPs. In: Proceedings of the IEEE International Conference RTAS. 58–59 (1995)
Kanhere, N.K., Birchfield, S.T., Sarasua, W.A.: Vehicle segmentation and tracking in the presence of occlusions. Transp. Res. Rec. 1944, 89–97 (2006)
Kim, S., Oh, S. Y., Kang, J., Ryu, Y. K., Park, C., Park, K.: Front and rear vehicle detection and tracking in the day and night-times using vision and sonar sensor fusion. IEEE/RS J. Int. Conf. Intell. Robots Sys. 2173–2178 (2005)
Koller, D., Weber, J., Malik, J.: Robust multiple car tracking with occlusion reasoning. In Proc. Third Europeon Conference on Computer Vision, Stockholm, Sweden. LNCS 800, pp. 189–196. Springer, 2–6 May 1994
Li, X., Yan, X., Murphey, Y., Karlsen, R., Gerhart, G.: A real-time vehicle detection and tracking system in outdoor traffic scenes. ICPR 2004, Proceedings of the 17th International Conference 2. (2004) 761-764
Lucas, B. D., Kanade, T.: An iterative image registration technique with an application to stereo vision. In: Proceedings of the 7th International Joint Conference on Artificial Intelligence. (1981)
Marmoiton, F., Collange, F., Alizon, J., Derutin, J.: 3d localization of a car observed through a monocular video camera. In: Proceedings of the IEEE International Conference on Intelligent Vehicles. (1998)
Rahman, C., Badawy, W., Radmanesh, A.: A real time vehicle’s license plate recognition system. In: AVSS, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, IEEE Computer Society Press, Los Alamitos 163–166. (2003)
Rastegar, S., Ghaderi, R., Ardeshir, J., Asadi, N.: An intelligent control system using an efficient license plate location and recognition approach. Int. J. Image Process. (IJIP) 3(5), 252–264 (2009)
Sergi, M., Shankwitz, C., Donath, M.: Lidar-based vehicle tracking for a virtual mirror. Intelligent Vehicle Symposium. Proc. IEEE. 333–338 (2003). doi:10.1109/IVS.2003.1212932
Shapiro, V., Gluhchev, G., Dimov, D.: Towards a multinational car license plate recognition system. Mach. Vis. Appl. 17(3), 173–183 (2006)
Tan, X., Li, J., and Liu, C. A video-based real-time vehicle detection method by classified background learning. World Transact. Eng. Technol. Educ. 6(1) (2007)
Yanamura, Y., Goto, M., Nishiyama, D., Soga, M., Nakatani, H., Saji, H.: Extraction and tracking of the license plate using Hough transform and voted block matching. IEEE IV2003 Intelligent Vehicles Symposium, Proceeding (Cat. No. 03TH8683), 243–246 (2003)
Zhang, H. et al.: Real-time license plate detection under various conditions. Springer-Verlag Berlin, Heidelberg, 192–199 (2006)
Zheng, D., Zhao, Y., Wang, J.: An efficient method of license plate location. Pattern Recogn. Lett. 26, 2431–2438 (2005)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Sarfraz, M.S., Shahzad, A., Elahi, M.A. et al. Real-time automatic license plate recognition for CCTV forensic applications. J Real-Time Image Proc 8, 285–295 (2013). https://doi.org/10.1007/s11554-011-0232-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11554-011-0232-7