Abstract
In the article we look at an architecture of a detector of groups of small objects in close proximity to each other with distances between them as short as couples of pixels. In modern days the issue with detection of such small objects using a neural network is often the pooling based architecture leading to spatial information loss. We suggest a model of a convolutional network based on a fully connected convolutional network such as Network in Network (NiN). Accuracy of the detector is measured in a license plate recognition problem when images of license plates are produced by roads and highways video surveillance systems. Our aim is to present a solution to a specific problem without regards to use case specifics such as license plate edge detection, segmentation, and binarization of symbols. We focus on symbol detection and we process raw grayscale data. Furthermore we avoid license plate pattern detection and matching. In spite of narrow conditions we put on the problem the result we achieve is useful since it can be universally applied to many kinds of real world problems due to it being invariant to orientation in space and having low requirements to quality of an image. There are no particular requirements to size of an image being processed, but scaling might require to be executed in order to fit symbols in a predefined range, which in most commonly used systems is achievable due to positions of cameras and surveilled objects being known in advance. In our benchmarking we achieved mean Average Precision (mAP) of 90.25% which is on the level with modern automatic recognition systems for license plates.
This work was financially supported by the Government of the Russian Federation (Grant 08-08).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Agarwal, S., Terrail, J.O.D., Jurie, F.: Recent advances in object detection in the age of deep convolutional neural networks. CoRR, abs/1809.03193 (2018)
Zhao, Z., Zheng, P., Xu, S., Wu, X.: Object detection with deep learning: a review. CoRR, abs/1807.05511 (2018)
Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. ArXiv e-prints, June 2015
Redmon, J., Divvala, S.K., Girshick, R.B., Farhadi, A.: You only look once: unified, real-time object detection. CoRR, abs/1506.02640 (2015)
Redmon, J., Farhadi, A.: Yolov3: an incremental improvement. arXiv (2018)
Lin, T., Goyal, P., Girshick, R.B., He, K., Dollár, P.: Focal loss for dense object detection. CoRR, abs/1708.02002 (2017)
Liu, W., et al.: SSD: single shot multibox detector. CoRR, abs/1512.02325 (2015)
Wong, A., Shafiee, M.J., Li, F., Chwyl, B.: Tiny SSD: a tiny single-shot detection deep convolutional neural network for real-time embedded object detection. CoRR, abs/1802.06488 (2018)
Szegedy, C., Toshev, A., Erhan, D.: Deep neural networks for object detection. In: Advances in Neural Information Processing Systems 26: 27th Annual Conference on Neural Information Processing Systems 2013. Proceedings of a meeting held 5–8 December 2013, Lake Tahoe, Nevada, United States, pp. 2553–2561 (2013)
Li, H., Wang, P., Shen, C.: Towards end-to-end car license plates detection and recognition with deep neural networks. CoRR, abs/1709.08828 (2017)
Masood, S.Z., Shu, G., Dehghan, A., Ortiz, E.G.: License plate detection and recognition using deeply learned convolutional neural networks. CoRR, abs/1703.07330 (2017)
Laroca, R., et al.: A robust real-time automatic license plate recognition based on the YOLO detector. In: 2018 International Joint Conference on Neural Networks (IJCNN), pp. 1–10, July 2018
LaLonde, R., Zhang, D., Shah, M.: Fully convolutional deep neural networks for persistent multi-frame multi-object detection in wide area aerial videos. CoRR, abs/1704.02694 (2017)
Li, H., Shen, C.: Reading car license plates using deep convolutional neural networks and LSTMS. CoRR, abs/1601.05610 (2016)
Alexeev, A., Matveev, Y., Kukharev, G.: Using a fully connected convolutional network to detect objects in images, pp. 141–146, October 2018
Kauderer-Abrams, E.: Quantifying translation-invariance in convolutional neural networks. CoRR, abs/1801.01450 (2018)
Ren, Y., Zhu, C., Xiao, S.: Small object detection in optical remote sensing images via modified faster R-CNN. Appl. Sci. 8(5), 813 (2018)
Kukharev, G., Kamenskaya, E., Matveev, Y., Shchegoleva, N.: Metody obrabotki i raspoznavanija izobrazhenij lic v zadachah biometrii. SPb, Politechnika (2013)
Cheng, Y.: Mean shift, mode seeking, and clustering. IEEE Trans. Pattern Anal. Mach. Intell. 17, 790–799 (1995)
Ester, M., Kriegel, H.-P., Sander, J., Xu, X.: A density-based algorithm for discovering clusters a density-based algorithm for discovering clusters in large spatial databases with noise. In: Proceedings of the Second International Conference on Knowledge Discovery and Data Mining, KDD 1996, pp. 226–231. AAAI Press (1996)
Keskar, N.S., Mudigere, D., Nocedal, J., Smelyanskiy, M., Tang, P.T.P.: On large-batch training for deep learning: generalization gap and sharp minima. CoRR, abs/1609.04836 (2016)
Smith, S.L., Kindermans, P., Le, Q.V.: Don’t decay the learning rate, increase the batch size. CoRR, abs/1711.00489 (2017)
Everingham, M., Van Gool, L., Williams, C.K.I., Winn, J., Zisserman, A.: The pascal visual object classes (VOC) challenge. Int. J. Comput. Vis. 88, 303–338 (2010)
Gu, J., et al.: Recent advances in convolutional neural networks. CoRR, abs/1512.07108 (2015)
Goncalves, G.R., da Silva, S.P.G., Menotti, D., Schwartz, W.R.: Benchmark for license plate character segmentation. J. Electron. Imaging 25(5), 1–5 (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Alexeev, A., Matveev, Y., Matveev, A., Kukharev, G., Almatarneh, S. (2019). Detector of Small Objects with Application to the License Plate Symbols. In: Rojas, I., Joya, G., Catala, A. (eds) Advances in Computational Intelligence. IWANN 2019. Lecture Notes in Computer Science(), vol 11506. Springer, Cham. https://doi.org/10.1007/978-3-030-20521-8_44
Download citation
DOI: https://doi.org/10.1007/978-3-030-20521-8_44
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-20520-1
Online ISBN: 978-3-030-20521-8
eBook Packages: Computer ScienceComputer Science (R0)