Abstract
The use of drones for several real-world applications is increasing exponentially, especially for the purpose of monitoring, surveillance, security, etc. Most existing scene text detection methods were developed for normal scene images. This work aims to develop a model for detecting text in drone as well as scene images. To reduce the adverse effects of drone images, we explore the combination of Fourier transform and Convolutional Block Attention Module (CBAM) to enhance the degraded information in the images without affecting high-contrast images. This is because the above combination helps us to extract prominent features which represent text irrespective of degradations. Therefore, the refined features extracted from the Fourier Contouring Network (FCN) are supplied to Vision Transformer, which uses the ResNet50 as a backbone and encoder-decoder for text detection in both drone and scene images. Hence, the model is called Fourier Transform based Transformer. Experimental results on drone datasets and benchmark datasets, namely, Total-Text and ICDAR 2015 of natural scene text detection show the proposed model is effective and outperforms the state-of-the-art models.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Mokayed, H., Shivakumara, P., Woon, H.H., Kankanhali, M., Lu, T., Pal, U.: A new DCT-PCM method for license plate number detection in drone images. Pattern Recognit. Lett. 148, 45–53 (2021)
Liao, M., Zou, Z., Wan, Z., Yao, C., Bai, X.: Real-time scene text detection with differentiable binarization and adaptive scale fusion. IEEE Trans. Pattern Anal. Mach. Intell. 45, 919–931 (2023)
Zhu, Y., Chen, J., Liang, L., Kuang, Z., Jin, L., Zhang, W.: Fourier contour embedding for arbitrary-shaped text detection. In: Proceedings of the CVPR, pp. 3122–3130 (2021)
Woo, S., Park, J., Lee, J.-Y., Kweon, I.S.: CBAM: convolutional block attention module. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11211, pp. 3–19. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01234-2_1
Zeng, C., Song, C.: Swin transformer with feature pyramid networks for scene text detection of the secondary circuit cabinet wiring. In: Proceedings of the ICPICS, pp. 255–258 (2022)
Zhang, S., et al.: Deep relational reasoning graph network for arbitrary shape text detection. In: Proceedings of the CVPR, pp. 9699–9708 (2020)
Wang, W., et al.: Efficient and accurate arbitrary-shaped text detection with pixel aggregation network. In: Proceedings of the ICCV, pp. 8440–8449 (2019)
Wang, W., et al.: Shape robust text detection with progressive scale expansion network. In: Proceedings of the CVPR, pp. 9336–9345 (2019)
Zheng, J.: Multi-level alignment for cross-domain scene text detection. In: Proceedings of the ICCECE, pp. 671–675 (2022)
Zhao, M., Feng, F., Yin, F., Zhang, X.Y., Liu, C.L.: Mixed-supervised scene text detection with expectation-maximization algorithm. IEEE Trans. Image Process. 31, 5513–5528 (2022)
Banerjee, A., Shivakumara, P., Acharya, P., Pal, U., Canet, J.L.: TWD: a new deep E2E model for text watermark/caption and scene text detection in video. In: Proceedings of the ICPR, pp. 1492–1498 (2022)
Bagi, R., Dutta, T., Nigam, N., Verma, D., Gupta, H.P.: Met-MLTS: leveraging smartphones for end-to-end spotting of multilingual oriented scene texts and traffic signs in adverse meteorological conditions. IEEE Trans. Intell. Transp. Syst. 23, 12801–12810 (2021)
Dai, P., Li, Y., Zhang, H., Li, J., Cao, X.: Accurate scene text detection via scale-aware data augmentation and shape similarity constraint. IEEE Trans Multimed. 24, 1883–1885 (2021)
Keserawani, P., Saini, R., Liwicki, M., Roy, P.P.: Robust scene text detection for partially annotated training data. IEEE Trans. Circuits Syst. Video Technol. 32, 8635–86745 (2022)
Deng, J., Luo, X., Zheng, J., Dang, W., Li, W.: Text enhancement network for cross-domain scene text detection. IEEE Signal Process. Lett. 29, 2203–2207 (2022)
Jain, S., Patel, S., Mehat, A., Verma, J.P.: Number plate detection using drone surveillance. In: Proceedings of the UPCON, pp. 1–6 (2022). https://doi.org/10.1109/UPCON56432.2022.9986360
Mokayed, H., Meng, L.K., Woon, H.H., Sin, N.H.: Car plate detection engine based on conventional edge detection technique. In: Proceedings of the International Conference on Computer Graphics, Multimedia and Image Processing (CGMIP) (2014)
Pal, S., Roy, A., Shivakumara, P., Pal, U.: Adapting a Swin transformer for license plate number/text detection in drone images. In: Artificial Intelligence and Applications (2023). https://doi.org/10.47852/bonviewAIA3202549
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., Zagoruyko, S.: End-to-end object detection with transformers. In: Vedaldi, A., Bischof, H., Brox, T., Frahm, J.-M. (eds.) ECCV 2020. LNCS, vol. 12346, pp. 213–229. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58452-8_13
Karatzas, D., et al.: ICDAR 2015 competition on robust reading. In: Proceedings of the ICDAR, pp. 1156–1160 (2015)
Ch’ng, C.K., Chan, C.S., Liu, C.: Total-text: towards orientation robustness in scene text detection. Int. J. Doc. Anal. Recognit. (IJDAR) 31–52 (2020)
Acknowledgement
This work is partly supported by Technology Innovation Hub (TIH), Indian Statistical Institute. Kolkata.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Roy, A., Shivakumara, P., Pal, U., Mokayed, H., Liwicki, M. (2023). Fourier Feature-based CBAM and Vision Transformer for Text Detection in Drone Images. In: Coustaty, M., Fornés, A. (eds) Document Analysis and Recognition – ICDAR 2023 Workshops. ICDAR 2023. Lecture Notes in Computer Science, vol 14194. Springer, Cham. https://doi.org/10.1007/978-3-031-41501-2_18
Download citation
DOI: https://doi.org/10.1007/978-3-031-41501-2_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-41500-5
Online ISBN: 978-3-031-41501-2
eBook Packages: Computer ScienceComputer Science (R0)
