Skip to main content
SpringerLink
Log in

Moving camera-based automated system for drone identification using focus measures

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

A few characteristics of advanced commercial drones have attracted increasing attention in recent years. Because of their ability to carry payloads bypassing ground security, there is a greater possibility of small drones being exploited for illegitimate operations. The drone tracking and surveillance is critical to prevent security breaches like these. Small drones and birds have similar appearances in complicated backgrounds and make it difficult to recognize drone in surveillance videos. Manual surveillance and drone detection are very complicated and tedious process. Therefore, an automated method is required to distinguish between drone and birds. In this paper, focus measure operators (FMOs)-based method is developed for drone detection. The five FMO parameters are computed on each frame of every video. Feature ranking is done to identify the significant feature for drone identification followed by classification which is performed using random forest classifier. Efficacy of the proposed method is evaluated on Drone-vs-Bird Detection Challenge at IEEE AVSS2021 dataset which is provided by Workshop on Small-Drone Surveillance, Detection and Counteraction Techniques (WOSDETC) supported by the SafeShore Consortium. The proposed method achieved average accuracy 94.15% with sensitivity 96.69% for identifying drones with drone present (DP) versus neither drone nor bird present (NDNBP) (two class), accuracy 93.60% with sensitivity 96.20% DP versus both bird and drone present (BBDP) versus NDNBP (three class), accuracy 92% with sensitivity 95% DP versus bird present versus BBDP versus NDNBP (four class) for moving camera recordings. Average accuracy for two class, three class, and four class classification system with moving as well as stationary camera is 95.18%, 93.20%, and 94%, respectively, which are significantly high and can be utilized for drone identification.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Belgiu, M., Drăguţ, L.: Random forest in remote sensing: a review of applications and future directions. ISPRS J. Photogramm. Remote Sens. 114, 24–31 (2016)

    Article  Google Scholar 

  2. Biau, G., Scornet, E.: A random forest guided tour. Test 25(2), 197–227 (2016)

    Article  MathSciNet  MATH  Google Scholar 

  3. Breiman, L.: Random forests. Mach. Learn. 45(1), 5–32 (2001)

    Article  MATH  Google Scholar 

  4. Brejl, M., Sonka, M.: Object localization and border detection criteria design in edge-based image segmentation: automated learning from examples. IEEE Trans. Med. Imaging 19(10), 973–985 (2000)

    Article  Google Scholar 

  5. Busset, J., Perrodin, F., Wellig, P., Ott, B., Heutschi, K., Rühl, T., Nussbaumer, T.: Detection and tracking of drones using advanced acoustic cameras. In: Unmanned/Unattended Sensors and Sensor Networks XI; and Advanced Free-Space Optical Communication Techniques and Applications, vol. 9647, p. 96470F (2015)

  6. Chikhi, S., Benhammada, S.: Reliefmss: a variation on a feature ranking relieff algorithm. Int. J. Bus. Intell. Data Min. 4(3–4), 375–390 (2009)

    Google Scholar 

  7. Coluccia, A., Parisi, G., Fascista, A.: Detection and classification of multirotor drones in radar sensor networks: a review. Sensors 20(15), 4172 (2020)

    Article  Google Scholar 

  8. Craye, C., Ardjoune, S.: Spatio-temporal semantic segmentation for drone detection. In: 2019 16th IEEE International Conference on Advanced Video and Signal based Surveillance (AVSS), pp. 1–5. IEEE (2019)

  9. Drone-vs-Bird Detection Challenge at IEEE AVSS2021. http://www.avss2021.org/pages/challenge.html

  10. Faita, F., Gemignani, V., Giannoni, M., Benassi, A., Ferdeghini, E., Demi, M.: The first order absolute central moment as an edge-detector in cardiovascular imaging: a comparison with two well-known edge-detectors. In: Computers in Cardiology, 2004, pp. 561–564. IEEE (2004)

  11. Han, J., Dong, F., Xu, Y.: Entropy feature extraction on flow pattern of gas/liquid two-phase flow based on cross-section measurement. J. Phys. Conf. Ser. 147, 012041 (2009)

    Article  Google Scholar 

  12. Harmanny, R., De Wit, J., Cabic, G.P.: Radar micro-doppler feature extraction using the spectrogram and the cepstrogram. In: 2014 11th European Radar Conference, pp. 165–168. IEEE (2014)

  13. Kaya, Y., Uyar, M., Tekin, R., Yıldırım, S.: 1D-local binary pattern based feature extraction for classification of epileptic EEG signals. Appl. Math. Comput. 243, 209–219 (2014)

    MathSciNet  MATH  Google Scholar 

  14. Khosiawan, Y., Nielsen, I.: A system of UAV application in indoor environment. Prod. Manuf. Res. 4(1), 2–22 (2016)

    Google Scholar 

  15. Kirillov, A., Wu, Y., He, K., Girshick, R.: Pointrend: image segmentation as rendering. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 9799–9808 (2020)

  16. Liu, H., Wei, Z., Chen, Y., Pan, J., Lin, L., Ren, Y.: Drone detection based on an audio-assisted camera array. In: 2017 IEEE Third International Conference on Multimedia Big Data (BigMM), pp. 402–406. IEEE (2017)

  17. Liu, J., Xu, Q.Y., Chen, W.S.: Classification of bird and drone targets based on motion characteristics and random forest model using surveillance radar data. IEEE Access 9, 160,135-160,144 (2021)

    Article  Google Scholar 

  18. Liu, Y., Liao, L., Wu, H., Qin, J., He, L., Yang, G., Zhang, H., Zhang, J.: Trajectory and image-based detection and identification of UAV. Vis. Comput. 37(7), 1769–1780 (2021)

    Article  Google Scholar 

  19. Magoulianitis, V., Ataloglou, D., Dimou, A., Zarpalas, D., Daras, P.: Does deep super-resolution enhance UAV detection? In: 2019 16th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 1–6. IEEE (2019)

  20. Maheshwari, S., Sharma, R.R., Kumar, M.: LBP-based information assisted intelligent system for COVID-19 identification. Comput. Biol. Med. 134, 104,453 (2021)

    Article  Google Scholar 

  21. Memon, F., Unar, M.A., Memon, S.: Image quality assessment for performance evaluation of focus measure operators. Mehran Univ. Res. J. Eng. Technol. 34(4), 379–386 (2015)

    Google Scholar 

  22. Mutahira, H., Ahmad, B., Muhammad, M.S., Shin, D.R.: Focus measurement in color space for shape from focus systems. IEEE Access 9, 103,291-103,310 (2021)

    Article  Google Scholar 

  23. Nalamati, M., Kapoor, A., Saqib, M., Sharma, N., Blumenstein, M.: Drone detection in long-range surveillance videos. In: 2019 16th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 1–6. IEEE (2019)

  24. Park, D., Lee, S., Park, S., Kwak, N.: Radar-spectrogram-based UAV classification using convolutional neural networks. Sensors 21(1), 210 (2021)

    Article  Google Scholar 

  25. Pertuz, S., Puig, D., Garcia, M.A.: Analysis of focus measure operators for shape-from-focus. Pattern Recognit. 46(5), 1415–1432 (2013)

    Article  MATH  Google Scholar 

  26. Schumann, A., Sommer, L., Klatte, J., Schuchert, T., Beyerer, J.: Deep cross-domain flying object classification for robust UAV detection. In: 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance, pp. 1–6 (2017)

  27. Seidaliyeva, U., Akhmetov, D., Ilipbayeva, L., Matson, E.T.: Real-time and accurate drone detection in a video with a static background. Sensors 20(14), 3856 (2020)

    Article  Google Scholar 

  28. Sharjeel, A., Naqvi, S.A.Z., Ahsan, M.: Real time drone detection by moving camera using COROLA and CNN algorithm. J. Chin. Inst. Eng. 44(2), 128–137 (2021)

    Article  Google Scholar 

  29. Sharma, R.R., Pachori, R.B.: Time-frequency representation using IEVDHM-HT with application to classification of epileptic EEG signals. IET Sci. Meas. Technol 12(1), 72–82 (2018)

    Article  Google Scholar 

  30. Shi, X., Yang, C., Xie, W., Liang, C., Shi, Z., Chen, J.: Anti-drone system with multiple surveillance technologies: architecture, implementation, and challenges. IEEE Commun. Mag 56(4), 68–74 (2018)

    Article  Google Scholar 

  31. Sun, J., Li, B., Jiang, Y., Wen, C. y: A camera-based target detection and positioning UAV system for search and rescue (SAR) purposes. Sensors 16(11), 1778 (2016)

    Article  Google Scholar 

  32. Taha, B., Shoufan, A.: Machine learning-based drone detection and classification: state-of-the-art in research. IEEE Access 7, 138,669-138,682 (2019)

    Article  Google Scholar 

  33. Toloşi, L., Lengauer, T.: Classification with correlated features: unreliability of feature ranking and solutions. Bioinformatics 27(14), 1986–1994 (2011)

    Article  Google Scholar 

  34. Unlu, E., Zenou, E., Rivière, N.: Generic Fourier descriptors for autonomous UAV detection (2018)

  35. Unlu, E., Zenou, E., Riviere, N., Dupouy, P.E.: Deep learning-based strategies for the detection and tracking of drones using several cameras. IPSJ Trans. Comput. Vis. Appl. 11(1), 1–13 (2019)

    Google Scholar 

  36. Vrba, M., Heřt, D., Saska, M.: Onboard marker-less detection and localization of non-cooperating drones for their safe interception by an autonomous aerial system. IEEE Robot. Autom. Lett. 4(4), 3402–3409 (2019)

    Article  Google Scholar 

  37. Yazdi, M., Bouwmans, T.: New trends on moving object detection in video images captured by a moving camera: a survey. Comput. Sci. Rev. 28, 157–177 (2018)

    Article  MathSciNet  Google Scholar 

  38. Yuan, Y., Hu, X.: Random forest and objected-based classification for forest pest extraction from UAV aerial imagery. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 41, 1093 (2016)

    Article  Google Scholar 

  39. Yue, X., Liu, Y., Wang, J., Song, H., Cao, H.: Software defined radio and wireless acoustic networking for amateur drone surveillance. IEEE Commun. Mag. 56(4), 90–97 (2018)

    Article  Google Scholar 

Download references

Acknowledgements

We are thankful to the editor and reviewers to provide valuable suggestions. We are grateful to AVSS-2021 and WOSDETC-2021 team to provide videos for research purpose.

Author information

Authors and Affiliations

  1. Department of Electronics Engineering, Defence Institute Advanced Technology, Pune, India

    Bhagyashri B. Bhagat & Rishi Raj Sharma

  2. Armament Research and Development Establishment, DRDO, Pune, India

    Dinesh Tilante

Authors
  1. Bhagyashri B. Bhagat
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rishi Raj Sharma
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dinesh Tilante
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Rishi Raj Sharma.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bhagat, B.B., Sharma, R.R. & Tilante, D. Moving camera-based automated system for drone identification using focus measures. SIViP 17, 2763–2770 (2023). https://doi.org/10.1007/s11760-023-02493-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-023-02493-3

Keywords

Search

Navigation