Skip to main content
SpringerLink
Log in

High anti-interference and FPGA-oriented method for real-time ship detection based on structured LBP features

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

With the continuous enhancement of remote sensing technology, using satellite to detect and identify targets has important research significance in military and civil fields. Due to the influence of many interference factors, the background of large-scale infrared remote sensing images is often complex and the target intensity is weak, and efficient and accurate target detection has become a difficult issue. Therefore, the purpose of this paper is to solve the issues of inaccurate target detection and inefficient hardware deployment. Firstly, the rough detection method based on the grey variance and gradient features can effectively extracted the target candidate region and eliminate simple background interference. Secondly, the fine detection method based on multiple features is used for ship classification, in which structured LBP (local binary pattern) features is applied to calculate the structured feature histogram, screen the local target features, and calculate and classify the global features through two-dimensional Fourier features. Thirdly, the improved non-maximum suppression method is used to merge adjacent target points to ensure the accuracy of the algorithm to the greatest extent. Finally, an efficient feature computing unit and multichannel storage structure is proposed to optimize the FPGA (field-programmable gate array) implementation and relieve the pressure of high data rate processing and can eliminate a lot of computational redundancy. Experimental results validate that, compared with some advanced methods, our method can reduce the processing time by up to 1.71 times while the ship detection performance can be improved by up to 5.4%. Furthermore, the hardware processing capability was verified by three indicators, among which the traversal processing performance and throughput can increase by up to 1.7 and 6.7%, while the delays of key modules can decrease by up to 4%.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Luo K (2015) Space-Based Infrared Sensor Scheduling with High Uncertainty: Issues and Challenges. Syst Eng 18(1):102–113

    Article  Google Scholar 

  2. Nie T, He B, Bi G, Zhang Y, Wang W (2017) A method of ship detection under complex background. ISPRS Int J Geo-Inf 6:159

    Article  Google Scholar 

  3. Yang X, Sun H, Fu K, Yang J, Sun X, Yan M, Guo Z (2018) Automatic ship detection of remote sensing images from google Earth in complex scenes based on multi-scale rotation dense feature pyramid networks. Remote Sens 10:132

    Article  Google Scholar 

  4. Jie H, Hong YX (2013) A method for infrared small target detection with high-pass filter and image enhancement technology. Infrared Technol 35:5

    Google Scholar 

  5. Zeng M, Li J, Peng Z (2006) The design of top-hat morphological filter and application to infrared target detection. Infrared Phys Technol 48:67–76

    Article  Google Scholar 

  6. Corbane Ch, Najman L, Pecoul E, Demagistri L, Petit M (2010) A complete processing chain for ship detection using optical satellite imagery. Int J Remote Sens 31:5837–5854

    Article  Google Scholar 

  7. Yang X, Sun H, Sun X, Yan M, Guo Z, Fu K (2018) Position detection and direction prediction for arbitrary-oriented ships via multiscale rotation region convolutional neural network. IEEE Access 6:50839–50849

    Article  Google Scholar 

  8. Girshick R, Donahue J, Darrell T, Malik J (2016) Region-based convolutional networks for accurate object detection and segmentation. IEEE Trans Pattern Anal Mach Intell 38:142–158

    Article  Google Scholar 

  9. Qin, Y.; Lu, H.; Xu, Y.; Wang, H. Saliency detection via Cellular Automata. In Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA 7–12 June 2015; pp. 110–119.

  10. Zhu C, Zhou H, Wang R, Guo J (2010) A novel hierarchical method of ship detection from spaceborne optical image based on shape and texture features. IEEE Trans Geosci Remote Sens 48:3446–3456

    Article  Google Scholar 

  11. Mumtaz, A.; Jabbar, A.; Mahmood, Z. Saliency based algorithm for ship detection in infrared images. International Bhurban Conference on Applied Sciences & Technology, Islamabad, Pakistan, 10 March 2016; pp. 2151-1411

  12. Noh J, Bae W, Lee W et al (2020) Better to follow, follow to be better: towards precise supervision of feature super-resolution for small object detection. In: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), IEEE

  13. Hosang J, Benenson R, Dollár P (2015) What makes for effective detection proposals. IEEE Transactions Pattern Anal Mach Intell 38(4):814

    Article  Google Scholar 

  14. Ao W, Xu F, Li Y (2018) Detection and discrimination of ship targets in complex background from spaceborne ALOS-2 SAR Images. IEEE J Selected Topics Appl Earth Obser Remote Sens 11(2):536–550

    Article  Google Scholar 

  15. Chen CLP, Li H, Wei Y, Xia T, Tang YY (2014) A local contrast method for small infrared target detection. IEEE Trans Geosci Remote Sens 52(1):574–581

    Article  Google Scholar 

  16. Deng H, Sun X, Liu M (2016) Small infrared target detection based on weighted local difference measure. IEEE Transactions Geosci Remote Sens 54(7):4204–4214

    Article  Google Scholar 

  17. He H, Lin Y, Chen F, Tai H, Yin Z (2017) Inshore ship detection in remote sensing images via weighted pose voting. IEEE Trans Geosci Remote Sens 55(6):3091–3107

    Article  Google Scholar 

  18. Xia Y, Wan S, Yue L (2011) A novel algorithm for ship detection based on dynamic fusion model of multi-feature and support vector machine In Proceedings of the International Conference on Image & Graphics, Hefei, China, 12–15 August 2011; pp. 521–526

  19. Deng H, Sun X, Liu M (2016) Infrared small-target detection using multiscale gray difference weighted image entropy. IEEE Trans Aerosp Electron Syst 52:60–72

    Article  Google Scholar 

  20. Shi Z, Yu X, Jiang Z, Li B (2014) Ship detection in high-resolution optical imagery based on anomaly detector and local shape feature. IEEE Trans Geosci Remote Sens 52:4511–4523

    Article  Google Scholar 

  21. Greidanus H, Kourti N (2006) Findings of the DECLIMS project—detection and classification of marine traffic from space In Proceedings of the Advances in SAR Oceanography from Envisat and ERS Missions, Frascati, Italy, 23–26 January 2006

  22. Shi Z, Yu X, Jiang Z (2014) Ship detection in high-resolution optical imagery based on anomaly detector and local shape feature. IEEE Trans Geosci Remote Sens 52(8):4511–4523

    Article  Google Scholar 

  23. Liu Z, Wang H, Weng L, Yang Y (2016) Ship rotated bounding box space for ship extraction from high-resolution optical satellite images with complex backgrounds. Remote Sens 13(8):1074–1078

    Google Scholar 

  24. Martin DR, Fowlkes CC, Malik J (2004) Learning to detect natural image boundaries using local brightness color and texture cues IEEE Transactions Pattern Anal Mach Intell 26(5), 0–549

  25. Desolneux A, Moisan L, Morel JM (2001) Edge detection by Helmholtz principle. J Math Imag Vision 14(3):271–284

    Article  Google Scholar 

  26. Faghih F, Smith M (2002) Combining spatial and scale-space techniques for edge detection to provide a spatially adaptive wavelet-based noise filtering algorithm. IEEE Trans Image Process 11(9):1062–1071

    Article  MathSciNet  Google Scholar 

  27. Lopez-Molina C, Bustince H, Fernández J (2009) A t-norm based approach to edge detection. Bio-Inspired Syst Comput Ambient Intell 5517:302–309

    Article  Google Scholar 

  28. Viola PA, Jones MJ (2001) Rapid object detection using a boosted cascade of simple features Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001. Kauai, HI, USA. 15 April 2001; pp. 1063–6919

  29. Singh R, Vashisht M, Qamar S (2017) Role of linguistic quantifier and digitally approximated Laplace operator in infrared based ship detection. Int J Syst Assurance Eng Manag 8(1):1–7

    Article  Google Scholar 

  30. Gioi Von RG (2010) LSD: a fast line segment detector with a false detection control IEEE Transactions Softw Eng 32(4): 722–732.

  31. Brian J, Hanson AR (2009) Extracting straight lines. IEEE Transactions Pattern Anal Mach Intell 8:425–455

    Google Scholar 

  32. Deng H, Sun X, Liu M, Ye C, Zhou X (2016) Infrared small-target detection using multiscale gray difference weighted image entropy. IEEE Trans Aerosp Electron Syst 52:60–72

    Article  Google Scholar 

  33. Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu CY, Berg AC (2016) SSD: single shot multibox detector In Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands,8–16 October 2016; pp. 21–37

  34. Redmon J, Divvala, S, Girshick R, Farhadi A(2016) You only look once: unified, real-time object detection.In Proceedings of the Computer Vision and Pattern Recognition, Las Vegas Valley, NV, USA, 26 June–1 July, pp 779–788

  35. Cai Z, Vasconcelos N (2017) Cascade R-CNN: delving into high quality object detection[J] arXiv: Computer Vision and Pattern Recognition

  36. Dai J, Li Y, He K, Sun J (2016) R-FCN: object detection via region-based fully convolutional networks. In: NIPS'16: proceedings of the 30th international Conference on neural information processing systems, pp 379–387

  37. Zhang Y, Li B, Lu H, Irie A, Ruan X (2016) Sample-specific SVM learning for person re-identification 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2016, pp.1278-1287

  38. Noskov MV, Tutatchikov VS (2017) Modification of a two-dimensional fast Fourier transform algorithm with an analog of the Cooley-Tukey algorithm for image processing. Pattern Recognit Image Anal 27(1):110–113

    Article  Google Scholar 

  39. Akopian D (2017) Fast FFT based GPS satellite acquisition methods IEE Proceedings - Radar, Sonar and Navigation 152(4),277-286

  40. Bodla N, Singh B, Chellappa R (2017) Soft-NMS — improving object detection with one line of code. 2017 IEEE International Conference on Computer Vision (ICCV). Venice, Italy, 25 December 2017; pp. 2380–7504

  41. Zou Z, Shi Z (2016) Ship detection in spaceborne optical image with SVD networks. IEEE Trans Geosci Remote Sens 54(10):5832–5845

    Article  Google Scholar 

  42. Ren S, He K, Girshick R, Sun J (2015) Faster R-CNN: towards real-time object detection with region proposal networks. In Proceedings of the International Conference on Neural Information Processing Systems, Montreal, QC, Canada, 7–12 December 2015; pp. 91–99

  43. Liu Z, Wang H, Weng H, Yang L (2016) Ship rotated bounding box space for ship extraction from high-resolution optical satellite images with complex backgrounds. IEEE Geosci Remote Sens Lett 13(8):1074–1078

    Article  Google Scholar 

  44. Qi S, Ma J, Lin J, Li Y, Tian J (2015) Unsupervised ship detection based on saliency and S-HOG descriptor from optical satellite images. IEEE Geosci Remote Sens Lett 12(7):1451–1455

    Article  Google Scholar 

  45. Yang F, Xu Q, Li B et al (2018) Ship detection from thermal remote sensing imagery through region-based deep forest. IEEE Geosci Remote Sens Lett 15(3):449–453

    Article  Google Scholar 

  46. Pandey JG, Karmakar A, Shekhar C (2014) A novel architecture for FPGA implementation of Otsu's global automatic image thresholding algorithm. International Conference on Embedded Systems 300–305

  47. Huang DY, Lin TW, Hu WC (2010) Automatic threshold selection based on histogram Gaussian estimation method in FPGA. Int J Computer Sci Emerg Technol 4(1):2044–6004

    Google Scholar 

  48. Mahmood F, Toots M, Ofverstedt LG (2016) 2D discrete fourier transform with simultaneous edge artifact removal for real-time applications International Conference on Field Programmable Technology (FPT) 2016, pp.236–239

  49. Yu CL, Irick K, Chakrabarti C (2011) Multidimensional DFT IP generator for FPGA platforms. IEEE Trans Circuits Syst I Regul Pap 58(4):755–764

    Article  MathSciNet  Google Scholar 

  50. Ma Y, Cao Y, Vrudhula S, et al. (2018) Optimizing the convolution operation to accelerate deep neural networks on FPGA[J] IEEE Transactions Very Large Scale Integr (VLSI) Syst

  51. Lian X, Liu Z, Song Z, et al. (2019) High-performance fpga-based cnn accelerator with block-floating-point arithmetic[J] IEEE Transactions Very Large Scale Integr (VLSI) Syst

  52. Li CJ, Qu Z, Wang SY et al (2021) A method of cross-layer fusion multi-object detection and recognition based on improved faster R-CNN model in complex traffic environment. Pattern Recogn Lett 145(8):127–134

    Article  Google Scholar 

  53. Ma Y, Dong W (2016) Accelerating SVD computation on FPGAs for DSP systems[C]// 2016 IEEE 13th International Conference on Signal Processing (ICSP). IEEE, 2016

  54. Wang N, Li B, Xu Q et al (2018) Automatic ship detection in optical remote sensing images based on anomaly detection and SPP-PCANet. Remote Sens 11(1):47

    Article  Google Scholar 

  55. Jiang H, Miao R, Chen J et al (2019) A resource-efficient parallel architecture for infrared image stripe noise removal based on the most stable window[J]. Infrared Phys Technol 97:258–269

    Article  Google Scholar 

  56. Zhang C, Jiang H, Pan R et al (2020) High-throughput, resource-efficient multi-dimensional parallel architecture for space-borne sea-land segmentation. J Circ Syst Comput 30(2):1793–6454

    Google Scholar 

Download references

Acknowledgements

The authors would like to thank the anonymous reviewers for their constructive comments. This work was partially supported by the Industry-university-research Cooperation Fund of the Eighth Research Institute of China Aerospace Science and Technology Corporation (Grant no. SAST2020-068).

Author information

Authors and Affiliations

  1. Beijing Key Laboratory of Digital Media, School of Computer Science and Engineering, Beihang University, Beijing, 100191, China

    Rui Miao, Hongxu Jiang, Fangzheng Tian & Xiaobin Li

Authors
  1. Rui Miao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hongxu Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fangzheng Tian
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xiaobin Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Rui Miao.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Miao, R., Jiang, H., Tian, F. et al. High anti-interference and FPGA-oriented method for real-time ship detection based on structured LBP features. J Supercomput 78, 13780–13813 (2022). https://doi.org/10.1007/s11227-022-04400-y

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-022-04400-y

Keywords

Search

Navigation