Skip to main content
Log in

Ship recognition method combined with image segmentation and deep learning feature extraction in video surveillance

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

To solve the problem of ship recognition in video images, a ship recognition method based on Morphological Watershed image segmentation and Zemike moment is proposed. Firstly, the video frame image is pre-processed by gray algorithm, and then the gray image is filtered by wavelet transform to remove noise. After denoising, the Morphological Watershed algorithm is used to segment the image and extract the ship area in the image. Next, the feature of ship image is extracted based on deep learning convolution neural network (CNN) and Zemike moment method. Finally, the KNN-SVM classifier is trained according to the image features and class labels to realize the automatic recognition of ships. Experimental results show that the method can effectively identify 3 types of ships, with an average detection accuracy of 87%.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. An T, Yang Z, Li YQ (2014) Research on the detection and tracking method of ship intrusion and remaining[J]. Appl Mech Mater 536-537:148–152

    Article  Google Scholar 

  2. Anand RS, Kumar P (2009) Flaw detection in radiographic weldment images using morphological watershed segmentation technique[J]. NDT E Int 42(1):2–8

    Article  Google Scholar 

  3. Caponetti L, Castellano G, Basile MT et al (2014) Fuzzy mathematical morphology for biological image segmentation[J]. Appl Intell 41(1):117–127

    Article  Google Scholar 

  4. Deng G, Liu Z (2016) A wavelet image denoising based on the new threshold function[C]// International Conference on Computational Intelligence and Security. IEEE 158–161

  5. Ismael SH, Mustafa FM, Okümüs IT (2016) A New approach of image denoising based on discrete wavelet transform[C]// Computer Applications & Research. IEEE 36–40

  6. Jain P, Tyagi V (2017) An adaptive edge-preserving image denoising technique using patch-based weighted-SVD filtering in wavelet domain[J]. Multimed Tools Appl 76(2):1–21

    Article  Google Scholar 

  7. Lee HJ, Huang LF, Chen Z (1990) Multi-frame ship detection and tracking in an infrared image sequence[J]. Pattern Recogn 23(7):785–798

    Article  Google Scholar 

  8. Li X, Song A (2010) A new edge detection method using Gaussian-Zemike moment operator[C]// International Asia Conference on Informatics in Control, Automation and Robotics. IEEE 276–279

  9. Mi C, Shen Y, Mi W et al (2015) Ship identification algorithm based on 3D point cloud for automated ship loaders[J]. J Coast Res 73:28–34

    Article  Google Scholar 

  10. Nandi A (2016) Detection of human brain tumour using MRI image segmentation and morphological operators[C]// IEEE International Conference on Computer Graphics, Vision and Information Security. IEEE 55–60

  11. Nugroho HA, Yusufiyah HKN, Adji TB et al (2016) Zemike moment feature extraction for classifying lesion’s shape of breast ultrasound images[C]// International Conference on Information Technology and Electrical Engineering. IEEE 458–463

  12. Rahman HAA, Wah YB, He H et al (2015) Comparisons of ADABOOST, KNN, SVM and logistic regression in classification of imbalanced dataset[C]// International Conference on Soft Computing in Data Science. Springer Singapore 54–64

  13. Rainey K, Reeder JD, Corelli AG (2016) Convolution neural networks for ship type recognition[C]. SPIE Defense + Security 9844:09

    Google Scholar 

  14. Saluja R, Boyat A (2016) Wavelet based image denoising using weighted highpass filtering coefficients and adaptive wiener filter[C]// International Conference on Computer, Communication and Control. IEEE 1–6

  15. Shi T, Yang L, Liu Z (2013) A moving ship detection based on edge information of single image and background subtraction[C]// MIPPR 2013: Pattern Recognition and Computer Vision. International Society for Optics and Photonics 891900

  16. Song Q, Ma L, Cao J et al (2016) Image denoising based on mean filter and wavelet transform[C]// International Conference on Advanced Information Technology and Sensor Application. IEEE 39–42

  17. Xia Y, Wan S, Yue L (2011) A Novel algorithm for ship detection based on dynamic fusion model of multi-feature and support vector machine[C]// International Conference on Image & Graphics. IEEE Computer Society 521–526

  18. Xie L, Chen J, Yan Z et al (2013) A new method of Inland River overloaded ship identification using digital image processing[J]. Lect Notes Electr Eng 220:499–506

    Article  Google Scholar 

  19. Yan F, Mei W, Zhang C (2009) SAR image target recognition based on Hu invariant moments and SVM[C]// International Conference on Information Assurance and Security. IEEE 585–588

  20. Yao Y, Jiang Z, Zhao D (2017) Ship detection in optical remote sensing images based on deep convolutional neural networks[J]. J Appl Remote Sens 11(4):1–7

    Article  Google Scholar 

Download references

Acknowledgements

The work was partially supported by National Natural Science Foundation of China (Grant No. 51479155), Natural Science Foundation of Hubei Province of China (Grant No.2014CFB190), Science and Technology Department of Bijie City of China (Grant No.29[2014]), Education and Teaching Reform Project of China University of Labor Relations [Grant No. JG1739].

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xiufeng Cao.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cao, X., Gao, S., Chen, L. et al. Ship recognition method combined with image segmentation and deep learning feature extraction in video surveillance. Multimed Tools Appl 79, 9177–9192 (2020). https://doi.org/10.1007/s11042-018-7138-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-7138-3

Keywords

Navigation