Jian Huang
ABSTRACT
With the continuous development of deep learning in computer vision, object detection technology is constantly employed for processing remote sensing images. Especially, ship detection has become a significant and challenging task due to complex environmental factors (strong waves, clouds interference, etc.) and object issues (orientation, scale variety, density, etc.). Current detection methods pay more attention to the detection accuracy while ignoring the detection speed. In contrast with accuracy, detection speed is more important in some cases such as marine rescue and vessel tracking. Aiming at addressing these problems, we propose an enhanced YOLOv4(C-YOLOv4) which contains the feature fusion attention module (FAM) with a channel correlation loss(C-loss). C-loss is proposed to constrain the relations between object classes and channels while maintaining the intra-class and the inter-class separability. To evaluate the effectiveness of the proposed approach, comprehensive experiments are conducted on a public dataset HRSC2016. According to the experimental results, our proposed approach outperforms the baselines.
- Fan Y , Wen Q , Wang W , Quantifying Disaster Physical Damage Using Remote Sensing Data—A Technical Work Flow and Case Study of the 2014 Ludian Earthquake in China[J]. International Journal of Disaster Risk Science, 2017, 8(4):1-18.Google Scholar
- Martinuzzi S , Gould W A , OMR González. Land development, land use, and urban sprawl in Puerto Rico integrating remote sensing and population census data[J]. Landscape & Urban Planning, 2007, 79(3):288-297.Google ScholarCross Ref
- Durieux L , Lagabrielle E , Nelson A . A method for monitoring building construction in urban sprawl areas using object-based analysis of Spot 5 images and existing GIS data[J]. Isprs Journal of Photogrammetry & Remote Sensing, 2008, 63(4):399-408.Google ScholarCross Ref
- Chen C , He C , Hu C , A Deep Neural Network Based on an Attention Mechanism for SAR Ship Detection in Multiscale and Complex Scenarios[J]. IEEE Access, 2019, PP(99):1-1.Google Scholar
- Jiexiong, Tang, Chenwei, Compressed-Domain Ship Detection on Spaceborne Optical Image Using Deep Neural Network and Extreme Learning Machine.[J]. IEEE Transactions on Geoscience & Remote Sensing, 2015.Google Scholar
- Nie, T.; He, B.; Bi, G.; Zhang, Y.; Wang, W. A Method of Ship Detection under Complex Background. ISPRS Int. J. Geo-Inf. 2017, 6, 159. https://doi.org/10.3390/ijgi6060159Google ScholarCross Ref
- Chen L , Shi W , Fan C , A Novel Coarse-to-Fine Method of Ship Detection in Optical Remote Sensing Images Based on a Deep Residual Dense Network[J]. Remote Sensing, 2020, 12(19):3115.Google ScholarCross Ref
- Wang W , Fu Y , Feng D , Remote sensing ship detection technology based on DoG preprocessing and shape features[C]// 2017 3rd IEEE International Conference on Computer and Communications (ICCC). IEEE, 2017.Google Scholar
- Nie, T.; He, B.; Bi, G.; Zhang, Y.; Wang, W. A method of ship detection under complex background. ISPRS Int. J. Geo-Inf. 2017, 6,159.Google ScholarCross Ref
- Feng Y , Xu Q , Bo L . Ship Detection From Optical Satellite Images Based on Saliency Segmentation and Structure-LBP Feature[J]. IEEE Geoscience and Remote Sensing Letters, 2017, 14(5):602-606. [1] Feng Y , Xu Q , Bo L . Ship Detection From Optical Satellite Images Based on Saliency Segmentation and Structure-LBP Feature[J]. IEEE Geoscience and Remote Sensing Letters, 2017, 14(5):602-606.Google ScholarCross Ref
- Qi S , Ma J , Lin J , Unsupervised Ship Detection Based on Saliency and S-HOG Descriptor From Optical Satellite Images[J]. IEEE Geoscience & Remote Sensing Letters, 2015, 12(7):1451-1455.Google Scholar
- A Novel Algorithm for Ship Detection Based on Dynamic Fusion Model of Multi-feature and Support Vector Machine[C]// 2011 Sixth International Conference on Image and Graphics. IEEE, 2011.Google Scholar
- Xu J , Sun X , Zhang D , Automatic Detection of Inshore Ships in High-Resolution Remote Sensing Images Using Robust Invariant Generalized Hough Transform[J]. IEEE Geoscience & Remote Sensing Letters, 2014, 11(12):2070-2074.Google Scholar
- Krizhevsky, A., Sutskever, I., & Hinton, G.E. (2012). ImageNet classification with deep convolutional neural networks. Communications of the ACM, 60, 84 - 90.Google Scholar
- Huang G , Liu Z , Laurens V , Densely Connected Convolutional Networks[J]. IEEE Computer Society, 2016.Google Scholar
- Simonyan K , Zisserman A . Very Deep Convolutional Networks for Large-Scale Image Recognition[J]. Computer Science, 2014.Google Scholar
- Lin H , Shi Z , Zou Z . Fully Convolutional Network With Task Partitioning for Inshore Ship Detection in Optical Remote Sensing Images[J]. IEEE Geoscience and Remote Sensing Letters, 2017:1-5.Google Scholar
- Yuan Y , Jiang Z , Zhang H , Ship detection in optical remote sensing images based on deep convolutional neural networks[J]. Journal of Applied Remote Sensing, 2017, 11(4):1.Google Scholar
- Liu W , Ma L , Chen H . Arbitrary-Oriented Ship Detection Framework in Optical Remote-Sensing Images[J]. IEEE Geoscience and Remote Sensing Letters, 2018:1-5.Google Scholar
- Wang Z , Y Zhou, Wang F , SDGH-Net: Ship Detection in Optical Remote Sensing Images Based on Gaussian Heatmap Regression[J]. Remote Sensing, 2021, 13(3):499.Google ScholarCross Ref
- Girshick, R.; Donahue, J.; Darrell, T.; Malik, J. Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. In Proceedings of the CVPR, Columbus, OH, USA, 24–27 June 2014.Google ScholarDigital Library
- Girshick, R. Fast r-cnn. In Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile, 11–18 December 2015; pp. 1440–1448Google ScholarDigital Library
- Ren S , He K , Girshick R , Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2017, 39(6):1137-1149.Google ScholarDigital Library
- Liu W , Anguelov D , Erhan D , SSD: Single Shot MultiBox Detector[J]. European Conference on Computer Vision, 2016.Google ScholarCross Ref
- Redmon J , Divvala S , Girshick R , You Only Look Once: Unified, Real-Time Object Detection[J]. IEEE, 2016.Google Scholar
- Redmon J , Farhadi A . YOLO9000: Better, Faster, Stronger[C]// IEEE Conference on Computer Vision & Pattern Recognition. IEEE, 2017:6517-6525.Google Scholar
- Redmon J , Farhadi A . YOLOv3: An Incremental Improvement[J]. arXiv e-prints, 2018.Google Scholar
- Bochkovskiy A , Wang C Y , Liao H . YOLOv4: Optimal Speed and Accuracy of Object Detection[J]. 2020.Google Scholar
- Lin T Y , Goyal P , Girshick R , Focal Loss for Dense Object Detection[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2017, PP(99):2999-3007.Google Scholar
- Law H , Deng J . CornerNet: Detecting Objects as Paired Keypoints[J]. International Journal of Computer Vision, 2020, 128(3):642-656.Google ScholarCross Ref
- Zhou X , Wang D , P Krhenbühl. Objects as Points[J]. 2019.Google Scholar
- Tian Z , Shen C , Chen H , FCOS: Fully Convolutional One-Stage Object Detection[C]// 2019 IEEE/CVF International Conference on Computer Vision (ICCV). IEEE, 2020.Google Scholar
- Yao, Y.; Jiang, Z.; Zhang, H.; Zhao, D.; Cai, B. Ship detection in optical remote sensing images based on deep convolutional neural networks. J. Appl. Remote Sens. 2017, 11, 042611.Google ScholarCross Ref
- Yang, X.; Sun, H.; Fu, K.; Yang, J.; Sun, X.; Yan, M.; Guo, Z. Automatic ship detection in remote sensing images from google earth of complex scenes based on multiscale rotation dense feature pyramid networks. Remote Sens. 2018, 10, 132.Google ScholarCross Ref
- Guo, H.Y.; Yang, X.; Wang, N.N.; Song, B.; Gao, X.B. A rotational libra R-CNN method for ship detection. IEEE Trans. Geosci. Remote Sens. 2020, 58, 5772–5781.Google ScholarCross Ref
- Tang, G.; Liu, S.; Fujino, I.; Claramunt, C.; Wang, Y.; Men, S. H-YOLO: A single-shot ship detection approach based on region of interest preselected network. Remote Sens. 2020, 12, 4192.Google ScholarCross Ref
- Yang X , Liu Q , Yan J , R3Det: Refined Single-Stage Detector with Feature Refinement for Rotating Object[J]. 2019.Google Scholar
- Nina W , Condori W , Machaca V , Small Ship Detection on Optical Satellite Imagery with YOLO and YOLT[M]. 2020.Google ScholarCross Ref
- Etten A V . You Only Look Twice: Rapid Multi-Scale Object Detection In Satellite Imagery[J]. 2018.Google Scholar
- Liu S , Qi L , Qin H , Path Aggregation Network for Instance Segmentation[C]// 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2018.Google Scholar
- Li Y , Chen Y , Wang N , Scale-Aware Trident Networks for Object Detection[C]// 2019 IEEE/CVF International Conference on Computer Vision (ICCV). IEEE, 2019.Google Scholar
- F Yu, Koltun V . Multi-Scale Context Aggregation by Dilated Convolutions[J]. 2016.Google Scholar
- Liu, Z.; Yuan, L.; Weng, L.; Yang, Y. A high resolution optical satellite image dataset for ship recognition and some new baselines. In Proceedings of the 6th International Conference on Pattern Recognition Application and Methods (ICPRAM 2017), Porto, Portugal, 24–26 February 2017; pp. 324–331.Google ScholarCross Ref
- Tan, M.; Le, Q.V. Efficientnet: Rethinking model scaling for convolutional neural networks. arXiv 2019, arXiv:1905.11946.Google Scholar
Recommendations
Attention-Based Convolutional Networks for Ship Detection in High-Resolution Remote Sensing Images
Pattern Recognition and Computer VisionAbstractEnvironmental information, like sea-land distribution, plays an important role in detecting ships from remote sensing images. However, the huge scale difference between environments and ship targets makes current CNN-based detection models hard to ...
Multi-layer Sparse Coding Based Ship Detection for Remote Sensing Images
IRI '15: Proceedings of the 2015 IEEE International Conference on Information Reuse and IntegrationWith the development of remote sensing technology, it becomes possible for the detection and identification of targets from remote sensing images. In this paper, we propose a new method integrating the bottom-up and the top-down mechanisms for the ship ...
Performance analysis of different DCNN models in remote sensing image object detection
AbstractIn recent years, deep learning, especially deep convolutional neural networks (DCNN), has made great progress. Many researchers use different DCNN models to detect remote sensing targets. Different DCNN models have different advantages and ...
Comments