Active Interactive Labelling Massive Samples for Object Detection
Article No.: 57, Pages 1 - 6
Abstract
Aerial object detection is the process of detecting objects in remote sensing images, such as aerial or satellite imagery. However, due to the unique characteristics and challenges of remote sensing images, such as large image sizes and dense distribution of small objects, annotating the data is time-consuming and costly. Active learning methods can reduce the cost of labeling data and improve the model’s generalization ability by selecting the most informative and representative unlabeled samples. In this paper, we studied how to apply active learning techniques to remote sensing object detection tasks and found that traditional active learning frameworks are not suitable. Therefore, we designed a remote sensing task-oriented active learning framework that can more efficiently select representative samples and improve the performance of remote sensing object detection tasks. In addition, we proposed an adaptive weighting loss to further improve the generalization ability of the model in unlabeled areas. A large number of experiments conducted on the remote sensing dataset DOTA-v2.0 showed that applying various classical active learning methods to the new active learning framework can achieve better performance.
References
[1]
William H Beluch, Tim Genewein, Andreas Nürnberger, and Jan M Köhler. 2018. The power of ensembles for active learning in image classification. In Proceedings of the IEEE conference on computer vision and pattern recognition. 9368–9377.
[2]
Lile Cai, Xun Xu, Jun Hao Liew, and Chuan Sheng Foo. 2021. Revisiting superpixels for active learning in semantic segmentation with realistic annotation costs. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 10988–10997.
[3]
Arantxa Casanova, Pedro O Pinheiro, Negar Rostamzadeh, and Christopher J Pal. 2020. Reinforced active learning for image segmentation. arXiv preprint arXiv:2002.06583 (2020).
[4]
Lixia Deng, Lingyun Bi, Hongquan Li, Haonan Chen, Xuehu Duan, Haitong Lou, Hongyu Zhang, Jingxue Bi, and Haiying Liu. 2023. Lightweight aerial image object detection algorithm based on improved YOLOv5s. Scientific Reports 13, 1 (2023), 7817.
[5]
Sai Vikas Desai and Vineeth N Balasubramanian. 2020. Towards fine-grained sampling for active learning in object detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. 924–925.
[6]
Jian Ding, Nan Xue, Gui-Song Xia, Xiang Bai, Wen Yang, Michael Ying Yang, Serge Belongie, Jiebo Luo, Mihai Datcu, Marcello Pelillo, 2021. Object detection in aerial images: A large-scale benchmark and challenges. IEEE transactions on pattern analysis and machine intelligence 44, 11 (2021), 7778–7796.
[7]
Sayna Ebrahimi, William Gan, Dian Chen, Giscard Biamby, Kamyar Salahi, Michael Laielli, Shizhan Zhu, and Trevor Darrell. 2020. Minimax active learning. arXiv preprint arXiv:2012.10467 (2020).
[8]
Jiaming Han, Jian Ding, Nan Xue, and Gui-Song Xia. 2021. Redet: A rotation-equivariant detector for aerial object detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2786–2795.
[9]
Huazhang Hu, Sixun Dong, Yiqun Zhao, Dongze Lian, Zhengxin Li, and Shenghua Gao. 2022. Transrac: Encoding multi-scale temporal correlation with transformers for repetitive action counting. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 19013–19022.
[10]
Yuansheng Hua, Lichao Mou, and Xiao Xiang Zhu. 2020. Relation network for multilabel aerial image classification. IEEE Transactions on Geoscience and Remote Sensing 58, 7 (2020), 4558–4572.
[11]
Chieh-Chi Kao, Teng-Yok Lee, Pradeep Sen, and Ming-Yu Liu. 2018. Localization-aware active learning for object detection. In Asian Conference on Computer Vision. Springer, 506–522.
[12]
Tejaswi Kasarla, Gattigorla Nagendar, Guruprasad M Hegde, Vineeth Balasubramanian, and CV Jawahar. 2019. Region-based active learning for efficient labeling in semantic segmentation. In 2019 IEEE Winter Conference on Applications of Computer Vision (WACV). IEEE, 1109–1117.
[13]
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2017. Imagenet classification with deep convolutional neural networks. Commun. ACM 60, 6 (2017), 84–90.
[14]
Dong Liang, Qixiang Geng, Zongqi Wei, Dmitry A Vorontsov, Ekaterina L Kim, Mingqiang Wei, and Huiyu Zhou. 2021. Anchor retouching via model interaction for robust object detection in aerial images. IEEE Transactions on Geoscience and Remote Sensing 60 (2021), 1–13.
[15]
Dong Liang, Jing-Wei Zhang, Ying-Peng Tang, and Sheng-Jun Huang. 2023. MUS-CDB: Mixed Uncertainty Sampling with Class Distribution Balancing for Active Annotation in Aerial Object Detection. IEEE Transactions on Geoscience and Remote Sensing (2023).
[16]
Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C Lawrence Zitnick. 2014. Microsoft coco: Common objects in context. In Computer Vision–ECCV 2014: 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceedings, Part V 13. Springer, 740–755.
[17]
Qi Ming, Lingjuan Miao, Zhiqiang Zhou, Junjie Song, Yunpeng Dong, and Xue Yang. 2023. Task interleaving and orientation estimation for high-precision oriented object detection in aerial images. ISPRS Journal of Photogrammetry and Remote Sensing 196 (2023), 241–255.
[18]
Pengzhen Ren, Yun Xiao, Xiaojun Chang, Po-Yao Huang, Zhihui Li, Brij B Gupta, Xiaojiang Chen, and Xin Wang. 2021. A survey of deep active learning. ACM computing surveys (CSUR) 54, 9 (2021), 1–40.
[19]
Soumya Roy, Asim Unmesh, and Vinay P Namboodiri. 2018. Deep active learning for object detection. In BMVC. 91.
[20]
Burr Settles. 2009. Active learning literature survey. (2009).
[21]
Samarth Sinha, Sayna Ebrahimi, and Trevor Darrell. 2019. Variational adversarial active learning. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 5972–5981.
[22]
Ying-Peng Tang, Xiu-Shen Wei, Borui Zhao, and Sheng-Jun Huang. 2021. Qbox: Partial transfer learning with active querying for object detection. IEEE Transactions on Neural Networks and Learning Systems (2021).
[23]
Qi Wang, Yanfeng Liu, Zhitong Xiong, and Yuan Yuan. 2022. Hybrid feature aligned network for salient object detection in optical remote sensing imagery. IEEE Transactions on Geoscience and Remote Sensing 60 (2022), 1–15.
[24]
Zongqi Wei, Dong Liang, Dong Zhang, Liyan Zhang, Qixiang Geng, Mingqiang Wei, and Huiyu Zhou. 2022. Learning calibrated-guidance for object detection in aerial images. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 15 (2022), 2721–2733.
[25]
Guang Xu, Xuan Zhu, and Nigel Tapper. 2020. Using convolutional neural networks incorporating hierarchical active learning for target-searching in large-scale remote sensing images. International Journal of Remote Sensing 41, 11 (2020), 4057–4079.
[26]
Nuo Xu, Chunlei Huo, Jiacheng Guo, Yiwei Liu, Jian Wang, and Chunhong Pan. 2021. Adaptive remote sensing image attribute learning for active object detection. In 2020 25th International Conference on Pattern Recognition (ICPR). IEEE, 111–118.
[27]
Haibo Ye, Xinjie Li, Yuan Yao, and Hanghang Tong. 2023. Towards robust neural graph collaborative filtering via structure denoising and embedding perturbation. ACM Transactions on Information Systems 41, 3 (2023), 1–28.
[28]
Haibo Ye, Fangyu Zhou, Xinjie Li, and Qingheng Zhang. 2023. Balanced Mixup Loss for Long-Tailed Visual Recognition. In ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 1–5.
[29]
Fangneng Zhan, Yingchen Yu, Rongliang Wu, Jiahui Zhang, Shijian Lu, and Changgong Zhang. 2022. Marginal contrastive correspondence for guided image generation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 10663–10672.
[30]
Lefei Zhang and Liangpei Zhang. 2022. Artificial Intelligence for Remote Sensing Data Analysis: A Review of Challenges and Opportunities. IEEE Geoscience and Remote Sensing Magazine Early Access (2022), 1–16.
Index Terms
- Active Interactive Labelling Massive Samples for Object Detection
Recommendations
Weakly Supervised Object Detection Based on Active Learning
AbstractWeakly supervised object detection which reduces the need for strong supersivison during training has recently made significant achievements. However, it remains a challenging issue due to the time-consuming and labor-intensive problems in ...
Object Recognition Consistency in Regression for Active Detection
AbstractActive learning has achieved great success in image classification because of selecting the most informative samples for data labeling and model training. However, the potential of active learning has been far from being realised in object ...
Consistency-Based Semi-supervised Active Learning: Towards Minimizing Labeling Cost
Computer Vision – ECCV 2020AbstractActive learning (AL) combines data labeling and model training to minimize the labeling cost by prioritizing the selection of high value data that can best improve model performance. In pool-based active learning, accessible unlabeled data are not ...
Comments
Information & Contributors
Information
Published In
October 2023
505 pages
ISBN:9798400702815
DOI:10.1145/3607822
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 13 October 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
Acceptance Rates
Overall Acceptance Rate 86 of 279 submissions, 31%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 80Total Downloads
- Downloads (Last 12 months)45
- Downloads (Last 6 weeks)8
Reflects downloads up to 08 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format