Abstract
Fine-grained visual classification task is challenging due to large variation in the appearance of the same subcategories and similarity in the appearance of different subcategories. To tackle the challenges, locating multiple discriminative regions plays a critical role. However, most previous works ignore the impact of background, which may provide negative clues that are not necessary or harmful for the network to classification. In this paper, we propose Foreground Feature Enhancement (FFE) module and Peak & Background Suppression (PBS) module, which are inserted in different layers of the CNN. The FFE module is designed to enhance and extract the most discriminative feature in the feature maps, and the PBS module is employed to suppress the peak features and background noise in the feature maps, forcing the network to mine other equally important features. Our proposed method can be trained end-to-end and does not require bounding boxes/part annotations. The experimental results achieve competitive performances on CUB200-2011, FGVC Aircraft, and Stanford Cars datasets.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Wah, C., Branson, S., Welinder, P., Perona, P.,Belongie, S.: The caltech-ucsd birds-200–2011 dataset. Tech. Rep. CNS-TR-2010–001, California Institute of Technology (2011)
Krause, J., Stark, M., Deng, J.,Fei-Fei, L.: 3d object representations for fine-grained categorization. In: Proceedings of the IEEE international conference on computer vision workshops, pp. 554–561. IEEE, Sydney, Australia (2013)
Maji, S., Rahtu, E., Kannala, J., Blaschko, M.,Vedaldi, A.: Fine-grained visual classification of aircraft. arXiv preprint arXiv:1306.5151 (2013)
Yang, Z., Luo, T., Wang, D., Hu, Z., Gao, J.,Wang, L.: Learning to navigate for fine-grained classification. In: Proceedings of the European conference on computer vision (ECCV), pp. 420–435 (2018). https://doi.org/10.1007/978-3-030-01264-9_26
Yang, S., Liu, S., Yang, C.,Wang, C.: Re-rank coarse classification with local region enhanced features for fine-grained image recognition. arXiv preprint arXiv:2102.09875 (2021)
Ding, Y., Zhou, Y., Zhu, Y., Ye, Q.,Jiao, J.: Selective sparse sampling for fine-grained image recognition. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 6599–6608. IEEE, Seoul, Korea (South) (2019)
Liu, M., Zhang, C., Bai, H., Zhang, R., Zhao, Y.: Cross-part learning for fine-grained image classification. IEEE Trans. Image Process. 31, 748–758 (2021). https://doi.org/10.1109/tip.2021.3135477
Zheng, H., Fu, J., Mei, T.,Luo, J.: Learning multi-attention convolutional neural network for fine-grained image recognition. In: Proceedings of the IEEE international conference on computer vision, pp. 5209–5217. IEEE, Venice, Italy (2017)
Luo, W., Yang, X., Mo, X., Lu, Y., Davis, L.S., Li, J., et al.: Cross-x learning for fine-grained visual categorization. In: Proceedings of the IEEE/CVF international conference on computer vision, pp. 8242–8251. IEEE, Seoul, Korea (South) (2019)
Zhuang, P., Wang, Y.,Qiao, Y.: Learning attentive pairwise interaction for fine-grained classification. In: Proceedings of the AAAI conference on artificial intelligence, pp. 13130–13137 (2020). https://doi.org/10.1609/aaai.v34i07.7016
Ji, R., Wen, L., Zhang, L., Du, D., Wu, Y., Zhao, C., et al.: Attention convolutional binary neural tree for fine-grained visual categorization. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10468–10477. IEEE, Seattle, WA, USA (2020)
Ai, D., Han, X., Ruan, X.,Chen, Y.: Color independent components based SIFT descriptors for object/scene classification. IEICE transactions on information and systems 93(9), 2577–2586 (2010)
Kerdvibulvech, C.: Real-time augmented reality application using color analysis. In: 2010 IEEE Southwest Symposium on Image Analysis & Interpretation (SSIAI), pp. 29–32. IEEE, Austin, USA (2010)
Zhang, F., Li, M., Zhai, G., Liu, Y.: Multi-branch and multi-scale attention learning for fine-grained visual categorization. In: MultiMedia Modeling: 27th International Conference, MMM 2021, pp. 136–147. Springer, Prague, Czech Republic (2021)
Sun, G., Cholakkal, H., Khan, S., Khan, F.,Shao, L.: Fine-grained recognition: Accounting for subtle differences between similar classes. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 12047–12054 (2020). https://doi.org/10.1609/aaai.v34i07.6882
Song, J.,Yang, R.: Feature boosting, suppression, and diversification for fine-grained visual classification. In: 2021 International Joint Conference on Neural Networks (IJCNN), pp. 1–8. IEEE, Shenzhen, China (2021). https://doi.org/10.1109/ijcnn52387.2021.9534004
Do, T., Tran, H., Tjiputra, E., Tran, Q.D.,Nguyen, A.: Fine-grained visual classification using self assessment classifier. arXiv preprint arXiv:2205.10529 (2022)
Chou, P.-Y., Kao, Y.-Y.,Lin, C.-H.: Fine-grained Visual Classification with High-temperature Refinement and Background Suppression. arXiv preprint arXiv:2303.06442 (2023)
Woo, S., Park, J., Lee, J.-Y.,Kweon, I.S.: Cbam: Convolutional block attention module. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 3–19 (2018) https://doi.org/10.1007/978-3-030-01234-2_1
He, K., Zhang, X., Ren, S.,Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Liu, C., Xie, H., Zha, Z.-J., Ma, L., Yu, L., Zhang, Y.: Filtration and distillation: Enhancing region attention for fine-grained visual categorization. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 11555–11562 (2020). https://doi.org/10.1609/aaai.v34i07.6822
Lin, T.-Y., RoyChowdhury, A.,Maji, S.: Bilinear CNN models for fine-grained visual recognition. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1449–1457. IEEE, Santiago, Chile (2015)
Zheng, H., Fu, J., Zha, Z.-J., Luo, J.: Learning deep bilinear transformation for fine-grained image representation. Adv. Neural. Inf. Process. Syst. 32, 4277–4286 (2019)
Gao, Y., Han, X., Wang, X., Huang, W.,Scott, M.: Channel interaction networks for fine-grained image categorization. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 10818–10825 (2020)
Fu, J., Zheng, H.,Mei, T.: Look closer to see better: recurrent attention convolutional neural network for fine-grained image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4438–4446. IEEE, Honolulu, USA (2017)
Sun, M., Yuan, Y., Zhou, F.,Ding, E.: Multi-attention multi-class constraint for fine-grained image recognition. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 805–821 (2018). https://doi.org/10.1007/978-3-030-01270-0_49
Chen, Y., Bai, Y., Zhang, W.,Mei, T.: Destruction and construction learning for fine-grained image recognition. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 5157–5166. IEEE, Long Beach, CA, USA (2019). https://doi.org/10.1109/CVPR.2019.00530
Wang, Z., Wang, S., Li, H., Dou, Z.,Li, J.: Graph-propagation based correlation learning for weakly supervised fine-grained image classification. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 12289–12296 (2020) https://doi.org/10.1609/aaai.v34i07.6912
Liang, Y., Zhu, L., Wang, X.,Yang, Y.: A simple episodic linear probe improves visual recognition in the wild. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 9559–9569, New Orleans, LA, USA (2022)
Liang, Y., Zhu, L., Wang, X.,Yang, Y.: Penalizing the hard example but not too much: a strong baseline for fine-grained visual classification. IEEE Trans. Neural Networks Learn. Syst., 1–12 (2022). https://doi.org/10.1109/tnnls.2022.3213563
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Yu, D., Fang, Z., Jiang, Y. (2024). Foreground Feature Enhancement and Peak & Background Suppression for Fine-Grained Visual Classification. In: Rudinac, S., et al. MultiMedia Modeling. MMM 2024. Lecture Notes in Computer Science, vol 14554. Springer, Cham. https://doi.org/10.1007/978-3-031-53305-1_11
Download citation
DOI: https://doi.org/10.1007/978-3-031-53305-1_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-53304-4
Online ISBN: 978-3-031-53305-1
eBook Packages: Computer ScienceComputer Science (R0)