skip to main content
10.1145/3594315.3594395acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiccaiConference Proceedingsconference-collections
research-article

Collaborative Global-Local Networks for Fine-Grained Few-shot Learning

Authors Info & Claims
Published:02 August 2023Publication History

ABSTRACT

In this paper, we focus on addressing the fine-grained few-shot learning task, which aims at recognizing the novel classes with a few fine-grained samples for each class, via learning a transfer model with some sample-rich base classes. Compared with the few-shot learning tasks on the coarse-grained classes, the fine-grained few-shot learning task is more challenging due to the intra-class dissimilarity and the inter-class similarity. To this end, we propose a Collaborative Global-Local Network (CGLNet) to exploit both global and local visual features for few-shot fine-grained classification. Through the features processing and multiple distance functions, the proposed CGLNet could effectively exploit the global and local information in features, thus it brings in benefits for the downstream few-shot tasks. To evaluate the effectiveness of the proposed approach, we conduct extensive experiments on three popular fine-grained datasets. The experimental results show that our model achieves superior performance to state-of-the-art methods.

References

  1. Chelsea Finn, Pieter Abbeel, and Sergey Levine. 2017. Model-agnostic meta-learning for fast adaptation of deep networks. In International conference on machine learning. PMLR, 1126–1135.Google ScholarGoogle Scholar
  2. Huaxi Huang, Junjie Zhang, Jian Zhang, Jingsong Xu, and Qiang Wu. 2020. Low-rank pairwise alignment bilinear network for few-shot fine-grained image classification. 23 (2020), 1666–1680.Google ScholarGoogle Scholar
  3. Zhong Ji, Xingliang Chai, Yunlong Yu, and Zhongfei Zhang. 2021. Reweighting and information-guidance networks for few-shot learning. 423 (2021), 13–23.Google ScholarGoogle Scholar
  4. Aditya Khosla, Nityananda Jayadevaprakash, Bangpeng Yao, and Fei-Fei Li. 2011. Novel dataset for fine-grained image categorization: Stanford dogs. In Proc. CVPR workshop on fine-grained visual categorization (FGVC), Vol. 2. Citeseer.Google ScholarGoogle Scholar
  5. Wenbin Li, Lei Wang, Jinglin Xu, Jing Huo, Yang Gao, and Jiebo Luo. 2019. Revisiting local descriptor based image-to-class measure for few-shot learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 7260–7268.Google ScholarGoogle ScholarCross RefCross Ref
  6. Wenbin Li, Jinglin Xu, Jing Huo, Lei Wang, Yang Gao, and Jiebo Luo. 2019. Distribution consistency based covariance metric networks for few-shot learning. In Proceedings of the AAAI conference on artificial intelligence, Vol. 33. 8642–8649.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Tsendsuren Munkhdalai, Xingdi Yuan, Soroush Mehri, and Adam Trischler. 2018. Rapid adaptation with conditionally shifted neurons. In International Conference on Machine Learning. PMLR, 3664–3673.Google ScholarGoogle Scholar
  8. M-E Nilsback and Andrew Zisserman. 2006. A visual vocabulary for flower classification. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’06), Vol. 2. IEEE, 1447–1454.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Victor Garcia Satorras and Joan Bruna Estrach. 2018. Few-Shot Learning with Graph Neural Networks. In International Conference on Learning Representations. 1–13.Google ScholarGoogle Scholar
  10. Christian Simon, Piotr Koniusz, Richard Nock, and Mehrtash Harandi. 2020. Adaptive subspaces for few-shot learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 4136–4145.Google ScholarGoogle ScholarCross RefCross Ref
  11. Jake Snell, Kevin Swersky, and Richard Zemel. 2017. Prototypical networks for few-shot learning. 30 (2017), 4077–4087.Google ScholarGoogle Scholar
  12. Flood Sung, Yongxin Yang, Li Zhang, Tao Xiang, Philip HS Torr, and Timothy M Hospedales. 2018. Learning to compare: Relation network for few-shot learning. In Proceedings of the IEEE conference on computer vision and pattern recognition. 1199–1208.Google ScholarGoogle ScholarCross RefCross Ref
  13. Oriol Vinyals, Charles Blundell, Timothy Lillicrap, and Daan Wierstra. 2016. Matching networks for one shot learning. 29 (2016), 3637–3645.Google ScholarGoogle Scholar
  14. Xiu-Shen Wei, Peng Wang, Lingqiao Liu, Chunhua Shen, and Jianxin Wu. 2019. Piecewise classifier mappings: Learning fine-grained learners for novel categories with few examples. 28, 12 (2019), 6116–6125.Google ScholarGoogle Scholar
  15. Peter Welinder, Steve Branson, Takeshi Mita, Catherine Wah, Florian Schroff, Serge Belongie, and Pietro Perona. 2010. Caltech-UCSD birds 200. (2010).Google ScholarGoogle Scholar
  16. Sanghyun Woo, Jongchan Park, Joon-Young Lee, and In So Kweon. [n.d.]. Cbam: Convolutional block attention module. In Proceedings of the European conference on computer vision (ECCV). 3–19.Google ScholarGoogle Scholar

Index Terms

  1. Collaborative Global-Local Networks for Fine-Grained Few-shot Learning

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      ICCAI '23: Proceedings of the 2023 9th International Conference on Computing and Artificial Intelligence
      March 2023
      824 pages
      ISBN:9781450399029
      DOI:10.1145/3594315

      Copyright © 2023 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 2 August 2023

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited
    • Article Metrics

      • Downloads (Last 12 months)27
      • Downloads (Last 6 weeks)2

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format .

    View HTML Format