skip to main content
10.1145/3704323.3704366acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiccprConference Proceedingsconference-collections
research-article

A Few-Shot Image Classification Algorithm Combining Graph Neural Network and Attention Mechanism

Published: 07 January 2025 Publication History

Abstract

Deep learning has achieved success in various applications, depending on the abundance of training data. However, in practical applications, it is challenging to gather a substantial number of training samples. We employ few-shot learning algorithm to tackle this issue. Graph neural network can effectively capture the intra-class similarities and inter-class differences, which is highly beneficial for few-shot learning. This paper introduces an enhanced architecture based on graph neural network. Initially, we utilize a pre-trained residual network to extract features, which serve as the initial node features. And the similarity information between node features is defined as edge features. Subsequently, the graph neural network iteratively updates node features and edge features. Finally, we incorporate an attention mechanism into the metric network to compute the similarity of node features, which is used for classifying test samples. The attention mechanism can mitigate the interference from irrelevant information of neighbouring nodes, thereby improving the robustness and performance of the algorithm. Experiments demonstrate that our algorithm exhibits excellent performance in few-shot image classification.

References

[1]
Liu Y, Lee J, Park M, et al. 2019. Learning to propagate labels: transductive propagation network for few-shot learning. International Conference on Learning Representations, 2019.
[2]
Schwartz E, Karlinsky L, Shtok J, et al. 2018. Delta-encoder: an effective sample synthesis method for few-shot object recognition. Advances in Neural Information Processing Systems, 2018: 2845-2855.
[3]
Wang P, Liu L, Shen C, et al. 2017. Multi-attention network for one shot learning. IEEE Conference on Computer Vision and Pattern Recognition. 2017: 2721-2729.
[4]
Wang B, Li L, Verma M, et al. 2023. Match them up: visually explainable few-shot image classification. Applied Intelligence. 2023, 53(9): 10956-10977.
[5]
Kim J, Kang S, Hwang D, et al. 2023. VNE: an effective method for improving deep representation by manipulating eigenvalue distribution. IEEE Conference on Computer Vision and Pattern Recognition. 2023: 3799-3810.
[6]
Vinyals O, Blundell C, Lillicrap T, et al. 2016. Matching networks for one shot learning. Advances in Neural Information Processing Systems, 2016, 29: 3630-3638.
[7]
Snell J, Swersky K, Zemel R. 2017. Prototypical networks for few-shot learning. Advances in Neural Information Processing Systems, 2017: 4077-4087.
[8]
Ren M, Triantafillou E, Ravi S, et al. 2018. Meta-learning for semi-supervised few-shot classification. International Conference on Learning Representations, 2018.
[9]
Huang K, Geng J, Jiang W, et al. 2021. Pseudo-loss Confidence Metric for Semi-supervised Few-shot Learning. International Conference on Computer Vision. 2021: 8651-8660.
[10]
Finn C, Abbeel P, Levine S. 2017. Model-agnostic meta-learning for fast adaptation of deep networks. International Conference on Machine Learning. 2017: 1126-1135.
[11]
Jamal M A, Qi G J. 2019. Task-agnostic meta-learning for few-shot learning. IEEE Conference on Computer Vision and Pattern Recognition. 2019: 11719-11727.
[12]
Chijiwa D, Yamaguchi S, Kumagai A, et al. 2022. Meta-ticket: finding optimal subnetworks for few-shot learning within randomly initialized neural networks. Advances in Neural Information Processing Systems. 2022: 25264-25277.
[13]
Kang S, Hwang H, Eo M, et al. 2023. Meta-Learning with a geometry-adaptive preconditioner. IEEE Conference on Computer Vision and Pattern Recognition, 2023: 16080-16090.
[14]
Garcia V, Bruna J. 2018. Few-shot learning with graph neural networks. International Conference on Learning Representations, 2018.
[15]
Kim J, Kim T, Kim S, et al. 2019. Edge-labeling graph neural network for few-shot learning. IEEE Conference on Computer Vision and Pattern Recognition. 2019: 11-20.
[16]
Hassani K. 2022. Cross-domain few-shot graph classification. AAAI Conference on Artificial Intelligence. 2022: 6856-6864.
[17]
Wang S, Chen C, Li J D. 2022. Graph few-shot learning with task-specific structures. Advances in Neural Information Processing Systems. 2022: 38925-38934.
[18]
Yu X, Fang Y, Liu Z, et al. 2024. HGPrompt: bridging homogeneous and heterogeneous graphs for few-shot prompt learning. AAAI Conference on Artificial Intelligence. 2024: 16578-16586.
[19]
He K, Zhang X, Ren S, et al. 2016. Deep residual learning for image recognition. IEEE Conference on Computer Vision and Pattern Recognition. 2016: 770-778.
[20]
Hu J, Shen L, Sun G. 2018. Squeeze-and-excitation networks. IEEE Conference on Computer Vision and Pattern Recognition. 2018: 7132-7141.
[21]
Buhrmester M, Kwang T, Gosling S D. 2011. Amazon's mechanical turk: a new source of inexpensive, yet high-quality data? Perspectives on Psychological Science, 2011, 6(1): 3-5.
[22]
Deng J. 2009. A large-scale hierarchical image database. IEEE Conference on Computer Vision and Pattern Recognition. 2009: 248-255.

Index Terms

  1. A Few-Shot Image Classification Algorithm Combining Graph Neural Network and Attention Mechanism

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    ICCPR '24: Proceedings of the 2024 13th International Conference on Computing and Pattern Recognition
    October 2024
    448 pages
    ISBN:9798400717482
    DOI:10.1145/3704323
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 07 January 2025

    Check for updates

    Author Tags

    1. Attention Mechanism
    2. Few-shot Learning
    3. Graph Neural Network
    4. Residual Network

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    ICCPR 2024

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 29
      Total Downloads
    • Downloads (Last 12 months)29
    • Downloads (Last 6 weeks)17
    Reflects downloads up to 05 Mar 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media