Skip to main content

Advertisement

Log in

A federated anti-forgetting representation method based on hybrid model architecture and gradient truncation

  • Letter
  • Published:
Frontiers of Computer Science Aims and scope Submit manuscript

Conclusion

This paper formulates the anti-forgetting representation problem under UFCL and proposes FedAFR. The experiments show that FedAFR effectively improves the model’s anti-forgetting performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

References

  1. Liu F, Zheng Z, Shi Y, Tong Y, Zhang Y. A survey on federated learning: a perspective from multi-party computation. Frontiers of Computer Science, 2024, 18(1): 181336

    Article  Google Scholar 

  2. Wang H, Sun J, Wo T, Liu X. FED-3DA: a dynamic and personalized federated learning framework. In: Proceedings of 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 2023, 1–5

    Google Scholar 

  3. Liu Z, Wang Y, Vaidya S, Ruehle F, Halverson J, Soljačić M, Hou T Y, Tegmark M. KAN: Kolmogorov-Arnold networks. 2024, arXiv preprint arXiv: 2404.19756

    Google Scholar 

  4. Lu C, Zhou Y, Bao F, Chen J, Li C, Zhu J. DPM-solver: a fast ODE solver for diffusion probabilistic model sampling in around 10 steps. In: Proceedings of the 36th International Conference on Neural Information Processing Systems. 2022, 418

    Google Scholar 

  5. Chen X, He K. Exploring simple Siamese representation learning. In: Proceedings of 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2021, 15745–15753

    Chapter  Google Scholar 

  6. Ren L, Jiang L, Zhang W, Li C. Label distribution similarity-based noise correction for crowdsourcing. Frontiers of Computer Science, 2024, 18(5): 185323

    Article  Google Scholar 

  7. Li Q, Li G, Niu W, Cao Y, Chang L, Tan J, Guo L. Boosting imbalanced data learning with wiener process oversampling. Frontiers of Computer Science, 2017, 11(5): 836–851

    Article  Google Scholar 

  8. Chen T, Kornblith S, Norouzi M, Hinton G. A simple framework for contrastive learning of visual representations. In: Proceedings of the 37th International Conference on Machine Learning. 2020, 1597–1607

    Google Scholar 

  9. Zhang F, Kuang K, Chen L, You Z, Shen T, Xiao J, Zhang Y, Wu C, Wu F, Zhuang Y, Li X. Federated unsupervised representation learning. Frontiers of Information Technology & Electronic Engineering, 2023, 24(8): 1181–1193

    Article  Google Scholar 

  10. Yoon J, Jeong W, Lee G, Yang E, Hwang S J. Federated continual learning with weighted inter-client transfer. In: Proceedings of the 38th International Conference on Machine Learning. 2021, 12073–12086

    Google Scholar 

Download references

Acknowledgements

This work was supported by the National Science and Technology Major Project (2022ZD0120203).

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Hui Wang or Tianyu Wo.

Ethics declarations

Competing interests The authors declare that they have no competing interests or financial conflicts to disclose.

Electronic supplementary material

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, H., Sun, J., Wo, T. et al. A federated anti-forgetting representation method based on hybrid model architecture and gradient truncation. Front. Comput. Sci. 19, 196339 (2025). https://doi.org/10.1007/s11704-024-40557-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11704-024-40557-w