skip to main content
10.1145/3589334.3645443acmconferencesArticle/Chapter ViewAbstractPublication PageswwwConference Proceedingsconference-collections
research-article
Free Access

T3RD: Test-Time Training for Rumor Detection on Social Media

Published:13 May 2024Publication History

ABSTRACT

With the increasing number of news uploaded to the internet daily, rumor detection has garnered significant attention in recent years. Existing rumor detection methods excel on familiar topics with sufficient training data (high resource) collected from the same domain. However, when facing emergent events or rumors propagated in different languages, the performance of these models is significantly degraded, due to the lack of training data and prior knowledge (low resource). To tackle this challenge, we introduce the Test-Time Training for Rumor Detection (T^3RD) to enhance the performance of rumor detection models on low-resource datasets. Specifically, we introduce self-supervised learning (SSL) as an auxiliary task in the test-time training. It consists of global and local contrastive learning, in which the global contrastive learning focuses on obtaining invariant graph representations and the local one focuses on acquiring invariant node representations. We employ the auxiliary SSL tasks for both the training and test-time training phases to mine the intrinsic traits of test samples and further calibrate the trained model for these test samples. To mitigate the risk of distribution distortion in test-time training, we introduce feature alignment constraints aimed at achieving a balanced synergy between the knowledge derived from the training set and the test samples. The experiments conducted on the two widely used cross-domain datasets demonstrate that the proposed model achieves a new state-of-the-art in performance. Our code is available at https://github.com/social-rumors/T3RD.

Skip Supplemental Material Section

Supplemental Material

rfp0713.mp4

Supplemental video

mp4

43.6 MB

References

  1. Alexander Bartler, Andre Bü hler, Felix Wiewel, Mario Dö bler, and Bin Yang. 2022. MT3: Meta Test-Time Training for Self-Supervised Test-Time Adaption. In International Conference on Artificial Intelligence and Statistics, AISTATS 2022, 28--30 March 2022, Virtual Event (Proceedings of Machine Learning Research, Vol. 151). PMLR, 3080--3090.Google ScholarGoogle Scholar
  2. Tian Bian, Xi Xiao, Tingyang Xu, Peilin Zhao, Wenbing Huang, Yu Rong, and Junzhou Huang. 2020. Rumor Detection on Social Media with Bi-Directional Graph Convolutional Networks. In The Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2020, The Thirty-Second Innovative Applications of Artificial Intelligence Conference, IAAI 2020, The Tenth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2020, New York, NY, USA, February 7--12, 2020. AAAI Press, 549--556.Google ScholarGoogle ScholarCross RefCross Ref
  3. Carlos Castillo, Marcelo Mendoza, and Barbara Poblete. 2011. Information credibility on twitter. In Proceedings of the 20th International Conference on World Wide Web, WWW 2011, Hyderabad, India, March 28 - April 1, 2011. ACM, 675--684.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Guowei Fan, Tao Wu, and Yamei Lei. 2022. Research on Rumor Detection Based on RoBERTa-BiGRU Model. In International Conference on Artificial Intelligence and Security. Springer, 194--204.Google ScholarGoogle Scholar
  5. Adrien Friggeri, Lada A. Adamic, Dean Eckles, and Justin Cheng. 2014. Rumor Cascades. In Proceedings of the Eighth International Conference on Weblogs and Social Media, ICWSM 2014, Ann Arbor, Michigan, USA, June 1--4, 2014. The AAAI Press.Google ScholarGoogle ScholarCross RefCross Ref
  6. Yang Fu, Sifei Liu, Umar Iqbal, Shalini De Mello, Humphrey Shi, and Jan Kautz. 2021. Learning to Track Instances without Video Annotations. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021, virtual, June 19--25, 2021. Computer Vision Foundation / IEEE, 8680--8689.Google ScholarGoogle ScholarCross RefCross Ref
  7. Han Guo, Juan Cao, Yazi Zhang, Junbo Guo, and Jintao Li. 2018. Rumor Detection with Hierarchical Social Attention Network. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management, CIKM 2018, Torino, Italy, October 22--26, 2018. ACM, 943--951.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Nicklas Hansen, Rishabh Jangir, Yu Sun, Guillem Alenyà, Pieter Abbeel, Alexei A. Efros, Lerrel Pinto, and Xiaolong Wang. 2021. Self-Supervised Policy Adaptation during Deployment. In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3--7, 2021. OpenReview.net.Google ScholarGoogle Scholar
  9. Kaveh Hassani and Amir Hosein Khasahmadi. 2020. Contrastive Multi-View Representation Learning on Graphs. In Proceedings of International Conference on Machine Learning. 3451--3461.Google ScholarGoogle Scholar
  10. Maria Janicka, Maria Pszona, and Aleksander Wawer. 2019. Cross-Domain Failures of Fake News Detection. Computació n y Sistemas, Vol. 23, 3 (2019).Google ScholarGoogle Scholar
  11. Ling Min Serena Khoo, Hai Leong Chieu, Zhong Qian, and Jing Jiang. 2020. Interpretable Rumor Detection in Microblogs by Attending to User Interactions. In The Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2020, The Thirty-Second Innovative Applications of Artificial Intelligence Conference, IAAI 2020, The Tenth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2020, New York, NY, USA, February 7--12, 2020. AAAI Press, 8783--8790.Google ScholarGoogle Scholar
  12. Hongzhan Lin, Jing Ma, Liangliang Chen, Zhiwei Yang, Mingfei Cheng, and Guang Chen. 2022. Detect Rumors in Microblog Posts for Low-Resource Domains via Adversarial Contrastive Learning. In Findings of the Association for Computational Linguistics: NAACL 2022, Seattle, WA, United States, July 10--15, 2022. Association for Computational Linguistics, 2543--2556.Google ScholarGoogle ScholarCross RefCross Ref
  13. Hongzhan Lin, Jing Ma, Mingfei Cheng, Zhiwei Yang, Liangliang Chen, and Guang Chen. 2021. Rumor Detection on Twitter with Claim-Guided Hierarchical Graph Attention Networks. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, EMNLP 2021, Virtual Event / Punta Cana, Dominican Republic, 7--11 November, 2021. Association for Computational Linguistics, 10035--10047.Google ScholarGoogle ScholarCross RefCross Ref
  14. Hongzhan Lin, Pengyao Yi, Jing Ma, Haiyun Jiang, Ziyang Luo, Shuming Shi, and Ruifang Liu. 2023. Zero-Shot Rumor Detection with Propagation Structure via Prompt Learning. In Thirty-Seventh AAAI Conference on Artificial Intelligence, AAAI 2023, Thirty-Fifth Conference on Innovative Applications of Artificial Intelligence, IAAI 2023, Thirteenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2023, Washington, DC, USA, February 7--14, 2023. AAAI Press, 5213--5221.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Xiaomo Liu, Armineh Nourbakhsh, Quanzhi Li, Rui Fang, and Sameena Shah. 2015. Real-time Rumor Debunking on Twitter. In Proceedings of the 24th ACM International Conference on Information and Knowledge Management, CIKM 2015, Melbourne, VIC, Australia, October 19 - 23, 2015. ACM, 1867--1870.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Yuejiang Liu, Parth Kothari, Bastien van Delft, Baptiste Bellot-Gurlet, Taylor Mordan, and Alexandre Alahi. 2021. TTT: When Does Self-Supervised Test-Time Training Fail or Thrive?. In Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, December 6--14, 2021, virtual. 21808--21820.Google ScholarGoogle Scholar
  17. Jing Ma, Wei Gao, Prasenjit Mitra, Sejeong Kwon, Bernard J. Jansen, Kam-Fai Wong, and Meeyoung Cha. 2016. Detecting Rumors from Microblogs with Recurrent Neural Networks. In Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI 2016, New York, NY, USA, 9--15 July 2016. IJCAI/AAAI Press, 3818--3824.Google ScholarGoogle Scholar
  18. Jing Ma, Wei Gao, and Kam-Fai Wong. 2017. Detect Rumors in Microblog Posts Using Propagation Structure via Kernel Learning. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, ACL 2017, Vancouver, Canada, July 30 - August 4, Volume 1: Long Papers. Association for Computational Linguistics, 708--717.Google ScholarGoogle ScholarCross RefCross Ref
  19. Jing Ma, Wei Gao, and Kam-Fai Wong. 2018a. Rumor Detection on Twitter with Tree-structured Recursive Neural Networks. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, ACL 2018, Melbourne, Australia, July 15--20, 2018, Volume 1: Long Papers. Association for Computational Linguistics, 1980--1989.Google ScholarGoogle ScholarCross RefCross Ref
  20. Jing Ma, Wei Gao, and Kam-Fai Wong. 2018b. Rumor Detection on Twitter with Tree-structured Recursive Neural Networks. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, ACL 2018, Melbourne, Australia, July 15--20, 2018, Volume 1: Long Papers. Association for Computational Linguistics, 1980--1989.Google ScholarGoogle ScholarCross RefCross Ref
  21. Shiwen Ni, Jiawen Li, and Hung-Yu kao. 2021. HAT4RD: Hierarchical Adversarial Training for Rumor Detection in Social Media. Sensors (Basel, Switzerland) , Vol. 22 (2021).Google ScholarGoogle Scholar
  22. Xing Su, Jian Yang, Jia Wu, and Yuchen Zhang. 2023. Mining User-aware Multi-relations for Fake News Detection in Large Scale Online Social Networks. In Proceedings of the Sixteenth ACM International Conference on Web Search and Data Mining, WSDM 2023, Singapore, 27 February 2023 - 3 March 2023. ACM, 51--59.Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Fan-Yun Sun, Jordan Hoffman, Vikas Verma, and Jian Tang. 2019. InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximization. In International Conference on Learning Representations.Google ScholarGoogle Scholar
  24. Tiening Sun, Zhong Qian, Sujun Dong, Peifeng Li, and Qiaoming Zhu. 2022. Rumor Detection on Social Media with Graph Adversarial Contrastive Learning. In WWW '22: The ACM Web Conference 2022, Virtual Event, Lyon, France, April 25 - 29, 2022. ACM, 2789--2797.Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Yu Sun, Xiaolong Wang, Zhuang Liu, John Miller, Alexei A. Efros, and Moritz Hardt. 2020. Test-Time Training with Self-Supervision for Generalization under Distribution Shifts. In Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13--18 July 2020, Virtual Event (Proceedings of Machine Learning Research, Vol. 119). PMLR, 9229--9248.Google ScholarGoogle Scholar
  26. Lin Tian, Xiuzhen Zhang, and Jey Han Lau. 2022. DUCK: Rumour Detection on Social Media by Modelling User and Comment Propagation Networks. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL 2022, Seattle, WA, United States, July 10--15, 2022. Association for Computational Linguistics, 4939--4949.Google ScholarGoogle ScholarCross RefCross Ref
  27. A"a ron van den Oord, Yazhe Li, and Oriol Vinyals. 2018. Representation Learning with Contrastive Predictive Coding. CoRR , Vol. abs/1807.03748 (2018).Google ScholarGoogle Scholar
  28. Petar Velickovic, William Fedus, William L. Hamilton, Pietro Liò, Yoshua Bengio, and R. Devon Hjelm. 2019. Deep Graph Infomax. In 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6--9, 2019. OpenReview.net.Google ScholarGoogle Scholar
  29. Yiqi Wang, Chaozhuo Li, Wei Jin, Rui Li, Jianan Zhao, Jiliang Tang, and Xing Xie. 2022. Test-Time Training for Graph Neural Networks. CoRR , Vol. abs/2210.08813 (2022).Google ScholarGoogle Scholar
  30. Weizhi Xu, Junfei Wu, Qiang Liu, Shu Wu, and Liang Wang. 2022. Evidence-aware Fake News Detection with Graph Neural Networks. In WWW '22: The ACM Web Conference 2022, Virtual Event, Lyon, France, April 25 - 29, 2022. ACM, 2501--2510.Google ScholarGoogle Scholar
  31. Fan Yang, Yang Liu, Xiaohui Yu, and Min Yang. 2012. Automatic detection of rumor on sina weibo. In Proceedings of the ACM SIGKDD workshop on mining data semantics. 1--7.Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Feng Yu, Qiang Liu, Shu Wu, Liang Wang, and Tieniu Tan. 2017a. A Convolutional Approach for Misinformation Identification. In Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI 2017, Melbourne, Australia, August 19--25, 2017. ijcai.org, 3901--3907.Google ScholarGoogle ScholarCross RefCross Ref
  33. Feng Yu, Qiang Liu, Shu Wu, Liang Wang, and Tieniu Tan. 2017b. A Convolutional Approach for Misinformation Identification. In Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI 2017, Melbourne, Australia, August 19--25, 2017. ijcai.org, 3901--3907.Google ScholarGoogle ScholarCross RefCross Ref
  34. Zhenrui Yue, Huimin Zeng, Yang Zhang, Lanyu Shang, and Dong Wang. 2023. MetaAdapt: Domain Adaptive Few-Shot Misinformation Detection via Meta Learning. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2023, Toronto, Canada, July 9--14, 2023. Association for Computational Linguistics, 5223--5239.Google ScholarGoogle ScholarCross RefCross Ref
  35. Li Yuechen, Qian Lingfei, and Ma Jing. 2022. Early Detection of Rumors Based on BERT Model. In AI and Analytics for Public Health: Proceedings of the 2020 INFORMS International Conference on Service Science. Springer, 261--268.Google ScholarGoogle Scholar
  36. Huaiwen Zhang, Shengsheng Qian, Quan Fang, and Changsheng Xu. 2021. Multimodal Disentangled Domain Adaption for Social Media Event Rumor Detection. IEEE Transactions on Multimedia , Vol. 23 (2021), 4441--4454.Google ScholarGoogle ScholarCross RefCross Ref
  37. Huaiwen Zhang, Shengsheng Qian, Quan Fang, and Changsheng Xu. 2022. Multi-Modal Meta Multi-Task Learning for Social Media Rumor Detection. IEEE Transactions on Multimedia , Vol. 24 (2022), 1449--1459.Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Taozheng Zhang and Shuaidong Hu. 2023. Unsupervised Cross-Domain Rumor Detection from Multiple Sources Based on RoBERTa and Multi-CNN. In Proceedings of the 2023 7th International Conference on Deep Learning Technologies. 85--90.Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Yanqiao Zhu, Yichen Xu, Feng Yu, Qiang Liu, Shu Wu, and Liang Wang. 2021. Graph Contrastive Learning with Adaptive Augmentation. In WWW '21: The Web Conference 2021, Virtual Event / Ljubljana, Slovenia, April 19--23, 2021. ACM / IW3C2, 2069--2080.Google ScholarGoogle Scholar
  40. Arkaitz Zubiaga, Ahmet Aker, Kalina Bontcheva, Maria Liakata, and Rob Procter. 2018. Detection and Resolution of Rumours in Social Media: A Survey. ACM Comput. Surv. , Vol. 51, 2, Article 32 (feb 2018), bibinfonumpages36 pages.ioGoogle ScholarGoogle Scholar

Index Terms

  1. T3RD: Test-Time Training for Rumor Detection on Social Media

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      WWW '24: Proceedings of the ACM on Web Conference 2024
      May 2024
      4826 pages
      ISBN:9798400701719
      DOI:10.1145/3589334

      Copyright © 2024 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 13 May 2024

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      Overall Acceptance Rate1,899of8,196submissions,23%
    • Article Metrics

      • Downloads (Last 12 months)75
      • Downloads (Last 6 weeks)74

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader