Tianshu Xiao
ABSTRACT
In recent years, fake news has been a primary concern as it plays a significant role in influencing the political, economic, and social spheres. The scientific community has proposed several solutions to detect such fraudulent information. However, such solutions are unsuitable for social media posts since they cannot extract sufficient information from one-line textual and graphical content or are highly dependent on prior knowledge, which may be unavailable in the case of unprecedented events (e.g., breaking news).
This paper tackles this issue by proposing HiPo, a novel multi-modal historical post-based fake news detection method. By combining the features extracted from the graphical and textual content, HiPo assesses the truthfulness of a social media post by building its historical context from prior off-label posts with high similarity, therefore, achieving online detection without maintaining a context or knowledge database. We evaluate the performance of HiPo via an exhaustive set of experiments involving four real-world datasets. Our method achieves a detection accuracy higher than 84%, outperforming the state-of-the-art methods in most experimental instances.
Supplemental Material
- Hunt Allcott and Matthew Gentzkow. 2017. Social Media and Fake News in the 2016 Election. Journal of Economic Perspectives, Vol. 31, 2 (May 2017), 211--236.Google Scholar
Cross Ref
- Nicolas Belloir, Wassila Ouerdane, Oscar Pastor, Émilien Frugier, and Louis-Antoine de Barmon. 2022. A Conceptual Characterization of Fake News: A Positioning Paper. In Research Challenges in Information Science, Renata Guizzardi, Jolita Ralyté, and Xavier Franch (Eds.). Springer International Publishing, Cham, 662--669.Google Scholar
- Bogdan Botezatu. 2017. Beware of Fake News - From a Cybersecurity Standpoint. https://businessinsights.bitdefender.com/fake-news-cybersecurity accessed 2023.2.1.Google Scholar
- Johnny Botha and Heloise Pieterse. 2020. Fake News and Deepfakes: A Dangerous Threat for 21st Century Information Security. In International Conference on Cyber Warfare and Security. Academic Conferences International Limited, 57--XII.Google Scholar
- Juan Cao, Peng Qi, Qiang Sheng, Tianyun Yang, Junbo Guo, and Jintao Li. 2020. Exploring the role of visual content in fake news detection. Disinformation, Misinformation, and Fake News in Social Media: Emerging Research Challenges and Opportunities (2020), 141--161.Google Scholar
- Yixuan Chen, Dongsheng Li, Peng Zhang, Jie Sui, Qin Lv, Lu Tun, and Li Shang. 2022. Cross-modal ambiguity learning for multimodal fake news detection. In Proceedings of the ACM Web Conference. 2897--2905.Google ScholarDigital Library
- Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). Association for Computational Linguistics, Minneapolis, Minnesota, 4171--4186.Google Scholar
- Yingtong Dou, Kai Shu, Congying Xia, Philip S Yu, and Lichao Sun. 2021. User preference-aware fake news detection. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2051--2055.Google ScholarDigital Library
- Karen N. DSouza and Aaron M. French. 2022. Social Media and Fake News Detection using Adversarial Collaboration. In Proceedings of the 55th Hawaii International Conference on System Sciences (HICSS). 115--123.Google Scholar
- Alex Graves and Jürgen Schmidhuber. 2005. Framewise phoneme classification with bidirectional LSTM and other neural network architectures. Neural networks, Vol. 18, 5--6 (2005), 602--610.Google ScholarDigital Library
- Chen Hajaj, Sixie Yu, Zlatko Joveski, Yifan Guo, and Yevgeniy Vorobeychik. 2019. Adversarial Coordination on Social Networks. In Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems. 1515--1523.Google Scholar
- Kaiming He, X. Zhang, Shaoqing Ren, and Jian Sun. 2015. Deep Residual Learning for Image Recognition. In Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 770--778.Google Scholar
- Aaron Hurst. 2023. Bard AI chatbot's wrong answer leads to drop in Alphabet shares. https://www.information-age.com/bard-ai-chatbots-wrong-answer-leads-to-drop-in-alphabet-shares-123501533/ accessed 2023.2.12.Google Scholar
- Zhiwei Jin, Juan Cao, Han Guo, Yongdong Zhang, and Jiebo Luo. 2017a. Multimodal fusion with recurrent neural networks for rumor detection on microblogs. In Proceedings of the 25th ACM international conference on Multimedia. 795--816.Google ScholarDigital Library
- Zhiwei Jin, Juan Cao, Yongdong Zhang, Jianshe Zhou, and Qi Tian. 2017b. Novel Visual and Statistical Image Features for Microblogs News Verification. IEEE Transactions on Multimedia, Vol. 19 (2017), 598--608.Google ScholarDigital Library
- Jean-Noel Kapferer. 2013. Rumors: Uses, interpretations, and images. Transaction Publishers.Google Scholar
- Dhruv Khattar, Jaipal Singh Goud, Manish Gupta, and Vasudeva Varma. 2019. Mvae: Multimodal variational autoencoder for fake news detection. In The world wide web conference. 2915--2921.Google Scholar
- Quanzhi Li, Qiong Zhang, and Luo Si. 2019. Rumor detection by exploiting user credibility information, attention and multi-task learning. In Proceedings of the 57th annual meeting of the Association for computational linguistics. 1173--1179.Google ScholarCross Ref
- Yichuan Li, Bohan Jiang, Kai Shu, and Huan Liu. 2020. MM-COVID: A multilingual and multimodal data repository for combating COVID-19 disinformation. arXiv, Vol. 2011.04088 (2020).Google Scholar
- Jing Ma, Wei Gao, Prasenjit Mitra, Sejeong Kwon, Bernard J Jansen, Kam-Fai Wong, and Meeyoung Cha. 2016. Detecting rumors from microblogs with recurrent neural networks. In Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence. 3818--3824.Google Scholar
- Jing Ma, Wei Gao, and Kam-Fai Wong. 2018. Detect rumor and stance jointly by neural multi-task learning. In Companion proceedings of the the web conference 2018. 585--593.Google ScholarDigital Library
- Jing Ma, Wei Gao, and Kam-Fai Wong. 2019. Detect rumors on twitter by promoting information campaigns with generative adversarial learning. In The world wide web conference. 3049--3055.Google Scholar
- Meta. 2020. Tips to Spot False News. https://www.facebook.com/formedia/blog/third-party-fact-checking-tips-to-spot-false-news accessed 2023.2.13.Google Scholar
- Kai Nakamura, Sharon Levy, and William Yang Wang. 2020. Fakeddit: A New Multimodal Benchmark Dataset for Fine-grained Fake News Detection. (2020), 6149--6157.Google Scholar
- Qiong Nan, Danding Wang, Yongchun Zhu, Qiang Sheng, Yuhui Shi, Juan Cao, and Jintao Li. 2022. Improving Fake News Detection of Influential Domain via Domain-and Instance-Level Transfer. In Proceedings of the 29th International Conference on Computational Linguistics. 2834--2848.Google Scholar
- Dan Saattrup Nielsen and Ryan McConville. 2022. MuMiN: A Large-Scale Multilingual Multimodal Fact-Checked Misinformation Social Network Dataset. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 3141--3153.Google ScholarDigital Library
- Feargus Pendlebury, Fabio Pierazzi, Roberto Jordaney, Johannes Kinder, and Lorenzo Cavallaro. 2019. TESSERACT: Eliminating experimental bias in malware classification across space and time. In Proceedings of the 28th USENIX Security Symposium. 729--746.Google Scholar
- Peng Qi, Juan Cao, Xirong Li, Huan Liu, Qiang Sheng, Xiaoyue Mi, Qin He, Yongbiao Lv, Chenyang Guo, and Yingchao Yu. 2021. Improving fake news detection by using an entity-enhanced framework to fuse diverse multimodal clues. In Proceedings of the 29th ACM International Conference on Multimedia. 1212--1220.Google ScholarDigital Library
- Peng Qi, Juan Cao, Tianyun Yang, Junbo Guo, and Jintao Li. 2019. Exploiting Multi-domain Visual Information for Fake News Detection. 2019 IEEE International Conference on Data Mining (ICDM) (2019), 518--527.Google Scholar
- Shengsheng Qian, Jinguang Wang, Jun Hu, Quan Fang, and Changsheng Xu. 2021. Hierarchical multi-modal contextual attention network for fake news detection. In Proceedings of the 44th international ACM SIGIR conference on research and development in information retrieval. 153--162.Google ScholarDigital Library
- Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. 2021. Learning transferable visual models from natural language supervision. In International conference on machine learning. PMLR, 8748--8763.Google Scholar
- Yuxiang Ren, Bo Wang, Jiawei Zhang, and Yi Chang. 2020. Adversarial Active Learning based Heterogeneous Graph Neural Network for Fake News Detection. In Proceedings of the 2020 IEEE International Conference on Data Mining (ICDM). 452--461.Google ScholarCross Ref
- Dilip Kumar Sharma and Sonal Garg. 2023. IFND: a benchmark dataset for fake news detection. Complex & intelligent systems, Vol. 9, 3 (2023), 2843--2863.Google Scholar
- Qiang Sheng, Juan Cao, Xueyao Zhang, Rundong Li, Danding Wang, and Yongchun Zhu. 2022. Zoom Out and Observe: News Environment Perception for Fake News Detection. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) (03 2022), 4543--4556.Google ScholarCross Ref
- Karen Simonyan and Andrew Zisserman. 2015. Very deep convolutional networks for large-scale image recognition. (2015).Google Scholar
- Shivangi Singhal, Anubha Kabra, Mohit Sharma, Rajiv Ratn Shah, Tanmoy Chakraborty, and Ponnurangam Kumaraguru. 2020. Spotfake: A multimodal framework for fake news detection via transfer learning (student abstract). In Proceedings of the AAAI conference on artificial intelligence, Vol. 34. 13915--13916.Google ScholarCross Ref
- Shivangi Singhal, Rajiv Ratn Shah, Tanmoy Chakraborty, Ponnurangam Kumaraguru, and Shin'ichi Satoh. 2019. SpotFake: A Multi-modal Framework for Fake News Detection. 2019 IEEE Fifth International Conference on Multimedia Big Data (BigMM) (2019), 39--47.Google Scholar
- Maciej Szpakowski and Renato Cordeiro. 2020. Fake News Corpus. https://github.com/several27/FakeNewsCorpus accessed 2023.1.21.Google Scholar
- Vaibhav Vaibhav, Raghuram Mandyam, and Eduard Hovy. 2019. Do Sentence Interactions Matter? Leveraging Sentence Level Representations for Fake News Classification. In Proceedings of the Thirteenth Workshop on Graph-Based Methods for Natural Language Processing (TextGraphs-13). 134--139.Google ScholarCross Ref
- Ashish Vaswani, Noam M. Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. ArXiv, Vol. abs/1706.03762 (2017).Google Scholar
- Antonia M. Villarruel and Richard James. 2022. Preventing the spread of misinformation. https://www.myamericannurse.com/preventing-the-spread-of-misinformation/ accessed 2023.2.12.Google Scholar
- Yaqing Wang, Fenglong Ma, Zhiwei Jin, Ye Yuan, Guangxu Xun, Kishlay Jha, Lu Su, and Jing Gao. 2018. EANN: Event Adversarial Neural Networks for Multi-Modal Fake News Detection. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 849--857.Google ScholarDigital Library
- Yaqing Wang, Fenglong Ma, Haoyu Wang, Kishlay Jha, and Jing Gao. 2021. Multimodal emergent fake news detection via meta neural process networks. In Proceedings of the 27th ACM SIGKDD conference on knowledge discovery & data mining. 3708--3716.Google ScholarDigital Library
- Youze Wang, Shengsheng Qian, Jun Hu, Quan Fang, and Changsheng Xu. 2020a. Fake news detection via knowledge-driven multimodal graph convolutional networks. In Proceedings of the 2020 international conference on multimedia retrieval. 540--547.Google ScholarDigital Library
- Yaqing Wang, Weifeng Yang, Fenglong Ma, Jin Xu, Bin Zhong, Qiang Deng, and Jing Gao. 2020b. Weak supervision for fake news detection via reinforcement learning. In Proceedings of the AAAI conference on artificial intelligence, Vol. 34. 516--523.Google ScholarCross Ref
- Chenxi Whitehouse, Tillman Weyde, Pranava Madhyastha, and Nikos Komninos. 2022. Evaluation of fake news detection with knowledge-enhanced language models. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 16. 1425--1429.Google ScholarCross Ref
- Yang Wu, Pengwei Zhan, Yunjian Zhang, Liming Wang, and Zhen Xu. 2021. Multimodal fusion with co-attention networks for fake news detection. In Findings of the association for computational linguistics: ACL-IJCNLP 2021. 2560--2569.Google Scholar
- Junxiao Xue, Yabo Wang, Yichen Tian, Yafei Li, Lei Shi, and Lin Wei. 2021. Detecting fake news by exploring the consistency of multimodal data. Information Processing & Management, Vol. 58 (2021), 102610 -- 102610.Google ScholarDigital Library
- Ruichao Yang, Xiting Wang, Yiqiao Jin, Chaozhuo Li, Jianxun Lian, and Xing Xie. 2022. Reinforcement subgraph reasoning for fake news detection. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2253--2262.Google ScholarDigital Library
- Long Ying, Hui Yu, Jinguang Wang, Yongze Ji, and Shengsheng Qian. 2021. Fake News Detection via Multi-Modal Topic Memory Network. IEEE Access, Vol. 9 (2021), 132818--132829.Google ScholarCross Ref
- Feng Yu, Qiang Liu, Shu Wu, Liang Wang, and Tieniu Tan. 2017. A convolutional approach for misinformation identification. In Proceedings of the 26th International Joint Conference on Artificial Intelligence. 3901--3907.Google ScholarCross Ref
- Huaiwen Zhang, Quan Fang, Shengsheng Qian, and Changsheng Xu. 2019. Multi-modal knowledge-aware event memory network for social media rumor detection. In Proceedings of the 27th ACM international conference on multimedia. 1942--1951.Google ScholarDigital Library
- Guangxiang Zhao, Xu Sun, Jingjing Xu, Zhiyuan Zhang, and Liangchen Luo. 2019. MUSE: Parallel Multi-Scale Attention for Sequence to Sequence Learning. ArXiv, Vol. abs/1911.09483 (2019).Google Scholar
- Xinyi Zhou, Jindi Wu, and Reza Zafarani. 2020. SAFE: Similarity-Aware Multi-modal Fake News Detection. (2020), 354--367.Google Scholar
- Yongchun Zhu, Qiang Sheng, Juan Cao, Shuokai Li, Danding Wang, and Fuzhen Zhuang. 2022. Generalizing to the future: Mitigating entity bias in fake news detection. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2120--2125.Google ScholarDigital Library
Index Terms
- HiPo: Detecting Fake News via Historical and Multi-Modal Analyses of Social Media Posts
Recommendations
Interpretable Fake News Detection on Social Media
ICSIM '23: Proceedings of the 2023 6th International Conference on Software Engineering and Information ManagementWith the development of information technology, public opinion can quickly spread to all over the world, permeate every corner of social life, and have a great impact on human's lives. Extracted from large-scale and multi-mode social media, user-...
Is It Really Fake? – Towards an Understanding of Fake News in Social Media Communication
Social Computing and Social Media. User Experience and BehaviorAbstractThis paper outlines the development of Fake News and seeks to clarify different perspectives regarding the term within Social Media communication. Current information systems, such as Social Media platforms, allow real-time communication, enabling ...
Believability and Harmfulness Shape the Virality of Misleading Social Media Posts
WWW '23: Proceedings of the ACM Web Conference 2023Misinformation on social media presents a major threat to modern societies. While previous research has analyzed the virality across true and false social media posts, not every misleading post is necessarily equally viral. Rather, misinformation has ...
Comments