Abstract
With the popularity of social media and online platforms, fake news has spread faster and more widely than ever before, with far-reaching impacts on many fields such as politics, economics, and society. Therefore, the research and development of fake news detection technology is particularly important. At present, the research in the field of fake news detection mainly focuses on the fusion and consistency detection of images and texts, and remarkable results have been achieved in this direction. However, the existing methods still face two major challenges: first, how to integrate multimodal features more evenly to ensure that the image and text are equal in the model; The second is how to construct a fusion model that can effectively deal with the potential inconsistencies between images and texts. In order to solve the above challenges, this paper proposes a Collaborative Attention Network Based on Multimodal Inconsistency (MICAN) for fake news detection. MICAN can not only fuse the features of text and images, but also effectively solve the problem of image-text mismatch that may occur during the fusion process. Through the innovative multi-modal collaborative attention network framework and mutual attention neural network architecture, the network realizes the accurate fusion of multimodal features, and enhances the accuracy and robustness of fake news detection. In addition, the MICAN model also adds an event discriminator, which is responsible for predicting the labels of events to achieve accurate classification and identification of news events, which further improves the practicability of the model. Experimental results show that the MICAN model outperforms the existing fake news detection models on multiple datasets such as weibo, twitter, and PHEME, which verifies its effectiveness and superiority.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Chen, Y., et al.: Cross-modal ambiguity learning for multimodal fake news detection. In: Proceedings of the ACM Web Conference 2022 (WWW ’22). Association for Computing Machinery, New York, NY, USA, pp. 2897–2905 (2022). https://doi.org/10.1145/3485447.3511968
Wu, L., Long, Y., Gao, C., Wang, Z., Zhang, Y.: MFIR: multimodal fusion and inconsistency reasoning for explainable fake news detection. Inf. Fus. 100, 101944 (2023). ISSN 1566-2535. https://doi.org/10.1016/j.2023.101944
Dhawan, M., Sharma, S., Kadam, A. et al.: Game-on: graph attention network based multimodal fusion for fake news detection. Soc. Netw. Anal. Min. 14, 114 (2024). https://doi.org/10.1007/s13278-024-01271-4
: Wu, L., Liu, P., Zhao, Y., Wang, P., Zhang, Y.: Human cognition-based consistency inference networks for multi-modal fake news detection. IEEE Trans. Knowl. Data Eng. 36(1), 211–225 (2024). https://doi.org/10.1109/TKDE.2023.3280555
Hua, K., Fang, X., Tang, Z., Cheng, Y., Yu, Z.: DCAM-NET: a novel domain generalization optic cup and optic disc segmentation pipeline with multi-region and multi-scale convolution attention mechanism. Comput. Biol. Med. 163, 107076 (2023). ISSN 0010-4825
Wang, Y., Ma, F., Jin, Z., Yuan, Y., Xun, G., Jha, K.: EANN: event adversarial neural networks for multi-modal fake news detection. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, ACM Press, pp. 849–857 (2018)
Khattar, D., Goud, J.S., Gupta, M., Varma, V.: MVAE: multimodal variational autoencoder for fake news detection. In: Proceedings of the World Wide Web Conference, ACM Press, pp. 2915–2921 (2019)
Singhal, S., Kabra, A., Sharma, M., Shah, R.R., Chakraborty, T., Kumaraguru, P.: SpotFake+: a multimodal framework for fake news detection via transfer learning (student abstract). In: Proceedings of the Conference on Artificial Intelligence, AAAI Press, pp. 13915–13916 (2020)
Zhou, X., Wu, J., Zafarani, R.: SAFE: similarity-aware multi-modal fake news detection. In: Proceedings of the 24th Pacific Asia Conference on Advances in Knowledge Discovery and Data Mining, pp. 354–367. Springer (2020). https://doi.org/10.1007/978-3-030-47436-2_27
Xue, J.X., Wang, Y.B., Tian, Y.C.: Detecting fake news by exploring the consistency of multimodal data. Inf. Process. Manage. 58(5), 102610 (2021)
Chen, Y.X., Li, D.S., Zhang, P.: Cross-modal ambiguity learning for multimodal fake news detection. In: Proceedings of the ACM web Conference 2022, ACM Press, pp. 2897–2905 (2022)
Qi, L., Wan, S., Tang, B., Xu, Y.: Multimodal fusion rumor detection method based on attention mechanism. Comput. Eng. Appl. 58(19), 209–217 (2022)
Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. In: Proceedings of the 3rd International Conference on Learning Representations, pp. 1–15 (2015)
Fan, Z., et al.: Sequential recommendation via stochastic self-attention. In: Proceedings of the ACM Web Conference, pp. 2036–2047. ACM Press (2022)
Song, C., Ning, N., Zhang, Y., Wu, B.: A multimodal fake news detection model based on crossmodal attention residual and multichannel convolutional neural networks. Inf. Process. Manage. 58(1), 102437 (2021)
Boididou, C., Papadopoulos, S., Zampoglou, M., Apostolidis, L., Papadopoulou, O., Kompatsiaris, Y.: Detection and visualization of misleading content on twitter. Int. J. Multimed. Info. Retr. 7(1), 71–86 (2018)
Yang, Z., Dai, Z., Yang, Y., Carbonell, J.G., Salakhutdinov, R., Le, Q.V.: XLNet: generalized autoregressive pretraining for language understanding. In: Proceedings of the 33rd International Conference on neural Information Processing Systems, pp. 5753–5763 (2019)
Wang, L., Zhang, C., Xu, H., Zhang, S., Xu, X., Wang, S.: Cross-modal contrastive learning for multimodal fake news detection. arXiv preprint arXiv:2302.14057 (2023)
Jiang, Y., Yu, X., Wang, Y., Xu, X., Song, X., Maynard, D.: Similarity-aware multimodal prompt learning for fake news detection. arXiv preprint arXiv: 2304.04187 (2023)
Zhou, Y., Yang, Y., Ying, Q., Qian, Z., Zhang, X.: Multi-modal fake news detection on social media via multi-grained information fusion. arXiv preprint arXiv:2304.00827 (2023)
Chen, Y., et al.: Cross-modal ambiguity learning for multimodal fake news detection. In: Proceedings of the ACM Web Conference 2022, pp. 2897–2905 (2022)
Acknowledgement
This work is supported by the Major Research Plan of Hubei Province under Grant/Award NO. 2023BAA027 and the project of Science, Technology and Innovation Commission of Shenzhen Municipality of China under Grant No. GJHZ20240218114659027.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2025 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Yi, Z., Lu, S., Tang, X., Zhu, J., Wu, J. (2025). MICAN: Multi-modal Inconsistency-Based Cooperation Attention Network for Fake News Detection. In: Ide, I., et al. MultiMedia Modeling. MMM 2025. Lecture Notes in Computer Science, vol 15521. Springer, Singapore. https://doi.org/10.1007/978-981-96-2061-6_26
Download citation
DOI: https://doi.org/10.1007/978-981-96-2061-6_26
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-96-2060-9
Online ISBN: 978-981-96-2061-6
eBook Packages: Computer ScienceComputer Science (R0)