Abstract
Online social media is characterized by a large number of users that creates conditions for large-scale news generation. News in multimodal form (images and text) often has a serious negative impact. Existing multimodal fake news detection methods mainly explore the relationship between images and texts by extracting image features and text features. However, these methods typically ignore textual content in images and fail to explore the relationship between news and image texts further. We propose a new fake news detection method based on correlation extension multimodal (CEMM) information to solve this problem. The correlation between multimodal information is extended and the relationship between the extended image information and the news text is explored further by extracting text and statistical features from the image. This CEMM-based detection method consists of five parts, which can discover the relevant parts of news and optical character recognition (OCR) text and the features of fake news images and relevant parts of news text, and combine the information of the news itself to detect fake news. Experimental results proved the effectiveness of our approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Allcott, H., Gentzkow, M.: Social media and fake news in the 2016 election. J. Econ. Perspectives 31(2), 211–36 (2017)
Chen, J., Wu, Z., Yang, Z., Xie, H., Wang, F.L., Liu, W.: Multimodal fusion network with latent topic memory for rumor detection. In: 2021 IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6. IEEE (2021)
Chen, Q., Zhu, X., Ling, Z.H., Wei, S., Jiang, H., Inkpen, D.: Enhanced lstm for natural language inference. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), vol. 1, pp. 1657–1668 (2017)
Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)
Hameleers, M., Powell, T.E., Van Der Meer, T.G., Bos, L.: A picture paints a thousand lies? the effects and mechanisms of multimodal disinformation and rebuttals disseminated via social media. Polit. Commun. 37(2), 281–301 (2020)
Jin, Z., Cao, J., Zhang, Y., Zhou, J., Qi, T.: Novel visual and statistical image features for microblogs news verification. IEEE Trans. Multimed. 19(3), 598–608 (2017)
Jin, Z., Cao, J., Guo, H., Zhang, Y., Luo, J.: Multimodal fusion with recurrent neural networks for rumor detection on microblogs. In: Proceedings of the 25th ACM international conference on Multimedia, pp. 795–816 (2017)
Khattar, D., Goud, J.S., Gupta, M., Varma, V.: Mvae: Multimodal variational autoencoder for fake news detection. In: The World Wide Web Conference on, pp. 2915–2921 (2019)
Mikolov, T., Chen, K., Corrado, G.S., Dean, J.: Efficient estimation of word representations in vector space. In: ICLR (Workshop Poster) (2013)
Parikh, A.P., Tackstrom, O., Das, D., Uszkoreit, J.: A decomposable attention model for natural language inference. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp. 2249–2255 (2016)
Qi, P., Cao, J., Yang, T., Guo, J., Li, J.: Exploiting multi-domain visual information for fake news detection. IEEE (2019)
Qian, S., Wang, J., Hu, J., Fang, Q., Xu, C.: Hierarchical multi-modal contextual attention network for fake news detection. In: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 153–162 (2021)
Singhal, S., Kabra, A., Sharma, M., Shah, R.R., Chakraborty, T., Kumaraguru, P.: Spotfake+: a multimodal framework for fake news detection via transfer learning (student abstract). In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 13915–13916 (2020)
Singhal, S., Shah, R.R., Chakraborty, T., Kumaraguru, P., Satoh, S.: Spotfake: a multi-modal framework for fake news detection. In: 2019 IEEE fifth international conference on multimedia big data (BigMM), pp. 39–47. IEEE (2019)
Soranamageswari, M., Meena, C.: Statistical feature extraction for classification of image spam using artificial neural networks. In: 2010 Second International Conference on Machine Learning and Computing, pp. 101–105 (2010)
Xue, J., Wang, Y., Tian, Y., Li, Y., Shi, L., Wei, L.: Detecting fake news by exploring the consistency of multimodal data. Inf. Process. Manage. 58(5), 102610 (2021)
Zhou, X., Wu, J., Zafarani, R.: [... formula...]: Similarity-aware multi-modal fake news detection. Advances in Knowledge Discovery and Data Mining 12085, 354 (2020)
Acknowledgements
This work is supported by National Science Foundation of China No. 61702216, 61772231, and Higher Educational Science and Technology Program of Jinan City under Grant with No. 2020GXRC057, 2018GXRC002.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Li, Y., Ji, K., Ma, K., Chen, Z., Zhou, J., Wu, J. (2023). Fake News Detection Based on the Correlation Extension of Multimodal Information. In: Li, B., Yue, L., Tao, C., Han, X., Calvanese, D., Amagasa, T. (eds) Web and Big Data. APWeb-WAIM 2022. Lecture Notes in Computer Science, vol 13421. Springer, Cham. https://doi.org/10.1007/978-3-031-25158-0_36
Download citation
DOI: https://doi.org/10.1007/978-3-031-25158-0_36
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-25157-3
Online ISBN: 978-3-031-25158-0
eBook Packages: Computer ScienceComputer Science (R0)