skip to main content
10.1145/3343031.3350850acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Multi-modal Knowledge-aware Event Memory Network for Social Media Rumor Detection

Authors Info & Claims
Published:15 October 2019Publication History

ABSTRACT

The wide dissemination and misleading effects of online rumors on social media have become a critical issue concerning the public and government. Detecting and regulating social media rumors is important for ensuring users receive truthful information and maintaining social harmony. Most of the existing rumor detection methods focus on inferring clues from media content and social context, which largely ignores the rich knowledge information behind the highly condensed text which is useful for rumor verification. Furthermore, existing rumor detection models underperform on unseen events because they tend to capture lots of event-specific features in seen data which cannot be transferred to newly emerged events. In order to address these issues, we propose a novel Multimodal Knowledge-aware Event Memory Network (MKEMN) which utilizes the Multi-modal Knowledge-aware Network (MKN) and Event Memory Network (EMN) as building blocks for social media rumor detection. Specifically, the MKN learns the multi-modal representation of the post on social media and retrieves external knowledge from real-world knowledge graph to complement the semantic representation of short texts of posts and takes conceptual knowledge as additional evidence to improve rumor detection. The EMN extracts event-invariant features of events and stores them into global memory. Given an event representation, the EMN takes it as a query to retrieve the memory network and output the corresponding features shared among events. With the additional information provided by EMN, our model can learn robust representations of events and consistently perform well on the newly emerged events. Extensive experiments on two Twitter benchmark datasets demonstrate that our rumor detection method achieves much better results than state-of-the-art methods.

References

  1. Hunt Allcott and Matthew Gentzkow. 2017. Social media and fake news in the 2016 election. Journal of economic perspectives , Vol. 31, 2 (2017), 211--36.Google ScholarGoogle ScholarCross RefCross Ref
  2. Carlos Castillo, Marcelo Mendoza, and Barbara Poblete. 2011. Information credibility on twitter. In Proceedings of the 20th International Conference on World Wide Web, WWW 2011, Hyderabad, India, March 28 - April 1, 2011 , , Sadagopan Srinivasan, Krithi Ramamritham, Arun Kumar, M. P. Ravindra, Elisa Bertino, and Ravi Kumar (Eds.). ACM , 675--684. https://doi.org/10.1145/1963405.1963500Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Lihan Chen, Jiaqing Liang, Chenhao Xie, and Yanghua Xiao. 2018b. Short Text Entity Linking with Fine-grained Topics. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management (CIKM '18). ACM, New York, NY, USA, 457--466. https://doi.org/10.1145/3269206.3271809Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Tong Chen, Xue Li, Hongzhi Yin, and Jun Zhang. 2018a. Call Attention to Rumors: Deep Attention Based Recurrent Neural Networks for Early Rumor Detection. In Trends and Applications in Knowledge Discovery and Data Mining - PAKDD 2018 Workshops, BDASC, BDM, ML4Cyber, PAISI, DaMEMO, Melbourne, VIC, Australia, June 3, 2018, Revised Selected Papers (Lecture Notes in Computer Science), , Mohadeseh Ganji, Lida Rashidi, Benjamin C. M. Fung, and Can Wang (Eds.), Vol. 11154. Springer, 40--52. https://doi.org/10.1007/978--3-030-04503--6_4Google ScholarGoogle ScholarCross RefCross Ref
  5. Kyunghyun Cho, Bart van Merrienboer, cC aglar Gü lcc ehre, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. CoRR , Vol. abs/1406.1078 (2014). arxiv: 1406.1078 http://arxiv.org/abs/1406.1078Google ScholarGoogle Scholar
  6. Nicholas DiFonzo and Prashant Bordia. 2007. Rumor psychology: Social and organizational approaches. American Psychological Association.Google ScholarGoogle Scholar
  7. Octavian-Eugen Ganea, Marina Ganea, Auré lien Lucchi, Carsten Eickhoff, and Thomas Hofmann. 2016. Probabilistic Bag-Of-Hyperlinks Model for Entity Linking. In Proceedings of the 25th International Conference on World Wide Web, WWW 2016, Montreal, Canada, April 11 - 15, 2016. 927--938. https://doi.org/10.1145/2872427.2882988Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Octavian-Eugen Ganea and Thomas Hofmann. 2017. Deep Joint Entity Disambiguation with Local Neural Attention. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, EMNLP 2017, Copenhagen, Denmark, September 9--11, 2017. 2619--2629. https://aclanthology.info/papers/D17--1277/d17--1277Google ScholarGoogle ScholarCross RefCross Ref
  9. Amir Globerson, Nevena Lazic, Soumen Chakrabarti, Amarnag Subramanya, Michael Ringgaard, and Fernando Pereira. 2016. Collective Entity Resolution with Multi-Focal Attention. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, ACL 2016, August 7--12, 2016, Berlin, Germany, Volume 1: Long Papers . http://aclweb.org/anthology/P/P16/P16--1059.pdfGoogle ScholarGoogle ScholarCross RefCross Ref
  10. Edouard Grave, Tomas Mikolov, Armand Joulin, and Piotr Bojanowski. 2017. Bag of Tricks for Efficient Text Classification. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2017, Valencia, Spain, April 3--7, 2017, Volume 2: Short Papers , , Mirella Lapata, Phil Blunsom, and Alexander Koller (Eds.). Association for Computational Linguistics, 427--431. https://aclanthology.info/papers/E17--2068/e17--2068Google ScholarGoogle Scholar
  11. Han Guo, Juan Cao, Yazi Zhang, Junbo Guo, and Jintao Li. 2018. Rumor Detection with Hierarchical Social Attention Network. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management, CIKM 2018, Torino, Italy, October 22--26, 2018 , , Alfredo Cuzzocrea, James Allan, Norman W. Paton, Divesh Srivastava, Rakesh Agrawal, Andrei Z. Broder, Mohammed J. Zaki, K. Selcc uk Candan, Alexandros Labrinidis, Assaf Schuster, and Haixun Wang (Eds.). ACM, 943--951. https://doi.org/10.1145/3269206.3271709Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Zhaochen Guo and Denilson Barbosa. 2018. Robust named entity disambiguation with random walks. Semantic Web , Vol. 9, 4 (2018), 459--479. https://doi.org/10.3233/SW-170273Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Haoran Huang, Qi Zhang, and Xuanjing Huang. 2017. Mention Recommendation for Twitter with End-to-end Memory Network. In Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI 2017, Melbourne, Australia, August 19--25, 2017 , , Carles Sierra (Ed.). ijcai.org, 1872--1878. https://doi.org/10.24963/ijcai.2017/260Google ScholarGoogle ScholarCross RefCross Ref
  14. Zhiwei Jin, Juan Cao, Han Guo, Yongdong Zhang, and Jiebo Luo. 2017. Multimodal Fusion with Recurrent Neural Networks for Rumor Detection on Microblogs. In Proceedings of the 2017 ACM on Multimedia Conference, MM 2017, Mountain View, CA, USA, October 23--27, 2017, Qiong Liu, Rainer Lienhart, Haohong Wang, Sheng-Wei "Kuan-Ta" Chen, Susanne Boll, Yi-Ping Phoebe Chen, Gerald Friedland, Jia Li, and Shuicheng Yan (Eds.). ACM, 795--816. https://doi.org/10.1145/3123266.3123454Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Z. Jin, J. Cao , Y. Zhang, J. Zhou, and Q. Tian. 2017. Novel Visual and Statistical Image Features for Microblogs News Verification. IEEE Transactions on Multimedia , Vol. 19, 3 (March 2017), 598--608. https://doi.org/10.1109/TMM.2016.2617078Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Nikolaos Kolitsas, Octavian-Eugen Ganea, and Thomas Hofmann. 2018. End-to-End Neural Entity Linking. In Proceedings of the 22nd Conference on Computational Natural Language Learning, CoNLL 2018, Brussels, Belgium, October 31 - November 1, 2018, Anna Korhonen and Ivan Titov (Eds.). Association for Computational Linguistics, 519--529. https://aclanthology.info/papers/K18--1050/k18--1050Google ScholarGoogle ScholarCross RefCross Ref
  17. S Kwon, M Cha, and K Jung. 2017. Rumor Detection over Varying Time Windows. Plos One , Vol. 12, 1 (2017), e0168344--.Google ScholarGoogle ScholarCross RefCross Ref
  18. S. Kwon, M. Cha , K. Jung, W. Chen, and Y. Wang. 2013. Prominent Features of Rumor Propagation in Online Social Media. In 2013 IEEE 13th International Conference on Data Mining. 1103--1108. https://doi.org/10.1109/ICDM.2013.61Google ScholarGoogle Scholar
  19. Nevena Lazic, Amarnag Subramanya, Michael Ringgaard, and Fernando Pereira. 2015. Plato: A Selective Context Model for Entity Resolution. TACL , Vol. 3 (2015), 503--515. https://tacl2013.cs.columbia.edu/ojs/index.php/tacl/article/view/637Google ScholarGoogle Scholar
  20. Phong Le and Ivan Titov. 2018. Improving Entity Linking by Modeling Latent Relations between Mentions. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, ACL 2018, Melbourne, Australia, July 15--20, 2018, Volume 1: Long Papers , , Iryna Gurevych and Yusuke Miyao (Eds.). Association for Computational Linguistics, 1595--1604. https://aclanthology.info/papers/P18--1148/p18--1148Google ScholarGoogle ScholarCross RefCross Ref
  21. Zheng Li, Yu Zhang, Ying Wei, Yuxiang Wu, and Qiang Yang. 2017. End-to-End Adversarial Memory Network for Cross-domain Sentiment Classification. In Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI 2017, Melbourne, Australia, August 19--25, 2017, Carles Sierra (Ed.). ijcai.org, 2237--2243. https://doi.org/10.24963/ijcai.2017/311Google ScholarGoogle ScholarCross RefCross Ref
  22. Xiaomo Liu, Armineh Nourbakhsh, Quanzhi Li, Rui Fang, and Sameena Shah. 2015. Real-time Rumor Debunking on Twitter. In Proceedings of the 24th ACM International on Conference on Information and Knowledge Management (CIKM '15). ACM, New York, NY, USA, 1867--1870. https://doi.org/10.1145/2806416.2806651Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Jing Ma, Wei Gao, Prasenjit Mitra, Sejeong Kwon, Bernard J. Jansen, Kam-Fai Wong, and Meeyoung Cha. 2016. Detecting Rumors from Microblogs with Recurrent Neural Networks. In Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI 2016, New York, NY, USA, 9--15 July 2016 , , Subbarao Kambhampati (Ed.). IJCAI/AAAI Press, 3818--3824. http://www.ijcai.org/Abstract/16/537Google ScholarGoogle Scholar
  24. Jing Ma, Wei Gao, Zhongyu Wei, Yueming Lu, and Kam-Fai Wong. 2015. Detect Rumors Using Time Series of Social Context Information on Microblogging Websites. In Proceedings of the 24th ACM International Conference on Information and Knowledge Management, CIKM 2015, Melbourne, VIC, Australia, October 19 - 23, 2015 , , James Bailey, Alistair Moffat, Charu C. Aggarwal, Maarten de Rijke, Ravi Kumar, Vanessa Murdock, Timos K. Sellis, and Jeffrey Xu Yu (Eds.). ACM, 1751--1754. https://doi.org/10.1145/2806416.2806607Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Jing Ma, Wei Gao, and Kam-Fai Wong. 2018. Rumor Detection on Twitter with Tree-structured Recursive Neural Networks. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, ACL 2018, Melbourne, Australia, July 15--20, 2018, Volume 1: Long Papers , , Iryna Gurevych and Yusuke Miyao (Eds.). Association for Computational Linguistics, 1980--1989. https://aclanthology.info/papers/P18--1184/p18--1184Google ScholarGoogle ScholarCross RefCross Ref
  26. Alexander H. Miller, Adam Fisch, Jesse Dodge, Amir-Hossein Karimi, Antoine Bordes, and Jason Weston. 2016. Key-Value Memory Networks for Directly Reading Documents. CoRR , Vol. abs/1606.03126 (2016). arxiv: 1606.03126 http://arxiv.org/abs/1606.03126Google ScholarGoogle Scholar
  27. George A. Miller. 1995. WordNet: A Lexical Database for English. Commun. ACM , Vol. 38, 11 (Nov. 1995), 39--41. https://doi.org/10.1145/219717.219748Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. David N. Milne and Ian H. Witten. 2008. Learning to link with wikipedia. In Proceedings of the 17th ACM Conference on Information and Knowledge Management, CIKM 2008, Napa Valley, California, USA, October 26--30, 2008, James G. Shanahan, Sihem Amer-Yahia, Ioana Manolescu, Yi Zhang, David A. Evans, Aleksander Kolcz, Key-Sun Choi, and Abdur Chowdhury (Eds.). ACM , 509--518. https://doi.org/10.1145/1458082.1458150Google ScholarGoogle Scholar
  29. Shengsheng Qian, Tianzhu Zhang, Changsheng Xu, and Jie Shao. 2016. Multi-Modal Event Topic Model for Social Event Analysis. IEEE Trans. Multimedia , Vol. 18, 2 (2016), 233--246. https://doi.org/10.1109/TMM.2015.2510329Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Jonathan Raiman and Olivier Raiman. 2018. DeepType: Multilingual Entity Linking by Neural Type System Evolution. CoRR , Vol. abs/1802.01021 (2018). arxiv: 1802.01021 http://arxiv.org/abs/1802.01021Google ScholarGoogle Scholar
  31. Natali Ruchansky, Sungyong Seo, and Yan Liu. 2017. CSI: A Hybrid Deep Model for Fake News Detection. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, CIKM 2017, Singapore, November 06 - 10, 2017, Ee-Peng Lim, Marianne Winslett, Mark Sanderson, Ada Wai-Chee Fu, Jimeng Sun, J. Shane Culpepper, Eric Lo, Joyce C. Ho, Debora Donato, Rakesh Agrawal, Yu Zheng, Carlos Castillo, Aixin Sun, Vincent S. Tseng, and Chenliang Li (Eds.). ACM, 797--806. https://doi.org/10.1145/3132847.3132877Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Kai Shu, Amy Sliva, Suhang Wang, Jiliang Tang, and Huan Liu. 2017. Fake News Detection on Social Media: A Data Mining Perspective. SIGKDD Explorations , Vol. 19, 1 (2017), 22--36. https://doi.org/10.1145/3137597.3137600Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Karen Simonyan and Andrew Zisserman. 2015. Very Deep Convolutional Networks for Large-Scale Image Recognition. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7--9, 2015, Conference Track Proceedings, Yoshua Bengio and Yann LeCun (Eds.). http://arxiv.org/abs/1409.1556Google ScholarGoogle Scholar
  34. Fabian M. Suchanek, Gjergji Kasneci, and Gerhard Weikum. 2008. YAGO: A Large Ontology from Wikipedia and WordNet. J. Web Semant. , Vol. 6, 3 (2008), 203--217. https://doi.org/10.1016/j.websem.2008.06.001Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Sainbayar Sukhbaatar, Arthur Szlam, Jason Weston, and Rob Fergus. 2015. End-To-End Memory Networks. In Advances in Neural Information Processing Systems 28: Annual Conference on Neural Information Processing Systems 2015, December 7--12, 2015, Montreal, Quebec, Canada , , Corinna Cortes, Neil D. Lawrence, Daniel D. Lee, Masashi Sugiyama, and Roman Garnett (Eds.). 2440--2448. http://papers.nips.cc/paper/5846-end-to-end-memory-networksGoogle ScholarGoogle ScholarDigital LibraryDigital Library
  36. Yaqing Wang, Fenglong Ma, Zhiwei Jin, Ye Yuan, Guangxu Xun, Kishlay Jha, Lu Su, and Jing Gao. 2018. EANN: Event Adversarial Neural Networks for Multi-Modal Fake News Detection. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD '18). ACM, New York, NY, USA, 849--857. https://doi.org/10.1145/3219819.3219903Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Jason Weston, Sumit Chopra, and Antoine Bordes. 2015. Memory Networks. CoRR , Vol. abs/1410.3916 (2015).Google ScholarGoogle Scholar
  38. Ke Wu, Song Yang, and Kenny Q. Zhu. 2015. False rumors detection on Sina Weibo by propagation structures. In 31st IEEE International Conference on Data Engineering, ICDE 2015, Seoul, South Korea, April 13--17, 2015, Johannes Gehrke, Wolfgang Lehner, Kyuseok Shim, Sang Kyun Cha, and Guy M. Lohman (Eds.). IEEE Computer Society, 651--662. https://doi.org/10.1109/ICDE.2015.7113322Google ScholarGoogle ScholarCross RefCross Ref
  39. Wentao Wu, Hongsong Li, Haixun Wang, and Kenny Qili Zhu. 2012. Probase: a probabilistic taxonomy for text understanding. In Proceedings of the ACM SIGMOD International Conference on Management of Data, SIGMOD 2012, Scottsdale, AZ, USA, May 20--24, 2012 , , K. Selcc uk Candan, Yi Chen, Richard T. Snodgrass, Luis Gravano, and Ariel Fuxman (Eds.). ACM, 481--492. https://doi.org/10.1145/2213836.2213891Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Ikuya Yamada, Hiroyuki Shindo, Hideaki Takeda, and Yoshiyasu Takefuji. 2017. Learning Distributed Representations of Texts and Entities from Knowledge Base. TACL , Vol. 5 (2017), 397--411. https://transacl.org/ojs/index.php/tacl/article/view/1065Google ScholarGoogle ScholarCross RefCross Ref
  41. Feng Yu, Qiang Liu, Shu Wu, Liang Wang, and Tieniu Tan. 2017a. A Convolutional Approach for Misinformation Identification. In Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI 2017, Melbourne, Australia, August 19--25, 2017 , , Carles Sierra (Ed.). ijcai.org, 3901--3907. https://doi.org/10.24963/ijcai.2017/545Google ScholarGoogle ScholarCross RefCross Ref
  42. Feng Yu, Qiang Liu, Shu Wu, Liang Wang, Tieniu Tan, et almbox. 2017b. A Convolutional Approach for Misinformation Identification.. In IJCAI . 3901--3907.Google ScholarGoogle Scholar
  43. Huaiwen Zhang, Quan Fang, Shengsheng Qian, and Changsheng Xu. 2018. Learning Multimodal Taxonomy via Variational Deep Graph Embedding and Clustering. In 2018 ACM Multimedia Conference on Multimedia Conference, MM 2018, Seoul, Republic of Korea, October 22--26, 2018. 681--689. https://doi.org/10.1145/3240508.3240586Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Arkaitz Zubiaga, Maria Liakata, and Rob Procter. 2016. Learning Reporting Dynamics during Breaking News for Rumour Detection in Social Media. CoRR , Vol. abs/1610.07363 (2016). arxiv: 1610.07363 http://arxiv.org/abs/1610.07363Google ScholarGoogle Scholar
  45. Arkaitz Zubiaga, Maria Liakata, and Rob Procter. 2017. Exploiting Context for Rumour Detection in Social Media. In Social Informatics - 9th International Conference, SocInfo 2017, Oxford, UK, September 13--15, 2017, Proceedings, Part I (Lecture Notes in Computer Science), , Giovanni Luca Ciampaglia, Afra J. Mashhadi, and Taha Yasseri (Eds.), Vol. 10539. Springer, 109--123. https://doi.org/10.1007/978--3--319--67217--5_8Google ScholarGoogle Scholar

Index Terms

  1. Multi-modal Knowledge-aware Event Memory Network for Social Media Rumor Detection

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      MM '19: Proceedings of the 27th ACM International Conference on Multimedia
      October 2019
      2794 pages
      ISBN:9781450368896
      DOI:10.1145/3343031

      Copyright © 2019 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 15 October 2019

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      MM '19 Paper Acceptance Rate252of936submissions,27%Overall Acceptance Rate995of4,171submissions,24%

      Upcoming Conference

      MM '24
      MM '24: The 32nd ACM International Conference on Multimedia
      October 28 - November 1, 2024
      Melbourne , VIC , Australia

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader