ABSTRACT
Social media users create millions of microblog entries on various topics each day. Retweet behaviour play a crucial role in spreading topics on social media. Retweet prediction task has received considerable attention in recent years. The majority of existing retweet prediction methods are focus on modeling user preference by utilizing various information, such as user profiles, user post history, user following relationships, etc. Yet, the users exposures towards real-time posting from their followees contribute significantly to making retweet predictions, considering that the users may participate into the hot topics discussed by their followees rather than be limited to their previous interests. To make efficient use of hot topics, we propose a novel masked self-attentive model to perform the retweet prediction task by perceiving the hot topics discussed by the users' followees. We incorporate the posting histories of users with external memory and utilize a hierarchical attention mechanism to construct the users' interests. Hence, our model can be jointly hot-topic aware and user interests aware to make a final prediction. Experimental results on a dataset collected from Twitter demonstrated that the proposed method can achieve better performance than state-of-the-art methods.
Supplemental Material
- Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014. Neural Machine Translation by Jointly Learning to Align and Translate. Computer Science (2014).Google Scholar
- Bin Bi and Junghoo Cho. 2016. Modeling a retweet network via an adaptive bayesian approach. In Proceedings of the 25th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, 459--469. Google ScholarDigital Library
- Johan Bollen, Huina Mao, and Alberto Pepe. 2011. Modeling public mood and emotion: Twitter sentiment and socio-economic phenomena. Icwsm, Vol. 11 (2011), 450--453.Google Scholar
- Johan Bollen, Huina Mao, and Xiaojun Zeng. 2011. Twitter mood predicts the stock market. Journal of computational science, Vol. 2, 1 (2011), 1--8.Google ScholarCross Ref
- Danah Boyd, Scott Golder, and Gilad Lotan. 2010. Tweet, tweet, retweet: Conversational aspects of retweeting on twitter. In System Sciences (HICSS), 2010 43rd Hawaii International Conference on. IEEE, 1--10. Google ScholarDigital Library
- Kailong Chen, Tianqi Chen, Guoqing Zheng, Ou Jin, Enpeng Yao, and Yong Yu. 2012. Collaborative personalized tweet recommendation. (2012), 661--670. Google ScholarDigital Library
- Giovanni Comarela, Mark Crovella, Virgilio Almeida, and Fabricio Benevenuto. 2012. Understanding factors that affect response rates in twitter. In Proceedings of the 23rd ACM conference on Hypertext and social media. ACM, 123--132. Google ScholarDigital Library
- Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018).Google Scholar
- Zhuoye Ding, Xipeng Qiu, Qi Zhang, and Xuanjing Huang. 2013. Learning Topical Translation Model for Microblog Hashtag Suggestion. In International Joint Conference on Artificial Intelligence. 2078--2084. Google ScholarDigital Library
- Wei Feng and Jianyong Wang. 2013. Retweet or not? personalized tweet re-ranking. In Proceedings of the sixth ACM international conference on Web search and data mining. ACM, 577--586. Google ScholarDigital Library
- Syeda Nadia Firdaus, Chen Ding, and Alireza Sadeghian. 2016. Retweet prediction considering user's difference as an author and retweeter. In Proceedings of the 2016 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining. IEEE Press, 852--859. Google ScholarDigital Library
- Yuyun Gong and Qi Zhang. 2016. Hashtag recommendation using attention-based convolutional neural network. In International Joint Conference on Artificial Intelligence. 2782--2788. Google ScholarDigital Library
- Yeyun Gong, Qi Zhang, Xuyang Sun, and Xuanjing Huang. 2015. Who Will You "@"? In ACM International on Conference on Information and Knowledge Management. 533--542. Google ScholarDigital Library
- Thomas L. Griffiths and Mark Steyvers. 2004. Finding scientific topics. Proceedings of the National academy of Sciences, Vol. 101, suppl 1 (2004), 5228--5235.Google ScholarCross Ref
- Sepp Hochreiter, Yoshua Bengio, Paolo Frasconi, Jürgen Schmidhuber, et al. 2001. Gradient flow in recurrent nets: the difficulty of learning long-term dependencies. (2001).Google Scholar
- Haoran Huang, Qi Zhang, Xuanjing Huang, Haoran Huang, Qi Zhang, and Xuanjing Huang. 2017. Mention Recommendation for Twitter with End-to-end Memory Network. In Twenty-Sixth International Joint Conference on Artificial Intelligence. 1872--1878. Google ScholarDigital Library
- Haoran Huang, Qi Zhang, Jindou Wu, and Xuanjing Huang. 2017. Predicting Which Topics You Will Join in the Future on Social Media. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 733--742. Google ScholarDigital Library
- Bo Jiang, Jiguang Liang, Ying Sha, and Lihong Wang. 2015. Message clustering based matrix factorization model for retweeting behavior prediction. In Proceedings of the 24th ACM International on Conference on Information and Knowledge Management. ACM, 1843--1846. Google ScholarDigital Library
- Yoon Kim. 2014. Convolutional neural networks for sentence classification. arXiv preprint arXiv:1408.5882 (2014).Google Scholar
- Diederik Kingma and Jimmy Ba. 2014. Adam: A Method for Stochastic Optimization. Computer Science (2014).Google Scholar
- Ioannis Konstas, Vassilios Stathopoulos, and Joemon M. Jose. 2009. On social networks and collaborative recommendation. In International ACM SIGIR Conference on Research and Development in Information Retrieval. 195--202. Google ScholarDigital Library
- Ralf Krestel, Peter Fankhauser, and Wolfgang Nejdl. 2009. Latent dirichlet allocation for tag recommendation. In ACM Conference on Recommender Systems, Recsys 2009, New York, NY, USA, October. 61--68. Google ScholarDigital Library
- Ankit Kumar, Ozan Irsoy, Peter Ondruska, Mohit Iyyer, James Bradbury, Ishaan Gulrajani, Victor Zhong, Romain Paulus, and Richard Socher. 2016. Ask me anything: Dynamic memory networks for natural language processing. In International Conference on Machine Learning. 1378--1387. Google ScholarDigital Library
- Changliang Li, Liang Li, and Ji Qi. 2018. A Self-Attentive Model with Gate Mechanism for Spoken Language Understanding. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. 3824--3833.Google ScholarCross Ref
- Daniel Li and Asim Kadav. 2018. Adaptive Memory Networks. arXiv preprint arXiv:1802.00510 (2018).Google Scholar
- Bing Liu. 2012. Sentiment analysis and opinion mining. Synthesis lectures on human language technologies, Vol. 5, 1 (2012), 1--167.Google ScholarDigital Library
- Yanbing Liu, Jinzhe Zhao, and Yunpeng Xiao. 2018. C-RBFNN: A user retweet behavior prediction method for hotspot topics based on improved RBF neural network. Neurocomputing, Vol. 275 (2018), 733--746. Google ScholarDigital Library
- Zhunchen Luo, Miles Osborne, Jintao Tang, and Ting Wang. 2013. Who will retweet me? Finding retweeters in twitter. In Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval. ACM, 869--872. Google ScholarDigital Library
- Volodymyr Mnih, Nicolas Heess, Alex Graves, and Koray Kavukcuoglu. 2014. Recurrent models of visual attention. Vol. 3 (2014), 2204--2212. Google ScholarDigital Library
- Yusuke Ota, Kazutaka Maruyama, and Minoru Terada. 2012. Discovery of interesting users in twitter by overlapping propagation paths of retweets. In Web Intelligence and Intelligent Agent Technology (WI-IAT), 2012 IEEE/WIC/ACM International Conferences on, Vol. 3. IEEE, 274--279. Google ScholarDigital Library
- Michael J. Paul and Mark Dredze. 2011. You are what you Tweet: Analyzing Twitter for public health. Icwsm, Vol. 20 (2011), 265--272.Google Scholar
- Huan-Kai Peng, Jiang Zhu, Dongzhen Piao, Rong Yan, and Ying Zhang. 2011. Retweet modeling using conditional random fields. In 2011 11th IEEE International Conference on Data Mining Workshops. IEEE, 336--343. Google ScholarDigital Library
- Jeffrey Pennington, Richard Socher, and Christopher D. Manning. 2014. GloVe: Global Vectors for Word Representation. In Empirical Methods in Natural Language Processing (EMNLP). 1532--1543. http://www.aclweb.org/anthology/D14-1162Google Scholar
- Takeshi Sakaki, Makoto Okazaki, and Yutaka Matsuo. 2010. Earthquake shakes Twitter users: real-time event detection by social sensors. In Proceedings of the 19th international conference on World wide web. ACM, 851--860. Google ScholarDigital Library
- Markus Schedl and Dominik Schnitzer. 2013. Hybrid retrieval approaches to geospatial music recommendation. In International ACM SIGIR Conference on Research and Development in Information Retrieval. 793--796. Google ScholarDigital Library
- Minjoon Seo, Aniruddha Kembhavi, Ali Farhadi, and Hannaneh Hajishirzi. 2016. Bidirectional attention flow for machine comprehension. arXiv preprint arXiv:1611.01603 (2016).Google Scholar
- Bongwon Suh, Lichan Hong, Peter Pirolli, and Ed H. Chi. 2010. Want to be retweeted? large scale analytics on factors impacting retweet in twitter network. In Social computing (socialcom), 2010 ieee second international conference on. IEEE, 177--184. Google ScholarDigital Library
- Sainbayar Sukhbaatar, Arthur Szlam, Jason Weston, and Rob Fergus. 2015. End-To-End Memory Networks. Computer Science (2015).Google Scholar
- Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in Neural Information Processing Systems. 5998--6008. Google ScholarDigital Library
- Beidou Wang, Can Wang, Jiajun Bu, Chun Chen, Wei Vivian Zhang, Deng Cai, and Xiaofei He. 2013. Whom to mention: expand the diffusion of tweets by@ recommendation on micro-blogging systems. In Proceedings of the 22nd international conference on World Wide Web. ACM, 1331--1340. Google ScholarDigital Library
- Can Wang, Qiudan Li, Lei Wang, and Daniel Dajun Zeng. 2017. Incorporating message embedding into co-factor matrix factorization for retweeting prediction. In Neural Networks (IJCNN), 2017 International Joint Conference on. IEEE, 1265--1272.Google ScholarCross Ref
- Mengmeng Wang, Wanli Zuo, and Ying Wang. 2015. A multidimensional nonnegative matrix factorization model for retweeting behavior prediction. Mathematical Problems in Engineering, Vol. 2015 (2015).Google ScholarCross Ref
- Kumanan Wilson and John S. Brownstein. 2009. Early detection of disease outbreaks using the Internet. Canadian Medical Association Journal, Vol. 180, 8 (2009), 829--831.Google ScholarCross Ref
- Caiming Xiong, Victor Zhong, and Richard Socher. 2016. Dynamic coattention networks for question answering. arXiv preprint arXiv:1611.01604 (2016).Google Scholar
- Zhiheng Xu and Qing Yang. 2012. Analyzing user retweet behavior on twitter. In Advances in Social Networks Analysis and Mining (ASONAM), 2012 IEEE/ACM International Conference on. IEEE, 46--50. Google ScholarDigital Library
- Zhiheng Xu, Yang Zhang, Yao Wu, and Qing Yang. 2012. Modeling user posting behavior on social media. In Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval. ACM, 545--554. Google ScholarDigital Library
- Jing Zhang, Jie Tang, Juanzi Li, Yang Liu, and Chunxiao Xing. 2015. Who influenced you? predicting retweet via social influence locality. ACM Transactions on Knowledge Discovery from Data (TKDD), Vol. 9, 3 (2015), 25. Google ScholarDigital Library
- Jing Zhang, Jie Tang, Yuanyi Zhong, Yuchen Mo, Juanzi Li, Guojie Song, Wendy Hall, and Jimeng Sun. 2017. StructInf: Mining Structural Influence from Social Streams. In AAAI. 73--80. Google ScholarDigital Library
- Qi Zhang, Yeyun Gong, Ya Guo, and Xuanjing Huang. 2015a. Retweet Behavior Prediction Using Hierarchical Dirichlet Process. In AAAI. 403--409. Google ScholarDigital Library
- Qi Zhang, Yeyun Gong, Jindou Wu, Haoran Huang, and Xuanjing Huang. 2016. Retweet prediction with attention-based deep neural network. In Proceedings of the 25th ACM International on Conference on Information and Knowledge Management. ACM, 75--84. Google ScholarDigital Library
- Wei Zhang, Jianyong Wang, and Wei Feng. 2013. Combining latent factor model with location features for event-based group recommendation. In ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 910--918. Google ScholarDigital Library
- Xue Zhang, Hauke Fuehres, and Peter A Gloor. 2011. Predicting stock market indicators through twitter ?I hope it is not as bad as I fear". Procedia-Social and Behavioral Sciences, Vol. 26 (2011), 55--62.Google ScholarCross Ref
- Zhou Zhao, Lingtao Meng, Jun Xiao, Min Yang, Fei Wu, Deng Cai, Xiaofei He, and Yueting Zhuang. 2018. Attentional Image Retweet Modeling via Multi-Faceted Ranking Network Learning. In IJCAI. 3184--3190. Google ScholarDigital Library
- Luowei Zhou, Yingbo Zhou, Jason J. Corso, Richard Socher, and Caiming Xiong. 2018. End-to-End Dense Video Captioning with Masked Transformer. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 8739--8748.Google ScholarCross Ref
Index Terms
- Hot Topic-Aware Retweet Prediction with Masked Self-attentive Model
Recommendations
Predicting retweet count using visual cues
CIKM '13: Proceedings of the 22nd ACM international conference on Information & Knowledge ManagementSocial media platforms allow rapid information diffusion, and serve as a source of information to many of the users. Particularly, in Twitter information provided by tweets diffuses over the users through retweets. Hence, being able to predict the ...
Predicting individual retweet behavior by user similarity
Users read microblogs and retweet the most "interesting" tweets to their friends in online social networks. Predicting retweet behavior is extremely challenging due to various reasons. First, the most of existing approaches primarily discuss a global ...
Prediction of retweet cascade size over time
CIKM '12: Proceedings of the 21st ACM international conference on Information and knowledge managementRetweet cascades play an essential role in information diffusion in Twitter. Popular tweets reflect the current trends in Twitter, while Twitter itself is one of the most important online media. Thus, understanding the reasons why a tweet becomes ...
Comments