Jiejun Xu
ABSTRACT
We propose an approach to automatically select a set of representative images to generate a concise visual summary of a real-world event from the Tumblr microblogging platform. Central to our approach is a unified graph model with heterogeneous nodes and edges to capture the interrelationship among various entities (e.g., users, posts, images, and tags) in online social media. With the graph representation, we then cast the summarization problem as a graph-based ranking problem by identifying the most representative images regarding to an event. The intuition behind our work is that not only can we crowdsource social media users as sensors to capture and share data, but we can also use them as filters to identify the most useful information through analyzing their interaction in the microblogging network. In addition, we propose a greedy algorithm to encourage diversity among top ranked results for the generation of temporal highlights of targeted events. Our approach is flexible to support different query tasks and is adaptable to additional graph entities and relationships.
- Tumblr Data - Gnip. https://gnip.com/sources/tumblr/, 2014.Google Scholar
- Cao, L., Luo, J., Gallagher, A. C., Jin, X., Han, J., and Huang, T. S. A worldwide tourism recommendation system based on geotagged web photos. In ICASSP (2010), 2274--2277.Google Scholar
- Chakrabarti, D., and Punera, K. Event summarization using tweets. In ICWSM (2011).Google Scholar
- Chua, F. C. T., and Asur, S. Automatic summarization of events from social media. In ICWSM (2013).Google Scholar
- Gao, H., Barbier, G., and Goolsby, R. Harnessing the crowdsourcing power of social media for disaster relief. IEEE Intelligent Systems 26, 3 (May 2011), 10--14. Google ScholarDigital Library
- Hua, T., Lu, C.-T., Ramakrishnan, N., Chen, F., Arredondo, J., Mares, D., and Summers, K. M. Analyzing civil unrest through social media. IEEE Computer 46, 12 (2013), 80--84. Google ScholarDigital Library
- Kennedy, L., Naaman, M., Ahern, S., Nair, R., and Rattenbury, T. How flickr helps us make sense of the world: context and content in community-contributed media collections. In ACM Multimedia (2007). Google ScholarDigital Library
- Lee, J. H. Crowdsourcing music similarity judgments using mechanical turk. In ISMIR (2010), 183--188.Google Scholar
- Meng, X., Wei, F., Liu, X., Zhou, M., Li, S., and Wang, H. Entity-centric topic-oriented opinion summarization in twitter. In KDD, ACM (2012), 379--387. Google ScholarDigital Library
- Nichols, J., Mahmud, J., and Drews, C. Summarizing sporting events using twitter. In IUI, ACM (2012), 189--198. Google ScholarDigital Library
- Pang, Y., Hao, Q., Yuan, Y., Hu, T., Cai, R., and Zhang, L. Summarizing tourist destinations by mining user-generated travelogues and photos. Computer Vision and Image Understanding 115, 3 (2011), 352--363. Google ScholarDigital Library
- Rudinac, S., Hanjalic, A., and Larson, M. Finding representative and diverse community contributed images to create visual summaries of geographic areas. In ACM Multimedia (2011). Google ScholarDigital Library
- Sharifi, B., Hutton, M.-A., and Kalita, J. Summarizing microblogs automatically. HLT '10, Association for Computational Linguistics (2010), 685--688. Google ScholarDigital Library
- Signorini, A., Segre, A. M., and Polgreen, P. M. The use of twitter to track levels of disease activity and public concern in the u.s. during the influenza a h1n1 pandemic. PLoS ONE 6, 5 (05 2011), e19467.Google Scholar
- Wang, Z., Cui, P., Xie, L., Chen, H., Zhu, W., and Yang, S. Analyzing social media via event facets. In Proceedings of the 20th ACM International Conference on Multimedia, MM '12, ACM (New York, NY, USA, 2012), 1359--1360. Google ScholarDigital Library
- Xu, J., Compton, R., Lu, T.-C., and Allen, D. Rolling through tumblr: Characterizing behavioral patterns of the microblogging platform. In ACM Web Science (2014). Google ScholarDigital Library
- Xu, J., Lu, T.-C., Compton, R., and Allen, D. Civil unrest prediction: A tumblr-based exploration. In SBP (2014).Google Scholar
- Yang, X., Ghoting, A., Ruan, Y., and Parthasarathy, S. A framework for summarizing and analyzing twitter feeds. In KDD, ACM (2012), 370--378. Google ScholarDigital Library
- Yin, W., Mei, T., and Chen, C. W. Automatic generation of social media snippets for mobile browsing. In ACM Multimedia (New York, NY, USA, 2013). Google ScholarDigital Library
- Zhou, D., Weston, J., Gretton, A., Bousquet, O., and Schölkopf, B. Ranking on data manifolds. In Neural Information Processing Systems (NIPS) (2003).Google Scholar
Index Terms
- Seeing the Big Picture from Microblogs: Harnessing Social Signals for Visual Event Summarization
Recommendations
#VisualHashtags: Visual Summarization of Social Media Events Using Mid-Level Visual Elements
MM '17: Proceedings of the 25th ACM international conference on MultimediaThe data generated on social media sites continues to grow at an increasing rate with more than 36% of tweets containing images making the dominance of multimedia content evidently visible. This massive user generated content has become a reflection of ...
Social Media as Social Transition Machinery
Social media, and people's online self-presentations and social networks, add complexity to people's experiences managing changing identities during life transitions. I use gender transition as a case study to understand how people experience liminality ...
'alksjdf;Lksfd': tumblr and the fandom user experience
DIS '14: Proceedings of the 2014 conference on Designing interactive systemsA growing trend is the participation in online fandom communities through the support of the blogging platform Tumblr. While past research has investigated backchannels-chatter related to live entertainment on micro-blogging sites such as Twitter-there ...
Comments