Wenyuan Yin
ABSTRACT
The ongoing revolution in media consumption from traditional PCs to the pervasiveness of mobile devices is driving the adoption of social media in our daily lives. More and more people are using their mobile devices to enjoy social media content while on the move. However, mobile display constraints create challenges for presenting and authoring the rich media content on screens with limited display size. This paper presents an innovative system to automatically generate magazine-like social media visual summaries, which is called "snippet," for efficient mobile browsing. The system excerpts the most salient and dominant elements, i.e., a major picture element and a set of textual elements, from the original media content, and composes these elements into a text overlaid image by maximizing information perception. In particular, we investigate a set of aesthetic rules and visual perception principles to optimize the layout of the extracted elements by considering display constraints. As a result, browsing the snippet on mobile devices is just like quickly glancing at a magazine. To the best of our knowledge, this paper represents one of the first attempts at automatic social media snippet generation by studying aesthetic rules and visual perception principles. We have conducted experiments and user studies with social posts from news entities. We demonstrated that the generated snippets are effective at representing media content in a visually appealing and compact way, leading to a better user experience when consuming social media content on mobile devices.
- M. Bauerly and Y. Liu. Computational modeling and experimental investigation of effects of compositional elements on interface and design aesthetics. Int. J. Human-Computer Studies, 64(8):670--682, Aug. 2006. Google Scholar
Digital Library
- T. Ben-Bassat, J. Meyer, and N. Tractinsky. Economic and subjective measures of the perceived value of aesthetics and usability. ACM Trans. Computer-Human Interaction, 13(2):210--234, June 2006. Google ScholarDigital Library
- M. S. Bernstein, B. Suh, L. Hong, J. Chen, S. Kairam, and E. H. Chi. Eddi: interactive topic-based browsing of social status streams. In Proceedings of ACM symposium on User interface software and technology, pages 303--312, 2010. Google ScholarDigital Library
- X. Chen and H. Zhang. Text area detection from video frames. In Proceedings of IEEE Pacific Rim Conference on Multimedia, pages 222--228, 2001. Google ScholarDigital Library
- D. Cohen-Or, O. Sorkine, R. Gal, T. Leyvand, and Y.-Q. Xu. Color harmonization. ACM Trans. Graph., 25(3):624--630, July 2006. Google ScholarDigital Library
- R. Datta, D. Joshi, J. Li, and J. Z. Wang. Studying aesthetics in photographic images using a computational approach. In Proceedings of European conference on Computer Vision, pages 288--301, 2006. Google ScholarDigital Library
- Flipboard. http://www.flipboard.com.Google Scholar
- X. Hou and L. Zhang. Saliency detection: A spectral residual approach. In Computer Vision and Pattern Recognition, pages 1--8, 2007.Google ScholarCross Ref
- J. Itten. The Art of Color: The Subjective Experience and Objective Rationale of Color. A VNR book. Wiley, 1974.Google Scholar
- B. Jiao, L. Yang, J. Xu, and F. Wu. Visual summarization of web pages. In Proceedings of ACM SIGIR conference on Research and development in information retrieval, pages 499--506, 2010. Google ScholarDigital Library
- S. Kaasten, S. Greenberg, and C. Edwards. How people recognize previously seen web pages from titles, urls and thumbnails. In Proceedings of Human Computer Interaction, pages 247--265, 2001.Google Scholar
- M. Kuhna, I.-M. Kivela, and P. Oittinen. Semi-automated magazine layout using content-based image features. In Proceedings of ACM Multimedia, pages 379--388, 2012. Google ScholarDigital Library
- C.-Y. Lai, P.-H. Chen, S.-W. Shih, Y. Liu, and J.-S. Hong. Computational models and experimental investigations of effects of balance and symmetry on the aesthetics of text-overlaid images. International Journal of Human-Computer Studies, 68(1--2):41 -- 56, 2010. Google ScholarDigital Library
- S. Z. Li, L. Zhu, Z. Zhang, A. Blake, H. Zhang, and H. Shum. Statistical learning of multi-view face detection. In Proceedings of European Conference on Computer Vision, pages 67--81, 2002. Google ScholarDigital Library
- Z. Li, S. Shi, and L. Zhang. Improving relevance judgment of web search results with image excerpts. In Proceedings of World Wide Web, pages 21--30, 2008. Google ScholarDigital Library
- T. Mei and X.-S. Hua. Contextual internet multimedia advertising. Proceedings of the IEEE, 98(8):1416--1433, 2010.Google ScholarCross Ref
- T. Mei, X.-S. Hua, and S. Li. Contextual in-image advertising. In Proceedings of ACM Multimedia, pages 439--448, 2008. Google ScholarDigital Library
- R. Mihalcea and P. Tarau. Textrank: Bringing order into text. In Proceedings of Conference on Empirical Methods in Natural Language Processing, pages 404--411, 2004.Google Scholar
- R. Pieters and M. Wedel. Attention capture and transfer in advertising: Brand, pictorial, and text-size effects. Journal of Marketing, 68(2):36--50, 2004.Google ScholarCross Ref
- M. Rabbath, P. Sandhaus, and S. Boll. Automatic creation of photo books from stories in social media. ACM Trans. Multimedia Comput. Commun. Appl., 7S(1):1--18, Nov. 2011. Google ScholarDigital Library
- J. Sankaranarayanan, H. Samet, B. E. Teitler, M. D. Lieberman, and J. Sperling. Twitterstand: news in tweets. In Proceedings of ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, pages 42--51, 2009. Google ScholarDigital Library
- M. Smit. Optimising advertising roi on print in a rapidly changing economic and media landscape - the contribution of eye tracking now and into the future. In Proceedings of Southern African Marketing Research Association Conference, 2012.Google Scholar
- J. Teevan, E. Cutrell, D. Fisher, S. M. Drucker, G. Ramos, P. André, and C. Hu. Visual snippets: summarizing web pages for search and revisitation. In Proceedings of SIGCHI Conference on Human Factors in Computing Systems, pages 2023--2032, 2009. Google ScholarDigital Library
- N. UzZaman, J. P. Bigham, and J. F. Allen. Multimodal summarization of complex sentences. In Proceedings of International Conference on Intelligent User Interfaces, pages 43--52, 2011. Google ScholarDigital Library
- Z. Wang, P. Cui, L. Xie, H. Chen, W. Zhu, and S. Yang. Analyzing social media via event facets. In Proceedings of ACM Multimedia, pages 1359--1360, 2012. Google ScholarDigital Library
- O. Wu, Y. Chen, B. Li, and W. Hu. Evaluating the visual quality of web pages using a computational aesthetic approach. In Proceedings of ACM International Conference on Web Search and Data Mining, pages 337--346, 2011. Google ScholarDigital Library
Index Terms
- Automatic generation of social media snippets for mobile browsing
Recommendations
Uses and gratifications of social networking sites for bridging and bonding social capital
Applying uses and gratifications theory (UGT) and social capital theory, our study examined users of four social networking sites (SNSs) (Facebook, Twitter, Instagram, and Snapchat), and their influence on online bridging and bonding social capital. ...
Social capital, social media, and TV ratings
Motivated by the increasing role of social media in relating to economic outcomes, this paper examines the relationship between social networking sites SNS and television ratings drawing from the social capital theoretical framework of bonding and ...
College students social media use and communication network heterogeneity
This study examined whether and how the usage of social media can influence college students' level of network heterogeneity and how network heterogeneity is associated with levels of bridging/bonding social capital and subjective well-being. In ...
Comments