skip to main content
10.1145/2501217.2501220acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article

Towards social imagematics: sentiment analysis in social multimedia

Published:11 August 2013Publication History

ABSTRACT

Online social networks have attracted attention of people from both the academia and real world. In particular, the rich multimedia information accumulated in recent years provides an easy and convenient way for more active communication between people. This offers an opportunity to research people's behaviors and activities based on those multimedia content, which can be considered as social imagematics. One emerging area is driven by the fact that these massive multimedia data contain people's daily sentiments and opinions. However, existing sentiment analysis typically only pays attention to the textual information regardless of the visual content, which may be more informative in expressing people's sentiments and opinions. In this paper, we attempt to analyze the online sentiment changes of social media users using both the textual and visual content. In particular, we analyze the sentiment changes of Twitter users using both textual and visual features. An empirical study of real Twitter data sets indicates that the sentiments expressed in textual content and visual content are correlated. The preliminary results in this paper give insight into the important role of visual content in online social media.

References

  1. P. H. Calais Guerra, A. Veloso, W. Meira Jr, and V. Almeida. From bias to opinion: a transfer-learning approach to real-time sentiment analysis. In Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 150--158. ACM, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. N. Dalal and B. Triggs. Histograms of oriented gradients for human detection. In Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, volume 1, pages 886--893. IEEE, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. M. De Choudhury, S. Counts, and M. Gamon. Not all moods are created equal! exploring human emotional states in social media. In Sixth International AAAI Conference on Weblogs and Social Media, 2012.Google ScholarGoogle Scholar
  4. M. De Choudhury, S. Counts, and E. Horvitz. Major life changes and behavioral markers in social media: case of childbirth. In Proceedings of the 2013 conference on Computer supported cooperative work, pages 1431--1442. ACM, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. E. Gilbert and K. Karahalios. Widespread worry and the stock market. In Proceedings of the international conference on weblogs and social media, volume 2, pages 229--247, 2010.Google ScholarGoogle Scholar
  6. A. Go, R. Bhayani, and L. Huang. Twitter sentiment classification using distant supervision. Technical Report, Stanford, pages 1--12, 2009.Google ScholarGoogle Scholar
  7. S. Goel, J. M. Hofman, and M. I. Sirer. Who does what on the web: A large-scale study of browsing behavior. In Proceedings of the 6th International AAAI Conference on Weblogs and Social Media (June 2012), 2012.Google ScholarGoogle Scholar
  8. X. Hu, L. Tang, J. Tang, and H. Liu. Exploiting social relations for sentiment analysis in microblogging. In Proceedings of the sixth ACM international conference on Web search and data mining, pages 537--546. ACM, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. M. Kosinski, D. Stillwell, and T. Graepel. Private traits and attributes are predictable from digital records of human behavior. Proceedings of the National Academy of Sciences, 2013.Google ScholarGoogle ScholarCross RefCross Ref
  10. J.-F. Lalonde, D. Hoiem, A. A. Efros, C. Rother, J. Winn, and A. Criminisi. Photo clip art. In ACM Transactions on Graphics (TOG), volume 26, page 3. ACM, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. M. Miller, C. Sathi, D. Wiesenthal, J. Leskovec, and C. Potts. Sentiment flow through hyperlink networks. Proc. AAAI CWSM, 2011.Google ScholarGoogle Scholar
  12. A. Oliva and A. Torralba. Modeling the shape of the scene: A holistic representation of the spatial envelope. International journal of computer vision, 42(3):145--175, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. D. Rao, M. Paul, C. Fink, D. Yarowsky, T. Oates, and G. Coppersmith. Hierarchical bayesian models for latent attribute detection in social media. Proc. ICWSM, pages 598--601, 2011.Google ScholarGoogle Scholar
  14. E. Shechtman and M. Irani. Matching local self-similarities across images and videos. In Computer Vision and Pattern Recognition, 2007. CVPR'07. IEEE Conference on, pages 1--8. IEEE, 2007.Google ScholarGoogle ScholarCross RefCross Ref
  15. S. Siersdorfer, E. Minack, F. Deng, and J. Hare. Analyzing and predicting sentiment of images on the social web. In Proceedings of the international conference on Multimedia, pages 715--718. ACM, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. I. S. Silva, J. Gomide, A. Veloso, W. Meira Jr, and R. Ferreira. Effective sentiment stream analysis with self-augmenting training and demand-driven projection. In Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval, pages 475--484. ACM, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. M. Speriosu, N. Sudan, S. Upadhyay, and J. Baldridge. Twitter polarity classification with label propagation over lexical links and the follower graph. In Proceedings of the First Workshop on Unsupervised Learning in NLP, pages 53--63. Association for Computational Linguistics, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. C. Tan, L. Lee, J. Tang, L. Jiang, M. Zhou, and P. Li. User-level sentiment analysis incorporating social networks. arXiv preprint arXiv:1109.6018, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. F. M. F. Wong, C. W. Tan, S. Sen, and M. Chiang. Quantifying political leaning from tweets and retweets. 2013.Google ScholarGoogle Scholar
  20. J. Xiao, J. Hays, K. A. Ehinger, A. Oliva, and A. Torralba. Sun database: Large-scale scene recognition from abbey to zoo. In Computer vision and pattern recognition (CVPR), 2010 IEEE conference on, pages 3485--3492. IEEE, 2010.Google ScholarGoogle Scholar

Index Terms

  1. Towards social imagematics: sentiment analysis in social multimedia

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          MDMKDD '13: Proceedings of the Thirteenth International Workshop on Multimedia Data Mining
          August 2013
          34 pages
          ISBN:9781450323338
          DOI:10.1145/2501217

          Copyright © 2013 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 11 August 2013

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

          Acceptance Rates

          MDMKDD '13 Paper Acceptance Rate3of5submissions,60%Overall Acceptance Rate3of5submissions,60%

          Upcoming Conference

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader