skip to main content
10.1145/2808797.2810065acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article

A Multistage Credibility Analysis Model for Microblogs

Authors Info & Claims
Published:25 August 2015Publication History

ABSTRACT

Currently, microblogs such as the well-known social network Twitter are one of the most important sources of information in an era of information overload, restiveness and uncertainty. Consequently, developing models to verify information from Twitter has become both a challenging and necessary task. In this paper, we propose a novel multi-stage credibility analysis framework to identify implausible content in Twitter in order to prevent the proliferation of fake or malicious information. We used Naïve Bayes classifier and it is enhanced by considering the relative importance of the used features to improve the classification accuracy. We examine the classifier with 1000 unique tweets along with 700 account. The result quite motivating with accuracy 90.3%, 86.24% Precision and 98.8% recall.

References

  1. A. J. Flanagin and M. J. Metzger, "Digital media and youth: Unparalleled opportunity and unprecedented responsibility," Digital media, youth, and credibility, pp. 5--27, 2008.Google ScholarGoogle Scholar
  2. M. Indrawan-Santiago, H. Han, H. Nakawatase, and K. Oyama, "Evaluating credibility of interest reflection on Twitter," International Journal of Web Information Systems, vol. 10, pp. 343--362, 2014.Google ScholarGoogle ScholarCross RefCross Ref
  3. C. Castillo, M. Mendoza, and B. Poblete, "Information credibility on twitter," presented at the Proceedings of the 20th international conference on World wide web, Hyderabad, India, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. K. R. Canini, B. Suh, and P. L. Pirolli, "Finding credible information sources in social networks based on content and social structure," in Privacy, Security, Risk and Trust (PASSAT) and 2011 IEEE Third Inernational Conference on Social Computing (SocialCom), 2011 IEEE Third International Conference on, 2011, pp. 1--8.Google ScholarGoogle Scholar
  5. S. K. Sikdar, B. Kang, J. O'Donovan, T. Hollerer, and S. Adal, "Cutting through the noise: Defining ground truth in information credibility on twitter," HUMAN, vol. 2, pp. pp. 151--167, 2013.Google ScholarGoogle Scholar
  6. S. Sikdar, S. Adali, M. Amin, T. Abdelzaher, K. Chan, J. H. Cho, B. Kang, and J. O'Donovan, "Finding true and credible information on Twitter," in Information Fusion (FUSION), 2014 17th International Conference on, 2014, pp. 1--8.Google ScholarGoogle Scholar
  7. D. Saez-Trumper, "Fake Tweet Buster: A Webtool to Identify Users Promoting Fake News on Twitter," 2014.Google ScholarGoogle Scholar
  8. A. A. AlMansour, L. Brankovic, and C. S. Iliopoulos, "A Model for Recalibrating Credibility in Different Contexts and Languages-A Twitter Case Study," International Journal of Digital Information and Wireless Communications (IJDIWC), vol. 4, pp. 53--62, 2014.Google ScholarGoogle ScholarCross RefCross Ref
  9. A. Gupta and P. Kumaraguru, "Credibility ranking of tweets during high impact events," in Proceedings of the 1st Workshop on Privacy and Security in Online Social Media, 2012, p. 2. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. A. Gupta and P. Kumaraguru, "@ Twitter credibility ranking of tweets on events# breakingnews," 2012.Google ScholarGoogle Scholar
  11. S. Y. Rieh, M. R. Morris, M. J. Metzger, H. Francke, and G. Y. Jeon, "Credibility Perceptions of Content Contributors and Consumers in Social Media," 2014.Google ScholarGoogle ScholarCross RefCross Ref
  12. S. M. Shariff, X. Zhang, and M. Sanderson, "User Perception of Information Credibility of News on Twitter," in Advances in Information Retrieval, ed: Springer, 2014, pp. 513--518.Google ScholarGoogle Scholar
  13. J. Yang, S. Counts, M. R. Morris, and A. Hoff, "Microblog credibility perceptions: Comparing the usa and china," in Proceedings of the 2013 conference on Computer supported cooperative work, 2013, pp. 575--586. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. M. Schmierbach and A. Oeldorf-Hirsch, "A little bird told me, so I didn't believe it: Twitter, credibility, and issue perceptions," Communication Quarterly, vol. 60, pp. 317--337, 2012.Google ScholarGoogle ScholarCross RefCross Ref
  15. M. R. Morris, S. Counts, A. Roseway, A. Hoff, and J. Schwarz, "Tweeting is believing?: understanding microblog credibility perceptions," in Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work, 2012, pp. 441--450. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. A. Pal and S. Counts, "What's in a@ name? How Name Value Biases Judgment of Microblog Authors," in ICWSM, 2011.Google ScholarGoogle Scholar
  17. D. Westerman, P. R. Spence, and B. Van Der Heide, "A social network as information: The effect of system generated reports of connectedness on credibility on Twitter," Computers in Human Behavior, vol. 28, pp. 199--206, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. K. A. Johnson, "The effect of Twitter posts on students' perceptions of instructor credibility," Learning, Media and Technology, vol. 36, pp. 21--38, 2011.Google ScholarGoogle ScholarCross RefCross Ref
  19. C. L. Armstrong and M. J. McAdams, "Blogs of information: How gender cues and individual motivations influence perceptions of credibility," Journal of Computer-Mediated Communication, vol. 14, pp. 435--456, 2009.Google ScholarGoogle ScholarCross RefCross Ref
  20. A. A. AlMansour, L. Brankovic, and C. S. Iliopoulos, "Evaluation of credibility assessment for microblogging: models and future directions," in Proceedings of the 14th International Conference on Knowledge Technologies and Data-driven Business, 2014, p. 32. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. A. Gupta, H. Lamba, P. Kumaraguru, and A. Joshi, "Faking Sandy: characterizing and identifying fake images on Twitter during Hurricane Sandy," presented at the Proceedings of the 22nd international conference on World Wide Web companion, Rio de Janeiro, Brazil, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. A. Pal and S. Counts, "Identifying topical authorities in microblogs," in Proceedings of the fourth ACM international conference on Web search and data mining, 2011, pp. 45--54. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. B. Kang, J. O'Donovan, and T. Höllerer, "Modeling topic specific credibility on twitter," in Proceedings of the 2012 ACM international conference on Intelligent User Interfaces, 2012, pp. 179--188. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Y. Ikegami, K. Kawai, Y. Namihira, and S. Tsuruta, "Topic and Opinion Classification Based Information Credibility Analysis on Twitter," in Systems, Man, and Cybernetics (SMC), 2013 IEEE International Conference on, 2013, pp. 4676--4681. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. E. J. Briscoe, D. S. Appling, and H. Hayes, "Social Network Derived Credibility," in Recommendation and Search in Social Networks, ed: Springer, 2015, pp. 59--75.Google ScholarGoogle Scholar
  26. S. Ravikumar, R. Balakrishnan, and S. Kambhampati, "Ranking tweets considering trust and relevance," in Proceedings of the Ninth International Workshop on Information Integration on the Web, 2012, p. 4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. H. S. Al-Khalifa and R. M. Al-Eidan, "An experimental system for measuring the credibility of news content in Twitter," International Journal of Web Information Systems, vol. 7, pp. 130--151, 2011.Google ScholarGoogle ScholarCross RefCross Ref
  28. M. Abdul-Mageed, S. Kübler, and M. Diab, "Samar: A system for subjectivity and sentiment analysis of arabic social media," in Proceedings of the 3rd Workshop in Computational Approaches to Subjectivity and Sentiment Analysis, 2012, pp. 19--28 Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. A Multistage Credibility Analysis Model for Microblogs

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      ASONAM '15: Proceedings of the 2015 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining 2015
      August 2015
      835 pages
      ISBN:9781450338547
      DOI:10.1145/2808797

      Copyright © 2015 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 25 August 2015

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited

      Acceptance Rates

      Overall Acceptance Rate116of549submissions,21%

      Upcoming Conference

      KDD '24

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader