Skip to main content

A Multi-criteria Decision Making Approach for the Assessment of Information Credibility in Social Media

  • Conference paper
  • First Online:
Fuzzy Logic and Soft Computing Applications (WILF 2016)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10147))

Included in the following conference series:

Abstract

In Social Media, large amounts of User Generated Content (UGC) generally diffuse without any form of trusted external control. In this context, the risk of running into misinformation is not negligible. For this reason, assessing the credibility of both information and its sources in Social Media platforms constitutes nowadays a fundamental issue for users. In the last years, several approaches have been proposed to address this issue. Most of them employ machine learning techniques to classify information and misinformation. Other approaches exploit multiple kinds of relationships connecting entities in Social Media applications, focusing on credibility and trust propagation. Unlike previous approaches, in this paper we propose a model-driven approach based on Multi-Criteria Decision Making (MCDM) and quantifier guided aggregation. An overall credibility estimate for each piece of information is obtained based on multiple criteria connected to both UGC and users generating it. The proposed model is evaluated in the context of opinion spam detection in review sites, on a real-world dataset crawled from Yelp, and it is compared with well-known supervised machine learning techniques.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    For the sake of conciseness, we omit the details concerning the definition of the function Q for the OWA + LQ + I scheme.

References

  1. Abbasi, A., Fu, T., Zeng, D., Adjeroh, D.: Crawling credible online medical sentiments for social intelligence. In: 2013 International Conference on Social Computing (SocialCom), pp. 254–263. IEEE (2013)

    Google Scholar 

  2. Banerjee, S., Chua, A.Y.: Applauses in hotel reviews: genuine or deceptive? In: 2014 Science and Information Conference (SAI), pp. 938–942. IEEE (2014)

    Google Scholar 

  3. Calvo, T., Mayor, G., Mesiar, R. (eds.): Aggregation Operators: New Trends and Applications. Physica-Verlag GmbH, Heidelberg (2002)

    MATH  Google Scholar 

  4. Castillo, C., Mendoza, M., Poblete, B.: Predicting information credibility in time-sensitive social media. Internet Res. 23(5), 560–588 (2012)

    Article  Google Scholar 

  5. Fogg, B.J., Tseng, H.: The elements of computer credibility. In: Proceeding of SIGCHI Conference on Human Factors in Computing Systems, pp. 80–87. ACM (1999)

    Google Scholar 

  6. Gupta, A., Kumaraguru, P., Castillo, C., Meier, P.: TweetCred: a real-time web-based system for assessing credibility of content on Twitter. In: Proceedings of 6th International Conference on Social Informatics (SocInfo), Barcelona, Spain (2014)

    Google Scholar 

  7. Heydari, A., ali Tavakoli, M., Salim, N., Heydari, Z.: Detection of review spam: a survey. Expert Syst. Appl. 42(7), 3634–3642 (2015)

    Article  Google Scholar 

  8. Hovland, C.I., Janis, I.L., Kelley, H.H.: Communication and Persuasion. Yale University Press, New Haven (1953)

    Google Scholar 

  9. Jin, Z., Cao, J., Jiang, Y.G., Zhang, Y.: News credibility evaluation on microblog with a hierarchical propagation model. In: 2014 IEEE International Conference on Data Mining, pp. 230–239. IEEE (2014)

    Google Scholar 

  10. Jindal, N., Liu, B.: Opinion spam and analysis. In: Proceedings of 2008 International Conference on Web Search and Data Mining, pp. 219–230. ACM (2008)

    Google Scholar 

  11. Kang, B., Höllerer, T., O’Donovan, J.: Believe it or not? Analyzing information credibility in microblogs. In: Proceedings of 2015 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining 2015, pp. 611–616. ACM (2015)

    Google Scholar 

  12. Li, H., Liu, B., Mukherjee, A., Shao, J.: Spotting fake reviews using positive-unlabeled learning. Computación y Sistemas 18(3), 467–475 (2014)

    Article  Google Scholar 

  13. Li, X., Liu, B.: Learning to classify texts using positive and unlabeled data. In: IJCAI, vol. 3, pp. 587–592 (2003)

    Google Scholar 

  14. Lim, E.P., Nguyen, V.A., Jindal, N., Liu, B., Lauw, H.W.: Detecting product review spammers using rating behaviors. In: Proceedings of 19th ACM International Conference on Information and Knowledge Management, pp. 939–948. ACM (2010)

    Google Scholar 

  15. Luca, M., Zervas, G.: Fake it till you make it: reputation, competition, and Yelp review fraud. Manag. Sci. 62(12), 3412–3427 (2016)

    Article  Google Scholar 

  16. Ma, T.J., Atkin, D.: User generated content and credibility evaluation of online health information: a meta analytic study. Telemat. Informat. (2016). In Press

    Google Scholar 

  17. Metzger, M.J., Flanagin, A.J., Eyal, K., Lemus, D.R., McCann, R.M.: Credibility for the 21st century: integrating perspectives on source, message, and media credibility in the contemporary media environment. Ann. Int. Commun. Assoc. 27(1), 293–335 (2003)

    Article  Google Scholar 

  18. Mukherjee, A., Liu, B., Glance, N.: Spotting fake reviewer groups in consumer reviews. In: Proceedings of 21st International Conference on World Wide Web, pp. 191–200. ACM (2012)

    Google Scholar 

  19. Mukherjee, A., Venkataraman, V., Liu, B., Glance, N.S.: What Yelp fake review filter might be doing? In: Proceedings of ICWSM (2013)

    Google Scholar 

  20. Mukherjee, S., Weikum, G., Danescu-Niculescu-Mizil, C.: People on drugs: credibility of user statements in health communities. In: Proceedings of 20th ACM SIGKDD International Conference, pp. 65–74. ACM (2014)

    Google Scholar 

  21. O’Donovan, J., Kang, B., Meyer, G., Höllerer, T., Adalii, S.: Credibility in context: an analysis of feature distributions in Twitter. In: Privacy, Security, Risk and Trust (PASSAT), 2012 International Conference on Social Computing, pp. 293–301. IEEE (2012)

    Google Scholar 

  22. Ott, M., Cardie, C., Hancock, J.: Estimating the prevalence of deception in online review communities. In: Proceedings of 21st International Conference on World Wide Web, pp. 201–210. ACM (2012)

    Google Scholar 

  23. Ren, Y., Ji, D., Zhang, H.: Positive unlabeled learning for deceptive reviews detection. In: EMNLP, pp. 488–498 (2014)

    Google Scholar 

  24. Seo, E., Mohapatra, P., Abdelzaher, T.: Identifying rumors and their sources in social networks. In: SPIE Defense, Security, and Sensing, p. 83891I. International Society for Optics and Photonics (2012)

    Google Scholar 

  25. Sikdar, S., Kang, B., ODonovan, J., Höllerer, T., Adah, S.: Understanding information credibility on Twitter. In: 2013 International Conference on Social Computing (SocialCom), pp. 19–24. IEEE (2013)

    Google Scholar 

  26. Wang, G., Xie, S., Liu, B., Yu, P.S.: Identify online store review spammers via social review graph. ACM Trans. Intell. Syst. Technol. (TIST) 3(4), 61 (2012)

    Google Scholar 

  27. Yager, R.R.: On ordered weighted averaging aggregation operators in multicriteria decisionmaking. IEEE Trans. Syst. Man Cybern. 18(1), 183–190 (1988)

    Article  MathSciNet  MATH  Google Scholar 

  28. Yager, R.R.: Quantifier guided aggregation using OWA operators. Int. J. Intell. Syst. 11(1), 49–73 (1996)

    Article  Google Scholar 

  29. Ye, J., Akoglu, L.: Discovering opinion spammer groups by network footprints. In: Appice, A., Rodrigues, P.P., Santos Costa, V., Soares, C., Gama, J., Jorge, A. (eds.) ECML PKDD 2015. LNCS (LNAI), vol. 9284, pp. 267–282. Springer, Heidelberg (2015). doi:10.1007/978-3-319-23528-8_17

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Marco Viviani .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Viviani, M., Pasi, G. (2017). A Multi-criteria Decision Making Approach for the Assessment of Information Credibility in Social Media. In: Petrosino, A., Loia, V., Pedrycz, W. (eds) Fuzzy Logic and Soft Computing Applications. WILF 2016. Lecture Notes in Computer Science(), vol 10147. Springer, Cham. https://doi.org/10.1007/978-3-319-52962-2_17

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-52962-2_17

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-52961-5

  • Online ISBN: 978-3-319-52962-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics