Skip to main content

Evaluating Preprocessing Techniques in Identifying Fake News

  • Conference paper
  • First Online:
Intelligent Systems Design and Applications (ISDA 2020)

Abstract

Combating the circulation of disinformation has been increasing since this type of news can influence people’s behavior and opinion. One way to deal with this problem is to develop automated fact-checking systems with machine learning techniques. An essential step in the generation of classifying models is data preprocessing. This work compared analysis using different preprocessing methodologies to normalization, transformation, and feature selection in a Portuguese Language Corpus that contained fake and legitimate news. We obtained better results compared to the current approaches presented in the literature.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Allcott, H., Gentzkow, M.: Social media and fake news in the 2016 election. J. Econ. Perspect. 31(2), 211–36 (2017)

    Article  Google Scholar 

  2. Bennett, W.L., Livingston, S.: The disinformation order: disruptive communication and the decline of democratic institutions. Eur. J. Commun. 33(2), 122–139 (2018)

    Article  Google Scholar 

  3. Conroy, N.J., Rubin, V.L., Chen, Y.: Automatic deception detection: methods for finding fake news. Proc. Assoc. Inf. Sci. Technol. 52(1), 1–4 (2015)

    Article  Google Scholar 

  4. García, S., Luengo, J., Herrera, F.: Data Preprocessing in Data Mining. Springer, Heidelberg (2015)

    Google Scholar 

  5. Graves, D.: Understanding the promise and limits of automated fact-checking (2018)

    Google Scholar 

  6. Hassan, N., Adair, B., Hamilton, J.T., Li, C., Tremayne, M., Yang, J., Yu, C.: The quest to automate fact-checking. In: Proceedings of the 2015 Computation + Journalism Symposium (2015)

    Google Scholar 

  7. Hassan, N., Arslan, F., Li, C., Tremayne, M.: Toward automated fact-checking: detecting check-worthy factual claims by claimbuster. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1803–1812 (2017)

    Google Scholar 

  8. Kotsiantis, S., Kanellopoulos, D., Pintelas, P.: Data preprocessing for supervised leaning. Int. J. Comput. Sci. 1(2), 111–117 (2006)

    Google Scholar 

  9. Lazer, D.M., Baum, M.A., Benkler, Y., Berinsky, A.J., Greenhill, K.M., Menczer, F., Metzger, M.J., Nyhan, B., Pennycook, G., Rothschild, D., et al.: The science of fake news. Science 359(6380), 1094–1096 (2018)

    Article  Google Scholar 

  10. Liu, H., Motoda, H.: Computational Methods of Feature Selection. CRC Press, Boca Raton (2007)

    Book  Google Scholar 

  11. Monteiro, R.A., Santos, R.L., Pardo, T.A., de Almeida, T.A., Ruiz, E.E., Vale, O.A.: Contributions to the study of fake news in Portuguese: new corpus and automatic detection results. In: International Conference on Computational Processing of the Portuguese Language, pp. 324–334. Springer, Heidelberg (2018)

    Google Scholar 

  12. Osborne, J.: Improving your data transformations: applying the box-cox transformation. Pract. Assess. Res. Eval. 15(1), 12 (2010)

    Google Scholar 

  13. Patro, S., Sahu, K.K.: Normalization: A preprocessing stage. arXiv preprint arXiv:1503.06462 (2015)

  14. Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., Duchesnay, E.: Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825–2830 (2011)

    MathSciNet  MATH  Google Scholar 

  15. Rocha Jr, D.B., Lins, A.J.D.C.C., de Souza, A.C.F., de Oliveira Libório, L.F., de Brito Leitão, A.H., Santos, F.H.S.: Verific. ai application: automated fact-checking in Brazilian 2018 general elections. Brazil. J. Res. 15(3), 514 (2019)

    Google Scholar 

  16. Ruiz, M.J.U., Verdú, F.J.M.: El fact checking: en busca de un nuevo modelo de negocio sostenible para el periodismo. estudio de caso de miniver. Miguel Hernández Commun. J. (9), 511–534 (2018)

    Google Scholar 

  17. Shu, K., Sliva, A., Wang, S., Tang, J., Liu, H.: Fake news detection on social media: a data mining perspective. ACM SIGKDD Explor. Newsl. 19(1), 22–36 (2017)

    Article  Google Scholar 

  18. Cardoso Durier da Silva, F., Vieira, R., Garcia, A.C.: Can machines learn to detect fake news? a survey focused on social media. In: Proceedings of the 52nd Hawaii International Conference on System Sciences (2019)

    Google Scholar 

  19. Silva, R.M., Santos, R.L., Almeida, T.A., Pardo, T.A.: Towards automatically filtering fake news in Portuguese. Expert Syst. Appl., 113199 (2020)

    Google Scholar 

  20. Tandoc Jr., E.C., Lim, Z.W., Ling, R.: Defining “fake news" a typology of scholarly definitions. Dig. J. 6(2), 137–153 (2018)

    Google Scholar 

  21. Thorne, J., Vlachos, A.: Automated fact checking: Task formulations, methods and future directions. arXiv preprint arXiv:1806.07687 (2018)

  22. Zhou, X., Zafarani, R., Shu, K., Liu, H.: Fake news: fundamental theories, detection strategies and challenges. In: Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, pp. 836–837 (2019)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Marinho, M., Bastos-Filho, C.J.A., Lins, A. (2021). Evaluating Preprocessing Techniques in Identifying Fake News. In: Abraham, A., Piuri, V., Gandhi, N., Siarry, P., Kaklauskas, A., Madureira, A. (eds) Intelligent Systems Design and Applications. ISDA 2020. Advances in Intelligent Systems and Computing, vol 1351. Springer, Cham. https://doi.org/10.1007/978-3-030-71187-0_46

Download citation

Publish with us

Policies and ethics