Skip to main content
SpringerLink
Log in

Illegal Aliens or Undocumented Immigrants? Towards the Automated Identification of Bias by Word Choice and Labeling

  • Conference paper
  • First Online:
Information in Contemporary Society (iConference 2019)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 11420))

Included in the following conference series:

Abstract

Media bias, i.e., slanted news coverage, can strongly impact the public perception of topics reported in the news. While the analysis of media bias has recently gained attention in computer science, the automated methods and results tend to be simple when compared to approaches and results in the social sciences, where researchers have studied media bias for decades. We propose Newsalyze, a work-in-progress prototype that imitates a manual analysis concept for media bias established in the social sciences. Newsalyze aims to find instances of bias by word choice and labeling in a set of news articles reporting on the same event. Bias by word choice and labeling (WCL) occurs when journalists use different phrases to refer to the same semantic concept, e.g., actors or actions. This way, instances of bias by WCL can induce strongly divergent emotional responses from readers, such as the terms “illegal aliens” vs. “undocumented immigrants.” We describe two critical tasks of the analysis workflow, finding and mapping such phrases, and estimating their effects on readers. For both tasks, we also present first results, which indicate the effectiveness of exploiting methods and models from the social sciences in an automated approach.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    The paragraphs about manual and automated approaches have been adapted partially from [21].

References

  1. Alsem, K.J., et al.: The impact of newspapers on consumer confidence: does spin bias exist? Appl. Econ. 40(5), 531–539 (2008). https://doi.org/10.1080/00036840600707100

    Article  Google Scholar 

  2. Angeli, G., et al.: Leveraging linguistic structure for open domain information extraction. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (vol. 1: Long Papers), pp. 344–354 (2015)

    Google Scholar 

  3. Baker, B.H., et al.: How to Identify, Expose & Correct Liberal Media Bias. Media Research Center, Alexandria (1994)

    Google Scholar 

  4. Balahur, A., et al.: Sentiment analysis in the news. arXiv preprint arXiv:1309.6202 (2013)

  5. Baumer, E.P.S., et al.: Testing and comparing computational approaches for identifying the language of framing in political news. In: Human Language Technologies: The 2015 Annual Conference of the North American Chapter of the ACL, Denver, Colorado, USA, pp. 1472–1482 (2015)

    Google Scholar 

  6. Business Insider: These 6 Corporations Control 90% of the Media in America. Lutz, Ashley (2014)

    Google Scholar 

  7. Chang, A.X., et al.: A comparison of named-entity disambiguation and word sense disambiguation. In: LREC, pp. 860–867 (2016)

    Google Scholar 

  8. Chong, D., Druckman, J.N.: Framing theory. Ann. Rev. Polit. Sci. 10(1), 103–126 (2007). https://doi.org/10.1146/annurev.polisci.10.072805.103054

    Article  Google Scholar 

  9. Clark, K., Manning, C.D.: Deep reinforcement learning for mention-ranking coreference models. In: Empirical Methods on Natural Language Processing (2016)

    Google Scholar 

  10. Crossley, S.A., et al.: Sentiment analysis and social cognition engine (SEANCE): an automatic tool for sentiment, social cognition, and social-order analysis. Behav. Res. Method. 49(3), 803–821 (2017). https://doi.org/10.3758/s13428-016-0743-z

    Article  Google Scholar 

  11. DellaVigna, S., Kaplan, E.: The fox news effect: media bias and voting. Q. J. Econ. 122(3), 1187–1234 (2007). https://doi.org/10.3386/w12169

    Article  Google Scholar 

  12. Ekman, P.: An argument for basic emotions. Cogn. Emot. 6, 169–200 (1992). https://doi.org/10.1080/02699939208411068

    Article  Google Scholar 

  13. Entman, R.M.: Framing: toward clarification of a fractured paradigm. J. Commun. 43(4), 51–58 (1993)

    Article  Google Scholar 

  14. Entman, R.M.: Framing bias: media in the distribution of power. J. Commun. 57(1), 163–173 (2007)

    Article  Google Scholar 

  15. Evans, D.K., et al.: Columbia newsblaster: multilingual news summarization on the web. In: Demonstration Papers at HLT-NAACL, pp. 1–4 (2004)

    Google Scholar 

  16. Fast, E., et al.: Empath: understanding topic signals in large-scale text. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI 2016, San Jose, California, USA, pp. 4647–4657 (2016)

    Google Scholar 

  17. Frey, B.J., Dueck, D.: Clustering by passing messages between data points. Science 315(5814), 972–976 (2007). https://doi.org/10.1126/science.1136800

    Article  MathSciNet  MATH  Google Scholar 

  18. Gauthier, G.: In defence of a supposedly outdated notion: the range of application of journalistic objectivity. Can. J. Commun. 18(4), 497 (1993)

    Article  Google Scholar 

  19. Gentzkow, M., Shapiro, J.: Media bias and reputation. J. Polit. Econ. 114(2), 280–316 (2006). https://doi.org/10.1086/499414

    Article  Google Scholar 

  20. Groseclose, T., Milyo, J.: A measure of media bias. Q. J. Econ. 120(4), 1191–1237 (2005). https://doi.org/10.1162/003355305775097542

    Article  Google Scholar 

  21. Hamborg, F., et al. Automated identification of media bias in news articles: an interdisciplinary literature review. Int. J. Digit. Libr. (2018). https://doi.org/10.1007/s00799-018-0261-y

  22. Hamborg, F., et al.: Bias-aware news analysis using matrix-based news aggregation. Int. J. Digit. Libr. (2018). https://doi.org/10.1007/s00799-018-0239-9

  23. Hamborg, F., et al.: Extraction of main event descriptors from news articles by answering the journalistic Five W and One H questions. In: Proceedings of the ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL), Fort Worth, Texas, USA, pp. 339–340 (2018)

    Google Scholar 

  24. Hamborg, F., Lachnit, S., Schubotz, M., Hepp, T., Gipp, B.: Giveme5 W: main event retrieval from news articles by extraction of the five journalistic W questions. In: Chowdhury, G., McLeod, J., Gillet, V., Willett, P. (eds.) iConference 2018. LNCS, vol. 10766, pp. 356–366. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-78105-1_39

    Chapter  Google Scholar 

  25. Hamborg, F., et al.: Identification and analysis of media bias in news articles. In: Proceedings of the 15th International Symposium of Information Science, pp. 224–236 (2017)

    Google Scholar 

  26. Hamborg, F., et al.: News-please: a generic news crawler and extractor. In: Proceedings of the 15th International Symposium of Information Science, pp. 218–223(2017)

    Google Scholar 

  27. Kaya, M., et al.: Sentiment analysis of Turkish political news. In: Proceedings of the 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology, vol. 01, pp. 174–180 (2012)

    Google Scholar 

  28. Lee, Y.: To dream or not to dream: a cost-benefit analysis of the development, relief, and education for alien minors (DREAM) act. Cornell J. Law Public Policy 16(1), 231 (2006)

    Google Scholar 

  29. Lim, S., et al.: Towards bias inducing word detection by linguistic cue analysis in news articles (2018)

    Google Scholar 

  30. Lin, K.H.-Y., et al.: What emotions do news articles trigger in their readers? In: Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval - SIGIR 2007, p. 733 (2007)

    Google Scholar 

  31. McCarthy, J., et al.: Assessing stability in the patterns of selection bias in newspaper coverage of protest during the transition from communism in Belarus. Mobil.: Int. Q. 13(2), 127–146 (2008)

    Google Scholar 

  32. Mehler, A., et al.: Spatial analysis of news sources. IEEE Trans. Vis. Comput. Graph. 13, 127–146 (2006)

    Google Scholar 

  33. Mikolov, T., et al.: Efficient estimation of word representations in vector space. In: Proceedings of the International Conference on Learning Representations (ICLR 2013) (2013). https://doi.org/10.1162/153244303322533223

  34. Mitchell, A., et al.: Political polarization and media habits. Pew Research Center (2014)

    Google Scholar 

  35. Munson, S.A., et al.: Encouraging reading of diverse political viewpoints with a browser widget. In: ICWSM (2013)

    Google Scholar 

  36. Munson, S.A., et al.: Sidelines: an algorithm for increasing diversity in news and opinion aggregators. In: ICWSM (2009)

    Google Scholar 

  37. Munson, S.A., Resnick, P.: Presenting diverse political opinions: how and how much. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1457–1466 (2010)

    Google Scholar 

  38. News Bias Explored - The art of reading the news (2014). http://umich.edu/~newsbias/. Accessed 01 Aug 2018

  39. Niven, D.: Tilt?: The Search for Media Bias. Greenwood Publishing Group, Westport (2002)

    Google Scholar 

  40. Oelke, D., et al.: Visual analysis of explicit opinion and news bias in German soccer articles. In: EuroVis Workshop on Visual Analytics, Vienna, Austria (2012)

    Google Scholar 

  41. Oliver, P.E., Maney, G.M.: Political processes and local newspaper coverage of protest events: from selection bias to triadic interactions. Am. J. Sociol. 106(2), 463–505 (2000)

    Article  Google Scholar 

  42. Papacharissi, Z., de Fatima Oliveira, M.: News frames terrorism: a comparative analysis of frames employed in terrorism coverage in U.S. and U.K. newspapers. Int. J. Press/Polit. 13(1), 52–74 (2008). https://doi.org/10.1177/1940161207312676

    Article  Google Scholar 

  43. Park, S., et al.: NewsCube: delivering multiple aspects of news to mitigate media bias. In: Proceedings of CHI 2009, The SIGCHI Conference on Human Factors in Computing Systems, pp. 443–453 (2009). https://doi.org/10.1145/1518701.1518772

  44. Park, S., et al.: NewsCube 2.0: an exploratory design of a social news website for media bias mitigation. In: Workshop on Social Recommender Systems (2011)

    Google Scholar 

  45. Park, S., et al.: The politics of comments: predicting political orientation of news stories with commenters’ sentiment patterns. In: Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work, pp. 113–122 (2011)

    Google Scholar 

  46. Price, V., et al.: Framing public discussion of gay civil unions. Public Opin. Q. 69, 179–212 (2005)

    Article  Google Scholar 

  47. Recasens, M., et al.: Linguistic models for analyzing and detecting biased language. In: Proceedings of the 51st Annual Meeting on Association for Computational Linguistics, pp. 1650–1659 (2013)

    Google Scholar 

  48. Rugg, D.: Experiments in wording questions: II. Public Opin. Q. 5, 91 (1941). https://doi.org/10.1086/265467

    Article  Google Scholar 

  49. Schuldt, J.P., et al.: “Global warming” or “climate change”? Whether the planet is warming depends on question wording. Public Opin. Q. 75, 115–124 (2011). https://doi.org/10.1093/poq/nfq073

    Article  Google Scholar 

  50. Smith, A., et al.: Hiérarchie: interactive visualization for hierarchical topic models. In: Proceedings of the Workshop on Interactive Language Learning, Visualization, and Interfaces, pp. 71–78 (2014)

    Google Scholar 

  51. Smith, M.S., et al.: The General Inquirer: A Computer Approach to Content Analysis. American Sociological Review (1967)

    Google Scholar 

  52. Speer, R., Havasi, C.: Representing general relational knowledge in ConceptNet 5. In: Proceedings of the Eight International Conference on Language Resources and Evaluation, LREC 2012 (2012)

    Google Scholar 

  53. Strapparava, C., Mihalcea, R.: Semeval-2007 task 14: affective text. In: Proceedings of the 4th International Workshop on Semantic Evaluations, pp. 70–74 (2007)

    Google Scholar 

  54. Tausczik, Y.R., Pennebaker, J.W.: The psychological meaning of words: LIWC and computerized text analysis methods. J. Lang. Soc. Psychol. 29(1), 24–54 (2010). https://doi.org/10.1177/0261927X09351676

    Article  Google Scholar 

Download references

Acknowledgements

This work was partially supported by the Carl Zeiss Foundation and the Zukunftskolleg program of the University of Konstanz. We thank the anonymous reviewers for their valuable comments.

Author information

Authors and Affiliations

  1. University of Konstanz, Constance, Germany

    Felix Hamborg, Anastasia Zhukova & Bela Gipp

Authors
  1. Felix Hamborg
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Anastasia Zhukova
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Bela Gipp
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Felix Hamborg .

Editor information

Editors and Affiliations

  1. University of South Florida, Tampa, FL, USA

    Natalie Greene Taylor

  2. University of Maryland, College Park, MD, USA

    Caitlin Christian-Lamb

  3. University of Washington, Seattle, WA, USA

    Michelle H. Martin

  4. University of California, Irvine, Irvine, CA, USA

    Bonnie Nardi

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Hamborg, F., Zhukova, A., Gipp, B. (2019). Illegal Aliens or Undocumented Immigrants? Towards the Automated Identification of Bias by Word Choice and Labeling. In: Taylor, N., Christian-Lamb, C., Martin, M., Nardi, B. (eds) Information in Contemporary Society. iConference 2019. Lecture Notes in Computer Science(), vol 11420. Springer, Cham. https://doi.org/10.1007/978-3-030-15742-5_17

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-15742-5_17

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-15741-8

  • Online ISBN: 978-3-030-15742-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation