Abstract
Online news websites face an increasing amount of hateful reactions of readers, and reactive attempts at enabling more civil discourse, such as moderation, do not prove sufficient. In this study, we propose a proactive approach to counter anti-social behavior by redesigning the comment section’s interface. We conducted an exploratory online experiment with 255 participants to determine the impact of including a discussion statement related to the news article’s topic in combination with two types of opinion elements. Results reveal a significant positive effect of the novel interfaces on civility and relevance, compared to a traditional comment section (control group). Users evaluated the pragmatic qualities of the traditional comment section significantly more positive compared to the interface with a discussion statement and the continuous opinion element.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
The choice to request participants’ name was relevant with the goal of making the experiment as realistic as possible, since many online platforms do not allow anonymous comments. However, during the first days of the pilot study, many respondents left the questionnaire at this stage. Based upon this finding, an ‘anonymous’ option was added, and consequently, the completion rate of the pilot survey increased.
- 2.
Original comments were translated into English.
- 3.
We found no significant impact of anonymity on the comment quality variables.
References
Acquisti, A., et al.: Nudges for privacy and security: understanding and assisting users’ choices online. ACM Comput. Surv. 50(3), 1–41 (2017). https://doi.org/10.1145/3054926
Anderson, A.A., et al.: The “nasty effect:” online incivility and risk perceptions of emerging technologies: crude comments and concern. J. Comput.-Mediat. Commun. 19(3), 373–387 (2014). https://doi.org/10.1111/jcc4.12009
Arkes, H.R.: Costs and benefits of judgment errors. Psychol. Bull. 110(3), 486–498 (1991)
Bachleda, S., et al.: Individual-level differences in negativity biases in news selection. Pers. Individ. Differ. 155, 109675 (2020). https://doi.org/10.1016/j.paid.2019.109675
Baumeister, R.F., et al.: Bad is stronger than good. Rev. Gen. Psychol. 5(4), 323–370 (2001). https://doi.org/10.1037/1089-2680.5.4.323
Beckert, J., Ziegele, M.: The effects of personality traits and situational factors on the deliberativeness and civility of user comments on news websites. Int. J. Commun. (Online) 3924, 22 (2020)
Berg, J.: The impact of anonymity and issue controversiality on the quality of online discussion. J. Inf. Technol. Polit. 13(1), 37–51 (2016). https://doi.org/10.1080/19331681.2015.1131654
Blank, G., Reisdorf, B.C.: The participatory web: a user perspective on Web 2.0. Inf. Commun. Soc. 15(4), 537–554 (2012)
Brückner, L., Schweiger, W.: Facebook discussions of journalistic news: investigating article objectivity, topic, and media brand as influencing factors. SCM 6(4), 365–394 (2017). https://doi.org/10.5771/2192-4007-2017-4-365
Chen, G.M.: Online Incivility and Public Debate. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-56273-5
Chen, M., et al.: We should not get rid of incivility online. Soc. Media Soc. 5(3), 1–5 (2019)
Cheng, F.-F., Wu, C.-S.: Debiasing the framing effect: the effect of warning and involvement. Decis. Support Syst. 49(3), 328–334 (2010)
Coe, K., et al.: Online and uncivil? Patterns and determinants of incivility in newspaper website comments. J. Commun. 64(4), 658–679 (2014). https://doi.org/10.1111/jcom.12104
Correia, V.: Contextual debiasing and critical thinking: reasons for optimism. Topoi 37(1), 103–111 (2016). https://doi.org/10.1007/s11245-016-9388-x
Croskerry, P., et al.: Cognitive debiasing 2: impediments to and strategies for change. BMJ Qual. Saf. 22(2), ii65–ii72 (2013). https://doi.org/10.1136/bmjqs-2012-001713
Curran, J., et al.: Media system, public knowledge and democracy: a comparative study. Eur. J. Commun. 24(1), 5–26 (2009). https://doi.org/10.1177/0267323108098943
Darics, E.: Politeness in computer-mediated discourse of a virtual team. J. Politeness Res. Lang. Behav. Cult. 6(1), 129–150 (2010)
Diakopoulos, N., Naaman, M.: Towards quality discourse in online news comments. In: Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work, pp. 133–142. Association for Computing Machinery, New York (2011)
Diakopoulos, N.A.: The editor’s eye: curation and comment relevance on the New York times. In: Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing, CSCW 2015, pp. 1153–1157. ACM Press, Vancouver (2015). https://doi.org/10.1145/2675133.2675160
Engelke, K.M.: Enriching the conversation: audience perspectives on the deliberative nature and potential of user comments for news media. Digit. J. 8(4), 447–466 (2020)
Esau, K., Friess, D., Eilders, C.: Design matters! An empirical analysis of online deliberation on different news platforms. Policy Internet 9(3), 321–342 (2017)
Fogg, B.J.: Persuasive Technology: Using Computers to Change What We Think and Do. Morgan Kaufmann Publishers, Amsterdam (2003)
Fredheim, R., et al.: Anonymity and online commenting: the broken windows effect and the end of drive-by commenting. In: Proceedings of the ACM Web Science Conference on ZZZ, WebSci 2015, pp. 1–8. ACM Press, Oxford (2015). https://doi.org/10.1145/2786451.2786459
Friess, D., Eilders, C.: A systematic review of online deliberation research. Policy Internet 7(3), 319–339 (2015)
Galtung, J., Ruge, M.H.: The structure of foreign news: the presentation of the Congo, Cuba and Cyprus crises in four Norwegian newspapers. J. Peace Res. 2(1), 64–90 (1965). https://doi.org/10.1177/002234336500200104
Gervais, B.T.: Incivility online: affective and behavioral reactions to uncivil political posts in a web-based experiment. J. Inf. Technol. Polit. 12(2), 167–185 (2015). https://doi.org/10.1080/19331681.2014.997416
Godi, M.: Beyond nudging: debiasing consumers through mixed framing. Yale Law J. 128(7), 2034–2086 (2019)
Graf, J., et al.: The role of civility and anonymity on perceptions of online comments. Mass Commun. Soc. 20(4), 526–549 (2017). https://doi.org/10.1080/15205436.2016.1274763
Halpern, D., Gibbs, J.: Social media as a catalyst for online deliberation? Exploring the affordances of Facebook and YouTube for political expression. Comput. Hum. Behav. 29(3), 1159–1168 (2013). https://doi.org/10.1016/j.chb.2012.10.008
Han, S.-H., et al.: Is civility contagious? Examining the impact of modeling in online political discussions. Soc. Media Soc. 4(3) (2018). https://doi.org/10.1177/2056305118793404
Han, S.-H., Brazeal, L.M.: Playing nice: modeling civility in online political discussions. Commun. Res. Rep. 32(1), 20–28 (2015). https://doi.org/10.1080/08824096.2014.989971
Herbst, S.: Rude Democracy: Civility and Incivility in American Politics. Temple University Press, Philadelpia (2010)
Hermida, A., Thurman, N.: A clash of cultures: the integration of user-generated content within professional journalistic frameworks at British newspaper websites. J. Pract. 2(3), 343–356 (2008)
Hullman, J., Diakopoulos, N.: Visualization rhetoric: framing effects in narrative visualization. IEEE Trans. Vis. Comput. Graph. 17(12), 2231–2240 (2011). https://doi.org/10.1109/TVCG.2011.255
Hung, H.T., Yeh, H.C., Chou, C.H.: An investigation into English language learners’ argumentative writing performance and perceptions. In: Wu, T.T., Gennari, R., Huang, Y.M., Xie, H., Cao, Y. (eds.) SETE 2016. LNCS, vol. 10108, pp. 712–720. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-52836-6_76
Jang, S.M., Oh, Y.W.: Getting attention online in election coverage: audience selectivity in the 2012 US presidential election. New Media Soc. 18(10), 2271–2286 (2016)
Jensen, J.L.: Public spheres on the Internet: anarchic or government-sponsored - a comparison. Scand. Pol. Studs. 26(4), 349–374 (2003). https://doi.org/10.1111/j.1467-9477.2003.00093.x
Kirman, B., Lineham, C., Lawson, S.: Exploring mischief and mayhem in social computing or how we learned to stop worrying and love the trolls. In: CHI 2012 Extended Abstracts on Human Factors in Computing Systems (CHI EA 2012), pp. 121–130. ACM, New York (2012)
Knobloch-Westerwick, S., et al.: Confirmation bias, ingroup bias, and negativity bias in selective exposure to political information. Commun. Res. 47(1), 104–124 (2020). https://doi.org/10.1177/0093650217719596
Kramp, L., Loosen, W.: The transformation of journalism: from changing newsroom cultures to a new communicative orientation? In: Hepp, A., Breiter, A., Hasebrink, U. (eds.) Communicative Figurations. TCSCR, pp. 205–239. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-65584-0_9
Krippendorff, K.: Content Analysis: An Introduction to Its Methodology, 2nd edn. Sage, Thousand Oaks (2004)
Ksiazek, T.B., Springer, N.: User Comments and Moderation in Digital Journalism: Disruptive Engagement. Routledge, London (2020)
Laugwitz, B., Held, T., Schrepp, M.: Construction and evaluation of a user experience questionnaire. In: Holzinger, A. (ed.) USAB 2008. LNCS, vol. 5298, pp. 63–76. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-89350-9_6
Lilienfeld, S.O., et al.: Giving debiasing away: can psychological research on correcting cognitive errors promote human welfare? Perspect. Psychol. Sci. 4(4), 390–398 (2009). https://doi.org/10.1111/j.1745-6924.2009.01144.x
Masullo Chen, G., et al.: We should not get rid of incivility online. Soc. Media Soc. 5(3) (2019). https://doi.org/10.1177/2056305119862641
Meany, J., Shuster, K.: On that Point!: An Introduction to Parliamentary Debate. International Debate Education Association, New York (2003)
Meffert, M.F., et al.: The effects of negativity and motivated information processing during a political campaign. J. Commun. 56(1), 27–51 (2006). https://doi.org/10.1111/j.1460-2466.2006.00003.x
Menon, S., et al.: Nudge for deliberativeness: how interface features influence online discourse. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–13. ACM, Honolulu (2020). https://doi.org/10.1145/3313831.3376646
Noveck, B.S.: Wiki Government: How Technology Can Make Government Better, Democracy Stronger, and Citizens More Powerful. Brookings Institution Press, Washington, D.C. (2009)
Papacharissi, Z.: Democracy online: civility, politeness, and the democratic potential of online political discussion groups. New Media Soc. 6(2), 259–283 (2004)
Park, D., et al.: Supporting comment moderators in identifying high quality online news comments. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 1114–1125. ACM, San Jose (2016). https://doi.org/10.1145/2858036.2858389
Peacock, C., et al.: The deliberative influence of comment section structure. Journalism 20(6), 752–771 (2019). https://doi.org/10.1177/1464884917711791
Pingree, R.J., et al.: Effects of postdebate coverage on spontaneous policy reasoning. J. Commun. 62(4), 643–658 (2012). https://doi.org/10.1111/j.1460-2466.2012.01656.x
Riffe, D., et al.: Analyzing Media Messages. Routledge, New York (2006)
Risch, J., Krestel, R.: Deep Learning-Based Approaches for Sentiment Analysis. Springer, Singapore (2020)
Rozin, P., Royzman, E.B.: Negativity bias, negativity dominance, and contagion. Pers. Soc. Psychol. Rev. 5(4), 296–320 (2001). https://doi.org/10.1207/S15327957PSPR0504_2
Santana, A.D.: Virtuous or Vitriolic: The effect of anonymity on civility in online newspaper reader comment boards. J. Pract. 8(1), 18–33 (2014)
Santana, A.D.: Incivility dominates online comments on immigration. Newspaper Res. J. 36(1), 92–107 (2015). https://doi.org/10.1177/0739532915580317
Saris, W.E., Sniderman, P.M.: Studies in Public Opinion: Attitudes, Nonattitudes, Measurement Error, and Change. Princeton University Press, Princeton (2004)
Schrepp, M., et al.: Design and evaluation of a short version of the user experience questionnaire (UEQ-S). IJIMAI 4(6), 103 (2017). https://doi.org/10.9781/ijimai.2017.09.001
Schrepp, M.: User Experience Questionnaire Handbook (2015). https://doi.org/10.13140/RG.2.1.2815.0245
Seering, J., et al.: Designing user interface elements to improve the quality and civility of discourse in online commenting behaviors. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1–14 (2019)
Sobieraj, S., Berry, J.M.: From incivility to outrage: political discourse in blogs, talk radio, and cable news. Polit. Commun. 28(1), 19–41 (2011). https://doi.org/10.1080/10584609.2010.542360
Stoll, A., Ziegele, M., Quiring, O.: Detecting impoliteness and incivility in online discussions: classification approaches for German user comments. Comput. Commun. Res. 2(1), 109–134 (2020)
Stromer-Galley, J.: Measuring deliberation’s content: a coding scheme. J. Deliberative Democracy 3(1), 12 (2007). https://doi.org/10.16997/jdd.50
Stroud, N.J., et al.: Changing deliberative norms on news organizations’ Facebook sites. J. Comput.-Mediat. Commun. 20(2), 188–203 (2015). https://doi.org/10.1111/jcc4.12104
Sui, M., Pingree, R.J.: In search of reason-centered discussion on China’s Twitter: the effects of initiating post and discussion format on reasoning. Int. J. Commun. 10(1), 416–431 (2016)
Sunstein, C.R., Thaler, R.H.: Nudge: Improving Decisions About Health. Wealth and Happiness. Yale University Press, New Haven (2008)
Towne, W.B., Herbsleb, J.D.: Design considerations for online deliberation systems. J. Inf. Technol. Polit. 9(1), 97–115 (2012). https://doi.org/10.1080/19331681.2011.637711
Trénel, M.: Measuring the deliberativeness of online discussions. Coding Scheme 2.4. Report. Social Science Research Centrex, Berlin (2004)
Tversky, A., Kahneman, D.: Judgment under uncertainty: heuristics and biases. In: Kahneman, D., et al. (eds.) Judgment under Uncertainty, pp. 3–20. Cambridge University Press (1982). https://doi.org/10.1017/CBO9780511809477.002
Wales, C., et al.: The structural features and the deliberative quality of online discussions. In: Presented at the Political Studies Association Conference, Edinburgh (2010)
Wessler, H.: Investigating deliberativeness comparatively. Polit. Commun. 25(1), 1–22 (2008)
Wilhelm, A.G.: Virtual sounding boards: how deliberative is on-line political discussion? Inf. Commun. Soc. 1(3), 313–338 (1998)
Zhang, W., et al.: The structural features and the deliberative quality of online discussions. Telematics Inform. 30(2), 74–86 (2013)
Ziegele, M., Quiring, O.: Conceptualizing online discussion value: a multidimensional framework for analyzing user comments on mass-media websites. Ann. Int. Commun. Assoc. 37(1), 125–153 (2013)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 IFIP International Federation for Information Processing
About this paper
Cite this paper
Bossens, E., Storms, E., Geerts, D. (2021). Improving the Debate: Interface Elements that Enhance Civility and Relevance in Online News Comments. In: Ardito, C., et al. Human-Computer Interaction – INTERACT 2021. INTERACT 2021. Lecture Notes in Computer Science(), vol 12935. Springer, Cham. https://doi.org/10.1007/978-3-030-85610-6_25
Download citation
DOI: https://doi.org/10.1007/978-3-030-85610-6_25
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-85609-0
Online ISBN: 978-3-030-85610-6
eBook Packages: Computer ScienceComputer Science (R0)