research-article

Assessing the Impact of AI-mediation on Changing Extreme Perception in Online Discussion: Post-Intervention Responses in Post-2021 Afghanistan

Authors:

Takayuki ItoAuthors Info & Claims

dg.o '24: Proceedings of the 25th Annual International Conference on Digital Government Research

Pages 312 - 320

https://doi.org/10.1145/3657054.3657093

Published: 11 June 2024 Publication History

dg.o '24: Proceedings of the 25th Annual International Conference on Digital Government Research

Assessing the Impact of AI-mediation on Changing Extreme Perception in Online Discussion: Post-Intervention Responses in Post-2021 Afghanistan

Pages 312 - 320

Abstract
References

Abstract

Fair and diverse perspectives discussion, aided by reliable AI intervention, can effectively burst filter bubbles and transform undemocratic behaviors into functional democratic processes in online forums. However, the impact of AI intervention on individuals may vary depending on the persona and social attributes of the AI. Here we conducted a two-timepoint online experiment to examine whether AI-mediated discussions on sensitive topics can form moderate perceptions. Our study focused on the impact of AI-intervention on participants' perceptions and attitudes towards engagement with AI technology, access to democracy and gender equality, and interethnic marriage rights in Afghanistan. We assigned 168 individuals with conservative, moderate, and liberal perspectives to three different settings in two experimental groups, with and without AI-mediation. Participants engaged in three-day online discussions, after which we measured their personality profiles through a self-reported survey. Our findings suggest that while AI intervention had a significant impact on participants' perceptions of AI chatbot as facilitator, but the participants' positions remained largely unaffected towards access to democracy and gender equality, and interethnic marriage rights, possibly due to the lack of contextual knowledge and human touch in the chatbot's responses. Our study provides insight into creating effective chatbot personas to address illiberal practices in online discussions.

References

[1]

Lipset, S. M. (1955). The Radical Right: A Problem for American Democracy. The British Journal of Sociology, 6(2), 176–209.

[2]

Jost, J. T., Glaser, J., Kruglanski, A. W., & Sulloway, F. J. (2003). Political conservatism as motivated social cognition. Psychological Bulletin, 129, 339–375.

[3]

Jenkins, H. (2009). Confronting the Challenges of Participatory Culture: Media Education for the 21st Century. MIT Press, Cambridge, MA

[4]

Bozdag, E. (2013). Bias in algorithmic filtering and personalization. Ethics Information Technology, 15, 209–227.

Digital Library

[5]

Kitchens, B., Johnson, S. L., & Gray, P. (2020). Understanding echo chambers and filter bubbles: the impact of social media on diversification and partisan shifts in news consumption. MIS Quarterly: Management Information Systems, 44(4), 1987–2011.

[6]

Seargeant, P., & Tagg, C. (2019). Social media and the future of open debate: A user-oriented approach to Facebook's filter bubble conundrum. Discourse, Context & Media, 27, 41–48

[7]

Sakhi, N. (2022). The Taliban Takeover in Afghanistan and Security Paradox. Journal of Asian Security and International Affairs, 9(3), 383–401.

[8]

Conquest, R. (1999). Reflections on a Ravaged Century. Norton, New York, NY, USA. pp.73.74

[9]

Haqbeen, J., Sahab, S., & Ito, T. (2023). A Digital Initiative to Address Girls Education Challenges in Collaboration with NPO in Post-2021 Afghanistan. Letters on Informatics and Interdisciplinary Research, 4, 176.

[10]

Ito, T., Hadfi, R., & Suzuki, S. (2022). An Agent that Facilitates Crowd Discussion. Group Decis Negot, 31, 621–647.

[11]

Hadfi, R., (2021). Argumentative Conversational Agents for Online Discussions. Journal of Systems Science and Systems Engineering, 30, 450–464.

[12]

Kuz, W., Kunz, W., & Rittel, H. W. (1970). Issues as Elements of Information Systems. Tech. Rep.

[13]

Sahab, S., Haqbeen, J., Hadfi, R., (2024). E-contact facilitated by conversational agents reduces interethnic prejudice and anxiety in Afghanistan. Commun Psychol, 2(22).

[14]

Mohammed, P. S., & Watson, E. ‘Nell’. (2019). Towards inclusive education in the age of artificial intelligence: Perspectives, challenges, and opportunities. Artificial Intelligence and Inclusive Education: Speculative futures and emerging practices, 2019, 17–37.

[15]

Hadfi, R., Okuhara, S., Haqbeen, J., (2023). Conversational agents enhance women's contribution in online debates. Sci Rep, 13, 14534.

[16]

Dryer, D. C. (1999). Getting personal with computers: how to design personalities for agents. Applied artificial intelligence, 13(3), 273–295.

[17]

Tanprasert, T., Fels, S., Sinnamon, L., & Yoon, D. (2024). Debate Chatbots to Facilitate Critical Thinking on YouTube: Social Identity and Conversational Style Make A Difference. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI ’24), May 11–16, 2024, Honolulu, HI, USA.

Digital Library

[18]

Schuman, S. (2007). The IAF Handbook of Group Facilitation: Best Practices from the Leading Organization in Facilitation. Jossey-Bass.

[19]

Tanis, M., & Postmes, T. (2005). A social identity approach to trust: Interpersonal perception, group membership and trusting behaviour. European journal of social psychology, 35(3), 413–424.

[20]

Mergel, I., Edelmann, N., & Haug, N. (2019). Defining Digital Transformation: Results from Expert Interviews. Government Information Quarterly, 36(4), 101385.

[21]

Criado, J. I., & Villodre, J. (2023). Exploring citizens attitudes towards social media use by public administrations: the case of Spanish local governments. In Proceedings of the 24th Annual International Conference on Digital Government Research (DGO '23).

Digital Library

[22]

Gamson, W., & Wolffeld, G. (1993). Movements and Media as Interacting Systems. The ANNALS of the American Academy of Political and Social Science, 428(1), 114–125.

[23]

Wolfsfeld, G., Segev, E., & Sheafer, T. (2013). Social media and the Arab Spring: politics comes first. The International Journal of Press/Politics, 18(2), 115–137.

[24]

Alsaleh, D. A., Elliott, M. T., Fu, F. Q., & Thakur, R. (2019). Cross-cultural differences in the adoption of social media. Journal of Research in Interactive Marketing, 13(1), 119–140.

[25]

Cinelli, M., (2020). Selective exposure shapes the facebook news diet. PLoS ONE, 15, e0229129.

[26]

Rasiah, R. R. V. (2014). Transformative higher education teaching and learning: using social media in a team-based learning environment. Procedia Soc Sci Behav, 123, 369–379.

[27]

Cinelli, M., de Francisci Morales, G., Galeazzi, A., (2021). The Echo Chamber Effect on Social Media. Proceedings of the National Academy of Sciences of the United States of America, 118, e2023301118.

[28]

Messing, S., & Westwood, S. J. (2014). Selective exposure in the age of social media: Endorsements trump partisan source affiliation when selecting news online. Commun. Res, 41, 1042–1063.

[29]

Etta, G., (2023). Characterizing engagement dynamics across topics on facebook. PLoS ONE, 18, e0286150.

[30]

Fuentes, A., & Peterson, J. V. (2021). Social media and public perception as core aspect of public health: The cautionary case of @realdonaldtrump and COVID-19. PLoS ONE, 16(5), e0251179.

[31]

Boulianne S. Social media use and participation: A metaanalysis of current research. Information, Communication & Society, 2015; 18:524–538.

[32]

Schwemmer, C. (2021). The Limited Influence of Right-Wing Movements on Social Media User Engagement. Social Media + Society, 7(3).

[33]

Tajfel, H., & Turner, J. C. (2004). The social identity theory of intergroup behavior. In Political psychology. Psychology Press, 276–293.

[34]

Wood, W. (2000). Attitude change: Persuasion and social influence. Annual review of psychology, 51(1), 539–570.

[35]

Bene, M. (2017). Go viral on the Facebook! Interactions between candidates and followers on Facebook during the Hungarian general election campaign of 2014. Information, Communication & Society, 20(4), 513–529.

[36]

Bernstein, M. S., Bakshy, E., Burke, M., & Karrer, B. (2013). Quantifying the invisible audience in social networks. In Proceedings of the SIGCHI conference on human factors in computing systems: CHI ’13 (p. 21). ACM.

Digital Library

[37]

Hussaini, S., & Morris, T. (2020). The Taliban's Information War: The Tactical Use of Frames. Journal of Information Warfare, 19(4), 89–109.

[38]

Brenner, P. S., & DeLamater, J. (2016). Lies, damned lies, and survey self-reports? Identify as a cause of measurement bias. Social Psychology Quarterly, 79, 333–354.

[39]

DeYoung, C. G., Quilty, L. C., & Peterson, J. B. (2007). Between facets and domains: 10 aspects of the Big Five. Journal of Personality and Social Psychology, 93(5), 880–896.

[40]

Likert, R. (1932). A technique for the measurement of attitudes. Arch Psychology, 22(140), 55.

[41]

Sullivan, G. M., & Artino, A. R. (2013). Analyzing and interpreting data from Likert-type scales. Journal of Graduate Medical Education, 5(4), 541–542.

[42]

Proch, J., Elad-Strenger, J., & Kessler, T. (2019). Liberalism and Conservatism, for a Change! Rethinking the Association Between Political Orientation and Relation to Societal Change. Political Psychology, 40(4), 877–903.

[43]

Carney, D. R., Jost, J. T., Gosling, S. D., & Potter, J. (2008). The secret lives of liberals and conservatives: Personality profiles, interaction styles, and the things they leave behind. Political Psychology, 29, 807–840.

[44]

EIU report Democracy Index (2023). Retrieved from https://www.eiu.com/n/campaigns/democracy-index-2023/

[45]

Geissel, B., Kneuer, M., & Lauth, H.-J. (2016). Measuring the quality of democracy: Introduction. International Political Science Review, 37(5), 571–579.

[46]

Levin, D. Z., Whitener, E. M., & Cross, R. (2006). Perceived trustworthiness of knowledge sources: The moderating impact of relationship length. Journal of Applied Psychology, 91(5), 1163.

[47]

Ryan, M. (2020). In AI we trust: ethics, artificial intelligence, and reliability. Science and Engineering Ethics, 26(5), 2749–2767.

[48]

Sahab, S., Haqbeen, J., & Ito, T. (2024). Conversational AI as a Facilitator Improves Participant Engagement and Problem-Solving in Online Discussion: Sharing Evidence from Five Cities in Afghanistan. IEICE Transaction on Information and Systems, Vol. E107-D, No. 4, pp. 434-442.

[49]

Haqbeen, J., Sahab, S., Ito, T., & Rizzi, P. (2021). Using decision support system to enable crowd identify neighborhood issues and its solutions for policy makers: An online experiment at Kabul municipal level. Sustainability, 13(10), 5453.

[50]

Sahab, S., Haqbeen, J., & Ito, T. (2023). Facilitating the Problems that lie within the Solutions using Conversational AI: A Case Study of Post-2021 Afghanistan. In Proceedings of the 24th Annual International Conference on Digital Government Research (DG.O2023), 13–24.

Digital Library

Cited By

Haqbeen JSahab SIto T(2024)Comparison of Best Paper Award selection between program committee members and attendees: Case of an international conference2024 IEEE/ACIS 9th International Conference on Big Data, Cloud Computing, and Data Science (BCD)10.1109/BCD61269.2024.10743083(65-72)Online publication date: 16-Jul-2024
https://doi.org/10.1109/BCD61269.2024.10743083

Index Terms

Assessing the Impact of AI-mediation on Changing Extreme Perception in Online Discussion: Post-Intervention Responses in Post-2021 Afghanistan
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI

Recommendations

The Differential Impact of Maternal Versus Paternal Post-Traumatic Symptoms on Child Symptom Development
Parental mediation, cyberbullying, and cybertrolling

Researchers are concerned with identifying the risk and protective factors associated with adolescents' involvement in cyberharassment. One such factor is parental mediation of children's electronic technology use. Little attention has been given to how ...
Cross Cutting Discussion: A form of online discussion discovered within local political online forums

There has been a growing concern regarding political disengagement among citizens within liberal western representative democracies. This concern has brought about calls for local political online forums to be used to support participatory and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

dg.o '24: Proceedings of the 25th Annual International Conference on Digital Government Research

June 2024

1089 pages

ISBN:9798400709883

DOI:10.1145/3657054

Copyright © 2024 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 June 2024

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Conference

dg.o 2024

dg.o 2024: 25th Annual International Conference on Digital Government Research

June 11 - 14, 2024

Taipei, Taiwan

Acceptance Rates

Overall Acceptance Rate 150 of 271 submissions, 55%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
128
Total Downloads

Downloads (Last 12 months)128
Downloads (Last 6 weeks)36

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Haqbeen JSahab SIto T(2024)Comparison of Best Paper Award selection between program committee members and attendees: Case of an international conference2024 IEEE/ACIS 9th International Conference on Big Data, Cloud Computing, and Data Science (BCD)10.1109/BCD61269.2024.10743083(65-72)Online publication date: 16-Jul-2024
https://doi.org/10.1109/BCD61269.2024.10743083

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten