Abstract
We discuss a computationally meaningful process for evaluating misinformation detection tools in the context of immigration in Austria, admitting for the wide variety of qualitative and quantitative data involved. The evaluation machinery is based on a library of tools to support the process in both the elicitation and evaluation phases, including automatized preference elicitation procedures, development of result robustness measures as well as algorithms for co-evaluating quantitative and qualitative data in various formats. The focus of our work is on the Austrian limited profit housing sector, which makes up 24% of the total housing stock and more than 30% of the total of new construction, with a high share of migrants as tenants. We describe the results from workshops analysing the existing misinformation on migration issues in Austria, where we also introduced a co-creation phase. To better understand the stakeholder ecosystem and the lifecycle of misinformation towards social conflicts, we applied a software for integrated multi-stakeholder-multi-attribute problems under risk subject to incomplete or imperfect information, based on the evaluation machinery. Perceived counter-measures of importance turned out to be institutional and regulatory measures in combination with the creation of info-points, measures to raise awareness and stimulate critical thinking, production of tools to deal with misinformation, provision of reliable sources of information, and creation of a culture of thinking.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Adali, S. et al.: Measuring behavioral trust in social networks. In: Proceedings of the IEEE International Conference on Intelligence and Security Informatics (ISI), pp. 150–152, May 2010
Al-JamalEmad, M., Abu-Shanab, E.: The influence of open government on e-government website: the case of Jordan. Int. J. Electron. Gov. 8(2), 159–179 (2016)
Alathur, S., Ilavarasan, V., Gupta, M.P.: Determinants of Citizens’ Electronic Participation: Insights from India. Transform. Gov. People Process Policy 8(3), 447–472 (2014)
Amerasinghe, M.: Enabling environmental justice: assessment of participatory tools. Environmental Department, United Nations Institute for Training and Research (2008)
Antoniadis, S., Litou, I., Kalogeraki, V.: A model for identifying misinformation in online social networks. In: Debruyne, C., et al. (eds.) OTM 2015. LNCS, vol. 9415, pp. 473–482. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-26148-5_32
Anttiroiko, A.-V.: Building strong E-democracy - The role of technology in developing democracy for the information age. Commun. ACM 46(9), 121–128 (2003)
Antunes, P., Santos, R., Videira, N.: Participatory decision-making for sustainable development – the use of mediated modeling techni- ques. Land Use Policy 2006(23), 44–52 (2006)
Beierle, T.C.: The quality of stakeholder-based decisions. Risk Anal. 22(4), 739–749 (2002). https://doi.org/10.1111/0272-4332.00065
Berry, T., et al.: We are all stakeholders: participatory decision-making and corporate sustainability. University of Technology, Sydney Australia, Institute for Sustainable Futures (2003)
Bindu, N., Prem Sankar, C., Satheesh Kumar, K.: From conventional governance to e-democracy: tracing the evolution of egovernance research trends using network analysis tools. Gov. Inf. Q. 36, 385–399 (2019)
Blicharska, M., Isaksson, K., Richardson, T., Wu, C.-J.: Context dependency and stakeholder involvement in EIA: the decisive role of practitioners. J. Environ. Plan. Manage. 54(3), 3 (2011)
Brech, J., Feigelfeld, G.: Ethnic dimensions of coexistence. In: Ludl, H.: Integration im Wohnbau. Modelle fuer ein Soziales Zusammenleben. Birkhauser, Basel (2017)
Brech, J., Feigelfeld, G.: Current relevance of an initial project. Integration in the interethnic neighbourhood housing model. In: Ludl, H. (ed.) Integration im Wohnbau. Modelle fuer ein Soziales Zusammenleben. Birkhauser, Basel (2017a)
Brech, J., Feigelfeld, G.: Living together on housing estate. empirical survey of newer Sozialbau housing estates in Vienna. In: Ludl, H. (ed.) Integration im Wohnbau. Modelle fuer ein Soziales Zusammenleben. Birkhauser, Basel (2017b)
Brech, J., Feigelfeld, G.: Everyday life together. In: Ludl, H. (ed.) Integration im Wohnbau. Modelle fuer ein Soziales Zusammenleben. Birkhauser, Basel (2017c)
Bright, J., Margetts, H.: Big data and public policy: can it succeed where e-Participation has failed? Policy Internet 8, 218–224 (2016). https://doi.org/10.1002/poi3.130
Canini, K.R., Suh, B., Pirolli, P.L.: Finding credible information sources in social networks based on content and social structure. In: Proceedings of the IEEE 3rd International Conference on Privacy, Security Risk Trust (PASSAT), IEEE 3rd International Conference on Social Computer (SocialCom), pp. 1–8, October 2011
Castles, S., de Haas, H., Miller, M.: The Age of Migration. International Population Movements in the Modern World. Palgrave Maximilian, London (2015)
Cook, B., Kothari, U.: Diversity and constructive conflict in stakeholder dialogue: considerations for design and methods. Policy Sci. 45(1), 23-46 (2001). https://doi.org/10.1007/s11077-011-9141-7 Participation: the new tyranny? Zed Books, London, UK. Cuppen, E. 2012
Dahlberg, L.: Re-constructing digital democracy: an outline of four ‘positions.’ New Media Soc. 3(6), 855–872 (2011)
Danielson, M., Ekenberg, L.: Efficient and sustainable risk management in large project portfolios. In: Zdravkovic, J., Grabis, J., Nurcan, S., Stirna, J. (eds.) Perspectives in Business Informatics Research. BIR 2018. Lecture Notes in Business Information Processing, vol. 330. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-99951-7_10
Danielson, M., Ekenberg, L.: An Improvement to swing techniques for elicitation in MCDM methods. Knowl. Based Syst. (2019). https://doi.org/10.1016/j.knosys.2019.01.001
Danielson, M., Ekenberg, L., Larsson, A.: A second-order-based decision tool for evaluating decisions under conditions of severe uncertainty. Knowl. Based Syst. (2019). https://doi.org/10.1016/j.knosys.2019.105219
Danielson, M., Ekenberg, L., Larsson, A.: Evaluating multi-criteria decisions under strong uncertainty. In: de Almeida, A., Ekenberg, L., Scarf, P., Zio, E., Zuo, M.J.: Multicriteria Decision Models and Optimization for Risk, Reliability, and Maintenance Decision Analysis - Recent Advances. Springer, Heidelberg (2020)
De Jong, S., Atac, I.: Demand and deliver: refugee support organisations in Austria. Soc. Inclusion 5(2), 28–37 (2017)
Diduck, A., Sinclair, A.J.: Public involvement in environmental assessment: the case of the nonparticipant. Environ. Manage. 29(4), 578–588 (2002). https://doi.org/10.1007/s00267-001-0028-9
Dietz, T., Stern, P.C.: Public Participation in Environmental Assessment and Decision-Making. National Academies Press, Washington (2008)
Dorostkar, N., Preisinger, A.: ‘Cyber hate’ vs. ‘cyber deliberation’. The case of an Austrian newspaper's discussion board from a critical online-discourse analytical perspective. J. Lang. Politics 16(6), 759–781 (2017)
Ekenberg, L., Fasth, T., Larsson, A.: Hazards and quality control in humanitarian demining. Int. J. Qual. Reliab. Manage. 35(4), 897–913 (2018). https://doi.org/10.1108/IJQRM-01-2016-0012
Ekenberg, L., Hansson, K., Danielson, M., Cars, G.: Deliberation, Representation, and Equity: Research Approaches, Tools, and Algorithms for Participatory Processes, p. 384. Open Book Publishers (2017). ISBN 978-1-78374-304-9
Fiorino, D.J.: Citizen participation and environmental risk: a survey of institutional mechanisms. Sci. Technol. Hum. Values 15(2), 226–243 (1990). https://doi.org/10.1177/016224399001500204
Forester, J.: The Deliberative Practitioner. Encouraging Participatory Planning Process. MIT Press, Cambridge (1999)
Freschi, A.C., Medaglia, R., Nørbjerg, J., et al.: eParticipation in the institutional domain: a review of research: analytical report on eParticipation research from an administration and political perspective in six European countries. In: Freschi, A.C., Medaglia, R., Nørbjerg, J., et al. (eds.) DEMO-Net Consortium, Bergamo (2009)
Funtowicz, S., Ravetz, J.: The worth of a songbird: ecological economics, as a post-normal science. Ecol. Econ. 10, 197–207 (1994)
Golbeck, J.A.: Computing and applying trust in Web-based social networks. Ph.D. dissertation, University of Maryland, Department of Computer Science, College Park, MD, USA (2005)
Gouillart, F., Hallett, T.: Co-Creation in Government. Stanf. Soc. Innov. Rev. 13, 40–47 (2015)
Habitat. Participatory decision-making indicators measuring progress on improving urban management decision-making processes. UNCHS (2009)
Hansson, K., Ekenberg, L.: Embodiment and gameplay: situating the user in crowdsourced information production. In: Manoharan, A.P. (ed.) Innovative Perspectives on Public Administration in the Digital Age, pp. 239–255. IGI Global (2018)
Hansson, K., Belkacem, K., Ekenberg, L.: Open government and democracy: a research review. Soc. Sci. Comput. Rev. 33(5), 540–555 (2014)
Hashim, F., et al.: Information and communication technology for participatory based decision-making-E-management for administrative efficiency in Higher Education. Int. J. Phys. Sci. 5(4), 383–392 (2010). Faculty of Education, 50603 Kuala Lumpur, MALAYSIA
IIBW. Third United Nations Conference on Housing and Sustainable Urban Development (HABITAT III) - Case Study – The Austrian System of Social Housing (in cooperation with the Austrian Federal Ministries for Europe, Integration and Foreign Affairs; for Transport, Innovation and Technology; of Agriculture, Forestry, Environment and Water Management; of Science, Research and Economy; the Austrian Economic Chamber) (2016)
Jia, J., Wang, B., Gong, N.Z.: Random walk based fake account detection in online social networks. In: Proceedings of the 47th Annual IEEE/IFIP International Conference on Dependable System Network (DSN), pp. 273–284, June 2017
Jiang, W., Wang, G., Wu, J.: Generating trusted graphs for trust evaluation in online social networks. Future Gener. Comput. Syst. 31, 48–58 (2014). https://www.sciencedirect.com/science/article/pii/S0167739X1200146X
Joshi, S., et al.: Co-creation framework – building a sustainable ecosystem. Co-Inform Consortium (2018)
Kohlbacher, J., Reeger, U., Schnell, P.: Place Attachment and social ties – migrants and natives in three urban settings in Vienna. Popul. Space Place, Special Issue Paper (2015). https://doi.org/10.1002/psp.1923
Komendantova, N., et al.: Multi-hazard and multi-risk decision support tools as a part of participatory risk governance: Feedback from civil protection stakeholders. Int. J. Disaster Risk Reduction 8, 50–67 (2014)
Komendantova, N., Ekenberg, L., Marashdeh, L., Al Salaymeh, A., Danielson, M., Linnerooth-Bayer, J.: Are energy security concerns dominating environmental concerns? Evidence from stakeholder participation processes on energy transition in Jordan. Climate 6(4), 88 (2018)
Koontz, T.M.: We finished the plan, so now what? Impacts of collaborative stakeholder participation on land use policy. Policy Stud. J. 33(3), 459–481 (2005). https://doi.org/10.1111/j.1541-0072.2005.00125.x
Koulolias, V., Jonathan, G., Fernandez, M., Sotirchos, D.: Combatting Misinformation: An Ecosystem in Co-Creation. Organization for Economic Cooperation and Development, April 2018 (2018)
Larsson, A., Fasth, T., Wärnhjelm, M., Ekenberg, L., Danielson, M.: Policy analysis on the fly with an online multi-criteria cardinal ranking tool. J. Multi-Criteria Decis. Anal. 2018, 1–12 (2018). https://doi.org/10.1002/mcda.1634
Ludl, H.: Integration in housing models for social cohesion. SOZIALBAU AG (2017)
Macintosh, A., Coleman, S., Schneeberger, A. (2009), “eParticipation: The research gaps”, Electronic Participation, Vol. 9 No. 1, pp. 1–11.
Medaglia, R.: The challenged identity of a field: The state of the art of eParticipation research. Inf. Polity 12(3), 169–181 (2007)
Medaglia, R.: eParticipation research: moving characterization forward (2006–2011). Gov. Inf. Q. 29(3), 346–360 (2012)
Migration Council for Austria. Understanding migration – managing migration. Migration Council for Austria and Austrian Federal Ministry of the Interior (2016)
Mihai, A., Marincea, A., Ekenberg, L.: A MCDM Analysis of the Roşia Montană Gold Mining Project. Sustainability 2015(7), 7261–7288 (2015). https://doi.org/10.3390/su7067261
Naranjo-Zolotov, M., Oliveira, T., Casteleyn, S.: E-participation adoption models research in the last 17 years: a weight and meta-analytical review. Comput. Hum. Behav. 81, 350–365 (2018)
Newig, J., Adzersen, A., Challies, E., Fritsch, O., Jager, N.: Comparative analysis of public environmental decision-making processes—a variable-based analytical scheme. Discussion Paper No. 37/13. Institut Für Umweltkommunikation, Lüneburg, Germany (2013). https://doi.org/10.2139/ssrn.2245518
Newig, J., Fritsch, O.: More input - better output: does citizen involvement improve environmental governance? In: Blühdorn, I. (ed.) In Search of Legitimacy: Policy Making in Europe and the Challenge of Complexity, pp. 205–224. Barbara Budrich, Opladen, Farmington Hills (2009)
Observatory of Public Attitudes to Migration. Public attitudes on migration: rethinking how people perceive migration. An analysis of existing opinion polls in the Euro-Mediterranean region. Observatory of Public Attitudes to Migration – Migration Policy Centre, European University Institute, Florence (2018)
Orihuela, L., Obi, T.: E-democracy: ICT for a better relation between the state and their citizens. In: Mishra, S.S. (ed.) E-Democracy Concepts and Practices by Mishra, Santap Sanhari, 31 December 2012, Hardback. SBS Publishers (2012)
Pichon, F., Labreuche, C., Duqueroie, B., Delavallade, T.: Multidimensional approach to reliability evaluation of information sources. Wiley Online Library. Inf. Eval. 30, 129–159 (2014)
Pirannejad, A., Janssen, M.: Internet and political empowerment: towards a taxonomy for online political empowerment. Inf. Dev. 35(1), 80–95 (2017)
Pluchinotta, I., Kazakçi, A.O., Giordano, R., Tsoukiàs, A.: Design Theory for Generating Alternatives in Public Decision-Making Processes. Group Decis. Negot. 28, 341–375 (2019). https://doi.org/10.1007/s10726-018-09610-5
Porwol, L., Ojo, A., Breslin, J.G.: Social Software Infrastructure for e-Participation. Gov. Inf. Q. 35, S88–S98 (2016)
Pretty, J.N.: Participatory learning for sustainable agriculture. World Dev. 23, 1247–1263 (1995). https://doi.org/10.1016/0305-750X(95)00046-F
Reed, M.S.: Stakeholder participation for environmental management: a literature review. Biol. Cons. 141(10), 2417–2431 (2008). https://doi.org/10.1016/j.biocon.2008.07.014
Renn, O.: Copying with Uncertainty in a Complex World, p. 455. Earthscan, London (2008)
Rheindorf, M., Wodak, R.: “Austria First” revisited: a diachronic cross-sectional analysis of the gender and body politics of the extreme right. Patterns Prejudice 53(3), 302–320 (2019)
Sæbø, Ø., Rose, J., Skiftenes Flak, L.: The shape of eParticipation: characterizing an emerging research area. Gov. Inf. Q. 25(3), 400–428 (2008)
Sanford, C., Rose, J.: Characterizing eParticipation. Int. J. Inf. Manage. 27(6), 406–421 (2007)
Schmiedel, U., Schmidt, G.: Religion in the European Refugee Crisis. Palgrave, Cham (2018)
Schwilch, G., Bachmann, F., Liniger, H.P.: Appraising and selecting conservation measures to mitigate desertification and land degradation based on stakeholder participation and global best practices. Land Degrad. Dev. 20(3), 308–326 (2009). https://doi.org/10.1002/ldr.920
Sharma, et al.: Participatory administration and collective decision making. Strengthening of State Administrative Training Institute in India (2003)
Stringer, L.C., Twyman, C., Thomas, D.S.G.: Combating land degradation through participatory means: the case of Swaziland. Ambio 36(5), 387–393 (2007). https://doi.org/10.1579/0044-7447(2007)36[387:cldtpm]2.0.co;2
Valente, S.: Stakeholder participation in Sustainable Forest Management in fire-prone areas. Dissertation, University of Aveiro, Portugal (2013)
Wimmer, M.A.: Ontology for an e-participation virtual resource centre. In: Proceedings of the 1st International Conference on Theory and Practice of Electronic Governance - ICEGOV 2007, Macao, China, pp. 91–101 (2007)
Wolsink, M.: Invalid theory impedes our understanding: a critique on the persistence of the language of NIMBY. Trans. Inst. Br. Geogr. 31(1), 85–91 (2006)
Zhao, L., Hua, T., Lu, C.-T., Chen, R.: A topic-focused trust model for Twitter. Comput. Commun. 76, 1–11 (2016)
Acknowledgment
This research was supported by the H2020 project “Co-Creating Misinformation-Resilient Societies” (Co-Inform, number 770302). We would like to express our gratitude to all stakeholders from the Austrian Limited Profit Housing Sector for their generosity with time and knowledge as well as all stakeholders who participated at our workshops and interviews. We are especially grateful to Gerlinde Gutheil-Knopp-Kirchwald from the Austrian Federation of Limited Profit Housing Associations and to Christian Zenz from the Federal Ministry for Digital and Economic Affairs of Austria.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Komendantova, N., Ekenberg, L., Amann, W., Danielson, M., Koulolias, V. (2021). Chapter 10 The Adequacy of Artificial Intelligence Tools to Combat Misinformation. In: Roberts, F.S., Sheremet, I.A. (eds) Resilience in the Digital Age. Lecture Notes in Computer Science(), vol 12660. Springer, Cham. https://doi.org/10.1007/978-3-030-70370-7_10
Download citation
DOI: https://doi.org/10.1007/978-3-030-70370-7_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-70369-1
Online ISBN: 978-3-030-70370-7
eBook Packages: Computer ScienceComputer Science (R0)