Gustavo Umbelino
Kristine Lu
ABSTRACT
Citizens can increase openness, transparency, and accountability of institutions by taking part in face-to-face participatory policy-making deliberations, such as participatory budgeting assemblies. But for participants’ contributions to influence policy outcomes, organizers need to capture and synthesize participants’ input. Existing approaches are not inclusive for participants or require too much time from organizers. We designed e-scribing, a novel approach for capturing and synthesizing participants’ input from face-to-face deliberations in real time by combining scribes with digital technology. To evaluate the approach, we built DeliberationWorks, a digital deliberation technology that helps scribes (a) capture proxy input (i.e., as participants) that is complete and accurate so that participants do not need to interact with technology themselves and (b) synthesize the discussion in real time using labels. We deployed DeliberationWorks with 5 scribes in two face-to-face deliberations with 8-10 participants and found that, on average, 82% of the input was captured mostly accurately. After one hour of training, scribes synthesized input within 10 minutes of the end of the deliberation. Our findings suggest that e-scribing makes participatory policy-making more inclusive by allowing participants to share their input without interacting with technology, and more time-efficient by reducing synthesis and training times for organizers.
- Chris Ansell and Alison Gash. 2008. Collaborative Governance in Theory and Practice. Journal of Public Administration Research and Theory 18, 4 (Oct. 2008), 543–571. https://doi.org/10.1093/jopart/mum032Google Scholar
Cross Ref
- Miguel Arana-Catania, Felix-Anselm Van Lier, Rob Procter, Nataliya Tkachenko, Yulan He, Arkaitz Zubiaga, and Maria Liakata. 2021. Citizen Participation and Machine Learning for a Better Democracy. Digital Government: Research and Practice 2, 3 (July 2021), 27:1–27:22. https://doi.org/10.1145/3452118Google ScholarDigital Library
- Ted Byrt, Janet Bishop, and John B. Carlin. 1993. Bias, prevalence and kappa. Journal of Clinical Epidemiology 46, 5 (May 1993), 423–429. https://doi.org/10.1016/0895-4356(93)90018-VGoogle ScholarCross Ref
- Claudia Chwalisz. 2020. Reimagining democratic institutions: Why and how to embed public deliberation. Technical Report. OECD, Paris. https://doi.org/10.1787/056573fa-enGoogle Scholar
- Eric Corbett and Christopher A. Le Dantec. 2018. Going the Distance: Trust Work for Citizen Participation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems(CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3173886Google ScholarDigital Library
- Eric Corbett and Christopher A. Le Dantec. 2018. The Problem of Community Engagement: Disentangling the Practices of Municipal Government. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems(CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3174148Google ScholarDigital Library
- C. C. Crawford. 1925. The Correlation between College Lecture Notes and Quiz Papers. The Journal of Educational Research 12, 4 (Nov. 1925), 282–291. https://doi.org/10.1080/00220671.1925.10879600 Publisher: Routledge _eprint: https://doi.org/10.1080/00220671.1925.10879600.Google ScholarCross Ref
- Jonathan Davies, Miguel Arana-Catania, and Rob Procter. 2022. Embedding digital participatory budgeting within local government: motivations, strategies and barriers faced. In 15th International Conference on Theory and Practice of Electronic Governance. ACM, Guimarães Portugal, 98–104. https://doi.org/10.1145/3560107.3560124Google ScholarDigital Library
- B. De Wever, T. Schellens, M. Valcke, and H. Van Keer. 2006. Content analysis schemes to analyze transcripts of online asynchronous discussion groups: A review. Computers & Education 46, 1 (Jan. 2006), 6–28. https://doi.org/10.1016/j.compedu.2005.04.005Google ScholarCross Ref
- Jeroen Delfos, Anneke Zuiderwijk, Sander Van Cranenburgh, and Caspar Chorus. 2022. Perceived challenges and opportunities of machine learning applications in governmental organisations: an interview-based exploration in the Netherlands. In Proceedings of the 15th International Conference on Theory and Practice of Electronic Governance(ICEGOV ’22). Association for Computing Machinery, New York, NY, USA, 82–89. https://doi.org/10.1145/3560107.3560122Google ScholarDigital Library
- Titiana-Petra Ertiö, Pekka Tuominen, and Mikko Rask. 2019. Turning Ideas into Proposals: A Case for Blended Participation During the Participatory Budgeting Trial in Helsinki. In Electronic Participation(Lecture Notes in Computer Science), Panos Panagiotopoulos, Noella Edelmann, Olivier Glassey, Gianluca Misuraca, Peter Parycek, Thomas Lampoltshammer, and Barbara Re (Eds.). Springer International Publishing, Cham, 15–25. https://doi.org/10.1007/978-3-030-27397-2_2Google ScholarDigital Library
- James S Fishkin. 2018. Deliberative polling. In The Oxford handbook of deliberative democracy. Oxford University Press, 315–328.Google Scholar
- Abraham E. Flanigan, Kenneth A. Kiewra, Junrong Lu, and Dzhovid Dzhuraev. 2023. Computer versus longhand note taking: Influence of revision. Instructional Science 51, 2 (April 2023), 251–284. https://doi.org/10.1007/s11251-022-09605-5Google ScholarCross Ref
- Abraham E. Flanigan and Scott Titsworth. 2020. The impact of digital distraction on lecture note taking and student learning. Instructional Science 48, 5 (Oct. 2020), 495–524. https://doi.org/10.1007/s11251-020-09517-2Google ScholarCross Ref
- Hahrie Han. 2014. How Organizations Develop Activists: Civic Associations and Leadership in the 21st Century. Oxford University Press. Google-Books-ID: rOESDAAAQBAJ.Google Scholar
- Soo-Hye Han, William Schenck-Hamlin, and Donna Schenck-Hamlin. 2015. Inclusion, Equality, and Discourse Quality in Citizen Deliberations on Broadband. Journal of Deliberative Democracy 11, 1 (May 2015). https://doi.org/10.16997/jdd.220 Number: 1 Publisher: University of Westminster Press.Google ScholarCross Ref
- Christina Harrington, Sheena Erete, and Anne Marie Piper. 2019. Deconstructing Community-Based Collaborative Design: Towards More Equitable Participatory Design Engagements. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (Nov. 2019), 216:1–216:25. https://doi.org/10.1145/3359318Google ScholarDigital Library
- Christina N. Harrington, Katya Borgos-Rodriguez, and Anne Marie Piper. 2019. Engaging Low-Income African American Older Adults in Health Discussions through Community-based Design Workshops. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems(CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3290605.3300823Google ScholarDigital Library
- Janette Hartz-Karp. 2005. A Case Study in Deliberative Democracy: Dialogue with the City. Journal of Deliberative Democracy 1, 1 (April 2005). https://doi.org/10.16997/jdd.27 Number: 1 Publisher: University of Westminster Press.Google ScholarCross Ref
- Janette Hartz-Karp and Brian Sullivan. 2014. The Unfulfilled Promise of Online Deliberation. Journal of Deliberative Democracy 10, 1 (June 2014). https://doi.org/10.16997/jdd.191 Number: 1 Publisher: University of Westminster Press.Google ScholarCross Ref
- Mahmood Jasim, Enamul Hoque, Ali Sarvghad, and Narges Mahyar. 2021. CommunityPulse: Facilitating Community Input Analysis by Surfacing Hidden Insights, Reflections, and Priorities. In Designing Interactive Systems Conference 2021(DIS ’21). Association for Computing Machinery, New York, NY, USA, 846–863. https://doi.org/10.1145/3461778.3462132Google ScholarDigital Library
- Mahmood Jasim, Pooya Khaloo, Somin Wadhwa, Amy X. Zhang, Ali Sarvghad, and Narges Mahyar. 2021. CommunityClick: Capturing and Reporting Community Feedback from Town Halls to Improve Inclusivity. Proceedings of the ACM on Human-Computer Interaction 4, CSCW3 (Jan. 2021), 213:1–213:32. https://doi.org/10.1145/3432912Google ScholarDigital Library
- Ian G. Johnson, Alistair MacDonald, Jo Briggs, Jennifer Manuel, Karen Salt, Emma Flynn, and John Vines. 2017. Community Conversational: Supporting and Capturing Deliberative Talk in Local Consultation Processes. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems(CHI ’17). Association for Computing Machinery, New York, NY, USA, 2320–2333. https://doi.org/10.1145/3025453.3025559Google ScholarDigital Library
- Saba Kawas, George Karalis, Tzu Wen, and Richard E. Ladner. 2016. Improving Real-Time Captioning Experiences for Deaf and Hard of Hearing Students. In Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility(ASSETS ’16). Association for Computing Machinery, New York, NY, USA, 15–23. https://doi.org/10.1145/2982142.2982164Google ScholarDigital Library
- Kenneth A. Kiewra. 2016. Note Taking on Trial: A Legal Application of Note-Taking Research. Educational Psychology Review 28, 2 (June 2016), 377–384. https://doi.org/10.1007/s10648-015-9353-zGoogle ScholarCross Ref
- Hélène Landemore. 2020. Open Democracy. https://press.princeton.edu/books/hardcover/9780691181998/open-democracyGoogle Scholar
- J. R. Landis and G. G. Koch. 1977. The measurement of observer agreement for categorical data. Biometrics 33, 1 (March 1977), 159–174.Google ScholarCross Ref
- Walter Lasecki, Christopher Miller, Adam Sadilek, Andrew Abumoussa, Donato Borrello, Raja Kushalnagar, and Jeffrey Bigham. 2012. Real-time captioning by groups of non-experts. In Proceedings of the 25th annual ACM symposium on User interface software and technology(UIST ’12). Association for Computing Machinery, New York, NY, USA, 23–34. https://doi.org/10.1145/2380116.2380122Google ScholarDigital Library
- Seunghoo Lim and Youngmin Oh. 2016. Online Versus Offline Participation: Has the Democratic Potential of the Internet Been Realized? Analysis of a Participatory Budgeting System in Korea. Public Performance & Management Review 39, 3 (July 2016), 676–700. https://doi.org/10.1080/15309576.2016.1146553 Publisher: Routledge _eprint: https://doi.org/10.1080/15309576.2016.1146553.Google ScholarCross Ref
- Narges Mahyar, Diana V. Nguyen, Maggie Chan, Jiayi Zheng, and Steven P. Dow. 2019. The Civic Data Deluge: Understanding the Challenges of Analyzing Large-Scale Community Input. In Proceedings of the 2019 on Designing Interactive Systems Conference(DIS ’19). Association for Computing Machinery, New York, NY, USA, 1171–1181. https://doi.org/10.1145/3322276.3322354Google ScholarDigital Library
- Nora McDonald, Sarita Schoenebeck, and Andrea Forte. 2019. Reliability and Inter-rater Reliability in Qualitative Research: Norms and Guidelines for CSCW and HCI Practice. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (Nov. 2019), 72:1–72:23. https://doi.org/10.1145/3359174Google ScholarDigital Library
- Moira McGregor and John C. Tang. 2017. More to Meetings: Challenges in Using Speech-Based Technology to Support Meetings. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing(CSCW ’17). Association for Computing Machinery, New York, NY, USA, 2208–2220. https://doi.org/10.1145/2998181.2998335Google ScholarDigital Library
- Matthew B. Miles, A. Michael Huberman, and Johnny Saldaña. 2014. Qualitative Data Analysis. SAGE Publications. Google-Books-ID: 3CNrUbTu6CsC.Google Scholar
- Simon Niemeyer and John S. Dryzek. 2007. The Ends of Deliberation: Meta-consensus and Inter-subjective Rationality as Ideal Outcomes. Swiss Political Science Review 13, 4 (2007), 497–526. https://doi.org/10.1002/j.1662-6370.2007.tb00087.x _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/j.1662-6370.2007.tb00087.x.Google ScholarCross Ref
- Otter.ai. 2022. Transcription accuracy FAQ. https://help.otter.ai/hc/en-us/articles/360048322533-Transcription-accuracy-FAQGoogle Scholar
- Fernando Pinto, Marie Anne Macadar, and Gabriela Viale Pereira. 2022. The potential of eParticipation in enlarging individual capabilities: a conceptual framework. Information Technology for Development 0, 0 (2022), 1–23. https://doi.org/10.1080/02681102.2022.2136129 arXiv:https://doi.org/10.1080/02681102.2022.2136129Google ScholarCross Ref
- Daniela K. Rosner, Saba Kawas, Wenqi Li, Nicole Tilly, and Yi-Chen Sung. 2016. Out of Time, Out of Place: Reflections on Design Workshops as a Research Method. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing(CSCW ’16). Association for Computing Machinery, New York, NY, USA, 1131–1141. https://doi.org/10.1145/2818048.2820021Google ScholarDigital Library
- Anwar Shah. 2007. Participatory Budgeting. World Bank Publications. Google-Books-ID: Y1WQYgC9JNEC.Google Scholar
- Stan W. Smith. 2010. An experiment in bibliographic mark-up: Parsing metadata for XML export. In Proceedings of the 3rd. annual workshop on Librarians and Computers(LAC ’10, Vol. 3), Reginald N. Smythe and Alexander Noble (Eds.). Paparazzi Press, Milan Italy, 422–431. https://doi.org/99.9999/woot07-S422Google Scholar
- Nick Taylor, Justin Marshall, Alicia Blum-Ross, John Mills, Jon Rogers, Paul Egglestone, David M. Frohlich, Peter Wright, and Patrick Olivier. 2012. Viewpoint: empowering communities with situated voting devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’12). Association for Computing Machinery, New York, NY, USA, 1361–1370. https://doi.org/10.1145/2207676.2208594Google ScholarDigital Library
- Nivek K. Thompson. 2012. Participatory budgeting - the Australian way. Journal of Deliberative Democracy 8, 2 (Dec. 2012). https://doi.org/10.16997/jdd.145 Number: 2 Publisher: University of Westminster Press.Google ScholarCross Ref
- Sunny Tian, Amy X. Zhang, and David Karger. 2021. A System for Interleaving Discussion and Summarization in Online Collaboration. Proceedings of the ACM on Human-Computer Interaction 4, CSCW3 (Jan. 2021), 241:1–241:27. https://doi.org/10.1145/3432940Google ScholarDigital Library
- Vasilis Vlachokyriakos, Rob Comber, Karim Ladha, Nick Taylor, Paul Dunphy, Patrick McCorry, and Patrick Olivier. 2014. PosterVote: expanding the action repertoire for local political activism. In Proceedings of the 2014 conference on Designing interactive systems(DIS ’14). Association for Computing Machinery, New York, NY, USA, 795–804. https://doi.org/10.1145/2598510.2598523Google ScholarDigital Library
- Jenny Waycott, Frank Vetere, Sonja Pedell, Amee Morgans, Elizabeth Ozanne, and Lars Kulik. 2016. Not For Me: Older Adults Choosing Not to Participate in a Social Isolation Intervention. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems(CHI ’16). Association for Computing Machinery, New York, NY, USA, 745–757. https://doi.org/10.1145/2858036.2858458Google ScholarDigital Library
- Amy X. Zhang and Justin Cranshaw. 2018. Making Sense of Group Chat through Collaborative Tagging and Summarization. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (Nov. 2018), 196:1–196:27. https://doi.org/10.1145/3274465Google ScholarDigital Library
Index Terms
- Increasing Inclusion and Time-Efficiency in Participatory Policy-Making Deliberations with E-Scribing Technology
Recommendations
Engineering software assemblies for participatory democracy: the participatory budgeting use case
ICSE '16: Proceedings of the 38th International Conference on Software Engineering CompanionThe worldwide use of the Internet and social networking has transformed the constraints of time and space in human interaction: we can now be heard at a massive scale unprecedented in human history. As a result, information and communication ...
Participatory budgeting and social inclusion in modern Brazil
IMS2017: Proceedings of the International Conference IMS-2017Despite serious resource base, in Brazil there are many complicated social problems - inequality of the black population, marginalized population of favelas, aggravating drug trafficking and crime, etc. To solve these problems the Brazilian Workers ...
Political participation via social media: a case study of deliberative quality in the public online budgeting process of Frankfurt/Main, Germany 2013
If social media are to reinforce sustainability of political decisions, their design has conceptually to take into account the implications of deliberative democracy, which stresses the active cooperation of virtually all citizens of a democracy for the ...
Comments