Abstract
Till now, conversational agents (CA) are often utilized as assistants to answer FAQs, but can they also be involved in other tasks with humans such as guiding them through a process as a group? We cooperate with an editorial office of an online journal and conduct an action design research project to instantiate a CA to facilitate their meetings. We design and develop the digital collaboration process (CP) of the meeting and a CA facilitator based on IBM Watson to integrate it in the digital environment to execute the CP. We conduct a pilot study and expert interviews to evaluate the CP and the derived design principles to facilitate the group during it and through its thinkLets. Our results show positive perception of the CA’s capability as a facilitator for a group within its limitations and its neutrality during group discussions perceived as one strengths compared to human facilitators.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Bittner, E.A.C., Leimeister, J.M.: Creating shared understanding in heterogeneous work groups: why it matters and how to achieve it. JMIS 31, 111–144 (2014)
Bowers, C.A., Pharmer, J.A., Salas, E.: When member homogeneity is needed in work teams a meta-analysis. Small Group Res. 31, 305–327 (2000)
Langan-Fox, J., Anglim, J., Wilson, J.R.: Mental models, team mental models, and performance: process, development, and future directions. Hum. Factors Ergon. Manuf. 14, 331–352 (2004)
Wegge, J., Roth, C., Neubach, B., Schmidt, K.-H., Kanfer, R.: Age and gender diversity as determinants of performance and health in a public organization: the role of task complexity and group size. J. Appl. Psychol. 93, 1301–1313 (2008)
Kolfschoten, G.L., Briggs, R.O., de Vreede, G.-J., Jacobs, P.H.M., Appelman, J.H.: A conceptual foundation of the thinkLet concept for collaboration engineering. Int. J. Hum.-Comput. Stud. 64, 611–621 (2006)
Briggs, R., Vreede, G.-J., de Nunamaker, J., Tobey, D.: ThinkLets: achieving predictable, repeatable patterns of group interaction with group support systems (GSS). In: 34th HICSS, Maui (2001)
Briggs, R., Kolfschoten, G., Vreede, G.-J., Albrecht, C., Dean, D., Lukosch, S.: A seven-layer model of collaboration: separation of concerns for designers of collaboration systems. In: ICIS 2009, Phoenix (2009)
Vreede, G.-J. de Briggs, R.: Collaboration engineering: designing repeatable processes for high-value collaborative tasks. In: 38th HICSS, Big Island (2005)
Nunamaker, J., Vogel, D., Heminger, A., Martz, B., Grohowski, R., McGoff, C.: Experience at IBM with group support systems: a field study. Decis. Support Syst. 5, 183–196 (1989)
Clawson, V.K., Bostrom, R.P.: Research-driven facilitation training for computer-supported environments. Group Decis. Negot. 5, 7–29 (1996)
Clawson, V.K., Bostrom, R.P., Anson, R.: The role of the facilitator in computer-supported meetings. Small Group Res. 24, 547–565 (1993)
Briggs, R.O., Kolfschoten, G.L., Vreede, G.-J. de Albrecht, C.C., Lukosch, S.G.: Facilitator in a box: computer assisted collaboration engineering and process support systems for rapid development of collaborative applications for high-value tasks. In: 43rd HICSS, Honolulu (2010)
Briggs, R., de Vreede, G.-J., Nunamaker, J.F.: Collaboration engineering with thinklets to pursue sustained success with group support systems. JMIS 19, 31–64 (2003)
Perry-Smith, J.E., Mannucci, P.V.: From creativity to innovation: the social network drivers of the four phases of the idea journey. Acad. Manag. Rev. 42, 53–79 (2017)
Schweitzer, F.M., Buchinger, W., Gassmann, O., Obrist, M.: Crowdsourcing: leveraging innovation through online idea competitions. Res.-Technol. Manag. 55, 32–38 (2012)
Seeber, I., et al.: Machines as teammates: a collaboration research agenda. In: 51st HICSS, Waikoloa Village (2018)
Tavanapour, N., Bittner, E.A.C.: Automated facilitation for idea platforms: design and evaluation of a chatbot prototype. In: 39th ICIS, San Francisco (2018)
Tegos, S., Demetriadis, S., Karakostas, A.: Leveraging conversational agents and concept maps to scaffold students’ productive talk. In: International Conference of Intelligent Networking and Collaborative Systems, Salerno (2014)
Tegos, S., Demetriadis, S., Karakostas, A.: Promoting academically productive talk with conversational agent interventions in collaborative learning settings. Comput. Educ. 87, 309–325 (2015)
Kumar, R., Rosé, C.P.: Triggering effective social support for online groups. ACM Trans. Interact. Intell. Syst. 3, 24 (2014)
Tavanapour, N., Bittner, E.A.C.: Supporting the idea generation process in citizen participation - toward an interactive system with a conversational agent as facilitator. In: 27th ECIS, Portsmouth (2019)
Sein, M.K., Henfridsson, O., Purao, S., Rossi, M., Lindgren, R.: Action design research. MIS Quart. 35, 37–56 (2011)
Mayring, P.: Qualitative Inhaltsanalyse: Grundlagen und Techniken. Beltz Verlag, Weinheim Basel (2010). (in German)
Gregor, S., Hevner, A.R.: Positioning and presenting design science research for maximum impact. MIS Quart. 37, 337–355 (2013)
Gregor, S.: The Nature of Theory in Information Systems. MIS Quart. 30, 611–642 (2006)
McCarthy, J., Minsky, M.L., Rochester, N., Shannon, C.E.: A proposal for the Dartmouth summer research project on artificial intelligence. AI Mag. 1–17 (1955)
Otto, B., Lee, Y.W., Caballero, I.: Information and data quality in networked business. Electron. Markets 21, 79–81 (2011)
Curry, C., O’Shea, J.: The implementation of a storytelling Chatbot. In: Agent and Multi-Agent Systems: Technologies and Applications - 5th KES International Conference, KES-AMSTA, Manchester (2011)
Ovchinnikova, E.: Integration of World Knowledge for Natural Language Understanding. Atlantis Press, Springer (2012)
Weizenbaum, J.: ELIZA - a computer program for the study of natural language communication between man and machine. Commun. ACM 9, 36–45 (1966)
Colby, K.M., Weber, S., Hilf, F.D.: Artificial paranoia. Artif. Intell. 2, 1–25 (1971)
Jurafsky, D., Martin, J.H.: Speech and Language Processing. Prentice Hall, NY (2008)
IBM Cloud: Watson Assistant (2016). https://cloud.ibm.com/catalog/services/conversation
Jeopardy Productions: Jeopardy (2018). https://www.jeopardy.com/
Ferrucci, D.A.: Introduction to “This is Watson”. IBM J. Res. Dev. 56, 1:1–1:15 (2012)
Tegos, S., Psathas, G., Tsiatsos, T., Demetriadis, S.N.: Designing conversational agent interventions that support collaborative chat activities in MOOCs. In: EMOOCs-WIP, Naples (2019)
Yoffie, D.B., Wu, L., Sweitzer, J., Eden, D.: Voice War: Hey Google vs. Alexa vs. Siri. https://files.transtutors.com/cdn/uploadassignments/2835385_1_voice-war.pdf
Eisman, E.M., López, V., Castro, J.L.: A framework for designing closed domain virtual assistants. Expert Syst. Appl. 39, 3135–3144 (2012)
Roda, C., Angehrn, A., Nabeth, T., Razmerita, L.: Using conversational agents to support the adoption of knowledge sharing practices. Interact. Comput. 15, 57–89 (2003)
Xu, K., Lombard, M.: Persuasive computing: feeling peer pressure from multiple computer agents. Comput. Hum. Behav. 74, 152–162 (2017)
Hill, J., Randolph Ford, W., Farreras, I.G.: Real conversations with artificial intelligence. Comput. Hum. Behav. 49, 245–250 (2015)
Porcheron, M., Fischer, J.E., Sharples, S.: “Do animals have accents?”: talking with agents in multi-party conversation. In: ACM Conference on CSCW and Social Computing, Portland (2017)
Angeli, A.D., Brahnam, S.: I hate you! Disinhibition with virtual partners. Interact. Comput. 20, 302–310 (2008)
Louvet, J.-B., Duplessis, G.D., Chaignaud, N., Vercouter, L., Kotowicz, J.-P.: Modeling a collaborative task with social commitments. Procedia Comput. Sci. 112, 377–386 (2017)
Tegos, S., Demetriadis, S.N., Karakostas, A.: Conversational agent to promote students’ productive talk: the effect of solicited vs. unsolicited agent intervention. In: 14th International Conference on Advanced Learning Technologies, Athens (2014)
Tegos, S., Demetriadis, S., Tsiatsos, T.: Using a conversational agent for promoting collaborative language learning. In: 4th International Conference on Intelligent Networking and Collaborative Systems, Bucharest (2012)
Tegos, S., Demetriadis, S.N., Karakostas, A.: Exploring the impact of a conversational agent when triggering students’ discourse in online collaboration. In: 12th International Conference on Advanced Learning Technologies, Rome (2012)
Kumar, R., Rosé, C.P.: Engaging learning groups using social interaction strategies. In: HLT-NAACL, Los Angeles (2010)
Dohsaka, K., Asai, R., Higashinaka, R., Minami, Y., Maeda, E.: Effects of conversational agents on human communication in thought-evoking multi-party dialogues. In: Healey, P.G.T., Pieraccini, R., Byron, D., Young, S., Purver, M. (eds.) 10th ACL SIGDIAL, pp. 217–224, Morristown (2009)
Mori, M.: The uncanny valley. Energy 7, 33–35 (1970)
Nass, C., Moon, Y.: Machines and mindlessness: social responses to computers. J. Soc. Issues 56, 81–103 (2000)
Adkins, M., Burgoon, M., Nunamaker, J.F.: Using group support systems for strategic planning with the united states air force. Decis. Support Syst. 34, 315–337 (2003)
Ayoub, J.L., Vanderboom, C., Knight, M., Walsh, K., Briggs, R., Grekin, K.: A study of the effectiveness of an interactive computer classroom. Comput. Nurs. 16, 333–338 (1998)
Bostrom, R.P., Anson, R., Clawson, V.K.: Group facilitation and group support systems. In: Jessup, L., Valchich, J. (eds.) Group Facilitation and Group Support Systems, pp. 146–168. Macmillan, New York (1993)
Briggs, R.O., Adkins, M., Mittleman, D., Kruse, J., Miller, S., Nunamaker, J.F.: A technology transition model derived from field investigation of gss use aboard the U.S.S. CORONADO. JMIS 15, 151–195 (1998)
Dennis, A.R., Nunamaker, J.F., Vogel, D.R.: A comparison of laboratory and field research in the study of electronic meeting systems. JMIS 7, 107–135 (1990)
Fjermestad, J.S.R.H.: Group support systems: a descriptive evaluation of case and field studies. JMIS 12, 115–159 (2000)
Hosler, K.A., Arend, B.D.: The importance of course design, feedback, and facilitation: student perceptions of the relationship between teaching presence and cognitive presence. Educ. Media Int. 49, 217–229 (2012)
Kelly, G.G., Bostrom, R.P.: Facilitating the socio-emotional dimension in group support systems environments. JMIS 14, 23–44 (1997)
Mosvick, R., Nelson, R.: We’ve Got to Start Meeting Like This! A Guide to Successful Business Meeting Management. Scott Forseman, Glenview (1987)
Niederman, F., Beise, C.M., Beranek, P.M.: Issues and concerns about computer-supported meetings: the facilitator’s perspective. MIS Quart. 20, 1–22 (1996)
Vogel, D.R., Nunamaker, J.F., Martz, W.B., Ronald, G., McGoff, C.: Electronic meeting system experience at IBM. JMIS 6, 25–43 (1989)
Dickson, G.W., Lee-Partridge, J.E., Limayem, M., Desanctis, G.L.: Facilitating computer-supported meetings: a cumulative analysis in a multiple-criteria task environment. Group Decis. Negot. 5, 51–72 (1996)
Keeling, K., Beatty, S., McGoldrick, P., Macaulay, L.: Face value? Customer views of appropriate formats for embodied conversational agents (ECAs) in online retailing. In: 37th HICSS, Big Island (2004)
McBreen, H.: Embodied conversational agents in e-commerce applications. In: Dautenhahn, K., Bond, A., Cañamero, L., Edmonds, B. (eds.) Socially Intelligent Agents, vol. 3, pp. 267–274. Kluwer Academic Publishers, Boston (2002)
Pak, R., Fink, N., Price, M., Bass, B., Sturre, L.: Decision support aids with anthropomorphic characteristics influence trust and performance in younger and older adults. Ergonomics 55, 1059–1072 (2012)
Beldad, A., Hegner, S., Hoppen, J.: The effect of virtual sales agent (VSA) gender – product gender congruence on product advice credibility, trust in VSA and online vendor, and purchase intention. Comput. Hum. Behav. 60, 62–72 (2016)
Forlizzi, J., Zimmerman, J., Mancuso, V., Kwak, S.: How interface agents affect interaction between humans and computers. In: Koskinen, I., Keinonen, T. (eds.) DPPI 2007, p. 209. ACM Press, New York (2007)
Krämer, N.C., Karacora, B., Lucas, G., Dehghani, M., Rüther, G., Gratch, J.: Closing the gender gap in STEM with friendly male instructors? On the effects of rapport behavior and gender of a virtual agent in an instructional interaction. Comput. Educ. 99, 1–13 (2016)
Braslavski, P., Blinov, V., Bolotova, V., Pertsova, K.: How to evaluate humorous response generation, seriously? In: Shah, C., Belkin, N.J., Byström, K., Huang, J., Scholer, F. (eds.) CHIIR 2018, pp. 225–228. ACM Press, New York (2018)
Endrass, B., Rehm, M., André, E.: Planning small talk behavior with cultural influences for multiagent systems. Comput. Speech Lang. 25, 158–174 (2011)
Ochs, M., Pelachaud, C., Mckeown, G.: A user perception-based approach to create smiling embodied conversational agents. ACM Trans. Interact. Intell. Syst. 7, 1–33 (2017)
Kolfschoten, G.L., de Vreede, G.-J.: A design approach for collaboration processes: a multimethod design science study in collaboration engineering. JMIS 26, 225–256 (2009)
Chandra, L., Seidel, S., Gregor, S.: Prescriptive knowledge in IS research: conceptualizing design principles in terms of materiality, action, and boundary conditions. In: 48th HICSS, Kauai (2015)
Briggs, R., de Vreede, G.-J.: ThinkLets: Building Blocks for Concerted Collaboration (2009)
Leimeister, J.M.: Collaboration Engineering: IT-gestützte Zusammenarbeitsprozesse systematisch entwickeln und durchführen. Springer Gabler, Berlin (2014). (in German)
Jenkins, M.-C., Churchill, R., Cox, S., Smith, D.: Analysis of user interaction with service oriented chatbot systems. In: Jacko, J.A. (ed.) HCI 2007. LNCS, vol. 4552, pp. 76–83. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-73110-8_9
Medhi Thies, I., Menon, N., Magapu, S., Subramony, M., O’Neill, J.: How do you want your chatbot? An exploratory wizard-of-oz study with young, urban Indians. In: Bernhaupt, R., Dalvi, G., Joshi, A., Balkrishan, Devanuj K., O’Neill, J., Winckler, M. (eds.) INTERACT 2017. LNCS, vol. 10513, pp. 441–459. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-67744-6_28
Morrissey, K., Kirakowski, J.: ‘Realness’ in chatbots: establishing quantifiable criteria. In: Kurosu, M. (ed.) HCI 2013. LNCS, vol. 8007, pp. 87–96. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39330-3_10
Ghose, S., Barua, J.J.: Toward the implementation of a topic specific dialogue based natural language chatbot as an undergraduate advisor. In: International Conference on Informatics, Electronics and Vision, Dhaka (2013)
Salomonson, N., Allwood, J., Lind, M., Alm, H.: Comparing human-to-human and human-to- AEA communication in service encounters. J. Bus. Commun. 50, 87–116 (2013)
Avery, M., Auvine, B., Streibel, B., Weiss, L.: Building UnitedJudgment: A Handbook for Consensus Decision Making. The Center for Conflict Resolution, Madison (1981)
Adams, S., et al.: Mapping the landscape of human-level artificial general intelligence. AI Mag. 33, 25 (2012)
Egen, G.: Face to Face: The Small Group Experience and Interpersonal Growth. Brooks/Cole, Monterey (1971)
Nimavat, K., Champaneria, T.: Chatbots: an overview, types, architecture, tools and future possibilities. J. Sci. Res. Dev. 5, 1019–1026 (2017)
Meuser, M., Nagel, U.: ExpertInneninterviews—vielfach erprobt, wenig bedacht. Theorie, Methode, Anwendung. In: Bogner, A., Littig, B., Menz, W. (eds.) Das Experteninterview, pp. 71–93 (2002). (in German)
Bittner, E.A.C., Oeste-Reiß, S., Leimeister, J.M.: Where is the bot in our team? Toward a taxonomy of design option combinations for conversational agents in collaborative work. In: 52nd HICSS, Maui (2019)
Montero, C.A.S., Araki, K.: Enhancing computer chat: toward a smooth user-computer interaction. In: Khosla, R., Howlett, R.J., Jain, L.C. (eds.) KES 2005. LNCS, vol. 3681, pp. 918–924. Springer, Heidelberg (2005). https://doi.org/10.1007/11552413_131
Kusber, R.: Chatbots – conversational UX platforms. In: Smolinski, R., Gerdes, M., Siejka, M., Bodek, M.C. (eds.) Innovationen und Innovationsmanagement in der Finanzbranche, pp. 231–244. Springer Gabler, Wiesbaden (2017). https://doi.org/10.1007/978-3-658-15648-0_11
Ramesh, K., Ravishankaran, S., Joshi, A., Chandrasekaran, K.: A survey of design techniques for conversational agents. In: Kaushik, S., Gupta, D., Kharb, L., Chahal, D. (eds.) ICICCT 2017. CCIS, vol. 750, pp. 336–350. Springer, Singapore (2017). https://doi.org/10.1007/978-981-10-6544-6_31
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Tavanapour, N., Theodorakopoulos, D., Bittner, E.A.C. (2020). A Conversational Agent as Facilitator: Guiding Groups Through Collaboration Processes. In: Zaphiris, P., Ioannou, A. (eds) Learning and Collaboration Technologies. Human and Technology Ecosystems. HCII 2020. Lecture Notes in Computer Science(), vol 12206. Springer, Cham. https://doi.org/10.1007/978-3-030-50506-6_9
Download citation
DOI: https://doi.org/10.1007/978-3-030-50506-6_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-50505-9
Online ISBN: 978-3-030-50506-6
eBook Packages: Computer ScienceComputer Science (R0)