ABSTRACT
The pandemic has caused a significant increase in the use of videoconferencing for oral presentations. Prior work demonstrated that an embodied conversational agent that co-delivers an oral presentation could be used in face-to-face presentations to reduce public speaking anxiety and increase presentation quality. In this work, we evaluate the use of a co-presenter agent in the delivery of virtual presentations given over a videoconferencing system, comparing them to presentations given without the agent. We found that participants were satisfied with the co-presenter agent, and those who liked the agent (scoring above the mean on a composite self-report measure of satisfaction) rated the presentations they gave with the agent as having significantly higher quality compared to those given without the agent. There was evidence the agent helped participants feel less nervous about their talks. Interviews confirmed these findings, and identified additional advantages and disadvantages of using co-presenter agents in virtual presentations.
- Adobe. 2021. Adobe: Creative, marketing and document management solutions. url=https://www.adobe.com/. Accessed: 2021-01-11.Google Scholar
- Google AI. 2018. Expressive Speech Synthesis with Tacotron. https://ai.googleblog.com/2018/03/expressive-speech-synthesis-with.html.Google Scholar
- Elisabeth André, Thomas Rist, and Jochen Müller. 1998. WebPersona: a lifelike presentation agent for the World-Wide Web. Knowledge-Based Systems 11, 1 (1998), 25–36.Google ScholarDigital Library
- Timothy Bickmore, Everlyne Kimani, Ameneh Shamekhi, Prasanth Murali, Dhaval Parmar, and Ha Trinh. 2020. Virtual agents as supporting media for scientific presentations. Journal on Multimodal User Interfaces 14, 4 (Nov. 2020), 1–16.Google Scholar
- John B Bishop, Karen W Bauer, and Elizabeth Trezise Becker. 1998. A survey of counseling needs of male and female college students.Journal of College Student Development 39, 2 (1998), 205–210.Google Scholar
- Anke W Blöte, Marcia JW Kint, Anne C Miers, and P Michiel Westenberg. 2009. The relation between public speaking anxiety and social anxiety: A review. Journal of Anxiety Disorders 23, 3 (2009), 305–313.Google ScholarCross Ref
- Justine Cassell, Hannes Högni Vilhjálmsson, and Timothy Bickmore. 2004. Beat: the behavior expression animation toolkit. In Life-Like Characters. Springer, Berlin, Heidelberg, 163–185. https://doi.org/10.1007/978-3-662-08373-4_8Google ScholarCross Ref
- CereProc. 2021. The world’s most advanced text to speech technology.https://www.cereproc.com/. Accessed: 2021-01-11.Google Scholar
- Mathieu Chollet, Pranav Ghate, Catherine Neubauer, and Stefan Scherer. 2018. Influence of Individual Differences When Training Public Speaking with Virtual Audiences. In Proceedings of the 18th International Conference on Intelligent Virtual Agents. Association for Computing Machinery, New York, NY, USA, 1–7. https://doi.org/10.1145/3267851.3267874Google ScholarDigital Library
- Roger Courville. 2009. The virtual presenter’s handbook. 1080 Group, Portland, OR, USA. https://www-users.cs.york.ac.uk/~alistair/presentations/TheVPsHB-2013-COLUK-GTM.pdfGoogle Scholar
- John A Daly, Anita L Vangelisti, and David J Weber. 1995. Speech anxiety affects how people prepare speeches: A protocol analysis of the preparation processes of speakers. Communications Monographs 62, 4 (1995), 383–397.Google ScholarCross Ref
- Elena L Glassman, Juho Kim, Andrés Monroy-Hernández, and Meredith Ringel Morris. 2015. Mudslide: A spatially anchored census of student confusion for online lecture videos. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1555–1564.Google ScholarDigital Library
- Google. 2021. Google Slides: Free Online Presentations. https://www.google.com/slides/about. Accessed: 2021-01-11.Google Scholar
- Daniel F Grös, Martin M Antony, Leonard J Simms, and Randi E McCabe. 2007. Psychometric properties of the state-trait inventory for cognitive and somatic anxiety (STICSA): comparison to the state-trait anxiety inventory (STAI).Psychological assessment 19, 4 (2007), 369.Google Scholar
- K Virginia Hemby. 2019. Delivering Effective Virtual Presentations. Business Expert Press, New York, NY, USA.Google Scholar
- Debra A Hope, Richard G Heimberg, and Cynthia L Turk. 2010. Managing social anxiety: A cognitive-behavioral therapy approach: Therapist guide. Oxford University Press, USA, New York, NY, USA.Google Scholar
- Forbes Insights. 2009. Business meetings: The case for face-to-face. New York. Retrieved from http://www.forbes.com/forbesinsights/Business_Meetings_FaceToFace/, and viewed on August 20 (2009), 2014.Google Scholar
- Jeffrey M Jackson and Bibb Latané. 1981. All alone in front of all those people: Stage fright as a function of number and type of co-performers and audience.Journal of personality and social psychology 40, 1(1981), 73.Google Scholar
- Colette Johnson. 2016. Virtual Presentations Made Simple: Practical tips for effective web presentations (1 ed.). 1, Vol. 1. CreateSpace Publishing, Scotts Valley, CA, USA.Google Scholar
- Stanislav V Kasl and George F Mahl. 1965. Relationship of disturbances and hesitations in spontaneous speech to anxiety.Journal of personality and social psychology 1, 5 (1965), 425.Google Scholar
- Everlyne Kimani, Ameneh Shamhekhi, Prasanth Murali, Dhaval Parmar, and Timothy Bickmore. 2019. Stagecraft for Scientists: Exploring Novel Interaction Formats for Virtual Co-Presenter Agents. In Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents. Association for Computing Machinery, New York, NY, USA, 10–12.Google ScholarDigital Library
- Kim T Kirkwood. 1998. Validity of cognitive assessments via telecommunication links. Ph.D. Dissertation. The University of Edinburgh.Google Scholar
- Timothy J Koegel. 2010. The exceptional presenter goes virtual. Greenleaf Book Group, Austin, Texas, USA.Google Scholar
- Bibb Latane, Steve Nida, 1987. Social impact theory and group influence: A social engineering perspective. Psychology of group influence 1, 1 (1987), 3–34.Google Scholar
- Fabrice Matulic, Lars Engeln, Christoph Träger, and Raimund Dachselt. 2016. Embodied interactions for novel immersive presentational experiences. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1713–1720.Google ScholarDigital Library
- James C. McCroskey and Linda L. McCroskey. 1988. Self‐report as an approach to measuring communication competence. Communication Research Reports 5, 2 (1988), 108–113. https://doi.org/10.1080/08824098809359810Google ScholarCross Ref
- Kent E Menzel and Lori J Carrell. 1994. The relationship between preparation and performance in public speaking. Communication Education 43, 1 (1994), 17–26.Google ScholarCross Ref
- Michael T Motley. 1990. Public speaking anxiety qua performance anxiety: A revised model and an alternative therapy. Journal of Social Behavior and Personality 5, 2 (1990), 85.Google Scholar
- Prasanth Murali, Javier Hernandez, Daniel McDuff, Kael Rowan, Jina Suh, and Mary Czerwinski. 2021. AffectiveSpotlight: Facilitating the Communication of Affective Responses from Audience Members during Online Presentations. arXiv preprint arXiv:2101.12284 1, 1 (2021), 1–13.Google Scholar
- Prasanth Murali, Lazlo Ring, Ha Trinh, Reza Asadi, and Timothy Bickmore. 2018. Speaker Hand-Offs in Collaborative Human-Agent Oral Presentations. In Proceedings of the 18th International Conference on Intelligent Virtual Agents. Association for Computing Machinery, New York, NY, USA, 153–158.Google ScholarDigital Library
- Anton Nijholt, Herwin van Welbergen, and Job Zwiers. 2005. Introducing an Embodied Virtual Presenter Agent in a Virtual Meeting Room. In Artificial Intelligence and Applications. ACTA Press, Canada, 579–584.Google Scholar
- Tsukasa Noma, Liwei Zhao, and Norman I Badler. 2000. Design of a virtual human presenter. IEEE Computer Graphics and Applications 20, 4 (2000), 79–85.Google ScholarDigital Library
- OBS. 2021. OBS Studio. https://obsproject.com/. Accessed: 2021-01-11.Google Scholar
- Gordon L Paul. 1966. Insight vs. desensitization in psychotherapy: An experiment in anxiety reduction. Stanford University Press, Palo Alto, CA.Google Scholar
- David-Paul Pertaub, Mel Slater, and Chris Barker. 2002. An experiment on public speaking anxiety in response to three different types of virtual audience. Presence: Teleoperators & Virtual Environments 11, 1(2002), 68–78.Google ScholarDigital Library
- Verónica Rivera-Pelayo, Johannes Munk, Valentin Zacharias, and Simone Braun. 2013. Live interest meter: learning from quantified feedback in mass lectures. In Proceedings of the Third International Conference on Learning Analytics and Knowledge. Association for Computing Machinery, New York, NY, USA, 23–27.Google ScholarDigital Library
- Hugo Romat, Emmanuel Pietriga, Nathalie Henry-Riche, Ken Hinckley, and Caroline Appert. 2019. SpaceInk: Making Space for In-Context Annotations. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery, New York, NY, USA, 871–882.Google ScholarDigital Library
- Nazmus Saquib, Rubaiat Habib Kazi, Li-Yi Wei, and Wilmot Li. 2019. Interactive body-driven graphics for augmented video performance. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–12.Google ScholarDigital Library
- Susan Simpson. 2009. Psychotherapy via videoconferencing: A review. British Journal of Guidance & Counselling 37, 3 (2009), 271–286.Google ScholarCross Ref
- Hariharan Subramonyam, Colleen Seifert, Priti Shah, and Eytan Adar. 2020. texSketch: Active Diagramming through Pen-and-Ink Annotations. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–13.Google ScholarDigital Library
- Wei Sun, Yunzhi Li, Feng Tian, Xiangmin Fan, and Hongan Wang. 2019. How Presenters Perceive and React to Audience Flow Prediction In-situ: An Explorative Study of Live Online Lectures. Proceedings of the ACM on Human-Computer Interaction 3, CSCW(2019), 1–19.Google ScholarDigital Library
- [42] Unity Technologies.2021. https://unity.com/. Accessed: 2021-01-11.Google Scholar
- David R Thomas. 2006. A general inductive approach for analyzing qualitative evaluation data. American journal of evaluation 27, 2 (2006), 237–246.Google Scholar
- Ha Trinh, Reza Asadi, Darren Edge, and T Bickmore. 2017. Robocop: A robotic coach for oral presentations. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 2 (2017), 1–24.Google ScholarDigital Library
- Ha Trinh, Lazlo Ring, and Timothy Bickmore. 2015. Dynamicduo: co-presenting with virtual agents. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1739–1748.Google ScholarDigital Library
- James Vincent. 2020. Nvidia says its AI can fix some of the biggest problems in video calls. https://www.theverge.com/2020/10/5/21502003/nvidia-ai-videoconferencing-maxine-platform-face-gaze-alignment-gans-compression-resolutionGoogle Scholar
- Tim Ward and Teresa Erickson. 2020. Resilience: Virtually Speaking: Communicating at a Distance. Hunt Publishing Limited, John, United Kingdom.Google Scholar
- Zoom. 2021. Video Conferencing, Web Conferencing, Webinars, Screen Sharing. https://zoom.us/. Accessed: 2021-01-11.Google Scholar
Index Terms
- Sharing the Load Online: Virtual Presentations with Virtual Co-Presenter Agents
Recommendations
DynamicDuo: Co-presenting with Virtual Agents
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing SystemsThe quality of most professional oral presentations is often poor, owing to a number of factors, including public speaking anxiety. We present DynamicDuo, a system that uses an automated, life-sized, animated agent to help inexperienced speakers deliver ...
Negotiating task interruptions with virtual agents for health behavior change
AAMAS '08: Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems - Volume 3Virtual health counseling agents on mobile devices need to be able to interrupt their users when it is time for them to engage in healthy behaviors, such as scheduled medication taking or exercise. However, these real-time reminders often represent task ...
The Presenter Experience of Canvas Presentations
Human-Computer Interaction – INTERACT 2015AbstractMost presentations are given with supporting visuals and driven by specialized presentation software. Today, this software either follows the classic slideware metaphor, presenting a series of discrete screens—or it implements the more recent ...
Comments