Abstract
To increase the creativity of discussions, it is important for participants to express their thoughts and ask questions while paying attention to each other. Meanwhile, inferring the thoughts and emotional states of others and working appropriately while organizing ones’ own opinions as well as those of others during discussions can be difficult. In this study, we propose a discussion support framework designed to realize adaptive intellectual intervention by interpreting discussion situations based on multimodal interaction information during online discussions. To do so, we formulated a notation to represent various discussion situations as well as a rule notation for presenting advice according to the discussion situation. We also developed a rule-setting support system designed to set concrete rules, and developed a multimodal information processing mechanism that handles multi-party multimodal data series measured in real-time and present advice collected during a discussion situation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
The “practical purpose” and “practical procedure” shown here represent the data of the document semantics (research content semantics) corresponding to arg[1].semantics=“Research Category” and arg[3].semantics=“Research Category” set in Table 2(6), respectively. Even in the same discussion situation, if the document semantics given to the AOI in the discussion material differ, the content of the advice changes adaptively.
References
Bitti, P.E.R., Garotti, P.L.: Nonverbal communication and cultural differences: issues for face-to-face communication over the internet. In: Face-to-Face Communication Over the Internet, pp. 81–99 (2011)
Sun, J., Holger, R.: Implementing three-party desktop videoconferencing. In: Proc. of 19th Australasian Conference on Computer-Human Interaction: Entertaining User Interfaces, pp. 95–102 (2007)
Sugimoto, A., Hayashi, Y., Seta, K.: Multimodal interaction aware platform for collaborative learning. In: Proc. of 25th International Conference on Computers in Education, pp. 316–325 (2017)
Sugimoto, A., Hayashi, Y., Seta, K.: Multimodal interaction-aware integrated platform for CSCL. In: Proc. of 22nd International Conference on Human-Computer Interaction, vol. 12185, pp. 264–277 (2020)
Mori, N., Hayashi, Y., Seta, K.: Ontology-based thought organization support system to prompt readiness of intention sharing and its long-term practice. J. Inf. Syst. Educ. 18(1), 27–39 (2019)
Shono, A., Hayashi, Y., Seta, K.: Reflection support environment for creative discussion based on document semantics and multimodal information. In: Proc. of 29th International Conference on Computers in Education, pp. 93–98 (2021)
Sumi, Y., Yano, M., Nishida, T.: Analysis environment of conversational structure with nonverbal multimodal data. In: Proc. of International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, Article No. 44 (2010)
Erman, L.D., Hayes-Roth, F., Lesser, V.R., Reddy, D.R.: The Hearsay-II speech-understanding system: integrating knowledge to resolve uncertainty. ACM Comput. Surv. 12, 213–253 (1980)
Huang, H.H., Nishida, T., Cerekovic, A., Pandzic, I.S., Nakano, Y.: The design of a generic framework for integrating ECA components. In: Proc. of 7th International Joint Conference on Autonomous Agents and Multiagent Systems, vol. 1, pp. 128–135 (2008)
Ishikawa, N., et al.: A face-to-face holographic agent which fosters co-regulation in collaborative discussion. Jpn. J. Educ. Technol. 44, 185–188 (2021)
Acknowledgements
This work was supported by JSPS KAKENHI Grant Numbers 22K12317 and 19K12275.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Shoji, Y., Hayashi, Y., Seta, K. (2023). Discussion Support Framework Enabling Advice Presentation that Captures Online Discussion Situation. In: Mori, H., Asahi, Y. (eds) Human Interface and the Management of Information. HCII 2023. Lecture Notes in Computer Science, vol 14015. Springer, Cham. https://doi.org/10.1007/978-3-031-35132-7_45
Download citation
DOI: https://doi.org/10.1007/978-3-031-35132-7_45
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-35131-0
Online ISBN: 978-3-031-35132-7
eBook Packages: Computer ScienceComputer Science (R0)