Valtteri Wikström
ABSTRACT
Inter-individual synchronization of motor activity, such as gestures, posture and speech rhythm during face-to-face interaction is a well-established phenomenon. Recent investigations have revealed that similar synchronization during interaction also occurs in brain activity and autonomous physiology. However, it is not known to what extent this synchronization emerges during computer-mediated interaction and whether its absence contributes to the widely acknowledged problems of online communication. We suggest that measuring the synchronization of biosignals is meaningful for assessing emotional capacity of computer-mediated communication systems, and intentionally increasing synchronization could improve understanding between people. As a proof-of-concept an interactive real-time system to quantify and visualize the synchronization of facial expressions, ECG, EEG and EDA of two players was piloted and results are presented in this paper.
Supplemental Material
- M. Balaam, G. Fitzpatrick, J. Good, and E. Harris. 2011. Enhancing Interactional Synchrony with an Ambient Display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 867--876. Google Scholar
Digital Library
- L.M. Carrier, A. Spradlin, J.P. Bunce, and L.D. Rosen. 2015. Virtual empathy: Positive and negative impacts of going online upon empathy in young adults. Computers in Human Behavior (2015).Google Scholar
- X. Cui, D.M. Bryant, and A.L. Reiss. 2012. NIRSbased hyperscanning reveals increased interpersonal coherence in superior frontal cortex during cooperation. NeuroImage 59, 3 (2012), 2430--2437. Google ScholarCross Ref
- G. Dumas, J. Nadel, R. Soussignan, J. Martinerie, and L. Garnero. 2010. Inter-Brain Synchronization during Social Interaction. PLoS ONE 5, 8 (aug 2010), e12166.Google ScholarCross Ref
- P. Ekman and H. Oster. 1979. Facial expressions of emotion. Annual review of psychology (1979).Google Scholar
- D. Engel, A.W. Woolley, L.X. Jing, and C.F. Chabris. 2014. Reading the mind in the eyes or reading between the lines? Theory of mind predicts collective intelligence equally well online and face-to-face. PloS ONE (2014).Google Scholar
- M.J. Hove and J.L. Risen. 2009. It's all in the timing: Interpersonal synchrony increases affiliation. Social Cognition (2009).Google Scholar
- J.H. Janssen, J.N. Bailenson, W.A. IJsselsteijn, and J.H.D.M. Westerink. 2010. Intimate heartbeats: Opportunities for affective communication technology. IEEE Transactions on Affective Computing 1, 2 (2010), 72-- 80. Google ScholarDigital Library
- M. Kawasaki, Y. Yamada, Y. Ushiku, E. Miyauchi, and Y. Yamaguchi. 2013. Inter-brain synchronization during coordination of speech rhythm in human-to-human social interaction. Scientific Reports 3 (apr 2013), 849--850. Google ScholarCross Ref
- I. Konvalinka and A. Roepstorff. 2012. The two-brain approach: how can mutually interacting brains teach us something about social interaction? Frontiers in Human Neuroscience 6 (2012), 215. Google ScholarCross Ref
- S.D. Kreibig, G. Schaefer, and T. Brosch. 2010. Psychophysiological response patterning in emotion: Implications for affective computing. A blueprint for affective computing (2010), 105--130.Google Scholar
- Z. Néda, E. Ravasz, Y. Brechet, T. Vicsek, and A.-L. Barabási. 2000. Self-organizing processes: The sound of many hands clapping. Nature 403, 6772 (feb 2000), 849--850. Google ScholarCross Ref
- M.J. Richardson and K.L. Marsh. 2005. Effects of visual and verbal interaction on unintentional interpersonal coordination. Journal of Experimental Psychology (2005).Google Scholar
- P. Slovák, J. Janssen, and G. Fitzpatrick. 2012. Understanding heart rate sharing: towards unpacking physiosocial space. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, 859--868. Google ScholarDigital Library
- G.J. Stephens, L.J. Silbert, and U. Hasson. 2010. Speaker-listener neural coupling underlies successful communication. Proceedings of the National Academy of Sciences of the USA 107, 32 (aug 2010), 14425--30. Google ScholarCross Ref
- P. Valdesolo, J. Ouyang, and D. DeSteno. 2010. The rhythm of joint action: Synchrony promotes cooperative ability. Journal of Experimental Social Psychology 46, 4 (2010), 693--695. Google ScholarCross Ref
- B. Vickhoff, H. Malmgren, R. Åström, G. Nyberg, S.R. Ekström, M. Engwall, J Snygg, M. Nilsson, and R. Jörnsten. 2013. Music structure determines heart rate variability of singers. Frontiers in Psychology 4 (2013), 334. Google ScholarCross Ref
- J. Zaki and K.N. Ochsner. 2012. The neuroscience of empathy: progress, pitfalls and promise. Nature neuroscience (2012).Google Scholar
Index Terms
- SynKin: A Game for Intentionally Synchronizing Biosignals
Recommendations
Can Biosignals be Expressive?: How Visualizations Affect Impression Formation from Shared Brain Activity
We are exploring the concept of expressive biosignals: leveraging wearable technologies to introduce sensed physiological data as cues for social perception. Biosignals can help us achieve a deeper understanding of each other by revealing or clarifying ...
An empirical study of players’ emotions in VR racing games based on a dataset of physiological data
AbstractA video game is an interactive software able to arouse intense emotions in players. Consequentially, different theories have been proposed to understand which game aspects are able to affect the players’ emotional state. However, only few works ...
Correlation between Psychological and Physiological Responses during Fear
BIOSTEC 2014: Proceedings of the International Joint Conference on Biomedical Engineering Systems and Technologies - Volume 4The purpose of this study is to examine the physiological responses to predict the psychological level of perceived fear. Thirty male and female college students (15 male and 15 female, mean age: 22.6±1.24) participated in the experiment. EDA (...
Comments