Shimeng Peng
ABSTRACT
For non-sport fans, perceiving the excitement of surrounding fan groups and the arousal of collective emotions are some of the crucial factors that motivate their engaged excitement and loyalty in a sport; these factors are closely related to the process of evolution from a non-fan to a fan. The global COVID-19 pandemic changed the way of sport-watching from watching at the arena to watching from home alone. This has highlighted significant difficulties in the excitement transmission and arousal channel between non-sport fans and fans. Previous remote emotional intervening mediums had been limited to the use of virtual avatars to convey partners’ external cues (such as appearance), to enhance the sense of presence from visual-audio perspectives. In this study, we explored a novel remote emotional intervening medium that conveys sport-fans’ internal cues (bio-signals) that are widely believed to be related to internal emotional states of human, and displays those signals in a way that gives non-sport fans a deeper and more immersive experience: haptic feedback experience. Three bio-signal-based haptic feedback prototypes were developed, including heart-rate-based vibration, electromyography (EMG)-based pressure, and skin-temperature-based thermal feedbacks. An exploratory pilot study was conducted on a group of non-sport fans in a lab-control environment of remote-sport-watching to explore the effectiveness of the proposed mediums in enhancing their perception of sport-fan’s excitement (emotion perception). Besides, we also analyzed non-sport fans’ heart rate data when they were participants in the experiments to measure the performance of the proposed mediums in evoking the engaged excitement of non-sport fans (emotion arousal). Our results indicate the outstanding ability of EMG-based pressure feedback in effectively enhancing the process of emotion perception and the notable advantage of heart-rate-based vibration feedback in the arousal of non-sport fans’ engaged excitement. This study presents the potential utility of bio-signal-based haptic feedback in augmenting remote emotional perception and arousal and also provides the underlining support for the future exploration and development directions for social computing based on bio-signals and haptic technologies.
Supplemental Material
- Moses Akazue, Martin Halvey, Lynne Baillie, and Stephen Brewster. 2016. The effect of thermal stimuli on the emotional perception of images. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 4401–4412.Google Scholar
Digital Library
- Judee K Burgoon, Nadia Magnenat-Thalmann, Maja Pantic, and Alessandro Vinciarelli. 2017. Social signal processing. Cambridge University Press.Google Scholar
- Carissa J Cascio, David Moore, and Francis McGlone. 2019. Social touch and human development. Developmental cognitive neuroscience 35 (2019), 5–11.Google Scholar
- Stephanie Cheung, Elizabeth Han, Azadeh Kushki, Evdokia Anagnostou, and Elaine Biddiss. 2016. Biomusic: An auditory interface for detecting physiological indicators of anxiety in children. Frontiers in neuroscience 10 (2016), 401.Google Scholar
- Max T Curran, Jeremy Raboff Gordon, Lily Lin, Priyashri Kamlesh Sridhar, and John Chuang. 2019. Understanding digitally-mediated empathy: An exploration of visual, narrative, and biosensory informational cues. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–13.Google ScholarDigital Library
- Emile Durkheim and Joseph Ward Swain. 2008. The elementary forms of the religious life. Courier Corporation.Google Scholar
- Abdallah El Ali, Xingyu Yang, Swamy Ananthanarayan, Thomas Röggla, Jack Jansen, Jess Hartcher-O’Brien, Kaspar Jansen, and Pablo Cesar. 2020. ThermalWear: Exploring Wearable On-chest Thermal Displays to Augment Voice Messages with Affect. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–14.Google ScholarDigital Library
- Friedrich M Götz, Stefan Stieger, Tobias Ebert, Peter J Rentfrow, David Lewetz, Simine Vazire, and Joanne Chung. 2020. What drives our emotions when we watch sporting events? An ESM study on the affective experience of German spectators during the 2018 FIFA World Cup. Collabra: Psychology 6, 1 (2020).Google ScholarCross Ref
- Mariam Hassib, Daniel Buschek, Paweł W Wozniak, and Florian Alt. 2017. HeartChat: Heart rate augmented mobile chat to support empathy and awareness. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 2239–2251.Google ScholarDigital Library
- Elaine Hatfield, John T Cacioppo, and Richard L Rapson. 1993. Emotional contagion. Current directions in psychological science 2, 3 (1993), 96–100.Google Scholar
- Brennan Jones, Yaying Zhang, Priscilla NY Wong, and Sean Rintel. 2020. VROOM: Virtual Robot Overlay for Online Meetings. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1–10.Google Scholar
- Palanisamy Karthikeyan, Murugappan Murugappan, and Sazali Yaacob. 2012. Descriptive analysis of skin temperature variability of sympathetic nervous system activity in stress. Journal of Physical Therapy Science 24, 12 (2012), 1341–1344.Google ScholarCross Ref
- Fannie Liu, Chunjong Park, Yu Jiang Tham, Tsung-Yu Tsai, Laura Dabbish, Geoff Kaufman, and Andrés Monroy-Hernández. 2021. Significant Otter: Understanding the Role of Biosignals in Communication. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–15.Google ScholarDigital Library
- Yuhu Liu, Satoshi Nishikawa, Young ah Seong, Ryuma Niiyama, and Yasuo Kuniyoshi. 2021. ThermoCaress: A Wearable Haptic Device with Illusory Moving Thermal Stimulation. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–12.Google ScholarDigital Library
- Mark Paterson. 2006. Feel the presence: technologies of touch and distance. Environment and Planning D: Society and Space 24, 5 (2006), 691–708.Google ScholarCross Ref
- Fred Shaffer and Jay P Ginsberg. 2017. An overview of heart rate variability metrics and norms. Frontiers in public health(2017), 258.Google Scholar
- Xuanyu Wang, Yang Wang, Yan Shi, Weizhan Zhang, and Qinghua Zheng. 2020. AvatarMeeting: An Augmented Reality Remote Interaction System With Personalized Avatars. In Proceedings of the 28th ACM International Conference on Multimedia. 4533–4535.Google ScholarDigital Library
- Julia Werner, Reto Wettach, and Eva Hornecker. 2008. United-pulse: feeling your partner’s pulse. In Proceedings of the 10th international conference on Human computer interaction with mobile devices and services. 535–538.Google ScholarDigital Library
- R Michael Winters, Bruce N Walker, and Grace Leslie. 2021. Can You Hear My Heartbeat?: Hearing an Expressive Biosignal Elicits Empathy. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–11.Google ScholarDigital Library
Recommendations
Differential effect of excitement versus contentment, and excitement versus relaxation
Divergent associations of different positive affects with the amount of new technology, and the intention of new technology.Interest and contentment as positive affects are highly correlated.Association with the intention to adopt new technology was ...
The Effect of Different Affective Arousal Levels on Taste Perception
ICMI '20 Companion: Companion Publication of the 2020 International Conference on Multimodal InteractionThe emotions we experience shape our perception, and our emotion is shaped by our perceptions. Taste perception is also influenced by emotions. Positive and negative emotions alter sweetness, sourness, and bitterness perception. However, most previous ...
Visualizing excitement of individuals and groups
EmoVis'16: Proceedings of the 2016 EmoVis Conference on Emotion and VisualizationExcitement or arousal is one of the main emotional dimensions that affects our lives on a daily basis. We win a tennis match, watch a great movie, get into an argument with a colleague—all of these are instances when most of us experience excitement, ...
Comments