Fannie Liu
Skip Abstract Section
Abstract
We are exploring the concept of expressive biosignals: leveraging wearable technologies to introduce sensed physiological data as cues for social perception. Biosignals can help us achieve a deeper understanding of each other by revealing or clarifying the psychological processes that underlie our subjective experience. We conducted an exploratory study investigating expressive biosignals, comparing the influence of a variety of brain activity visualizations on impression formation. Results revealed that while participants readily infer emotional and cognitive states from visualized brain activity, the ambiguity of the data can lead to diverse perceptions and interpretations. Participants also expressed concerns that the observation of another individual's data during interaction might be invasive or distracting. We present a set of design considerations addressing issues of interpretability, integration, and privacy of biosignals in interpersonal contexts.
- Maher Abujelala, Cheryl Abellanoza, Aayush Sharma, and Fillia Makedon.2016. Brain-ee: Brain enjoyment evaluation using commercial eeg headband Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments. ACM, 33. Google Scholar
Digital Library
- Gordon W Allport.1933. Studies in Expressive Movement. The Macmillan Company.Google Scholar
- Nalini Ambady and Robert Rosenthal.1992. Thin Slices of Expressive Behavior as Predictors of Interpersonal Consequences: A Meta-Analysis. Psychological Bulletin Vol. 111, 2 (1992), 256--274.Google ScholarCross Ref
- Yadid Ayzenberg, Javier Hernandez Rivera, and Rosalind Picard.2012. FEEL: frequent EDA and event logging--a mobile social interaction stress monitoring system Proceedings of the CHI 2012 Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 2357--2362. Google ScholarDigital Library
- Fabio Babiloni and Laura Astolfi.2014. Social neuroscience and hyperscanning techniques: past, present and future. Neuroscience & Biobehavioral Reviews Vol. 44 (2014), 76--93.Google ScholarCross Ref
- Pouya Bashivan, Irina Rish, and Steve Heisig.2015. Mental State Recognition via Wearable EEG. (2015).Google Scholar
- Chris Berka, Daniel J Levendowski, Milenko M Cvetinovic, Miroslav M Petrovic, Gene Davis, Michelle N Lumicao, Vladimir T Zivkovic, Miodrag V Popovic, and Richard Olmstead.2004. Real-time analysis of EEG indexes of alertness, cognition, and memory acquired with a wireless EEG headset. International Journal of Human-Computer Interaction, Vol. 17, 2 (2004), 151--170.Google ScholarCross Ref
- Franco Curmi, Maria Angela Ferrario, Jen Southern, and Jon Whittle.2013. HeartLink: open broadcast of live biometric data to social networks Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1749--1758. Google ScholarDigital Library
- Bella M DePaulo.1992. Nonverbal behavior and self-presentation. Psychological Bulletin Vol. 111, 2 (1992), 203.Google ScholarCross Ref
- Empatica.2017. Monitor stress, seizures, activity, sleep. (2017). Retrieved April 24, 2017 from https://www.empatica.com/product-embrace.Google Scholar
- Jérémy Frey.2016. Remote Heart Rate Sensing and Projection to Renew Traditional Board Games and Foster Social Interactions. In Proceedings of the CHI 2016 Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 1865--1871. Google ScholarDigital Library
- Laurent George and Anatole Lécuyer.2010. An overview of research on "passive" brain-computer interfaces for implicit human-computer interaction. In International Conference on Applied Bionics and Biomechanics ICABB 2010-Workshop W1 "Brain-Computer Interfacing and Virtual Reality".Google Scholar
- Robert Gifford.1994. A lens-mapping framework for understanding the encoding and decoding of interpersonal dispositions in nonverbal behavior. Journal of Personality and Social Psychology, Vol. 66, 2 (1994), 398.Google ScholarCross Ref
- Daniel T Gilbert, Brett W Pelham, and Douglas S Krull.1988. On cognitive busyness: When person perceivers meet persons perceived. Journal of Personality and Social Psychology, Vol. 54, 5 (1988), 733.Google ScholarCross Ref
- Erving Goffman.1959. The presentation of self in everyday life. Anchor, Garden City, NY.Google Scholar
- Samuel D Gosling, Peter J Rentfrow, and William B Swann.2003. A very brief measure of the Big-Five personality domains. Journal of Research in Personality Vol. 37, 6 (2003), 504--528.Google ScholarCross Ref
- Mariam Hassib, Daniel Buschek, PawelW W Wozniak, and Florian Alt.2017 a. HeartChat: Heart Rate Augmented Mobile Chat to Support Empathy and Awareness Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 2239--2251. Google ScholarDigital Library
- Mariam Hassib, Stefan Schneegass, Philipp Eiglsperger, Niels Henze, Albrecht Schmidt, and Florian Alt.2017 b. EngageMeter: A System for Implicit Audience Engagement Sensing Using Electroencephalography Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 5114--5119. Google ScholarDigital Library
- Javier Hernandez, Ivan Riobo, Agata Rozga, Gregory D Abowd, and Rosalind W Picard.2014. Using electrodermal activity to recognize ease of engagement in children during social interactions. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 307--317. Google ScholarDigital Library
- Noura Howell, Laura Devendorf, Rundong Kevin Tian, Tomás Vega Galvez, Nan-Wei Gong, Ivan Poupyrev, Eric Paulos, and Kimiko Ryokai.2016. Biosignals as Social Cues: Ambiguity and Emotional Interpretation in Social Displays of Skin Conductance. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems. ACM, 865--870. Google ScholarDigital Library
- Interaxon.2015. Available Data - Muse Developers. (2015). Retrieved November 11, 2016 from http://developer.choosemuse.com/research-tools/available-dataGoogle Scholar
- Joris H Janssen, Jeremy N Bailenson, Wijnand A IJsselsteijn, and Joyce HDM Westerink.2010. Intimate heartbeats: Opportunities for affective communication technology. IEEE Transactions on Affective Computing Vol. 1, 2 (2010), 72--80. Google ScholarDigital Library
- Markus Koppensteiner and Karl Grammer.2010. Motion patterns in political speech and their influence on personality ratings. Journal of Research in Personality Vol. 44, 3 (2010), 374--379.Google ScholarCross Ref
- Megan N Kozak, Abigail A Marsh, and Daniel M Wegner.2006. What do I think you're doing? Action identification and mind attribution. Journal of Personality and Social Psychology, Vol. 90, 4 (2006), 543.Google ScholarCross Ref
- Sylvia D Kreibig.2010. Autonomic nervous system activity in emotion: A review. Biological Psychology Vol. 84, 3 (2010), 394--421.Google ScholarCross Ref
- Erik Andreas Larsen.2011. Classification of EEG signals in a brain-computer interface system. (2011).Google Scholar
- Lucian Leahu and Phoebe Sengers.2014. Freaky: performing hybrid human-machine emotion. Proceedings of the 2014 ACM Conference on Designing Interactive Systems. ACM, 607--616. Google ScholarDigital Library
- Robert W Levenson and Anna M Ruef.1997. Physiological aspects of emotional knowledge and rapport. Empathic Accuracy, bibfieldeditorWilliam J Ickes (Ed.). Guilford Press, Chapter 2, 44--72.Google Scholar
- Rashima Mahajan, Dipali Bansal, and Shweta Singh.2014. A Real Time Set Up for Retrieval of Emotional States from Human Neural Responses. International Journal of Medical, Health, Pharmaceutical and Biomedical Engineering, Vol. 8, 3 (2014), 142--147.Google Scholar
- Banu Manav.2007. Color-emotion associations and color preferences: A case study for residences. Color Research & Application Vol. 32, 2 (2007), 144--150.Google ScholarCross Ref
- Jennifer Mankoff, Anind K Dey, Gary Hsieh, Julie Kientz, Scott Lederer, and Morgan Ames.2003. Heuristic evaluation of ambient displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 169--176. Google ScholarDigital Library
- Gerald Matthews and Manfred Amelang.1993. Extraversion, arousal theory and performance: A study of individual differences in the EEG. Personality and Individual Differences Vol. 14, 2 (1993), 347--363.Google ScholarCross Ref
- Nick Merrill and Coye Cheshire.2016. Habits of the Heart (rate): Social Interpretation of Biosignals in Two Interaction Contexts Proceedings of the 19th International Conference on Supporting Group Work. ACM, 31--38. Google ScholarDigital Library
- Nick Merrill and Coye Cheshire.2017. Trust Your Heart: Assessing Cooperation and Trust with Biosignals in Computer-Mediated Interactions. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 2--12. Google ScholarDigital Library
- Crysta Metcalf, Gunnar Harboe, Joe Tullio, Noel Massey, Guy Romano, Elaine M Huang, and Frank Bentley.2008. Examining presence and lightweight messaging in a social television experience. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Vol. 4, 4 (2008), 27. Google ScholarDigital Library
- Hyeryung Christine Min and Tek-Jin Nam.2014. Biosignal sharing for affective connectedness. In Proceedings of the CHI 2014 Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 2191--2196. Google ScholarDigital Library
- Helmuth Petsche, K Linder, Peter Rappelsberger, and Gerold Gruber.1988. The EEG: An adequate method to concretize brain processes elicited by music. Music Perception: An Interdisciplinary Journal, Vol. 6, 2 (1988), 133--159.Google ScholarCross Ref
- Ronald E Riggio and Howard S Friedman.1986. Impression formation: the role of expressive behavior. Journal of Personality and Social Psychology, Vol. 50, 2 (1986), 421.Google ScholarCross Ref
- Louis A Schmidt and Laurel J Trainor.2001. Frontal brain electrical activity (EEG) distinguishes valence and intensity of musical emotions. Cognition & Emotion, Vol. 15, 4 (2001), 487--500.Google ScholarCross Ref
- Holger Schn"adelbach, Stefan Rennick Egglestone, Stuart Reeves, Steve Benford, Brendan Walker, and Michael Wright.2008. Performing thrill: designing telemetry systems and spectator interfaces for amusement rides Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1167--1176. Google ScholarDigital Library
- Mark S Schwartz and Frank Andrasik.2015. Biofeedback: A Practitioner's Guide. Guilford Publications.Google Scholar
- Petr Slovák, Joris Janssen, and Geraldine Fitzpatrick.2012. Understanding heart rate sharing: towards unpacking physiosocial space Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 859--868. Google ScholarDigital Library
- Jaime Snyder, Mark Matthews, Jacqueline Chien, Pamara F Chang, Emily Sun, Saeed Abdullah, and Geri Gay.2015. Moodlight: Exploring personal and social implications of ambient display of biosensor data. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. ACM, 143--153. Google ScholarDigital Library
- A Strauss and J Corbin.1998. Basics of qualitative research techniques. (1998).Google Scholar
- Chiew Seng Sean Tan, Johannes Schöning, Kris Luyten, and Karin Coninx.2014. Investigating the effects of using biofeedback as visual stress indicator during video-mediated collaboration. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 71--80. Google ScholarDigital Library
- Martin Tanis and Tom Postmes.2003. Social cues and impression formation in CMC. Journal of Communication Vol. 53, 4 (2003), 676--693.Google ScholarCross Ref
- Kristin Taraldsen, Sebastien FM Chastin, Ingrid I Riphagen, Beatrix Vereijken, and Jorunn L Helbostad.2012. Physical activity monitoring by use of accelerometer-based body-worn sensors in older adults: a systematic literature review of current knowledge and applications. Maturitas, Vol. 71, 1 (2012), 13--19.Google ScholarCross Ref
- Wouter Walmink, Danielle Wilde, and Florian'Floyd' Mueller.2014. Displaying heart rate data on a bicycle helmet to support social exertion experiences Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction. ACM, 97--104. Google ScholarDigital Library
- Julia Werner, Reto Wettach, and Eva Hornecker.2008. United-pulse: feeling your partner's pulse. In Proceedings of the 10th International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, 535--538. Google ScholarDigital Library
- Amanda L Wheat and Kevin T Larkin.2010. Biofeedback of heart rate variability and related physiology: A critical review. Applied Psychophysiology and Biofeedback Vol. 35, 3 (2010), 229--242.Google ScholarCross Ref
- Michele A Williams, Asta Roseway, Chris O'Dowd, Mary Czerwinski, and Meredith Ringel Morris.2015. Swarm: an actuated wearable for mediating affect. Proceedings of the 9th International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 293--300. Google ScholarDigital Library
Index Terms
- Can Biosignals be Expressive?: How Visualizations Affect Impression Formation from Shared Brain Activity
Recommendations
The Effect of Expressive Biosignals on Empathy and Closeness for a Stigmatized Group Member
We explore the potential for expressive biosignals, or displays of sensed physiological data as social cues, to influence perceptions of a member of a stigmatized group. In a between-subjects experiment (N=62) participants read a fictional interview ...
Expressive Biosignals: Authentic Social Cues for Social Connection
CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing SystemsMy research introduces expressive biosignals as a novel social cue to improve interpersonal communication. Expressive biosignals are sensed physiological data revealed between people to provide a deeper understanding of each other's psychological ...
SynKin: A Game for Intentionally Synchronizing Biosignals
CHI EA '17: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing SystemsInter-individual synchronization of motor activity, such as gestures, posture and speech rhythm during face-to-face interaction is a well-established phenomenon. Recent investigations have revealed that similar synchronization during interaction also ...
Comments