Margaret E. Morris
Carl S. Marshall
ABSTRACT
An interactive system, PIXEE, was developed to promote greater emotional expression in image-based social media. Images shared on social media were projected onto a large interactive display at public events. A multimodal interface displayed the sentiment analysis of images and invited viewers to express their emotional responses. Viewers could adjust the emotional classification and thereby change the color and sound associated with a picture, and experiment with emotion-based composition. An interdisciplinary team deployed this system around the world to explore new ways for technology to catalyze emotional connectedness. This paper describes the system, design iterations, and observations about how people used it for self-expression and connection.
- D'Andrade & Egan. (1974). The Colors of Emotion. American Ethnologist, 1: 49--63.Google Scholar
- Boehner, K., Sengers, P., & Warner., S. "Interfaces with the ineffable: Meeting aesthetic experience on its own terms." ACM Trans. Comput.-Hum. Interact. Vol 15, no. 3. Nov. 2008. pp. 1--29. Google ScholarDigital Library
- Burke, M., Kraut, R., & Marlow, C. Social capital on Facebook: Differentiating uses and users. In ACM CHI: Conference on human factors in computing. Vancouver, BC, 2011. Google ScholarDigital Library
- Goleman D. Emotional Intelligence. Bantam Books. New York (NY), 1995.Google Scholar
- Harris, J. & Kamvar, S. An exploration of human emotion, in six movements. http://wefeelfine.org/Google Scholar
- Hawkley, L. C. & Cacioppo, J. T. Loneliness matters: A theoretical and empirical review of consequences and mechanisms. Annals of Behavioral Medicine, 40(2), 218--227, 2010.Google ScholarCross Ref
- Mayer et al. (1990). Perceiving Affective Content in Ambiguous Visual Stimuli. Journal of Personality Assessment, 54: 772--781.Google ScholarCross Ref
- Morris, M.E., Kathawala, Q., Leen, T.K., Gorenstein, E.E., Guilak, F., Labhard, M., Deleeuw, W. Mobile therapy: case study evaluations of a cell phone application for emotional self-awareness. Journal of Medical Internet Research, 12,2 (2010), e10.Google ScholarCross Ref
- Pennebaker, J.W., Francis, M.E., & Booth, R.J. Linguistic Inquiry and Word Count: LIWC 2001. Mahwah, NJ: Erlbaum Publishers, 2001. http://www.liwc.net/.Google Scholar
- Pollack, J.P., Adams, P. Gay, G. PAM: A Photographic Affect Meter for frequent, in situ measurement of affect. CHI 2011, Vancouver, BC, Canada, May 7--12, 2011. Google ScholarDigital Library
- Russell, J. A Circumplex Model of Affect. J. Personality and Social Psych, 39, pp 1161--1178, 1980.Google ScholarCross Ref
- Salovey, P. & Mayer JD. Emotional intelligence. Imagination, Cognition, and Personality, 9, pp 185--211, 1990.Google Scholar
- Steblin, R. A History of Key Characteristics in the 18th and Early 19th Centuries. University of Rochester Press. 2005.Google Scholar
- Turkle, S. Alone together. Basic Books. New York (NY), 2011.Google ScholarDigital Library
- Wilson, A. D. Using a depth camera as a touch sensor. ACM International Conference on Interactive Tabletops and Surfaces (ITS '10), pp 69--72. New York, 2010. Google ScholarDigital Library
Index Terms
- PIXEE: pictures, interaction and emotional expression
Recommendations
Demonstrating PIXEE: pictures, interaction and emotional expression
CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing SystemsAn interactive system, PIXEE, was developed to promote greater emotional expression in image-based social media. An interdisciplinary team developed this system and has deployed it as a cultural probe around the world to explore ways that technology can ...
The communicative role of non-face emojis
Emojis have evolved from imitations of facial expressions meant to communicate affect into pictures of objects, food, and places that are not directly linked to affect. While emojis that resemble facial expressions are well-researched, emojis that ...
Affective guidance of intelligent agents: How emotion controls cognition
How do emotions and moods color cognition? In this article, we examine how such reactions influence both judgments and cognitive performance. We argue that many affective influences are due, not to affective reactions themselves, but to the information ...
Comments