Emotion-prints: interaction-driven emotion visualization on multi-touch interfaces

Daniel Cernea; Christopher Weber; Achim Ebert; Andreas Kerren

doi:10.1117/12.2076473

8 February 2015 Emotion-prints: interaction-driven emotion visualization on multi-touch interfaces

Daniel Cernea, Christopher Weber, Achim Ebert, Andreas Kerren

Proceedings Volume 9397, Visualization and Data Analysis 2015; 93970A (2015) https://doi.org/10.1117/12.2076473
Event: SPIE/IS&T Electronic Imaging, 2015, San Francisco, California, United States

Abstract

Emotions are one of the unique aspects of human nature, and sadly at the same time one of the elements that our technological world is failing to capture and consider due to their subtlety and inherent complexity. But with the current dawn of new technologies that enable the interpretation of emotional states based on techniques involving facial expressions, speech and intonation, electrodermal response (EDS) and brain-computer interfaces (BCIs), we are finally able to access real-time user emotions in various system interfaces. In this paper we introduce emotion-prints, an approach for visualizing user emotional valence and arousal in the context of multi-touch systems. Our goal is to offer a standardized technique for representing user affective states in the moment when and at the location where the interaction occurs in order to increase affective self-awareness, support awareness in collaborative and competitive scenarios, and offer a framework for aiding the evaluation of touch applications through emotion visualization. We show that emotion-prints are not only independent of the shape of the graphical objects on the touch display, but also that they can be applied regardless of the acquisition technique used for detecting and interpreting user emotions. Moreover, our representation can encode any affective information that can be decomposed or reduced to Russell's two-dimensional space of valence and arousal. Our approach is enforced by a BCI-based user study and a follow-up discussion of advantages and limitations.

Citation Download Citation

Daniel Cernea, Christopher Weber, Achim Ebert, and Andreas Kerren "Emotion-prints: interaction-driven emotion visualization on multi-touch interfaces", Proc. SPIE 9397, Visualization and Data Analysis 2015, 93970A (8 February 2015); https://doi.org/10.1117/12.2076473

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available