Tomoko Yonezawa
ABSTRACT
In this study, we investigate a stuffed-toy robot capable of estimating a user's emotional state via physical contact; the research is oriented toward the development of bidirectional human-robot communications. Textile-type pressure-map sensors are embedded in the robot's head and back, to facilitate detection of the location and strength of various touches via time-sequence data. Based on the recognition of such touching patterns as stroking, patting, and hugging, we conducted a verification of the estimation of the user's emotions using extracted features, such as strength and duration. The results indicate that emotional arousal was reflected by the number and strength of the touches, while the emotional valence emerged through the factor related to the context of the interaction. Our study thereby represents a possibility of understanding the user via physical contact.
- uvilehto, J. T., Glerean, E., Dunbar, R. I., Hari, R., & Nummenmaa, L. (2015). Topography of social touching depends on emotional bonds between humans. Proceedings of the National Academy of Sciences, 112(45), 13811--13816.Google Scholar
Cross Ref
- geland, B., & Farber, E. A. (1984). Infant-mother attachment: Factors related to its development and changes over time. Child development, 753--771.Google Scholar
- ield, T. M. (1998). Massage therapy effects. American Psychologist, 53(12), 1270.Google ScholarCross Ref
- argas M, (1986) Louder Than Words: An Introduction to Nonverbal Communication. Iowa State Press.Google Scholar
- hayer, S (1982) Social touching. Tactual perception: A sourcebook, 263--304. Schiff W, Foulke E (eds) Cambridge University PressGoogle Scholar
- ayer, S. (1986) History and strategies of research on social touch. Journal of Nonverbal Behavior Volume 10, Issue 1, pp. 12--28.Google ScholarCross Ref
- chiff, W., & Foulke, E. (Eds.). (1982). Tactual perception: a sourcebook. Cambridge University Press.Google Scholar
- ark Paterson. (2007) The Senses of Touch: Haptics, Affects and Technologies. Berg Publishers.Google Scholar
- ertenstein, M. J., Keltner, D., App, B., Bulleit, B. A., & Jaskolka, A. R. (2006). Touch communicates distinct emotions. Emotion, 6(3), 528.Google ScholarCross Ref
- ubbard, G., Cook, A., Tester, S., & Downs, M. (2002). Beyond words: Older people with dementia using and interpreting nonverbal behaviour. Journal of Aging Studies, 16(2), 155--167.Google ScholarCross Ref
- ineste, Y. and Pellissier, J. (2007). Humanitude: Comprendre la vieillesse, prendre soin des Hommes vieux (think old age, caregiving for old men), Armand Colin. (in French)Google Scholar
- eil, N. (1992). Validation therapy. Geriatr. Nurs. 13(3), pp. 129--133.Google ScholarCross Ref
- onezawa, T. and Yamazoe, H. (2017). Haptic interaction design for physical contact between a wearable robot and the user. DHM 2017 in HCII 2017, pp.476--490.Google Scholar
- olt-Lunstad, J., Birmingham, W. A., & Light, K. C. (2008). Influence of a “warm touch” support enhancement intervention among married couples on ambulatory blood pressure, oxytocin, alpha amylase, and cortisol. Psychosomatic medicine, 70(9), 976--985.Google Scholar
- ada, K., & Shibata, T. (2007). Living with seal robots-its sociopsychological and physiological influences on the elderly at a care house. IEEE Transactions on Robotics, 23(5), 972--980. Google ScholarDigital Library
- rgall, B. D., & Billard, A. G. (2010). A survey of tactile human-robot interactions. Robotics and autonomous systems, 58(10), 1159--1176. Google ScholarDigital Library
- itsunaga, N., Miyashita, T., Ishiguro, H., Kogure, K., & Hagita, N. (2006). Robovie-IV: A Communication Robot Interacting with People Daily in an Office. in Proc. IROS'06. 5066--5072.Google Scholar
- aya, F., Yamato, J., & Shinozawa, K. (1999). Recognizing human touching behaviors using a haptic interface for a pet-robot. In Systems, Man, and Cybernetics (SMC) Conference Proceedings. Vol. 2, pp. 1030--1034.Google Scholar
- ilvera Tawil, D., Rye, D., & Velonaki, M. (2012). Interpretation of the modality of touch on an artificial arm covered with an EIT-based sensitive skin. The International Journal of Robotics Research, 31(13), 1627--1641. Google ScholarDigital Library
- ang, P. J., Bradley, M. M., and Cuthbert, B. N. (1999). International affective picture system (IAPS): Technical manual and affective ratings. Gainesville, FL: The Center for Research in Psychophysiology, University of Florida, 2.Google Scholar
- . Russell. (1980). A circumplex model of affect. Journal of Personality and Social Psychology. 39: 1161--1178.Google ScholarCross Ref
Index Terms
- Analyses of Textile Pressure-map Sensor Data of a Stuffed Toy for Understanding Human Emotional Physical Contact
Recommendations
Investigating Breathing Expression of a Stuffed-Toy Robot Based on Body-Emotion Model
HAI '16: Proceedings of the Fourth International Conference on Human Agent InteractionIn this research, we focus on physiological phenomena expression of robots, propose the Body-Emotion Model (BEM), which concerns the relationship between the internal states of robots and their involuntary physical reactions. We expect that the robot ...
Emotional Gripping Expression of a Robotic Hand as Physical Contact
HAI '19: Proceedings of the 7th International Conference on Human-Agent InteractionThis research aims at the emotional expression of a robotic hand through various gripping manners on the user's hand. The proposed system is implemented with a robotic hand's various haptic actuators to realize the change of the fingers' gripping force ...
Recognizing the emotional state of human and virtual instructors
AbstractStudents' learning from an instructional video could be affected by the instructor's emotional stance during a lesson. A first step in investigating this emotional design hypothesis is to determine whether students perceive the ...
Highlights- This research investigated whether participants are able to recognize the emotional tone of instructors in video clips.
Comments