research-article

Haptic Human-Robot Affective Interaction in a Handshaking Social Protocol

Authors:

Virginie Demulier,

Sylvain Caillou,

Yacine Tsalamlal,

Jean-Claude Martin,

Adriana TapusAuthors Info & Claims

HRI '15: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction

Pages 263 - 270

https://doi.org/10.1145/2696454.2696485

Published: 02 March 2015 Publication History

Abstract

This paper deals with the haptic affective social interaction during a greeting handshaking between a human and a humanoid robot. The goal of this work is to study how the haptic interaction conveys emotions, and more precisely, how it in'uences the perception of the dimensions of emotions expressed through the facial expressions of the robot. Moreover, we examine the bene'ts of the multimodality (i.e., visuo-haptic) over the monomodality (i.e., visual-only and haptic-only). The experimental results with Meka robot show that the multimodal condition presenting high values for grasping force and joint stiffness are evaluated with higher values for the arousal and dominance dimensions than during the visual condition. Furthermore, the results corresponding to the monomodal haptic condition showed that participants discriminate well the dominance and the arousal dimensions of the haptic behaviours presenting low and high values for grasping force and joint stiffness.

References

[1]

F. Almeida, A. Lopes, and P. Abreu. Force-impedance control: a new control strategy of robotic manipulators. 1999.

[2]

A. Aly and A. Tapus. Towards an online fuzzy modeling for human internal states detection. In Proceedings of the International Conference on Control, Automatics, Robotics, and Vision (ICARCV), Guangzhou, China, 2012.

[3]

B. App, D. N. McIntosh, C. L. Reed, and M. J. Hertenstein. Nonverbal channel use in communication of emotion: how may depend on why. 11(3):603--417, 2011.

[4]

M. Argyle and J. Dean. Eye-contact, distance and afïn Aliation. 28:289--304, 1965.

[5]

G. Avraham, I. Nisky, H. Fernandes, D. Acuna, K. Kording, G. Loeb, and A. Karniel. Toward perceiving robots as humans: Three handshake models face the turing-like handshake test. 5(3):196--207, 2012.

Digital Library

[6]

J. Bailenson, N. Yee, S. Brave, D. Merget, and D. Koslow. Virtual interpersonal touch: Expressing and recognizing emotions through haptic devices. 22(3):325--353, 2007.

Digital Library

[7]

M. Bergamasco and E. Ruffaldi. Haptic interfaces for embodiment in virtual environment. In Proc. of RO-MAN, 2011.

[8]

T. Bickmore, R. Fernando, L. Ring, and D. Schulman. Empathic touch by relational agents. 1(1):60--71, 2010.

Digital Library

[9]

C. Breazeal and L. Aryananda. Recognition of affective communicative intent in robot-directed speech. Autonomous Robots Journal, 12(1):83--104, January 2002.

Digital Library

[10]

N. Chen, C.-M. Chew, K.-P. Tee, and B. S. Han. Human-aided robotic grasping. In Proc of RO-MAN, pages 75--80, Sept 2012.

[11]

Y. Gaffary, V. Eyharabide, J. Martin, and M. Ammi. Clustering approach to characterize haptic expressions of emotions. 10(4), 2013.

Digital Library

[12]

Y. Gaffary, V. Eyharabide, J. Martin, and M. Ammi. The impact of combining kinesthetic and facial expression displays on emotion recognition by users. 2014.

[13]

P. Giraudoux. pgirmess: Data analysis in ecology. R package version, 1(4), 2012.

[14]

R. K. Groten. Haptic Human-Robot Collaboration: How to Learn from Human Dyads. PhD thesis, Technische Universitat Munchen, 2010.

[15]

M. Hertenstein, D. Keltner, B. App, B. Bulleit, and A. Jaskolka. Touch communicates distinct emotions. 6(3):528--533, 2006.

[16]

B. Major and R. Heslin. Perceptions of cross-sex and same-sex nonreciprocal touch: It is better to give than to receive. 6(3):148--162, 1982.

[17]

A. Mehrabian. Basic Dimensions for a General Psychological Theory: Implications for Personality, Social and Environmental Psychology. 1980.

[18]

H. Olausson, J. Cole, A. Vallbo, F. McGlone, M. Elam, H. Kramer, and M. Bushnell. Unmyelinated tactile afferents have opposite effects on insular and somatosensory cortical processing. 436(2):128--132, 2008.

[19]

K. R. Scherer. The component process model: a blueprint for a comprehensive computational model of emotion. In in Blueprint for Affective Computing: A Sourcebook, eds K. R. Scherer, T. Banziger, and E. B. Roesch, volume Oxford: Oxford University Press, pages 47--70. 2010.

[20]

S. Siegel and N. J. Castellan. Multiple comparisons between treatments. In in, Siegel, S., and Castellan, N. J. Nonparametric Statistics for the Behavioral Sciences (2nd), volume McGraw-Hill: New York. 1988.

[21]

D. Simon, K. D. Craig, F. Gosselin, P. Belin, and P. Rainville. Recognition and discrimination of prototypical dynamic expressions of pain and emotions. 2007.

[22]

M.-Y. Tsalamlal, N. Ouarti, J.-C. Martin, and M. Ammi. Perception of emotions from air jet based tactile stimulation. In Proc. of ACII 2013, pages 215--220, 2013.

Digital Library

[23]

W. Wang, E. Giannopoulos, M. Slater, and A. Peer. Handshake: Realistic human-robot interaction in haptic enhanced virtual reality. 20(4):371--392, 2011.

Digital Library

[24]

Y. Yamato, M. Jindai, and T. Watanabe. Development of a shake-motion leading model for human-robot handshaking. In SICE Annual Conference, 2008.

[25]

S. Yohanan and K. E. MacLean. The haptic creature project: Social human-robot interaction through affective touch. In Proc. of the AISB 2008 Symposium on the Reign of Catz and Dogz, volume 1, pages 7--11, 2008.

[26]

S. Yohanan and K. E. MacLean. The role of affective touch in human-robot interaction: Human intent and expectations in touching the haptic creature. 4(2):168--180, 2012.

Cited By

Watatani SNagano HTazaki YYokokohji Y(2025)Tele Haptic Handshake Using Distributed Pressure Presentation Device and Mutual Interaction Pressure ModelElectronics10.3390/electronics1403053714:3(537)Online publication date: 28-Jan-2025
https://doi.org/10.3390/electronics14030537
Seifi HBhatia AHornbæk K(2024)Charting User Experience in Physical Human–Robot InteractionACM Transactions on Human-Robot Interaction10.1145/365905813:2(1-29)Online publication date: 28-Jun-2024
https://dl.acm.org/doi/10.1145/3659058
Hou YCheon EJung MGrollman DBroadbent EJu WSoh HWilliams T(2024)Power in Human-Robot InteractionProceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610977.3634949(269-282)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610977.3634949
Show More Cited By

Index Terms

Haptic Human-Robot Affective Interaction in a Handshaking Social Protocol
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

The emotion expression robot through the affective interaction: KOBIE
RoboComm '07: Proceedings of the 1st international conference on Robot communication and coordination

In this paper, we propose the method for expressing emotion for the emotional robot through the affective stimuli such as 'hit,' 'stoke,' 'tickle,' 'poke,' 'embrace,' etc. We developed the experiment platform, KOBIE, for experiment the emotion expression ...
Behavioral and Emotional Spoken Cues Related to Mental States in Human-Robot Social Interaction
ICMI '15: Proceedings of the 2015 ACM on International Conference on Multimodal Interaction

Understanding human behavioral and emotional cues occurring in interaction has become a major research interest due to the emergence of numerous applications such as in social robotics. While there is agreement across different theories that some ...
Mood contagion of robot body language in human robot interaction

The aim of our work is to design bodily mood expressions of humanoid robots for interactive settings that can be recognized by users and have (positive) effects on people who interact with the robots. To this end, we develop a parameterized behavior ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

HRI '15: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction

March 2015

368 pages

ISBN:9781450328838

DOI:10.1145/2696454

General Chairs:
Julie A. Adams
Vanderbilt University, USA
,
William Smart
Oregon State University, USA
,
Program Chairs:
Bilge Mutlu
University of Wisconsin-Madison, USA
,
Leila Takayama
Google[x], USA

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGAI: ACM Special Interest Group on Artificial Intelligence
RA: IEEE Robotics and Automation Society
SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 March 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

HRI '15

Sponsor:

HRI '15: ACM/IEEE International Conference on Human-Robot Interaction

March 2 - 5, 2015

Oregon, Portland, USA

Acceptance Rates

HRI '15 Paper Acceptance Rate 43 of 169 submissions, 25%;

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

32
Total Citations
View Citations
659
Total Downloads

Downloads (Last 12 months)56
Downloads (Last 6 weeks)2

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Watatani SNagano HTazaki YYokokohji Y(2025)Tele Haptic Handshake Using Distributed Pressure Presentation Device and Mutual Interaction Pressure ModelElectronics10.3390/electronics1403053714:3(537)Online publication date: 28-Jan-2025
https://doi.org/10.3390/electronics14030537
Seifi HBhatia AHornbæk K(2024)Charting User Experience in Physical Human–Robot InteractionACM Transactions on Human-Robot Interaction10.1145/365905813:2(1-29)Online publication date: 28-Jun-2024
https://dl.acm.org/doi/10.1145/3659058
Hou YCheon EJung MGrollman DBroadbent EJu WSoh HWilliams T(2024)Power in Human-Robot InteractionProceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610977.3634949(269-282)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610977.3634949
Koike ALin KMutlu BWehner M(2024)Sprout: Fiber Patterns in Soft Actuators Create Expressions in Social Robots2024 10th IEEE RAS/EMBS International Conference for Biomedical Robotics and Biomechatronics (BioRob)10.1109/BioRob60516.2024.10719885(1313-1319)Online publication date: 1-Sep-2024
https://doi.org/10.1109/BioRob60516.2024.10719885
Yamasaki KShibata THénaff P(2024)Individual adaptation and social attributes in a handshake robot with CPG controlAdvanced Robotics10.1080/01691864.2024.238442238:17(1202-1217)Online publication date: 7-Aug-2024
https://doi.org/10.1080/01691864.2024.2384422
Abdulazeem NHu Y(2023)Human Factors Considerations for Quantifiable Human States in Physical Human–Robot Interaction: A Literature ReviewSensors10.3390/s2317738123:17(7381)Online publication date: 24-Aug-2023
https://doi.org/10.3390/s23177381
Faisal MLaamarti FEl Saddik A(2023)Digital Twin Haptic Robotic Arms: Towards Handshakes in the MetaverseElectronics10.3390/electronics1212260312:12(2603)Online publication date: 9-Jun-2023
https://doi.org/10.3390/electronics12122603
Abou Chahine RVasquez SFazli PSeifi H(2023)Clustering Social Touch Gestures for Human-Robot InteractionSocial Robotics10.1007/978-981-99-8715-3_6(53-67)Online publication date: 3-Dec-2023
https://doi.org/10.1007/978-981-99-8715-3_6
Palacín JRubies EClotet E(2022)The Assistant Personal Robot Project: From the APR-01 to the APR-02 Mobile Robot PrototypesDesigns10.3390/designs60400666:4(66)Online publication date: 25-Jul-2022
https://doi.org/10.3390/designs6040066
Li DYang ZHou FKang QLiu SSong YGao QDong E(2022)EEG-Based Emotion Recognition With Haptic Vibration by a Feature Fusion MethodIEEE Transactions on Instrumentation and Measurement10.1109/TIM.2022.314788271(1-11)Online publication date: 2022
https://doi.org/10.1109/TIM.2022.3147882
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten