Article

Design and evaluation of expressive gesture synthesis for embodied conversational agents

Authors:

B. Hartmann,

M. Mancini,

S. Buisine,

C. PelachaudAuthors Info & Claims

AAMAS '05: Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems

Pages 1095 - 1096

https://doi.org/10.1145/1082473.1082640

Published: 25 July 2005 Publication History

Get Access

Abstract

To increase the believability and life-likeness of Embodied Conversational Agents (ECAs), we introduce a behavior synthesis technique for the generation of expressive gesturing. A small set of dimensions of expressivity is used to characterize individual variability of movement. We empirically evaluate our implementation in two separate user studies. The results suggest that our approach works well for a subset of expressive behavior. However, animation fidelity is not high enough to realize subtle changes. Interaction effects between different parameters need to be studied further.

References

[1]

B. DeCarolis, C. Pelachaud, I. Poggi, and M. Steedman. APML, a mark-up language for believable behavior generation. In H. Prendinger and M. Ishizuka, Eds., Life-Like Characters, Cognitive Technologies, Springer, 2004.

Google Scholar

[2]

P. E. Gallaher. Individual differences in nonverbal behavior: Dimensions of style. Journal of Personality and Social Psychology, 63(1):133--145, 1992.

Crossref

Google Scholar

[3]

B. Hartmann, M. Mancini, and C. Pelachaud. Implementation of expressive eca gesture synthesis. Submitted to Gesture Workshop, 2005.

Google Scholar

[4]

A. B. Loyall and J. Bates. Personality-rich believable agents that use language. In W. L. Johnson and B. Hayes-Roth, Eds., Proceedings of the First International Conference on Autonomous Agents (Agents '97), 106--113, Marina del Rey, CA, USA, 1997. ACM Press.

Digital Library

Google Scholar

[5]

C. Martell, P. Howard, C. Osborn, L. Britt, and K. Myers. Form2 kinematic gesture corpus. video recording and annotation, 2003.

Google Scholar

[6]

C. Pelachaud, V. Carofiglio, B. D. Carolis, and F. de Rosis. Embodied contextual agent in information delivering application. In First International Joint Conference on Autonomous Agents & Multi-Agent Systems (AAMAS), Bologna, Italy, July 2002.

Digital Library

Google Scholar

[7]

H. G. Wallbott. Bodily expression of emotion. European Journal of Social Psychology, 28:879--896, 1998.

Crossref

Google Scholar

Cited By

View all

Rashik MJasim MKucher KSarvghad AMahyar N(2024)Beyond Text and Speech in Conversational Agents: Mapping the Design Space of AvatarsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661563(1875-1894)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661563
de Melo CGratch JMarsella SPelachaud C(2023)Social Functions of Machine Emotional ExpressionsProceedings of the IEEE10.1109/JPROC.2023.3261137111:10(1382-1397)Online publication date: Oct-2023
https://doi.org/10.1109/JPROC.2023.3261137
Paschalidou S(2022)Effort inference and prediction by acoustic and movement descriptors in interactions with imaginary objects during Dhrupad vocal improvisationWearable Technologies10.1017/wtc.2022.83Online publication date: 5-Jul-2022
https://doi.org/10.1017/wtc.2022.8
Show More Cited By

Index Terms

Design and evaluation of expressive gesture synthesis for embodied conversational agents
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Recommendations

Embodied conversational agents: computing and rendering realistic gaze patterns
PCM'06: Proceedings of the 7th Pacific Rim conference on Advances in Multimedia Information Processing

We describe here our efforts for modeling multimodal signals exchanged by interlocutors when interacting face-to-face. This data is then used to control embodied conversational agents able to engage into a realistic face-to-face interaction with human ...
Personality Analysis of Embodied Conversational Agents
IVA '18: Proceedings of the 18th International Conference on Intelligent Virtual Agents

People tend to personify machines. Giving machines the ability to actually produce social information can help improve human-machine interactions. Embodied Conversational Agents (ECAs) are virtual software agents that can process and produce speech, ...
Fully Embodied Conversational Avatars: Making Communicative Behaviors Autonomous

Although avatars may resemble communicative interface agents, they have for the most part not profited from recent research into autonomous embodied conversational systems. In particular, even though avatars function within conversational environments (...

Comments

Information & Contributors

Information

Published In

AAMAS '05: Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems

July 2005

1407 pages

ISBN:1595930930

DOI:10.1145/1082473

Program Chairs:
Michal Pechoucek
Czech Republic
,
Donald Steiner
USA
,
Simon Thompson
UK

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 July 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tag

embodied conversational agents

Qualifiers

Article

Conference

AAMAS05

Sponsor:

SIGAI

AAMAS05: AAMAS '05 - Fourth International Joint Conference on Autonomous Agents and Multiagent Systems 2005

July 25 - 29, 2005

The Netherlands

Acceptance Rates

Overall Acceptance Rate 1,155 of 5,036 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

59
Total Citations
View Citations
599
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Rashik MJasim MKucher KSarvghad AMahyar N(2024)Beyond Text and Speech in Conversational Agents: Mapping the Design Space of AvatarsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661563(1875-1894)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661563
de Melo CGratch JMarsella SPelachaud C(2023)Social Functions of Machine Emotional ExpressionsProceedings of the IEEE10.1109/JPROC.2023.3261137111:10(1382-1397)Online publication date: Oct-2023
https://doi.org/10.1109/JPROC.2023.3261137
Paschalidou S(2022)Effort inference and prediction by acoustic and movement descriptors in interactions with imaginary objects during Dhrupad vocal improvisationWearable Technologies10.1017/wtc.2022.83Online publication date: 5-Jul-2022
https://doi.org/10.1017/wtc.2022.8
Wu BLiu CIshi CIshiguro H(2021)Modeling the Conditional Distribution of Co-Speech Upper Body Gesture Jointly Using Conditional-GAN and Unrolled-GANElectronics10.3390/electronics1003022810:3(228)Online publication date: 20-Jan-2021
https://doi.org/10.3390/electronics10030228
Wang IRuiz J(2021)Examining the Use of Nonverbal Communication in Virtual AgentsInternational Journal of Human–Computer Interaction10.1080/10447318.2021.189885137:17(1648-1673)Online publication date: 28-Mar-2021
https://doi.org/10.1080/10447318.2021.1898851
Moncrief R(2021)Generalizing a model for animating adverbs of manner in American Sign LanguageMachine Translation10.1007/s10590-021-09279-9Online publication date: 24-Aug-2021
https://doi.org/10.1007/s10590-021-09279-9
Castillo GNeff MElkind EVeloso MAgmon NTaylor M(2019)What do we express without knowing?Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems10.5555/3306127.3331759(702-710)Online publication date: 8-May-2019
https://dl.acm.org/doi/10.5555/3306127.3331759
Pelachaud C(2019)Les émotions dans l’interaction homme-machineInformatique et sciences cognitives10.4000/books.editionsmsh.13902(47-71)Online publication date: 29-Nov-2019
https://doi.org/10.4000/books.editionsmsh.13902
Rach NWeber KAicher ALingenfelser FAndre EMinker W(2019)Emotion Recognition Based Preference Modelling in Argumentative Dialogue Systems2019 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops)10.1109/PERCOMW.2019.8730650(838-843)Online publication date: Mar-2019
https://doi.org/10.1109/PERCOMW.2019.8730650
Hendrix ROwan PGarbini JDevasia S(2019)Context-Specific Separable Gesture Selection For Control of a Robotic Manufacturing AssistantIFAC-PapersOnLine10.1016/j.ifacol.2019.01.03451:34(89-96)Online publication date: 2019
https://doi.org/10.1016/j.ifacol.2019.01.034
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Embodied conversational agents: computing and rendering realistic gaze patterns

Personality Analysis of Embodied Conversational Agents

Fully Embodied Conversational Avatars: Making Communicative Behaviors Autonomous

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tag

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations