poster

Perception of visual scene and intonation patterns of robot utterances

Authors:

Ivana Kruijff-Korbayová,

Raveesh Meena,

Pirita PyykkönenAuthors Info & Claims

HRI '11: Proceedings of the 6th international conference on Human-robot interaction

Pages 173 - 174

https://doi.org/10.1145/1957656.1957717

Published: 06 March 2011 Publication History

Get Access

Abstract

Assigning intonation to dialogue system output in a way that reflects relationships between entities in the discourse context can enhance the acceptability of system utterances. Previous research concentrated on the role of linguistic context; dialogue situatedness and the role of visual context in determining accent placement has not been studied. We present an experimental study on the influence of visual context on the perception of nuclear accent placement in synthesized clarification requests. We found that utterances are perceived as appropriate more often when the visual scene licenses the nuclear accent placement than when it does not.

References

[1]

G. Altmann and Y. Kamide. Discourse-mediation of the mapping between language and the visual world: Eye movements and mental representation. Cognition, 111:55--71, 2009.

Crossref

Google Scholar

[2]

M. W. Crocker, P. Knoeferle, and M. R. Mayberry. Situated sentence comprehension: The coordinated interplay account and a neurobehavioral model. Brain and Language, 112(3):189--201, 2010. MC.

Crossref

Google Scholar

[3]

I. Kruijff-Korbayová, S. Ericsson, K. J. Rodríguez, and E. Karagjosova. Producing contextually appropriate intonation is an information-state based dialogue system. In Proceedings of the 10th Conference of the European Chapter of the Association for Computational Linguistics (EACL), pages 227--234. ACL, 2003.

Digital Library

Google Scholar

[4]

J. Pierrehumbert and J. Hirschberg. The meaning of intonation in the interpretation of discourse. In P. Cohen, J. Morgan, and M. Pollack, editors, Intentions in Communication. MIT Press, Cambridge MA, 1990.

Google Scholar

[5]

M. Schröder and J. Trouvain. The german text-to-speech synthesis system MARY: A tool for research, development and teaching. International Journal of Speech Technology, 6:365--377, 2003.

Crossref

Google Scholar

[6]

M. Steedman. Information structure and the syntax-phonology interface. Linguistic Inquiry, 31:649--689, 2000.

Crossref

Google Scholar

[7]

M. Tanenhaus, M. Spivey-Knowlton, K. Eberhard, and J. Sedivy. Integration of visual and linguistic information in spoken language comprehension. Science, 268:1632--1634, 1995.

Crossref

Google Scholar

[8]

M. White, R. Baker, and R. A. J. Clark. Synthetizing contextually appropriate intonation in limited domains. In Proceedings of the 5th ISCA Speech Synthesis Workshop, 2004.

Google Scholar

Cited By

View all

Stavropoulou PSpiliotopoulos DKouroupetroglou G(2020)Voice User Interfaces for Service Robots: Design Principles and MethodologyUniversal Access in Human-Computer Interaction. Design Approaches and Supporting Technologies10.1007/978-3-030-49282-3_35(489-505)Online publication date: 19-Jul-2020
https://dl.acm.org/doi/10.1007/978-3-030-49282-3_35

Index Terms

Perception of visual scene and intonation patterns of robot utterances
1. Computing methodologies
  1. Artificial intelligence
    1. Natural language processing
      1. Discourse, dialogue and pragmatics
      2. Natural language generation
2. Human-centered computing

Recommendations

On the perception of "segmental intonation": F0 context effects on sibilant identification in German

In normal modally voiced utterances, voiceless fricatives like [s], [ź], [f], and [x] vary such that their aperiodic pitch impressions mirror the pitch level of the adjacent F0 contour. For instance, if the F0 contour creates a high or low pitch context,...
The Intonation of Backchannel Tokens in Italian Collaborative Dialogues
Human Language Technology Challenges for Computer Science and Linguistics
Abstract
This paper offers a contribution to the intonational modelling of backchannel lexical and non-lexical tokens in Italian, which can be used for improving naturalness in voice-based dialogue systems. Results of pragmatic and intonation analysis of ...
Intonation in Robot Speech: Does it Work the Same as with People?
HRI '20: Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction

Human-robot interaction (HRI) research aims to design natural interactions between humans and robots. Intonation, a social signaling function in human speech investigated thoroughly in linguistics, has not yet been studied in HRI. This study ...

Comments

Information & Contributors

Information

Published In

HRI '11: Proceedings of the 6th international conference on Human-robot interaction

March 2011

526 pages

ISBN:9781450305617

DOI:10.1145/1957656

General Chairs:
Aude Billard
EPFL, Switzerland
,
Peter Kahn
University of Washington, USA
,
Program Chairs:
Julie A. Adams
Vanderbilt University, USA
,
Greg Trafton
US Naval Research Laboratories, USA

In-Cooperation

RA: IEEE Robotics and Automation Society
Human Factors & Ergonomics Soc: Human Factors & Ergonomics Soc
The Association for the Advancement of Artificial Intelligence (AAAI)
IEEE Systems, Man and Cybernetics Society

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 March 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster

Conference

HRI'11

Sponsor:

HRI'11: International Conference on Human-Robot Interaction

March 6 - 9, 2011

Lausanne, Switzerland

Acceptance Rates

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
100
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Stavropoulou PSpiliotopoulos DKouroupetroglou G(2020)Voice User Interfaces for Service Robots: Design Principles and MethodologyUniversal Access in Human-Computer Interaction. Design Approaches and Supporting Technologies10.1007/978-3-030-49282-3_35(489-505)Online publication date: 19-Jul-2020
https://dl.acm.org/doi/10.1007/978-3-030-49282-3_35

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

On the perception of "segmental intonation": F0 context effects on sibilant identification in German

The Intonation of Backchannel Tokens in Italian Collaborative Dialogues

Intonation in Robot Speech: Does it Work the Same as with People?

Comments

Information

Published In

Sponsors

In-Cooperation

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations