skip to main content
10.1145/2993148.2998532acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
demonstration

Niki and Julie: a robot and virtual human for studying multimodal social interaction

Published: 31 October 2016 Publication History

Abstract

We demonstrate two agents, a robot and a virtual human, which can be used for studying factors that impact social influence. The agents engage in dialogue scenarios that build familiarity, share information, and attempt to influence a human participant. The scenarios are variants of the classical “survival task,” where members of a team rank the importance of a number of items (e.g., items that might help one survive a crash in the desert). These are ranked individually and then re-ranked following a team discussion, and the difference in ranking provides an objective measure of social influence. Survival tasks have been used in psychology, virtual human research, and human-robot interaction. Our agents are operated in a “Wizard-of-Oz” fashion, where a hidden human operator chooses the agents’ dialogue actions while interacting with an experiment participant.

References

[1]
S. O. Adalgeirsson and C. Breazeal. Mebot: A robotic platform for socially embodied presence. In Proc. HRI, pages 15–22. IEEE Press, 2010.
[2]
P. F. Dominey, T. van der Zant, S. Lallee, A.-L. Jouen, X. Hinaut, A. Weitzenfeld, H. van Hoof, and J. Dávila-Chacón. Cooperative human robot interaction with the Nao humanoid: Technical description paper for the “radical dudes”. In RoboCup@Home Technical Description Papers: Germany - Singapore, 2010.
[3]
A. Edmondson. Psychological safety and learning behavior in work teams. Administrative Science Quarterly, 44(2):350–383, 1999.
[4]
J. Gratch, N. Wang, J. Gerten, E. Fast, and R. Duffy. Creating rapport with virtual agents. In Proc. IVA 2007, pages 125–138. Springer, September 2007.
[5]
A. Hartholt, D. Traum, S. C. Marsella, A. Shapiro, G. Stratou, A. Leuski, L.-P. Morency, and J. Gratch. All together now: Introducing the Virtual Human Toolkit. In Proc. IVA 2013, pages 368–381. Springer, August 2013.
[6]
P. Khooshabeh, C. McCall, S. Gandhe, J. Gratch, and J. Blascovich. Does it matter if a computer jokes? In CHI’11 Extended Abstracts on Human Factors in Computing Systems, pages 77–86. ACM, 2011.
[7]
P. J. Werkhoven, J. M. Schraagen, and P. A. J. Punte. Seeing is believing: communication performance under isotropic teleconferencing conditions. Displays, 22(4):137–149, 2001.

Cited By

View all
  • (2023)Worldwide Overview and Country Differences in Metaverse Research: A Bibliometric AnalysisSustainability10.3390/su1504354115:4(3541)Online publication date: 15-Feb-2023
  • (2022)Platforms and Tools for SIA Research and DevelopmentThe Handbook on Socially Interactive Agents10.1145/3563659.3563668(261-304)Online publication date: 27-Oct-2022
  • (2022)The Handbook on Socially Interactive AgentsundefinedOnline publication date: 27-Oct-2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ICMI '16: Proceedings of the 18th ACM International Conference on Multimodal Interaction
October 2016
605 pages
ISBN:9781450345569
DOI:10.1145/2993148
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 31 October 2016

Check for updates

Author Tags

  1. Affective Computing and interaction
  2. Human-robot/agent multimodal interaction
  3. Multimodal interactive applications

Qualifiers

  • Demonstration

Conference

ICMI '16
Sponsor:

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)7
  • Downloads (Last 6 weeks)1
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Worldwide Overview and Country Differences in Metaverse Research: A Bibliometric AnalysisSustainability10.3390/su1504354115:4(3541)Online publication date: 15-Feb-2023
  • (2022)Platforms and Tools for SIA Research and DevelopmentThe Handbook on Socially Interactive Agents10.1145/3563659.3563668(261-304)Online publication date: 27-Oct-2022
  • (2022)The Handbook on Socially Interactive AgentsundefinedOnline publication date: 27-Oct-2022
  • (2019)Can a Signing Virtual Human Engage a Baby's Attention?Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents10.1145/3308532.3329463(162-169)Online publication date: 1-Jul-2019
  • (2018)Modeling Emotional Valence Integration From Voice and TouchFrontiers in Psychology10.3389/fpsyg.2018.019669Online publication date: 12-Oct-2018

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media