introduction

Free access

Introduction to the Special Issue on Machine Learning for Multiple Modalities in Interactive Systems and Robots

Authors:

Heriberto Cuayáhuitl,

Hendrik ZenderAuthors Info & Claims

ACM Transactions on Interactive Intelligent Systems (TiiS), Volume 4, Issue 3

Article No.: 12e, Pages 1 - 6

https://doi.org/10.1145/2670539

Published: 14 October 2014 Publication History

PDF eReader

Abstract

This special issue highlights research articles that apply machine learning to robots and other systems that interact with users through more than one modality, such as speech, gestures, and vision. For example, a robot may coordinate its speech with its actions, taking into account (audio-)visual feedback during their execution. Machine learning provides interactive systems with opportunities to improve performance not only of individual components but also of the system as a whole. However, machine learning methods that encompass multiple modalities of an interactive system are still relatively hard to find. The articles in this special issue represent examples that contribute to filling this gap.

References

[1]

Luciana Benotti, Tessa Lau, and Martín Villalba. 2014. Interpreting Natural Language Instructions Using Language, Vision, and Behavior. ACM Transactions on Interactive Intelligent Systems 4, 3 (2014).

Digital Library

Google Scholar

[2]

Heriberto Cuayáhuitl, Ivana Kruijff-Korbayová, and Nina Dethlefs. 2014. Non-Strict Hierarchical Reinforcement Learning for Interactive Systems and Robots. ACM Transactions on Interactive Intelligent Systems 4, 3 (2014).

Digital Library

Google Scholar

[3]

Heriberto Cuayáhuitl, Martijn van Otterlo, Nina Dethlefs, and Lutz Frommberger. 2013. Machine Learning for Interactive Systems and Robots: A Brief Introduction. In IJCAI Workshop on Machine Learning for Interactive Systems: Bridging the Gap Between Perception, Action and Communication (MLIS’13). ACM International Conference Proceedings Series.

Digital Library

Google Scholar

[4]

Anthony Jameson and John Riedl. 2011. Introduction to the Transactions on Interactive Intelligent Systems. ACM Transactions on Interactive Intelligent Systems 1, 1 (Oct. 2011).

Digital Library

Google Scholar

[5]

Simon Keizer, Mary Ellen Foster, Zhuoran Wang, and Oliver Lemon. 2014. Machine Learning for Social Multi-Party Human-Robot Interaction. ACM Transactions on Interactive Intelligent Systems 4, 3 (2014).

Digital Library

Google Scholar

[6]

Hung Ngo, Matthew Luciw, Jawas Nagi, Alexander Förster, Jürgen Schmidhuber, and Ngo Anh Vien. 2014. Efficient Interactive Multiclass Learning from Binary Feedback. ACM Transactions on Interactive Intelligent Systems 4, 3 (2014).

Digital Library

Google Scholar

[7]

Kiri Wagstaff. 2012. Machine Learning that Matters. In International Conference on Machine Learning (ICML).

Google Scholar

Cited By

View all

Bricout JGreer JFields NXu LTamplain PDoelling KSharma B(2021)The “humane in the loop”: Inclusive research design and policy approaches to foster capacity building assistive technologies in the COVID-19 eraAssistive Technology10.1080/10400435.2021.193028234:6(644-652)Online publication date: 24-Jun-2021
https://doi.org/10.1080/10400435.2021.1930282
Cuayáhuitl HKomatani KSkantze G(2015)Introduction for Speech and language for interactive robotsComputer Speech & Language10.1016/j.csl.2015.05.00634:1(83-86)Online publication date: Nov-2015
https://doi.org/10.1016/j.csl.2015.05.006

Index Terms

Introduction to the Special Issue on Machine Learning for Multiple Modalities in Interactive Systems and Robots
1. Computer systems organization
  1. Embedded and cyber-physical systems
    1. Robotics
2. Computing methodologies
  1. Artificial intelligence
    1. Control methods
      1. Robotic planning
    2. Planning and scheduling
      1. Robotic planning
  2. Machine learning

Recommendations

Nonstrict Hierarchical Reinforcement Learning for Interactive Systems and Robots
Special Issue on Multiple Modalities in Interactive Systems and Robots

Conversational systems and robots that use reinforcement learning for policy optimization in large domains often face the problem of limited scalability. This problem has been addressed either by using function approximation techniques that estimate the ...
Introduction for Speech and language for interactive robots

This special issue includes research articles which apply spoken language processing to robots that interact with human users through speech, possibly combined with other modalities. Robots that can listen to human speech, understand it, interact ...
Inverse reinforcement learning for interactive systems
MLIS '13: Proceedings of the 2nd Workshop on Machine Learning for Interactive Systems: Bridging the Gap Between Perception, Action and Communication

Human machine interaction is a field where machine learning is present at almost any level, from human activity recognition to natural language generation. The interaction manager is probably one of the latest components of an interactive system that ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Interactive Intelligent Systems

ACM Transactions on Interactive Intelligent Systems Volume 4, Issue 3

Special Issue on Multiple Modalities in Interactive Systems and Robots

October 2014

115 pages

ISSN:2160-6455

EISSN:2160-6463

DOI:10.1145/2660857

Editors:
Anthony Jameson
German Research Center for Artifi cial Intelligence (DFKI), Germany
,
Krzysztof Gajos
Harvard University, U.S.A.

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 October 2014

Accepted: 01 September 2014

Received: 01 July 2014

Published in TIIS Volume 4, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Introduction
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
307
Total Downloads

Downloads (Last 12 months)51
Downloads (Last 6 weeks)10

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Bricout JGreer JFields NXu LTamplain PDoelling KSharma B(2021)The “humane in the loop”: Inclusive research design and policy approaches to foster capacity building assistive technologies in the COVID-19 eraAssistive Technology10.1080/10400435.2021.193028234:6(644-652)Online publication date: 24-Jun-2021
https://doi.org/10.1080/10400435.2021.1930282
Cuayáhuitl HKomatani KSkantze G(2015)Introduction for Speech and language for interactive robotsComputer Speech & Language10.1016/j.csl.2015.05.00634:1(83-86)Online publication date: Nov-2015
https://doi.org/10.1016/j.csl.2015.05.006

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

References

Cited By

Index Terms

Recommendations

Nonstrict Hierarchical Reinforcement Learning for Interactive Systems and Robots

Introduction for Speech and language for interactive robots

Inverse reinforcement learning for interactive systems

Comments

Information

Published In

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

Login options

Full Access

Share

Share this Publication link

Share on social media

Affiliations