skip to main content
10.1145/3371382.3378386acmconferencesArticle/Chapter ViewAbstractPublication PageshriConference Proceedingsconference-collections
abstract

Long-term Motion Generation for Interactive Humanoid Robots using GAN with Convolutional Network

Published: 01 April 2020 Publication History

Abstract

In this report, we propose a framework for generating long-term human-like motion based on a deep generative model. Thanks to the network structure, the proposed method allows us generating seem- less long-term motions while the model is trained by 4 seconds long short motion samples. The computer graphics of generated motions seem to be reproduced scenes where a pair of persons talking to each other.

References

[1]
Zhe Cao, Tomas Simon, Shih-En Wei, and Yaser Sheikh. 2017. Realtime multi-person 2d pose estimation using part affinity fields. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition .
[2]
Stanford Artificial Intelligence Laboratory et al. 2018. Robotic Operating System . https://www.ros.org
[3]
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial nets. (2014), 2672--2680.
[4]
Ishaan Gulrajani, Faruk Ahmed, Martin Arjovsky, Vincent Dumoulin, and Aaron Courville. 2017. Improved Training of Wasserstein GANs. (2017), 5767--5777.
[5]
Diederik P Kingma and Max Welling. 2013. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114 (2013).
[6]
Nathan Koenig and Andrew Howard. 2004. Design and Use Paradigms for Gazebo, An Open-Source Multi-Robot Simulator. In IEEE/RSJ International Conference on Intelligent Robots and Systems. Sendai, Japan, 2149--2154.
[7]
Yusuke Nishimura, Yutaka Nakamura, and Hiroshi Ishiguro. 2019. Human Behavior Modeling During Dialogue by Using Generative Adversarial Networks. Journal of the Robotics Society of Japan, Vol. 37, 7 (2019), 632--638. https://doi.org/10.7210/jrsj.37.632
[8]
Alec Radford, Luke Metz, and Soumith Chintala. 2016. Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks. In In The International Conference on Learning Representations .
[9]
Aaron van den Oord, Sander Dieleman, Heiga Zen, Karen Simonyan, Oriol Vinyals, Alex Graves, Nal Kalchbrenner, Andrew Senior, and Koray Kavukcuoglu. 2016. WaveNet: A Generative Model for Raw Audio. (2016). http://arxiv.org/abs/1609.03499
[10]
Shiqi Yu, Yusuke Nishimura, Satoshi Yagi, Naoki Ise, Yifei Wang, Yoshihiro Nakata, Yutaka Nakamura, and Hiroshi Ishiguro. 2020. A Software Framework to Create Behaviors for Androids and Its Implementation on the Mobile Android "ibuki". In In Proceedings of ACM/IEEE Conference (HRI'20) . Cambridge, United Kingdom (To appear).

Cited By

View all
  • (2024)Human Motion Generation: A SurveyIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2023.333093546:4(2430-2449)Online publication date: Apr-2024
  • (2024)Programmable Motion Generation for Open-Set Motion Control Tasks2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00139(1399-1408)Online publication date: 16-Jun-2024
  • (2022)Modeling and evaluating beat gestures for social robotsMultimedia Tools and Applications10.1007/s11042-021-11289-x81:3(3421-3438)Online publication date: 1-Jan-2022

Index Terms

  1. Long-term Motion Generation for Interactive Humanoid Robots using GAN with Convolutional Network

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      HRI '20: Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction
      March 2020
      702 pages
      ISBN:9781450370578
      DOI:10.1145/3371382
      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 01 April 2020

      Check for updates

      Author Tags

      1. generative adversarial networks
      2. human behavior during dialogue
      3. human motion modeling
      4. human robot interaction

      Qualifiers

      • Abstract

      Conference

      HRI '20
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 192 of 519 submissions, 37%

      Upcoming Conference

      HRI '25
      ACM/IEEE International Conference on Human-Robot Interaction
      March 4 - 6, 2025
      Melbourne , VIC , Australia

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)20
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 16 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Human Motion Generation: A SurveyIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2023.333093546:4(2430-2449)Online publication date: Apr-2024
      • (2024)Programmable Motion Generation for Open-Set Motion Control Tasks2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00139(1399-1408)Online publication date: 16-Jun-2024
      • (2022)Modeling and evaluating beat gestures for social robotsMultimedia Tools and Applications10.1007/s11042-021-11289-x81:3(3421-3438)Online publication date: 1-Jan-2022
      • (2021)Property-Aware Robot Object Manipulation: a Generative Approach2021 IEEE International Conference on Development and Learning (ICDL)10.1109/ICDL49984.2021.9515667(1-7)Online publication date: 23-Aug-2021

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media