skip to main content
10.1145/3469213.3470259acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicaiisConference Proceedingsconference-collections
research-article

Deep Neuro-Evolution: Evolving Neural Network for Character Locomotion Controller

Published: 18 August 2021 Publication History

Abstract

Designing the controller to actuate the virtual character is challenging given the high dimensions of both character states and controls. Flexible user control is normally required in interactive applications (virtual and augmented reality), which further adds to constructing a motion controller for the virtual characters. Although deep neural networks showed their potential in tackling this problem, existing works based on neural networks normally require the manual design of the network architecture, which requires professional experience and a trial-and-error process. This paper proposes an automatic solution to optimize both the topology and connection weights of the deep neural network, used as a character locomotion controller. This method mimics the evolution process in nature, evaluates individual fitness, and generates the individuals for the next generation while maintaining the current generation's fitness level. We show that this method is convenient to construct the locomotion controller for virtual characters on a general basis.

References

[1]
Holden, Daniel, Jun Saito, and Taku Komura. "A deep learning framework for character motion synthesis and editing." ACM Transactions on Graphics (TOG) 35.4 (2016): 1-11.
[2]
Holden, Daniel, Taku Komura, and Jun Saito. "Phase-functioned neural networks for character control." ACM Transactions on Graphics (TOG) 36.4 (2017): 1-13.
[3]
Peng, Xue Bin, Glen Berseth, and Michiel Van de Panne. "Terrain-adaptive locomotion skills using deep reinforcement learning." ACM Transactions on Graphics (TOG) 35.4 (2016): 1-12.
[4]
Peng, Xue Bin, "Deeploco: Dynamic locomotion skills using hierarchical deep reinforcement learning." ACM Transactions on Graphics (TOG) 36.4 (2017): 1-13.
[5]
Liu, Libin, and Jessica Hodgins. "Learning to schedule control fragments for physics-based characters using deep q-learning." ACM Transactions on Graphics (TOG) 36.3 (2017): 1-14.
[6]
Tsai, Yao-Yang, "Real-time physics-based 3d biped character animation using an inverted pendulum model." IEEE transactions on visualization and computer graphics 16.2 (2009): 325-337.
[7]
Lillicrap, Timothy P., "Continuous control with deep reinforcement learning." arXiv preprint arXiv: 1509.02971 (2015).
[8]
Guo, Shihui, "Simulating collective transport of virtual ants." Computer Animation and Virtual Worlds 28.3-4 (2017): e1779.
[9]
Jia, Yangqing, "Caffe: Convolutional architecture for fast feature embedding." Proceedings of the 22nd ACM international conference on Multimedia. 2014.

Cited By

View all
  • (2023)Emerging Modularity During the Evolution of Neural NetworksJournal of Artificial Intelligence and Soft Computing Research10.2478/jaiscr-2023-001013:2(107-126)Online publication date: 11-Mar-2023
  • (2022)Using Hill Climb Modular Assembler Encoding and Differential Evolution to evolve modular neuro-controllers of an autonomous underwater vehicle acting as a Magnetic Anomaly DetectorApplied Soft Computing10.1016/j.asoc.2022.109347127:COnline publication date: 1-Sep-2022

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
ICAIIS 2021: 2021 2nd International Conference on Artificial Intelligence and Information Systems
May 2021
2053 pages
ISBN:9781450390200
DOI:10.1145/3469213
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 August 2021

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

ICAIIS 2021

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)2
  • Downloads (Last 6 weeks)0
Reflects downloads up to 07 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Emerging Modularity During the Evolution of Neural NetworksJournal of Artificial Intelligence and Soft Computing Research10.2478/jaiscr-2023-001013:2(107-126)Online publication date: 11-Mar-2023
  • (2022)Using Hill Climb Modular Assembler Encoding and Differential Evolution to evolve modular neuro-controllers of an autonomous underwater vehicle acting as a Magnetic Anomaly DetectorApplied Soft Computing10.1016/j.asoc.2022.109347127:COnline publication date: 1-Sep-2022

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media