skip to main content
10.1145/2576768.2598373acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
research-article

Evolving joint-level control with digital muscles

Published: 12 July 2014 Publication History

Abstract

The neuromuscular systems of animals are governed by extremely complex networks of control signals, sensory feedback loops, and mechanical interactions. Morphology and control are inherently intertwined. In the case of animal joints, groups of muscles work together to provide power and stability to move limbs in a coordinated manner. In contrast, many robot controllers handle both high-level planning and low-level control of individual joints. In this paper, we propose a joint-level control method, called digital muscles, that operates in a manner analogous to biological muscles, yet is abstract enough to apply to conventional robotic joints. An individual joint is controlled by multiple muscle nodes, each of which responds to a control signal according to a node-specific activation function. Evolving the physical orientation of muscle nodes and their respective activation functions enables relatively complex and coordinated gaits to be realized with simple high-level control. Even using a sinusoid as the high-level control signal, we demonstrate the evolution of effective gaits for a simulated quadruped. The proposed model realizes a control strategy for governing the behavior of individual joints, and can be coupled with a high-level controller that focuses on decision making and planning.

References

[1]
Joshua E. Auerbach and Josh C. Bongard. Dynamic resolution in the co-evolution of morphology and control. In Proceedings of the Twelfth International Conference on Artificial Life, pages 451--458, Odense, Denmark, 2010.
[2]
Josh Bongard. Morphological change in machines accelerates the evolution of robust behavior. Proceedings of the National Academy of Sciences, 108(4):1234--1239, 2011.
[3]
Rodney A. Brooks. A robot that walks; emergent behaviors from a carefully evolved network. Neural Computation, 1(2):253--262, 1989.
[4]
Anthony J. Clark, Jared M. Moore, Jianxun Wang, Xiaobo Tan, and Philip K. McKinley. Evolutionary design and experimental validation of a flexible caudal fin for robotic fish. In Proceedings of the 13th International Conference on the Simulation and Synthesis of Living Systems, pages 325--332, East Lansing, Michigan, USA, 2012.
[5]
Dave Cliff, Phil Husbands, and Inman Harvey. Explorations in Evolutionary Robotics. Adaptive Behavior, 2(1):73--110, 1993.
[6]
MA Daley, G Felix, and AA Biewener. Running stability is enhanced by a proximo-distal gradient in joint neuromechanical control. The Journal of Experimental Biology, 210(3):383--394, 2007.
[7]
Monica A Daley, Alexandra Voloshina, and Andrew A Biewener. The role of intrinsic muscle mechanics in the neuromuscular control of stable running in the guinea fowl. Journal of Physiology, 587(Pt 11):2693--2707, Jun 2009.
[8]
Michael H. Dickinson, Claire T. Farley, Robert J. Full, M. A. R. Koehl, Rodger Kram, and Steven Lehman. How animals move: An integrative view. Science, 288(5463):100--106, 2000.
[9]
S. Doncieux and J.-A. Meyer. Evolving modular neural networks to solve challenging control problems. In Proceedings of the Fourth International ICSC Symposium on Engineering of Intelligent Systems (EIS 2004), pages 1--7, Madeira, Portugal, 2004.
[10]
Dario Floreano, Phil Husbands, and Stefano Nolfi. Evolutionary Robotics. In Handbook of Robotics. Springer Verlag, Berlin, 2008.
[11]
Thomas Geijtenbeek, Michiel van de Panne, and A. Frank van der Stappen. Flexible muscle-based locomotion for bipedal creatures. ACM Transactions on Graphics, 32(6):206:1--206:11, November 2013.
[12]
K G Gerritsen, A J van den Bogert, M Hulliger, and R F Zernicke. Intrinsic muscle properties facilitate locomotor control - a computer simulation study. Motor Control, 2(3):206--220, Jul 1998.
[13]
A.J. Ijspeert, A. Crespi, and J.M. Cabelguen. Simulation and robotics studies of salamander locomotion. Neuroinformatics, 3(3):171--195, 2005.
[14]
K. Inoue, T. Sumi, and Shugen Ma. CPG-based control of a simulated snake-like robot adaptable to changing ground friction. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 1957--1962, San Diego, California, USA, 2007.
[15]
Dan Lessin, Don Fussell, and Risto Miikkulainen. Open-ended behavioral complexity for evolved virtual creatures. In Proceedings of the 2013 ACM Genetic and Evolutionary Computing Conference, pages 335--342, Amsterdam, Netherlands, 2013. ACM.
[16]
Hod Lipson. Evolutionary robotics and open-ended design automation. In Biomimetics, pages 129--155. CRC Press, 2005.
[17]
Daniel Marbach and Auke Jan Ijspeert. Co-evolution of configuration and control for homogenous modular robots. In Proceedings of the Eighth Conference on Intelligent Autonomous Systems (IAS8), pages 712--719, Amsterdam, Netherlands, 2004.
[18]
K. Matsuoka. Mechanisms of frequency and pattern control in the neural rhythm generators. Biological Cybernetics, 56:345--353, 1987.
[19]
C.P. McGowan, R.R. Neptune, and W. Herzog. A phenomenological muscle model to assess history dependent effects in human movement. Journal of Biomechanics, 46(1):151--157, 2013.
[20]
Craig P. McGowan, Richard R. Neptune, and Walter Herzog. A phenomenological model and validation of shortening-induced force depression during muscle contractions. Journal of Biomechanics, 43(3):449--454, 02 2010.
[21]
Jared M. Moore, Anthony J. Clark, and Philip K. McKinley. Evolution of station keeping as a response to flows in an aquatic robot. In Proceedings of the 2013 ACM Genetic and Evolutionary Computing Conference, pages 239--246, Amsterdam, Netherlands, 2013. ACM.
[22]
Jared M. Moore, Anne K. Gutmann, Craig P. McGowan, and Philip K. McKinley. Exploring the role of the tail in bipedal hopping through computational evolution. In Proceedings of the 12th European Conference on Artificial Life, pages 11--18, Taormina, Italy, 2013.
[23]
Richard R. Neptune and Craig P. McGowan. Muscle contributions to whole-body sagittal plane angular momentum during walking. Journal of Biomechanics, 44(1):6--12, 2011.
[24]
Stefano Nolfi and Dario Floreano. Evolutionary Robotics: The Biology, Intelligence and Technology of Self-Organizing Machines. The MIT Press, 2000.
[25]
C. Paul and J. C. Bongard. The road less travelled: Morphology in the optimization of biped robot locomotion. In Proceedings of the 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 226--232, Maui, Hawaii, USA, 2001.
[26]
Rolf Pfeifer, Max Lungarella, and Fumiya Iida. Self-Organization, Embodiment, and Biologically Inspired Robotics. Science, 318(5853):1088--1093, 2007.
[27]
T. Reil and P. Husbands. Evolution of central pattern generators for bipedal walking in a real-time physics environment. IEEE Transactions on Evolutionary Computation, 6(2):159--168, 2002.
[28]
K Sims. Evolving virtual creatures. In Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, pages 15--22, 1994.
[29]
Russell Smith. Open Dynamics Engine, http://www.ode.org/, 2013.
[30]
Kenneth O. Stanley and Risto Miikkulainen. Evolving neural networks through augmenting topologies. Evolutionary Computation, 10(2):99--127, June 2002.
[31]
X. Yao. Evolving artificial neural networks. Proceedings of the IEEE, 87(9):1423--1447, 1999.

Cited By

View all
  • (2017)Effect of animat complexity on the evolution of hierarchical controlProceedings of the Genetic and Evolutionary Computation Conference10.1145/3071178.3071246(147-154)Online publication date: 1-Jul-2017

Index Terms

  1. Evolving joint-level control with digital muscles

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    GECCO '14: Proceedings of the 2014 Annual Conference on Genetic and Evolutionary Computation
    July 2014
    1478 pages
    ISBN:9781450326629
    DOI:10.1145/2576768
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 12 July 2014

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. bio-inspired design
    2. digital muscles
    3. evolutionary robotics
    4. joint-level control
    5. simulation

    Qualifiers

    • Research-article

    Conference

    GECCO '14
    Sponsor:
    GECCO '14: Genetic and Evolutionary Computation Conference
    July 12 - 16, 2014
    BC, Vancouver, Canada

    Acceptance Rates

    GECCO '14 Paper Acceptance Rate 180 of 544 submissions, 33%;
    Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)2
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 08 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2017)Effect of animat complexity on the evolution of hierarchical controlProceedings of the Genetic and Evolutionary Computation Conference10.1145/3071178.3071246(147-154)Online publication date: 1-Jul-2017

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media