Elsevier

Neurocomputing

Volume 331, 28 February 2019, Pages 108-120
Neurocomputing

Rhythmic control of oscillatory sequential dynamics in heteroclinic motifs

https://doi.org/10.1016/j.neucom.2018.11.056Get rights and content

Highlights

  • We study networks with heteroclinic oscillatory dynamics under periodic stimulation.

  • Rhythmic stimulation controls coherence and coordination of sequential switching.

  • Spectrum control, dynamical filtering and encoding enhancement are observed.

  • We suggest analyses of sequential activity in rhythmic input experimental protocols.

  • This can help interpreting data from transcranial stimulation and evoked potentials.

Abstract

Cognitive/behavioral brain functions are implemented through temporary correlated sequential activity of many brain elements that form universal anatomical and functional motifs, i.e., characteristic functional interactions among brain nodes, at different levels of the neural hierarchy. Such motif dynamics is determined by both the interconnections among nodes and their intrinsic oscillations. This paper focuses on heteroclinic motifs, i.e., those built in networks of oscillatory nodes that interact through asymmetric inhibitory coupling in a winnerless competitive way. We introduce a basic rate-phase motif model – based on a generalization of the well-known ecological Lotka–Volterra model – for the analysis and prediction of control processes that emerge in interacting heteroclinic motifs under periodic stimulation. This approach describes both intensity and phase in each node. We study how a rhythmic signal, which can be linked to internal or external sources, can functionally change the heteroclinic network and produce a rich gallery of motifs in the form of coordinated sequential activations. In computer simulations of the model in a “master-slave” approximation, we report phenomena such as dynamical filtering, encoding enhancement and transition to chaos. Our results are relevant in the context of several experimental protocols related to the role of brain rhythms and/or the use of external rhythmic stimulation, in particular in the context of transcranial control and evoked potentials, to assess cognitive functions and their associated pathologies.

Introduction

The human brain is composed of a vast number of elements that form hierarchical networks that cooperate and compete in wide spatial and temporal scales [1], [2], [3], [4], [5]. The dynamical features of brain networks, from microcircuits to global systems, provide the performance of diverse important cognitive functions, which involves robust transient sequential activity among different coordinated brain regions [6], [7], [8], [9], [10]. Key mechanisms of robust brain sequential dynamics are: (i) winnerless competition (WLC) [11], (ii) entrainment of oscillatory activity at different levels of the hierarchy [12], [13], and (iii) binding of different cognitive/perception modalities [10], [14]. Modern nonlinear dynamical theory can suggest several tools for the analysis of multiscale transient brain activities (e.g., see [9], [15], [16]). However, keeping in mind that theoretical and computational complexity exponentially increases with the number of degrees of freedom, investigators require constructive network analysis tools and reduced approaches based on key dynamical principles [17], [18], [19], [20], [21]. Approximations in this context can profit from the consideration of: (i) the topological reduction of the structural organization of complex networks through the representation of the corresponding graphs as sets of connected functional networks; and (ii) the low-dimensionality of oscillatory dynamics, which in many cases arises from asymmetric inhibitory interactions [9], [22], [23].

The term “network” is used in this paper in a general sense to denote a set of interconnected neural groups in the brain (a physical space), while the term “heteroclinic network” denotes a set of invariant objects/structures produced in the phase space by the dynamics of the physical network constituents. In this phase space, nodes in the network are metastable states connected through separatrices. We call motifs the recurrent patterns of interactions in such modular heteroclinic hierarchical networks. The modern theory of dynamical systems considers both robust (i.e., structurally stable) and non-robust heteroclinic networks. Robust heteroclinic structures are mathematical objects that often appear as attractors in the phase space of dissipative dynamical systems with invariant subspaces or manifolds. Investigating the link between physical brain networks and the presence of robust heteroclinic structures in the phase space has been a hot topic in the last years both in dynamical system theory and neuroscience [11], [24], [25], [26], [27], [28]. Here, we focus on transient sequential dynamics phenomena in global network oscillatory activity controlled by an endogenous rhythm or by an external rhythmic stimulus. Rhythmic stimulation is widely used both in cognitive studies as well as in clinical or rehabilitation procedures (e.g., see [29], [30], [31]). Recent modeling efforts have pointed out the importance of taking into account ongoing rhythms in brain stimulation protocols [32]. However, the effect of rhythmic stimulation on sequential brain dynamics based on oscillatory motifs has not been addressed yet. To motivate experimental research in this direction, the basic model proposed in this paper allows studying the effect of periodic input on the switching dynamics of metastable network oscillatory activity. Such activity is the result of temporal entrainment of different oscillatory nodes. The heteroclinic dynamics of the metastable state sequential switching (see Fig. 1) builds up the phases of the node oscillations resulting in coordinated motif dynamics.

Brain rhythms are considered to be involved in higher cognitive activities ranging from functional coordination and integration to attentional control [1], [33], [34], [35], [36]. The corresponding information processing phenomena are thought to be implemented mainly through neural synchronization mechanisms (e.g., see [37], [38], [39]), not necessarily involving synaptic transmission [40], and include transient coordination processes between hemispheres [41]. Microelectrode recordings and modern brain imaging, in particular fMRI, have unveiled the transient functional reorganization of large scale brain networks during the performance of different cognitive tasks (e.g., see [42], [43]). The dynamical mechanisms underlying the fast functional restructuring of flexible cognitive networks are still unclear. Departing from observed metastable informational patterns in the nervous system [21], [44], [45], our basic dynamical model helps to understand different dynamical phenomena that can be related to behavioral/cognitive programs in the framework of the same structural heteroclinic network. In particular, our results suggest that by changing the frequency of an input field that models a brain rhythm band or an external rhythmic input, it is possible to alter the level of coherence between different oscillating competitive patterns in the heteroclinic motif network and dynamically control their sequential interactions while preserving the coordination.

We assume that the human cognitive control system employs multiple strategies that include brain rhythms as a mechanism for the robustness and functional changing of circuits in specialized networks like those that build up working memory, information binding and attention processes. Brain functional networks require having a dependence on the phase, as this is probably the only way to be sensitive to entrainment and perform frequency control. However, it is not clear that neural sequential activity can keep its stability when modulated by extrinsic rhythms, e.g., by ephaptic interactions [40], [46]. Inhibition plays a key role in shaping cognitive network architectures [23] and can be responsible for stable dynamics and sequential behavior, as a key factor for suppressing noise, but at the same time can prevent the interaction with excitation that depends on extrinsic rhythms. We also proceed from the hypothesis that brain networks display WLC, a competitive process through inhibitory interactive nodes that are only transient winners during a finite time [10], [47], [48]. Thus, the network generates sequential dynamics through node switching activity [49], [50]. From this view, top-down approaches, although far from a biophysical detailed description, provide the required ingredients to model cognitive dynamics, being also suitable for the interpretation of activation sequences in regions of interest in EEG and fMRI (see also [16], [51], [52]).

External rhythmic stimulation has been suggested as a control paradigm to manipulate the brain's intrinsic oscillatory properties of networks driven via a variety of input-driven mechanisms [31]. Noninvasive protocols such as steady state visually evoked potentials (SSVEPs) [53], [54] and transcranial alternating current stimulation are examples where an external rhythm drives brain dynamics [29], [30], [31], [55]. Rhythmic light stimulation evoking SSVEPs is used in cognitive studies dealing with visual attention [56], [57]. Transcranial periodic stimulation allows modulating brain oscillations and, in turn, influence cognitive processes to assess their causal link. In particular, transcranial rhythmic protocols have been used to modulate basic motor and sensory processes as well as higher cognitive processes like memory, ambiguous perception, and decision making [58], [59], [60].

Here, we propose a complementary view on brain rhythms from the perspective of their interaction with neural sequential dynamics involved in a wide variety of information processing tasks [50], [61], [62], [63]. Thus, the network that we consider has a general function, the generation of input rhythm-specific coordinated sequential activity, which can be adapted to many specific neural systems. In the next sections, we show that a multifunctional network with sequential activations entrained by external rhythms, described by a simple frequency and amplitude, can evolve through distinct dynamical states. These states can be related to different brain functions and characterized by the broadness of their frequency spectrum, their level of regularity and the specific features of the sequential activations generated in a heteroclinic network.

Section snippets

Canonic model of heteroclinic motif interaction

To test our hypothesis, we need a model able to describe both components of cognitive dynamics – i.e., sequential transient behavior and oscillatory activities of elements (nodes, motifs and complex networks as a whole). Robust heteroclinic dynamics emerges in neural networks with prevailing inhibitory connections. Experimental studies support that most brain temporal activities are inhibitory-based interactions [22]. Thus, a convenient top-down paradigm to represent sequential activity is the

Motif sequential heteroclinic dynamics in the absence of periodic stimulation

In the absence of external stimulation, i.e., when Qi = 0 in Eqs. (1) and (3), the different nodes generate oscillatory activity covering a broad range of frequencies. Fig. 2 illustrates the network sequential dynamics in this autonomous regime. Inhibitory interactions among the oscillatory nodes produce activity with a wide variety of amplitude and frequency profiles. In spite of the overall broad power spectra for all nodes, WLC among them induces the generation of coordinated transient

Rhythm control and cognitive functions

Brain rhythm control of sequential dynamics is linked to important cognitive functions: improving attentional mechanisms [75], [76] and working memory capacity [77]; providing novel mechanisms for information binding and integration [10], [78], [79]; modulating multifunctional networks into different kinds of encodings and information execution, and making sequential dynamics act as dynamical filters. Rhythmic entrainment has been found in the brain of several animal species [80], and its study

Acknowledgments

This work was funded by MINECO/FEDER DPI2015-65833-P, ONR MURI 14-13-1-0205 and MURI N00014-13-1-0678 (MIR).

Roberto Latorre received the B.S. degree in Computer Engineering and the Ph.D. in Computer Science and Telecommunications from Universidad Autónoma de Madrid, Spain, in 2000 and 2008, respectively. Since 2002 he has been a professor at Escuela Politécnica Superior, Universidad Autónoma de Madrid where he currently is Profesor Contratado Doctor. His main research interests include neuroinformatics, computational biology and bio-inspired technology.

References (95)

  • N. Schaworonkow et al.

    Ongoing brain rhythms shape I-wave properties in a computational model

    Brain Stimul.

    (2018)
  • G. Thut et al.

    The functional importance of rhythmic activity in the brain

    Curr. Biol.

    (2012)
  • T. Womelsdorf et al.

    The role of neuronal synchronization in selective attention

    Curr. Opin. Neurobiol.

    (2007)
  • M.I. Rabinovich et al.

    Information flow dynamics in the brain

    Phys. Life Rev.

    (2012)
  • R.F. Helfrich et al.

    Entrainment of brain oscillations by transcranial alternating current stimulation

    Curr. Biol.

    (2014)
  • M.I. Rabinovich et al.

    Hierarchical nonlinear dynamics of human attention

    Neurosci. Biobehav. Rev.

    (2015)
  • Z. Lu et al.

    Three limit cycles for a three-dimensional Lotka–Volterra competitive system with a heteroclinic cycle

    Comput. Math. Appl.

    (2003)
  • D.J. Calderone et al.

    Entrainment of neural oscillations as a modifiable substrate of attention

    Trends Cognit. Sci.

    (2014)
  • R.G. James et al.

    Crutchfield, Chaos forgets and remembers: measuring information creation, destruction, and storage

    Physics Letters A

    (2014)
  • F. Roux et al.

    Working memory and neural oscillations: alpha–gamma versus theta-gamma codes for distinct WM information

    Trends Cognit. Sci.

    (2014)
  • G. Thut et al.

    New insights into rhythmic brain activity from TMS-EEG studies

    Trends Cognit. Sci.

    (2009)
  • I. Alekseichuk et al.

    Spatial working memory in humans depends on theta and high gamma synchronization in the prefrontal cortex

    Curr. Biol.

    (2016)
  • S. Baumeister et al.

    Sequential inhibitory control processes assessed through simultaneous EEG-fMRI

    Neuroimage

    (2014)
  • G. Buzsáki et al.

    Neuronal oscillations in cortical networks

    Science

    (2004)
  • F. Varela et al.

    The brainweb: phase synchronization and large-scale integration

    Nat. Rev. Neurosci.

    (2001)
  • A. Barardi et al.

    Probing scale interaction in brain dynamics through synchronization

    Philos. Trans. R. Soc. B Biol. Sci.

    (2014)
  • O. Sporns

    Discovering the Human Connectome

    (2012)
  • M. Rabinovich et al.

    Dynamical encoding by networks of competing neuron groups: winnerless competition

    Phys. Rev. Lett.

    (2001)
  • G. Buzsaki

    Rhythms of the Brain

    (2006)
  • P. Varona et al.

    Hierarchical dynamics of informational patterns and decision making

    Proc. R. Soc. B.

    (2016)
  • K.J. Friston

    Brain function, nonlinear coupling, and neuronal transients

    Neuroscience

    (2001)
  • G. Deco et al.

    The dynamics of resting fluctuations in the brain: metastability and its dynamical cortical core

    Sci. Rep.

    (2017)
  • M.I. Rabinovich et al.

    Dynamical principles in neuroscience

    Rev. Mod. Phys.

    (2006)
  • S.J. Kiebel et al.

    A hierarchy of time-scales and the brain

    PLoS Comput. Biol.

    (2008)
  • X.J. Wang

    Neurophysiological and computational principles of cortical rhythms in cognition

    Physiol. Rev.

    (2010)
  • G. Buzsáki et al.

    Brain rhythms and neural syntax: implications for efficient coding of cognitive content and neuropsychiatric disease

    Dialogues Clin. Neurosci.

    (2012)
  • R. Huerta et al.

    Reproducible sequence generation in random neural ensembles

    Phys. Rev. Lett.

    (2004)
  • P. Ashwin et al.

    Criteria for robustness of heteroclinic cycles in neural microcircuits

    J. Math. Neurosci.

    (2011)
  • T. Nowotny et al.

    Dynamics of odor-evoked activity patterns in the olfactory system

  • H. Nakahara et al.

    Near saddle-node bifurcation behavior as dynamics in working memory for goal-directed behavior

    Neural Comput.

    (1998)
  • M.J. Field

    Patterns of desynchronization and resynchronization in heteroclinic networks

    Nonlinearity

    (2017)
  • G. Thut et al.

    Entrainment of perceptually relevant brain oscillations by non-invasive rhythmic stimulation of the human brain

    Front Psychol.

    (2011)
  • C.S. Herrmann et al.

    Shaping intrinsic neural oscillations with periodic stimulation

    J. Neurosci.

    (2016)
  • J. Cannon et al.

    Neurosystems: brain rhythms and cognitive processing

    Eur. J. Neurosci.

    (2014)
  • B. Voloh et al.

    A Role of Phase-Resetting in Coordinating Large Scale Neural Networks During Attention and Goal-Directed Behavior

    Front Syst. Neurosci.

    (2016)
  • L. Dugué et al.

    Transcranial magnetic stimulation reveals intrinsic perceptual and attentional rhythms

    Front Neurosci.

    (2017)
  • Cited by (6)

    • Computational exploration of dynamic mechanisms of steady state visual evoked potentials at the whole brain level

      2021, NeuroImage
      Citation Excerpt :

      Our model further predicts that the frequency-sensitivity range of SSVEPs can be regulated by changing the intrinsic oscillation frequency of the brain. At the microscopic scale, a real brain may provide some endogenous mechanisms to automatically adjust intrinsic neural oscillations (Buzsáki and Draguhn, 2004; Herrmann et al., 2016; Latorre et al., 2019); two of these mechanisms are discussed as follows. First, one possibility with high plausibility is directly modulating the intrinsic response properties of neurons.

    • Sequential dynamics of complex networks in mind: Consciousness and creativity

      2020, Physics Reports
      Citation Excerpt :

      The dynamical characterization of resting state and stimulus-induced cognitive neural activity has been suggested for the design novel biomarkers of brain diseases [18,203,204]. Recently, the characterization of sequential brain dynamics has also been proposed for the analysis of techniques that use rhythmic stimulation such as steady state visually evoked potentials and intracranial stimulation in the context of different research and biomedical applications [205]. All these works point out the need and potential wide impact of the theoretical framework and the models discussed in this paper.

    Roberto Latorre received the B.S. degree in Computer Engineering and the Ph.D. in Computer Science and Telecommunications from Universidad Autónoma de Madrid, Spain, in 2000 and 2008, respectively. Since 2002 he has been a professor at Escuela Politécnica Superior, Universidad Autónoma de Madrid where he currently is Profesor Contratado Doctor. His main research interests include neuroinformatics, computational biology and bio-inspired technology.

    Pablo Varona received his degree in theoretical physics in 1992 and the Ph.D. in computer science in 1997 from the Universidad Autónoma de Madrid. He was a postdoc and later an assistant research scientist at the Institute for Nonlinear Science, University of California, San Diego. In 2002 he became associate professor at the Escuela Politécnica Superior, Universidad Autónoma de Madrid (EPS-UAM). Currently he is a professor of Computer Science at EPS-UAM. His main research interests are computational neuroscience, biomedical engineering and bio-inspired technology.

    Mikhail I. Rabinovich received his Ph.D. degree in physics from Nizhny Novgorod University, Russia, where he later became a professor of radiophysics. During this period, he published several seminar papers in nonlinear dynamic. In 1992 he became a Research Scientist at the Institute of Nonlinear Science, University of California, San Diego (UCSD), where he started working in Neuroscience. He is currently affiliated at the Biocircuit Institute at UCSD. Main results: Fundamental works both theoretical and experimental in “deterministic chaos” and conception of turbulence; see Rabinovich–Fabrikant equations. Theoretical and experimental work in dynamics of structures in non-equilibrium media, in particular the discovery of stable particle-like states in dissipative fields. Discovery of the synchronization phenomenon of various chaotic systems in radio electronics and neuro-dynamics. Introduced a principle of space-time coding of sensory information in living systems: The Winnerless Competition principle confirmed by experimental evidence. Proposed a novel dynamics object: “Stable Heteroclinic Channel” that is robust in the phase space of dissipative non-equilibrium system with large number of degrees of freedom. SHC was introduced to describe stable transition processes in mind. Formulated fundamental dynamical principles of brain activity and built dynamical models that describe the interaction between emotional and cognitive functions.

    View full text