0000000000742948
AUTHOR
Sebastiano Stramaglia
Synergetic and redundant information flow detected by unnormalized Granger causality: application to resting state fMRI
Objectives: We develop a framework for the analysis of synergy and redundancy in the pattern of information flow between subsystems of a complex network. Methods: The presence of redundancy and/or synergy in multivariate time series data renders difficult to estimate the neat flow of information from each driver variable to a given target. We show that adopting an unnormalized definition of Granger causality one may put in evidence redundant multiplets of variables influencing the target by maximizing the total Granger causality to a given target, over all the possible partitions of the set of driving variables. Consequently we introduce a pairwise index of synergy which is zero when two in…
A new framework for the time- and frequency-domain assessment of high-order interactions in networks of random processes
While the standard network description of complex systems is based on quantifying the link between pairs of system units, higher-order interactions (HOIs) involving three or more units often play a major role in governing the collective network behavior. This work introduces a new approach to quantify pairwise and HOIs for multivariate rhythmic processes interacting across multiple time scales. We define the so-called O-information rate (OIR) as a new metric to assess HOIs for multivariate time series, and present a framework to decompose the OIR into measures quantifying Granger-causal and instantaneous influences, as well as to expand all measures in the frequency domain. The framework ex…
Local Granger causality
Granger causality is a statistical notion of causal influence based on prediction via vector autoregression. For Gaussian variables it is equivalent to transfer entropy, an information-theoretic measure of time-directed information transfer between jointly dependent processes. We exploit such equivalence and calculate exactly the 'local Granger causality', i.e. the profile of the information transfer at each discrete time point in Gaussian processes; in this frame Granger causality is the average of its local version. Our approach offers a robust and computationally fast method to follow the information transfer along the time history of linear stochastic processes, as well as of nonlinear …
Altered processing of sensory stimuli in patients with migraine.
Migraine is a cyclic disorder, in which functional and morphological brain changes fluctuate over time, culminating periodically in an attack. In the migrainous brain, temporal processing of external stimuli and sequential recruitment of neuronal networks are often dysfunctional. These changes reflect complex CNS dysfunction patterns. Assessment of multimodal evoked potentials and nociceptive reflex responses can reveal altered patterns of the brain's electrophysiological activity, thereby aiding our understanding of the pathophysiology of migraine. In this Review, we summarize the most important findings on temporal processing of evoked and reflex responses in migraine. Considering these d…
Measuring High-Order Interactions in Rhythmic Processes Through Multivariate Spectral Information Decomposition
Many complex systems in physics, biology and engineering are modeled as dynamical networks and described using multivariate time series analysis. Recent developments have shown that the emergent dynamics of a network system are significantly affected by interactions involving multiple network nodes which cannot be described using pairwise links. While these higher-order interactions can be probed using information-theoretic measures, a rigorous framework to describe them in the frequency domain is still lacking. This work presents an approach for the spectral decomposition of multivariate information measures, capable of identifying higher-order synergistic and redundant interactions betwee…
Inclusion of Instantaneous Influences in the Spectral Decomposition of Causality: Application to the Control Mechanisms of Heart Rate Variability
Heart rate variability is the result of several physiological regulation mechanisms, including cardiovascular and cardiorespiratory interactions. Since instantaneous influences occurring within the same cardiac beat are commonplace in this regulation, their inclusion is mandatory to get a realistic model of physiological causal interactions. Here we exploit a recently proposed framework for the spectral decomposition of causal influences between autoregressive processes [2] and generalize it by introducing instantaneous couplings in the vector autoregressive model (VAR). We show the effectiveness of the proposed approach on a toy model, and on real data consisting of heart period (RR), syst…
Multiscale Granger causality
In the study of complex physical and biological systems represented by multivariate stochastic processes, an issue of great relevance is the description of the system dynamics spanning multiple temporal scales. While methods to assess the dynamic complexity of individual processes at different time scales are well-established, multiscale analysis of directed interactions has never been formalized theoretically, and empirical evaluations are complicated by practical issues such as filtering and downsampling. Here we extend the very popular measure of Granger causality (GC), a prominent tool for assessing directed lagged interactions between joint processes, to quantify information transfer a…
Multiscale Information Decomposition Dissects Control Mechanisms of Heart Rate Variability at Rest and During Physiological Stress.
Heart rate variability (HRV
Partial Information Decomposition in the Frequency Domain: Application to Control Mechanisms of Heart Rate Variability at Rest and During Postural Stress
We exploit a recently proposed framework for assessing causal influences in the frequency domain to construct the partial information decomposition (PID) for informational circuits of three variables, thus obtaining the spectral decomposition of redundancy, synergy and unique information. The approach is applied to heart period (HP), systolic pressure (SP) and respiration (RESP) variability series measured in healthy subjects in baseline and head up tilt conditions. Integrating the informational quantities in the respiratory band, the total influence from RESP to HP does not change in the two conditions. However, we find that in baseline RESP causes HP mostly through the direct pathway desc…
Complexity and Nonlinearity Analysis of the Time Series of Electric Field Intensity
In this work, the conditional entropy (CE) and the method of surrogate data are applied on time series of electric field (EF) intensity to explore their degree of complexity and the possible presence of nonlinear dynamics. The time series were obtained during the wide-band cumulative EF intensity monitoring, performed by one sensor of the Serbian EMF RATEL monitoring system installed in the campus area of the University of Novi Sad, and are re-sampled at one sample per two hours over consecutive time epochs of one month duration. The field intensity measurements during the years 2019 and 2020 allowed us to explore the effects of mobility restrictions related to the COVID-19 pandemic on the …
Multiscale Granger causality analysis by à trous wavelet transform
Since interactions in neural systems occur across multiple temporal scales, it is likely that information flow will exhibit a multiscale structure, thus requiring a multiscale generalization of classical temporal precedence causality analysis like Granger's approach. However, the computation of multiscale measures of information dynamics is complicated by theoretical and practical issues such as filtering and undersampling: to overcome these problems, we propose a wavelet-based approach for multiscale Granger causality (GC) analysis, which is characterized by the following properties: (i) only the candidate driver variable is wavelet transformed (ii) the decomposition is performed using the…
Neural networks with non-uniform embedding and explicit validation phase to assess Granger causality
A challenging problem when studying a dynamical system is to find the interdependencies among its individual components. Several algorithms have been proposed to detect directed dynamical influences between time series. Two of the most used approaches are a model-free one (transfer entropy) and a model-based one (Granger causality). Several pitfalls are related to the presence or absence of assumptions in modeling the relevant features of the data. We tried to overcome those pitfalls using a neural network approach in which a model is built without any a priori assumptions. In this sense this method can be seen as a bridge between model-free and model-based approaches. The experiments perfo…
Predictability decomposition detects the impairment of brain-heart dynamical networks during sleep disorders and their recovery with treatment
This work introduces a framework to study the network formed by the autonomic component of heart rate variability (cardiac process η ) and the amplitude of the different electroencephalographic waves (brain processes δ , θ , α , σ , β ) during sleep. The framework exploits multivariate linear models to decompose the predictability of any given target process into measures of self-, causal and interaction predictability reflecting respectively the information retained in the process and related to its physiological complexity, the information transferred from the other source processes, and the information modified during the transfer according to redundant or synergistic interaction betwee…
On the interpretability and computational reliability of frequency-domain Granger causality
This Correspondence article is a comment which directly relates to the paper “A study of problems encountered in Granger causality analysis from a neuroscience perspective” (Stokes and Purdon, 2017). We agree that interpretation issues of Granger causality (GC) in neuroscience exist, partially due to the historically unfortunate use of the name “causality”, as described in previous literature. On the other hand, we think that Stokes and Purdon use a formulation of GC which is outdated (albeit still used) and do not fully account for the potential of the different frequency-domain versions of GC; in doing so, their paper dismisses GC measures based on a suboptimal use of them. Furthermore, s…
Information Dynamics of Electric Field Intensity before and during the COVID-19 Pandemic.
This work investigates the temporal statistical structure of time series of electric field (EF) intensity recorded with the aim of exploring the dynamical patterns associated with periods with different human activity in urban areas. The analyzed time series were obtained from a sensor of the EMF RATEL monitoring system installed in the campus area of the University of Novi Sad, Serbia. The sensor performs wideband cumulative EF intensity monitoring of all active commercial EF sources, thus including those linked to human utilization of wireless communication systems. Monitoring was performed continuously during the years 2019 and 2020, allowing us to investigate the effects on the patterns…
Multiscale Information Decomposition: Exact Computation for Multivariate Gaussian Processes
Exploiting the theory of state space models, we derive the exact expressions of the information transfer, as well as redundant and synergistic transfer, for coupled Gaussian processes observed at multiple temporal scales. All of the terms, constituting the frameworks known as interaction information decomposition and partial information decomposition, can thus be analytically obtained for different time scales from the parameters of the VAR model that fits the processes. We report the application of the proposed methodology firstly to benchmark Gaussian systems, showing that this class of systems may generate patterns of information decomposition characterized by prevalently redundant or sy…
Lack of effects of low frequency repetitive transcranial magnetic stimulation on alpha rhythm phase synchronization in migraine patients
The study aimed to test the modulation induced by 1 Hz repetitive Transcranial Magnetic Stimulation (rTMS) of the occipital cortex on the alpha phase synchronization under repetitive flash stimuli in 15 migraine without aura patients compared to 10 controls. The EEG was recorded by 7 channels, while flash stimuli were delivered at 9, 18, 21 and 24 Hz in basal, rTMS (15 min of 1 Hz stimulation of the occipital cortex) and sham conditions. Migraine patients displayed increased alpha-band phase synchronization under visual stimulation, while an overall desynchronizing effect was evident in controls. The rTMS resulted in a slight increase of synchronization index in migraine patients, which did…
Multiscale analysis of information dynamics for linear multivariate processes.
In the study of complex physical and physiological systems represented by multivariate time series, an issue of great interest is the description of the system dynamics over a range of different temporal scales. While information-theoretic approaches to the multiscale analysis of complex dynamics are being increasingly used, the theoretical properties of the applied measures are poorly understood. This study introduces for the first time a framework for the analytical computation of information dynamics for linear multivariate stochastic processes explored at different time scales. After showing that the multiscale processing of a vector autoregressive (VAR) process introduces a moving aver…
Quantifying High-Order Interactions in Cardiovascular and Cerebrovascular Networks
We present a method to analyze the dynamics of physiological networks beyond the framework of pairwise interactions. Our method defines the so-called O-information rate (OIR) as a measure of the higher-order interaction among several physiological variables. The OIR measure is computed from the vector autoregressive representation of multiple time series, and is applied to the network formed by heart period, systolic and diastolic arterial pressure, respiration and cerebral blood flow variability series measured in healthy subjects at rest and after head-up tilt. Our results document that cardiovascular, cerebrovascular and respiratory interactions are highly redundant, and that redundancy …
Extending the spectral decomposition of Granger causality to include instantaneous influences: application to the control mechanisms of heart rate variability.
Assessing Granger causality (GC) intended as the influence, in terms of reduction of variance of surprise, that a driver variable exerts on a given target, requires a suitable treatment of ‘instantaneous’ effects, i.e. influences due to interactions whose time scale is much faster than the time resolution of the measurements, due to unobserved confounders or insufficient sampling rate that cannot be increased because the mechanism of generation of the variable is inherently slow (e.g. the heartbeat). We exploit a recently proposed framework for the estimation of causal influences in the spectral domain and include instantaneous interactions in the modelling, thus obtaining (i) a novel index…
Synergistic Information Transfer in the Global System of Financial Markets.
Uncovering dynamic information flow between stock market indices has been the topic of several studies which exploited the notion of transfer entropy or Granger causality, its linear version. The output of the transfer entropy approach is a directed weighted graph measuring the information about the future state of each target provided by the knowledge of the state of each driving stock market index. In order to go beyond the pairwise description of the information flow, thus looking at higher order informational circuits, here we apply the partial information decomposition to triplets consisting of a pair of driving markets (belonging to America or Europe) and a target market in Asia. Our …