Search results for "Transfer Entropy"

showing 10 items of 44 documents

Decomposing the transfer entropy to quantify lag-specific Granger causality in cardiovascular variability.

2013

We present a modification of the well known transfer entropy (TE) which makes it able to detect, besides the direction and strength of the information transfer between coupled processes, its exact timing. The approach follows a decomposition strategy which identifies--according to a lag-specific formulation of the concept of Granger causality--the set of time delays carrying significant information, and then assigns to each of these delays an amount of information transfer such that the total contribution yields the overall TE. We propose also a procedure for the practical estimation from time series data of the relevant delays and lag-specific TE in both bivariate and multivariate settings…

Multivariate statisticsMathematical optimizationInformation transferMedicine (all)LagEntropyBivariate analysisCardiovascular Physiological PhenomenaGranger causalitySettore ING-INF/06 - Bioingegneria Elettronica E InformaticaMultivariate AnalysisEntropy (information theory)HumansTransfer entropyComputer SimulationTime seriesAlgorithmsMathematicsAnnual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference
researchProduct

Model-Based Transfer Entropy Analysis of Brain-Body Interactions with Penalized regression techniques

2020

The human body can be seen as a functional network depicting the dynamical interactions between different organ systems. This exchange of information is often evaluated with information-theoretic approaches which comprise the use of vector autoregressive (VAR) and state space (SS) models, normally identified with the Ordinary Least Squares (OLS). However, the number of time series to be included in the model is strictly related to the length of data recorded thus limiting the use of the classical approach. In this work, a new method based on penalized regressions, the so-called LASSO, was compared with OLS on physiological time-series extracted from 18 subjects during different stress condi…

Network physiologyPenalized regressionOrdinary Least Squares (OLS)Netywork PhysiologyNetywork Physiology; mental stress; entropyFunctional networksstate space modelAutoregressive modelSettore ING-INF/06 - Bioingegneria Elettronica E Informaticamental stressOrdinary least squaresStatisticsEntropy (information theory)least absolute shrinkage and selection operator (LASSO)Transfer entropyTime seriesentropyInformation DynamicsSubnetworkMathematics2020 11th Conference of the European Study Group on Cardiovascular Oscillations (ESGCO)
researchProduct

Apparent remote synchronization of amplitudes: A demodulation and interference effect

2018

A form of "remote synchronization" was recently described, wherein amplitude fluctuations across a ring of non-identical, non-linear electronic oscillators become entrained into spatially-structured patterns. According to linear models and mutual information, synchronization and causality dip at a certain distance, then recover before eventually fading. Here, the underlying mechanism is finally elucidated through novel experiments and simulations. The system non-linearity is found to have a dual role: it supports chaotic dynamics, and it enables the energy exchange between the lower and higher sidebands of a predominant frequency. This frequency acts as carrier signal in an arrangement rese…

PhysicsSidebandApplied MathematicsStatistical and Nonlinear Physics; Mathematical Physics; Physics and Astronomy (all); Applied MathematicsFOS: Physical sciencesGeneral Physics and AstronomyStatistical and Nonlinear PhysicsNonlinear Sciences - Chaotic DynamicsTopologyInterference (wave propagation)01 natural sciences010305 fluids & plasmasAmplitude modulationPhysics and Astronomy (all)Amplitude0103 physical sciencesBasebandMathematical PhysicDemodulationFadingTransfer entropyChaotic Dynamics (nlin.CD)010306 general physicsMathematical PhysicsStatistical and Nonlinear PhysicChaos: An Interdisciplinary Journal of Nonlinear Science
researchProduct

Interictal cardiorespiratory variability in temporal lobe and absence epilepsy in childhood

2015

It is well known that epilepsy has a profound effect on the autonomic nervous system, especially on the autonomic control of heart rate and respiration. This effect has been widely studied during seizure activity, but less attention has been given to interictal (i.e. seizure-free) activity. The studies that have been done on this topic, showed that heart rate and respiration can be affected individually, even without the occurrence of seizures. In this work, the interactions between these two individual physiological variables are analysed during interictal activity in temporal lobe and absence epilepsy in childhood. These interactions are assessed by decomposing the predictive information …

PhysiologyInformation Theory02 engineering and technologyElectroencephalographyMultimodal Imaging01 natural sciencesAutonomic controlElectrocardiographyEpilepsy0302 clinical medicineHeart RateHeart rate variabilityChildmedicine.diagnostic_testSISTARespirationheart rate variabilityElectroencephalographySignal Processing Computer-Assistedtemporal lobe epilepsy3. Good healthabsence epilepsyCardiologyPsychologymedicine.medical_specialty0206 medical engineeringBiophysicsBiomedical EngineeringTemporal lobe03 medical and health sciencesInternal medicinePhysiology (medical)0103 physical sciencesRespirationHeart ratemedicineHumansIctal010306 general physicsinformation dynamicbusiness.industryCardiorespiratory fitnessmedicine.disease020601 biomedical engineeringAutonomic nervous systemEpilepsy AbsenceEpilepsy Temporal LobeBiophysicSettore ING-INF/06 - Bioingegneria Elettronica E InformaticaepilepsyTransfer entropybusinessNeuroscience030217 neurology & neurosurgery
researchProduct

Estimating the decomposition of predictive information in multivariate systems

2015

In the study of complex systems from observed multivariate time series, insight into the evolution of one system may be under investigation, which can be explained by the information storage of the system and the information transfer from other interacting systems. We present a framework for the model-free estimation of information storage and information transfer computed as the terms composing the predictive information about the target of a multivariate dynamical process. The approach tackles the curse of dimensionality employing a nonuniform embedding scheme that selects progressively, among the past components of the multivariate process, only those that contribute most, in terms of co…

Statistics and ProbabilityComputer scienceEntropyTRANSFER ENTROPYStochastic ProcesseInformation Storage and RetrievalheartAPPROXIMATE ENTROPYMaximum entropy spectral estimationInformation theoryGRANGER CAUSALITYJoint entropyNonlinear DynamicMECHANISMSBinary entropy functionTheoreticalHeart RateModelsInformationSLEEP EEGStatisticsOSCILLATIONSTOOLEntropy (information theory)Multivariate AnalysiElectroencephalography; Entropy; Heart Rate; Information Storage and Retrieval; Linear Models; Nonlinear Dynamics; Sleep; Stochastic Processes; Models Theoretical; Multivariate AnalysisConditional entropyStochastic ProcessesHEART-RATE-VARIABILITYCOMPLEXITYConditional mutual informationBrainElectroencephalographyModels TheoreticalScience GeneralCondensed Matter PhysicscardiorespiratoryNonlinear DynamicsPHYSIOLOGICAL TIME-SERIESSettore ING-INF/06 - Bioingegneria Elettronica E InformaticaMultivariate AnalysisLinear ModelsLinear ModelTransfer entropySleepAlgorithmStatistical and Nonlinear Physic
researchProduct

Disentangling cardiovascular control mechanisms during head-down tilt via joint transfer entropy and self-entropy decompositions

2015

A full decomposition of the predictive entropy (PE) of the spontaneous variations of the heart period (HP) given systolic arterial pressure (SAP) and respiration (R) is proposed. The PE of HP is decomposed into the joint transfer entropy (JTE) from SAP and R to HP and self-entropy (SE) of HP. The SE is the sum of three terms quantifying the synergistic/redundant contributions of HP and SAP, when taken individually and jointly, to SE and one term conditioned on HP and SAP denoted as the conditional SE (CSE) of HP given SAP and R. The JTE from SAP and R to HP is the sum of two terms attributable to SAP or R plus an extra term describing the redundant/synergistic contribution to the JTE. All q…

Supine positionInformation storageComputer sciencePhysiologyAutonomic nervous system; Baroreflex; Blood pressure variability; Cardiopulmonary coupling; Heart rate variability; Information dynamics; Multivariate linear regression analysis; Physiology; Physiology (medical)Cardiovascular controlAutonomic Nervous Systemlcsh:PhysiologyNuclear magnetic resonanceCardiopulmonary couplingPhysiology (medical)Cardiac controlHeart rate variabilityOriginal Researchlcsh:QP1-981redundancymultivariate linear regression analysiscardiopulmonary couplingBaroreflexHead-Down TiltInformation dynamicSynergySettore ING-INF/06 - Bioingegneria Elettronica E InformaticaSystolic arterial pressureTransfer entropyblood pressure variabilityMultivariate linear regression analysiinformation dynamicsAlgorithmFrontiers in Physiology
researchProduct

Measuring spectrally-resolved information transfer for sender- and receiver-specific frequencies

2020

AbstractInformation transfer, measured by transfer entropy, is a key component of distributed computation. It is therefore important to understand the pattern of information transfer in order to unravel the distributed computational algorithms of a system. Since in many natural systems distributed computation is thought to rely on rhythmic processes a frequency resolved measure of information transfer is highly desirable. Here, we present a novel algorithm, and its efficient implementation, to identify separately frequencies sending and receiving information in a network. Our approach relies on the invertible maximum overlap discrete wavelet transform (MODWT) for the creation of surrogate d…

Temporal cortexInformation transferComputer scienceInformation theory01 natural sciencesSurrogate data03 medical and health sciences0302 clinical medicine0103 physical sciencesTransfer entropyCommunication sourceInformation flow (information theory)010306 general physicsAlgorithm030217 neurology & neurosurgeryInformation exchange
researchProduct

Assessing Transfer Entropy in cardiovascular and respiratory time series under long-range correlations.

2021

Heart Period (H) results from the activity of several coexisting control mechanisms, involving Systolic Arterial Pressure (S) and Respiration (R), which operate across multiple time scales encompassing not only short-term dynamics but also long-range correlations. In this work, multiscale representation of Transfer Entropy (TE) and of its decomposition in the network of these three interacting processes is obtained by extending the multivariate approach based on linear parametric VAR models to the Vector AutoRegressive Fractionally Integrated (VARFI) framework for Gaussian processes. This approach allows to dissect the different contributions to cardiac dynamics accounting for the simultane…

Time FactorsTransfer entropyHeart RateEntropySettore ING-INF/06 - Bioingegneria Elettronica E InformaticaHumansHeartVector AutoRegressive Fractionally Integrated (VARFI) modelCardiovascular Systemlong-range correlationAnnual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference
researchProduct

Information Decomposition in Bivariate Systems: Theory and Application to Cardiorespiratory Dynamics

2015

In the framework of information dynamics, the temporal evolution of coupled systems can be studied by decomposing the predictive information about an assigned target system into amounts quantifying the information stored inside the system and the information transferred to it. While information storage and transfer are computed through the known self-entropy (SE) and transfer entropy (TE), an alternative decomposition evidences the so-called cross entropy (CE) and conditional SE (cSE), quantifying the cross information and internal information of the target system, respectively. This study presents a thorough evaluation of SE, TE, CE and cSE as quantities related to the causal statistical s…

causalityInformation dynamicsTransfer entropyDynamical systems theoryComputationGeneral Physics and Astronomylcsh:AstrophysicsBivariate analysisMultivariate autoregressive processeMachine learningcomputer.software_genreMultivariate autoregressive processesCardiorespiratory interactionsPhysics and Astronomy (all)Systems theoryDynamical systemslcsh:QB460-466Decomposition (computer science)Statistical physicslcsh:ScienceCardiorespiratory interactions; Causality; Dynamical systems; Heart rate variability; Information dynamics; Multivariate autoregressive processes; Transfer entropyHeart rate variabilityMathematicsCardiorespiratory interactions; Causality; Dynamical systems; Heart rate variability; Information dynamics; Multivariate autoregressive processes; Transfer entropy; Physics and Astronomy (all)business.industryCardiorespiratory interactionheart rate variabilitytransfer entropyDynamical systemcardiorespiratory interactionsdynamical systemslcsh:QC1-999CausalityInformation dynamicCross entropySettore ING-INF/06 - Bioingegneria Elettronica E Informaticamultivariate autoregressive processesBenchmark (computing)lcsh:QTransfer entropyArtificial intelligenceinformation dynamicsbusinesscomputerlcsh:PhysicsEntropy
researchProduct

Information Transfer in Linear Multivariate Processes Assessed through Penalized Regression Techniques: Validation and Application to Physiological N…

2020

The framework of information dynamics allows the dissection of the information processed in a network of multiple interacting dynamical systems into meaningful elements of computation that quantify the information generated in a target system, stored in it, transferred to it from one or more source systems, and modified in a synergistic or redundant way. The concepts of information transfer and modification have been recently formulated in the context of linear parametric modeling of vector stochastic processes, linking them to the notion of Granger causality and providing efficient tools for their computation based on the state&ndash

conditional transfer entropyInformation transferlinear predictionDynamical systems theoryComputer scienceState–space modelsGeneral Physics and Astronomylcsh:AstrophysicsNetwork topologycomputer.software_genrenetwork physiology01 natural sciencesArticle03 medical and health sciences0302 clinical medicinepenalized regression techniquelcsh:QB460-4660103 physical sciencesEntropy (information theory)Statistics::Methodologylcsh:Science010306 general physicspartial information decompositionmultivariate time series analysisinformation dynamics; partial information decomposition; entropy; conditional transfer entropy; network physiology; multivariate time series analysis; State–space models; vector autoregressive model; penalized regression techniques; linear predictionState–space modellcsh:QC1-999multivariate time series analysiInformation dynamicData pointpenalized regression techniquesAutoregressive modelSettore ING-INF/06 - Bioingegneria Elettronica E InformaticaParametric modelOrdinary least squaresvector autoregressive modellcsh:QData mininginformation dynamicsentropycomputerlcsh:Physics030217 neurology & neurosurgery
researchProduct