Search results for "Conditional entropy"

showing 10 items of 24 documents

A validity and reliability study of Conditional Entropy Measures of Pulse Rate Variability

2019

In this work, we present the feasibility to use a simpler methodological approach for the assessment of the short-term complexity of Heart Rate Variability (HRV). Specifically, we propose to exploit Pulse Rate Variability (PRV) recorded through photoplethysmography in place of HRV measured from the ECG, and to compute complexity via a linear Gaussian approximation in place of the standard model-free methods (e.g., nearest neighbor entropy estimates) usually applied to HRV. Linear PRV-based and model-free HRV-based complexity measures were compared via statistical tests, correlation analysis and Bland-Altman plots, demonstrating an overall good agreement. These results support the applicabil…

020205 medical informaticsComputer scienceEntropy0206 medical engineeringValidity02 engineering and technologySettore ING-INF/01 - ElettronicaElectrocardiographyPulse Rate Variability (PRV)Heart RatePhotoplethysmogram0202 electrical engineering electronic engineering information engineeringHumansEntropy (information theory)Heart rate variabilityEntropy (energy dispersal)Time seriesPhotoplethysmographyEntropy (arrow of time)Statistical hypothesis testingConditional entropyEntropy (statistical thermodynamics)Reproducibility of ResultsHeart Rate Variability (HRV)020601 biomedical engineeringSettore ING-INF/06 - Bioingegneria Elettronica E InformaticacomplexityAlgorithmEntropy (order and disorder)2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)
researchProduct

Lag-specific transfer entropy as a tool to assess cardiovascular and cardiorespiratory information transfer

2014

In the study of interacting physiological systems, model-free tools for time series analysis are fundamental to provide a proper description of how the coupling among systems arises from the multiple involved regulatory mechanisms. This study presents an approach which evaluates direction, magnitude, and exact timing of the information transfer between two time series belonging to a multivariate dataset. The approach performs a decomposition of the well-known transfer entropy (TE) which achieves 1) identifying, according to a lag-specific information-theoretic formulation of the concept of Granger causality, the set of time lags associated with significant information transfer, and 2) assig…

AdultMaleInformation transferMultivariate statisticsDynamical systems theoryDatabases FactualComputer sciencePhysiologyEntropyBiomedical EngineeringBlood Pressuredynamical systemYoung AdultGranger causalityControl theoryHumansAutonomic nervous systemmultivariate time serieTime seriesmutual informationcardiovascular controlconditional entropy (CE)RespirationModels CardiovascularComputational BiologyHeartMutual informationCausalityNonlinear systemSettore ING-INF/06 - Bioingegneria Elettronica E InformaticaGranger causalityTransfer entropy
researchProduct

Mechanisms of causal interaction between short-term RR interval and systolic arterial pressure oscillations during orthostatic challenge

2013

The transition from the supine to the upright position requires a reorganization of the mechanisms of cardiovascular control that, if not properly accomplished, may lead to neurally mediated syncope. We investigated how the patterns of causality between systolic arterial pressure (SAP) and cardiac RR interval were modified by prolonged head-up tilt using a novel nonlinear approach based on corrected conditional entropy (CCE) compared with the standard approach exploiting the cross-correlation function (CCF). Measures of coupling strength and delay of the causal interactions from SAP to RR and from RR to SAP were obtained in 10 patients with recurrent, neurally mediated syncope (RNMS) and 10…

AdultMaleSupine positionAdolescentPhysiologyPostureBaroreflexCardiovascular SystemSyncopeCardiovascular Physiological PhenomenaElectrocardiographyYoung AdultTilt table testOrthostatic vital signsNeurally mediated syncopeTilt-Table TestPhysiology (medical)medicineAutonomic nervous systemHumansArterial PressureCardiovascular Physiological PhenomenaAgedmedicine.diagnostic_testbusiness.industryHead-up tiltCrosscorrelationHeartBaroreflexMiddle AgedAutonomic nervous systemBlood pressureCardiovascular controlCase-Control StudiesAnesthesiaSettore ING-INF/06 - Bioingegneria Elettronica E InformaticaFemaleConditional entropybusinessElectrocardiographyJournal of Applied Physiology
researchProduct

Are nonlinear model-free conditional entropy approaches for the assessment of cardiac control complexity superior to the linear model-based one?

2016

Objective : We test the hypothesis that the linear model-based (MB) approach for the estimation of conditional entropy (CE) can be utilized to assess the complexity of the cardiac control in healthy individuals. Methods : An MB estimate of CE was tested in an experimental protocol (i.e., the graded head-up tilt) known to produce a gradual decrease of cardiac control complexity as a result of the progressive vagal withdrawal and concomitant sympathetic activation. The MB approach was compared with traditionally exploited nonlinear model-free (MF) techniques such as corrected approximate entropy, sample entropy, corrected CE, two k -nearest-neighbor CE procedures and permutation CE. Electroca…

Computer scienceEntropyBiomedical EngineeringSensitivity and Specificity01 natural sciencesApproximate entropy03 medical and health sciencesEntropy (classical thermodynamics)0302 clinical medicineHeart RateHeart Rate Determination0103 physical sciencesStatisticsHumansEntropy (information theory)Autonomic nervous systemComputer SimulationEntropy (energy dispersal)010306 general physicsEntropy (arrow of time)Heart rate variabilityFeedback PhysiologicalConditional entropyEntropy (statistical thermodynamics)Head-up tiltModels CardiovascularLinear modelCardiovascular regulationReproducibility of ResultsHeartStatistical modelMutual informationSample entropyMutual informationNonlinear DynamicsConcomitantSettore ING-INF/06 - Bioingegneria Elettronica E InformaticaLinear ModelsAlgorithmRandom variableAlgorithms030217 neurology & neurosurgeryEntropy (order and disorder)
researchProduct

Conditional Entropy-Based Evaluation of Information Dynamics in Physiological Systems

2014

We present a framework for quantifying the dynamics of information in coupled physiological systems based on the notion of conditional entropy (CondEn). First, we revisit some basic concepts of information dynamics, providing definitions of self entropy (SE), cross entropy (CE) and transfer entropy (TE) as measures of information storage and transfer in bivariate systems. We discuss also the generalization to multivariate systems, showing the importance of SE, CE and TE as relevant factors in the decomposition of the system predictive information. Then, we show how all these measures can be expressed in terms of CondEn, and devise accordingly a framework for their data-efficient estimation.…

Conditional entropyComputer scienceEstimatorMutual informationCross entropyArtificial IntelligenceSettore ING-INF/06 - Bioingegneria Elettronica E InformaticaTransfer entropyEntropy (energy dispersal)Time seriesComputational MechanicAlgorithmSoftwareCurse of dimensionality
researchProduct

Multiscale Information Storage of Linear Long-Range Correlated Stochastic Processes

2019

Information storage, reflecting the capability of a dynamical system to keep predictable information during its evolution over time, is a key element of intrinsic distributed computation, useful for the description of the dynamical complexity of several physical and biological processes. Here we introduce a parametric approach which allows one to compute information storage across multiple timescales in stochastic processes displaying both short-term dynamics and long-range correlations (LRC). Our analysis is performed in the popular framework of multiscale entropy, whereby a time series is first "coarse grained" at the chosen timescale through low-pass filtering and downsampling, and then …

Conditional entropyFOS: Computer and information sciencesComputer scienceStochastic processDynamical system01 natural sciencesMeasure (mathematics)010305 fluids & plasmasMethodology (stat.ME)Multiscale Entropy Information Theory ComplexityAutoregressive model0103 physical sciencesState space010306 general physicsRepresentation (mathematics)AlgorithmStatistics - MethodologyParametric statistics
researchProduct

Information dynamics of brain-heart physiological networks during sleep

2014

This study proposes an integrated approach, framed in the emerging fields of network physiology and information dynamics, for the quantitative analysis of brain-heart interaction networks during sleep. With this approach, the time series of cardiac vagal autonomic activity and brain wave activities measured respectively as the normalized high frequency component of heart rate variability and the EEG power in the δ, θ, σ, and β bands, are considered as realizations of the stochastic processes describing the dynamics of the heart system and of different brain sub-systems. Entropy-based measures are exploited to quantify the predictive information carried by each (sub)system, and to dissec…

Conditional entropyPhysicsSleep StagesInformation transfermedicine.diagnostic_testGeneral Physics and AstronomyElectroencephalographynetwork physiologybrainheart interactions; information dynamics; network physiology; Physics and Astronomy (all)Physics and Astronomy (all)Settore ING-INF/06 - Bioingegneria Elettronica E Informaticamedicinebrainheart interactionHeart rate variabilityEntropy (information theory)Transfer entropyNeuroscienceinformation dynamicSlow-wave sleep
researchProduct

Entropy measures, entropy estimators, and their performance in quantifying complex dynamics: Effects of artifacts, nonstationarity, and long-range co…

2017

Entropy measures are widely applied to quantify the complexity of dynamical systems in diverse fields. However, the practical application of entropy methods is challenging, due to the variety of entropy measures and estimators and the complexity of real-world time series, including nonstationarities and long-range correlations (LRC). We conduct a systematic study on the performance, bias, and limitations of three basic measures (entropy, conditional entropy, information storage) and three traditionally used estimators (linear, kernel, nearest neighbor). We investigate the dependence of entropy measures on estimator- and process-specific parameters, and we show the effects of three types of …

Conditional entropyStatistics and ProbabilityDynamical systems theoryComputer scienceEstimatorCondensed Matter Physics01 natural sciencesArticlek-nearest neighbors algorithm03 medical and health sciencesComplex dynamics0302 clinical medicineAutoregressive modelLocal variance0103 physical sciencesStatisticsSettore ING-INF/06 - Bioingegneria Elettronica E InformaticaPreprocessorStatistical physics010306 general physics030217 neurology & neurosurgeryStatistical and Nonlinear PhysicPhysical review. E
researchProduct

Information-based detection of nonlinear Granger causality in multivariate processes via a nonuniform embedding technique

2010

We present an approach, framed in information theory, to assess nonlinear causality between the subsystems of a whole stochastic or deterministic dynamical system. The approach follows a sequential procedure for nonuniform embedding of multivariate time series, whereby embedding vectors are built progressively on the basis of a minimization criterion applied to the entropy of the present state of the system conditioned to its past states. A corrected conditional entropy estimator compensating for the biasing effect of single points in the quantized hyperspace is used to guarantee the existence of a minimum entropy rate at which to terminate the procedure. The causal coupling is detected acc…

Conditional entropyStatistics and ProbabilityStochastic ProcessesInformation transferEntropyInformation TheoryEstimatorElectroencephalographyCondensed Matter PhysicInformation theoryCardiovascular Physiological PhenomenaNonlinear DynamicsMultivariate AnalysisStatisticsSettore ING-INF/06 - Bioingegneria Elettronica E InformaticaRespiratory Physiological PhenomenaEntropy (information theory)Applied mathematicsEmbeddingPredictabilityTime seriesMathematicsStatistical and Nonlinear Physic
researchProduct

Entropy characteristics of heart rate wavelet multiscale components in epileptic children before and after seizures

2020

In this work, we analyze the information content of the multiple time scale components of heart rate variability (HRV) in children with focal epilepsy. HRV components are extracted from 30 pediatric patients, monitored 10 min and 10 s before and after focal epileptic seizures, using wavelet multiscale decomposition (with 5, 15, 30, 60, 120, 180 s time scale), and then characterized computing Entropy (E), permutation entropy (PE), conditional entropy (CE) and information storage (IS). Moving from preictal to postictal windows, we find statistically significant differences in the CE and IS values of HRV components at short time scales, which reflect autonomic imbalance and appear as potential…

Conditional entropyconditional entropy (CE)business.industryPattern recognitionHeart Rate Variability (HRV)medicine.diseaseinformation storage (IS)EpilepsyWaveletHeart rateSettore ING-INF/06 - Bioingegneria Elettronica E InformaticaMultiple timemedicineEntropy (information theory)Heart rate variabilityArtificial intelligenceTime seriesbusinessentropywavelet transformMathematics
researchProduct