Search results for " Entropy"

Entropy-Based Detection of Complexity and Nonlinearity in Short-Term Heart Period Variability under different Physiopathological States

2020

We compare different estimators of a popular en-tropy-based nonlinear dynamic measure, i.e. the conditional entropy (CE), as regards their ability to assess the complexity and nonlinearity of short-term heart rate variability (HRV). The CE is computed using binning, kernel and nearest neighbor entropy estimators in HRV time series measured from young, old and post-myocardial infarction patients studied at rest and during orthostatic stress. We find that the three estimators yield similar patterns of CE, but different patterns of nonlinear dynamics, across groups and conditions. These results suggest that the strategy for CE estimation is not crucial for the quantification of complexity, but…

Arabic Named Entity Recognition: A Feature-Driven Study

2009

The named entity recognition task aims at identifying and classifying named entities within an open-domain text. This task has been garnering significant attention recently as it has been shown to help improve the performance of many natural language processing applications. In this paper, we investigate the impact of using different sets of features in three discriminative machine learning frameworks, namely, support vector machines, maximum entropy and conditional random fields for the task of named entity recognition. Our language of interest is Arabic. We explore lexical, contextual and morphological features and nine data-sets of different genres and annotations. We measure the impact …

Harmony perception and regularity of spike trains in a simple auditory model

2013

A probabilistic approach for investigating the phenomena of dissonance and consonance in a simple auditory sensory model, composed by two sensory neurons and one interneuron, is presented. We calculated the interneuron’s firing statistics, that is the interspike interval statistics of the spike train at the output of the interneuron, for consonant and dissonant inputs in the presence of additional "noise", representing random signals from other, nearby neurons and from the environment. We find that blurry interspike interval distributions (ISIDs) characterize dissonant accords, while quite regular ISIDs characterize consonant accords. The informational entropy of the non-Markov spike train …

Entropy measures in Image Classification

2005

On the Evaluation of Images Complexity: A Fuzzy Approach

2006

The inherently multidimensional problem of evaluating the complexity of an image is of a certain relevance in both computer science and cognitive psychology. Computer scientists usually analyze spatial dimensions, to deal with automatic vision problems, such as feature-extraction. Psychologists seem more interested in the temporal dimension of complexity, to explore attentional models. Is it possible, by merging both approaches, to define an more general index of visual complexity? We have defined a fuzzy mathematical model of visual complexity, using a specific entropy function; results obtained by applying this model to pictorial images have a strong correlation with ones from an experime…

Quasi-Newton approach to nonnegative image restorations

2000

Abstract Image restoration, or deblurring, is the process of attempting to correct for degradation in a recorded image. Typically the blurring system is assumed to be linear and spatially invariant, and fast Fourier transform (FFT) based schemes result in efficient computational image restoration methods. However, real images have properties that cannot always be handled by linear methods. In particular, an image consists of positive light intensities, and thus a nonnegativity constraint should be enforced. This constraint and other ways of incorporating a priori information have been suggested in various applications, and can lead to substantial improvements in the reconstructions. Neverth…

Maximum entropy method : an unconventional approach to explore observables related to the electron density in phengites

2009

The maximum entropy method (MEM) is used here to get an insight into the electron density [rho(r)] of phengites 2M (1) and 3T, paying special attention to the M1-formally empty site and charge distribution. Room temperature single crystal X-ray diffraction data have been used as experimental input for MEM. The results obtained by MEM have been compared with those from conventional structure refinement which, in turn, has provided the prior-electron density to start the entropy maximization process. MEM reveals a comparatively non-committal approach, able to produce information related to the M1-site fractional occupancy, and yields results consistent with those from the difference Fourier s…

About the reliability of the Maximum Entropy Method in reconstructing electron density: the case of MgO

2006

Abstract The reliability of the Maximum Entropy Method (MEM) to reconstruct finite temperature electron density (ED) is here discussed, investigating the case of periclase (MgO). A theoretical electron density has been generated by quantum mechanic calculations and folded with a function simulating atomic thermal motion, in order to produce a reference errorless ED [ρ(r)REF]. The Fourier coefficients of ρ(r)REF have been calculated, and used as “observed” diffraction intensities to reconstruct via MEM the original ED. The electron density attained by MEM [ρ(r)MEM] and ρ(r)REF have been compared with each other (pixel-by-pixel and critical points) to assess the ability of MEM to retrieve EDs…

Nonlinear Diffusion in Transparent Media

2021

Abstract We consider a prototypical nonlinear parabolic equation whose flux has three distinguished features: it is nonlinear with respect to both the unknown and its gradient, it is homogeneous, and it depends only on the direction of the gradient. For such equation, we obtain existence and uniqueness of entropy solutions to the Dirichlet problem, the homogeneous Neumann problem, and the Cauchy problem. Qualitative properties of solutions, such as finite speed of propagation and the occurrence of waiting-time phenomena, with sharp bounds, are shown. We also discuss the formation of jump discontinuities both at the boundary of the solutions’ support and in the bulk.

Feasibility of Linear Parametric Estimation of Dynamic Information Measures to assess Physiological Stress from Short-Term Cardiovascular Variability

2021

Extensive efforts have been recently devoted to implement fast and reliable algorithms capable of assessing the physiological response of the organism to physiological stress. In this study, we propose the comparison between model-free and linear parametric methods as regards their ability to detect alterations in the dynamics and in the complexity of cardiovascular and respiratory variability evoked by postural and mental stress. Dynamic entropy (DE) and information storage (IS) measures were calculated on three physiological time-series, i.e. heart period, respiratory volume and systolic arterial pressure, on 61 healthy subjects monitored in resting conditions as well as during head-up ti…