Search results for " Entropy"
showing 10 items of 236 documents
Cross-entropy-based adaptive optimization of simulation parameters for Markovian-driven service systems
2005
Abstract Markov fluid models represent a general description of the process of service request arrivals to service systems. The solution of performance analysis problems incorporating them often calls for a simulation approach, for which a reference methodology is Importance Sampling. However, in this case the appropriate choice of the biasing conditions is a problem in itself. In this paper an iterative method based on the cross-entropy is proposed for this choice. The equations are given that allow to derive the biasing conditions from the simulation itself. The application of the proposed method to three different sample cases, referring to one transient scenario (finite time horizon and…
Hybridizing the cross-entropy method: An application to the max-cut problem
2009
Cross-entropy has been recently proposed as a heuristic method for solving combinatorial optimization problems. We briefly review this methodology and then suggest a hybrid version with the goal of improving its performance. In the context of the well-known max-cut problem, we compare an implementation of the original cross-entropy method with our proposed version. The suggested changes are not particular to the max-cut problem and could be considered for future applications to other combinatorial optimization problems.
Optimal Placement of Pressure Sensors Using Fuzzy DEMATEL-Based Sensor Influence
2020
[EN] Nowadays, optimal sensor placement (OSP) for leakage detection in water distribution networks is a lively field of research, and a challenge for water utilities in terms of network control, management, and maintenance. How many sensors to install and where to install them are crucial decisions to make for those utilities to reach a trade-off between efficiency and economy. In this paper, we address the where-to-install-them part of the OSP through the following elements: nodes' sensitivity to leakage, uncertainty of information, and redundancy through conditional entropy maximisation. We evaluate relationships among candidate sensors in a network to get a picture of the mutual influenc…
A fuzzy approach to the evaluation of image complexity
2009
The inherently multidimensional problem of evaluating the complexity of an image is of a certain relevance in both computer science and cognitive psychology. Computer scientists usually analyze spatial dimensions in order to deal with automatic vision problems, such as feature extraction. Psychologists seem more interested in the temporal dimension of complexity, as a means to explore attentional models. Is it possible to define, by merging both approaches, a more general index of visual complexity? The aim of this paper is the definition of objective measures of image complexity that fits with the so named perceived time. Towards the end we have defined a fuzzy mathematical model of visual…
A derivation of the isothermal quantum hydrodynamic equations using entropy minimization
2005
Isothermal quantum hydrodynamic equations of order O(h 2 ) using the quantum entropy minimization method recently developed by Degond and Ringhofer are derived. The equations have the form of the usual quantum hydrodynamic model including a correction term of order O(h 2 ) which involves the vorticity. If the initial vorticity is of order 0(h), the standard model is obtained up to order O(h 4 ). The derivation is based on a careful expansion of the quantum equilibrium obtained from the entropy minimization in powers of h 2 .
Vibrational spectrum of the spin crossover complex [Fe(phen)(2)(NCS)(2)] studied by IR and Raman spectroscopy, nuclear inelastic scattering and DFT c…
2006
The vibrational modes of the low-spin and high-spin isomers of the spin crossover complex [Fe(phen)(2)(NCS)(2)] (phen = 1,10-phenanthroline) have been measured by IR and Raman spectroscopy and by nuclear inelastic scattering. The vibrational frequencies and normal modes and the IR and Raman intensities have been calculated by density functional methods. The vibrational entropy difference between the two isomers, DeltaS(vib), which is--together with the electronic entropy difference DeltaS(el)--the driving force for the spin-transition, has been determined from the measured and from the calculated frequencies. The calculated difference (DeltaS(vib) = 57-70 J mol(-1) K(-1), depending on the m…
Studying the evolution of neural activation patterns during training of feed-forward ReLU networks
2021
The ability of deep neural networks to form powerful emergent representations of complex statistical patterns in data is as remarkable as imperfectly understood. For deep ReLU networks, these are encoded in the mixed discrete–continuous structure of linear weight matrices and non-linear binary activations. Our article develops a new technique for instrumenting such networks to efficiently record activation statistics, such as information content (entropy) and similarity of patterns, in real-world training runs. We then study the evolution of activation patterns during training for networks of different architecture using different training and initialization strategies. As a result, we see …
MuTE: a new matlab toolbox for estimating the multivariate transfer entropy in physiological variability series
2014
We present a new time series analysis toolbox, developed in Matlab, for the estimation of the Transfer entropy (TE) between time series taken from a multivariate dataset. The main feature of the toolbox is its fully multivariate implementation, that is made possible by the design of an approach for the non-uniform embedding (NUE) of the observed time series. The toolbox is equipped with parametric (linear) and non-parametric (based on binning or nearest neighbors) entropy estimators. All these estimators, implemented using the NUE approach in comparison with the classical approach based on uniform embedding, are tested on RR interval, systolic pressure and respiration variability series mea…
Information Dynamics Analysis: A new approach based on Sparse Identification of Linear Parametric Models*
2020
The framework of information dynamics allows to quantify different aspects of the statistical structure of multivariate processes reflecting the temporal dynamics of a complex network. The information transfer from one process to another can be quantified through Transfer Entropy, and under the assumption of joint Gaussian variables it is strictly related to the concept of Granger Causality (GC). According to the most recent developments in the field, the computation of GC entails representing the processes through a Vector Autoregressive (VAR) model and a state space (SS) model typically identified by means of the Ordinary Least Squares (OLS). In this work, we propose a new identification …
MuTE: a MATLAB toolbox to compare established and novel estimators of the multivariate transfer entropy.
2014
A challenge for physiologists and neuroscientists is to map information transfer between components of the systems that they study at different scales, in order to derive important knowledge on structure and function from the analysis of the recorded dynamics. The components of physiological networks often interact in a nonlinear way and through mechanisms which are in general not completely known. It is then safer that the method of choice for analyzing these interactions does not rely on any model or assumption on the nature of the data and their interactions. Transfer entropy has emerged as a powerful tool to quantify directed dynamical interactions. In this paper we compare different ap…