Search results for "Entropy"
showing 10 items of 496 documents
Information dynamics: Temporal behavior of uncertainty measures
2008
We carry out a systematic study of uncertainty measures that are generic to dynamical processes of varied origins, provided they induce suitable continuous probability distributions. The major technical tool are the information theory methods and inequalities satisfied by Fisher and Shannon information measures. We focus on a compatibility of these inequalities with the prescribed (deterministic, random or quantum) temporal behavior of pertinent probability densities.
Boosting Textual Compression in Optimal Linear Time
2005
We provide a general boosting technique for Textual Data Compression. Qualitatively, it takes a good compression algorithm and turns it into an algorithm with a better compression performance guarantee. It displays the following remarkable properties: (a) it can turn any memoryless compressor into a compression algorithm that uses the “best possible” contexts; (b) it is very simple and optimal in terms of time; and (c) it admits a decompression algorithm again optimal in time. To the best of our knowledge, this is the first boosting technique displaying these properties.Technically, our boosting technique builds upon three main ingredients: the Burrows--Wheeler Transform, the Suffix Tree d…
The heterogeneity of inter-domain Internet application flows: entropic analysis and flow graph modelling
2013
The growing popularity of the Internet has triggered the proliferation of various applications, which possess diverse communication patterns and user behaviour. In this paper, the heterogeneous characteristics of Internet applications and traffic are investigated from a complex network and entropic perspective. On the basis of real-life flow data collected from a public network provided by an Internet service provider, flow graphs are constructed for five types of applications as follows: Web, P2P Download, P2P Stream, Video Stream and Instant Messaging. Three types of entropy measures are introduced to the flow graphs, and the heterogeneity of applications within a 24-h period is analysed …
Text Compression Using Antidictionaries
1999
International audience; We give a new text compression scheme based on Forbidden Words ("antidictionary"). We prove that our algorithms attain the entropy for balanced binary sources. They run in linear time. Moreover, one of the main advantages of this approach is that it produces very fast decompressors. A second advantage is a synchronization property that is helpful to search compressed data and allows parallel compression. Our algorithms can also be presented as "compilers" that create compressors dedicated to any previously fixed source. The techniques used in this paper are from Information Theory and Finite Automata.
Thermodynamic formalism and linear response theory for non-equilibrium steady states
2016
We study the linear response in systems driven away from thermal equilibrium into a nonequilibrium steady state with nonvanishing entropy production rate. A simple derivation of a general response formula is presented under the condition that the generating function describes a transformation that (to lowest order) preserves normalization and thus describes a physical stochastic process. For Markov processes we explicitly construct the conjugate quantities and discuss their relation with known response formulas. Emphasis is put on the formal analogy with thermodynamic potentials and some consequences are discussed.
Relations frequency hypermatrices in mutual, conditional and joint entropy-based information indices.
2012
Graph-theoretic matrix representations constitute the most popular and significant source of topological molecular descriptors (MDs). Recently, we have introduced a novel matrix representation, named the duplex relations frequency matrix, F, derived from the generalization of an incidence matrix whose row entries are connected subgraphs of a given molecular graph G. Using this matrix, a series of information indices (IFIs) were proposed. In this report, an extension of F is presented, introducing for the first time the concept of a hypermatrix in graph-theoretic chemistry. The hypermatrix representation explores the n-tuple participation frequencies of vertices in a set of connected subgrap…
Assessing Transfer Entropy in cardiovascular and respiratory time series under long-range correlations.
2021
Heart Period (H) results from the activity of several coexisting control mechanisms, involving Systolic Arterial Pressure (S) and Respiration (R), which operate across multiple time scales encompassing not only short-term dynamics but also long-range correlations. In this work, multiscale representation of Transfer Entropy (TE) and of its decomposition in the network of these three interacting processes is obtained by extending the multivariate approach based on linear parametric VAR models to the Vector AutoRegressive Fractionally Integrated (VARFI) framework for Gaussian processes. This approach allows to dissect the different contributions to cardiac dynamics accounting for the simultane…
Localification of variable-basis topological systems
2011
The paper provides another approach to the notion of variable-basis topological system generalizing the fixed-basis concept of S. Vickers, considers functorial relationships between the categories of modified variable-basis topological systems and variable-basis fuzzy topological spaces in the sense of S.E. Rodabaugh and shows that the procedure of localification is possible in the new setting. Quaestiones Mathematicae 33(2010), 11–33
Fuzzy Multi-Criteria Decision Making: An entropy-based approach to assess tourism sustainability
2019
In this article, we propose a method for ranking tourist destinations and evaluating their performances under a sustainability perspective: a fuzzy multiple criteria decision-making method is applied for determining sustainability performance values and ranking destinations accordingly. We select a set of sustainability evaluation criteria and use a fuzzy analytic hierarchy process to weight the selected criteria. We also optimize each evaluator’s membership function support by means of a fuzzy entropy maximization criteria. A case study is illustrated and results are compared with two data envelopment analysis–based models. The simplicity of the proposed approach along with the easy reada…
Robust existence of nonhyperbolic ergodic measures with positive entropy and full support
2021
We prove that for some manifolds $M$ the set of robustly transitive partially hyperbolic diffeomorphisms of $M$ with one-dimensional nonhyperbolic centre direction contains a $C^1$-open and dense subset of diffeomorphisms with nonhyperbolic measures which are ergodic, fully supported and have positive entropy. To do so, we formulate abstract conditions sufficient for the construction of an ergodic, fully supported measure $\mu$ which has positive entropy and is such that for a continuous function $\phi\colon X\to\mathbb{R}$ the integral $\int\phi\,d\mu$ vanishes. The criterion is an extended version of the control at any scale with a long and sparse tail technique coming from the previous w…