Search results for "Mathematics - Statistics Theory"

showing 10 items of 46 documents

Probabilistic entailment in the setting of coherence: The role of quasi conjunction and inclusion relation

2013

In this paper, by adopting a coherence-based probabilistic approach to default reasoning, we focus the study on the logical operation of quasi conjunction and the Goodman-Nguyen inclusion relation for conditional events. We recall that quasi conjunction is a basic notion for defining consistency of conditional knowledge bases. By deepening some results given in a previous paper we show that, given any finite family of conditional events F and any nonempty subset S of F, the family F p-entails the quasi conjunction C(S); then, given any conditional event E|H, we analyze the equivalence between p-entailment of E|H from F and p-entailment of E|H from C(S), where S is some nonempty subset of F.…

FOS: Computer and information sciencesClass (set theory)Goodman–Nguyen’s inclusion relationQAND ruleSettore MAT/06 - Probabilita' E Statistica MatematicaComputer Science - Artificial IntelligenceMathematics - Statistics TheoryStatistics Theory (math.ST)Logical consequencegoodman-nguyen's inclusion relationTheoretical Computer ScienceArtificial IntelligenceQuasi conjunctionFOS: MathematicsEquivalence (measure theory)MathematicsEvent (probability theory)Discrete mathematicsSettore INF/01 - InformaticaApplied MathematicsProbability (math.PR)quasi conjunction; goodman-nguyen inclusion relation; qand rule; coherence; probabilistic default reasoning; p-entailment; goodman-nguyen's inclusion relationProbabilistic logicCoherence (statistics)Conjunction (grammar)Greatest elementArtificial Intelligence (cs.AI)Probabilistic default reasoninggoodman-nguyen inclusion relationp-EntailmentCoherenceSoftwareMathematics - Probability
researchProduct

Fractional generalized cumulative entropy and its dynamic version

2021

Following the theory of information measures based on the cumulative distribution function, we propose the fractional generalized cumulative entropy, and its dynamic version. These entropies are particularly suitable to deal with distributions satisfying the proportional reversed hazard model. We study the connection with fractional integrals, and some bounds and comparisons based on stochastic orderings, that allow to show that the proposed measure is actually a variability measure. The investigation also involves various notions of reliability theory, since the considered dynamic measure is a suitable extension of the mean inactivity time. We also introduce the empirical generalized fract…

FOS: Computer and information sciencesExponential distributionComputer Science - Information TheoryMathematics - Statistics TheoryStatistics Theory (math.ST)01 natural sciencesMeasure (mathematics)010305 fluids & plasmas0103 physical sciencesFOS: MathematicsApplied mathematicsAlmost surelyCumulative entropy; Fractional calculus; Stochastic orderings; EstimationEntropy (energy dispersal)010306 general physicsStochastic orderingsMathematicsCentral limit theoremNumerical AnalysisInformation Theory (cs.IT)Applied MathematicsCumulative distribution functionProbability (math.PR)Fractional calculusEmpirical measureFractional calculusModeling and SimulationEstimationCumulative entropyMathematics - ProbabilityCommunications in Nonlinear Science and Numerical Simulation
researchProduct

Multiscale Information Decomposition: Exact Computation for Multivariate Gaussian Processes

2017

Exploiting the theory of state space models, we derive the exact expressions of the information transfer, as well as redundant and synergistic transfer, for coupled Gaussian processes observed at multiple temporal scales. All of the terms, constituting the frameworks known as interaction information decomposition and partial information decomposition, can thus be analytically obtained for different time scales from the parameters of the VAR model that fits the processes. We report the application of the proposed methodology firstly to benchmark Gaussian systems, showing that this class of systems may generate patterns of information decomposition characterized by prevalently redundant or sy…

FOS: Computer and information sciencesInformation transferComputer scienceGaussianSocial SciencesGeneral Physics and AstronomyInformation theory01 natural sciences010305 fluids & plasmasState spaceStatistical physicslcsh:Scienceinformation theorymultiscale entropylcsh:QC1-999Interaction informationMathematics and Statisticssymbolsinformation dynamicsInformation dynamics; Information transfer; Multiscale entropy; Multivariate time series analysis; Redundancy and synergy; State space models; Vector autoregressive models; Physics and Astronomy (all)information dynamics; information transfer; multiscale entropy; multivariate time series analysis; redundancy and synergy; state space models; vector autoregressive modelsMultivariate time series analysiMathematics - Statistics Theorylcsh:AstrophysicsStatistics Theory (math.ST)Statistics - ApplicationsMethodology (stat.ME)symbols.namesakePhysics and Astronomy (all)0103 physical scienceslcsh:QB460-466FOS: Mathematicsinformation transferRelevance (information retrieval)Applications (stat.AP)Transfer Entropy010306 general physicsGaussian processStatistics - MethodologyState space modelstate space modelsmultivariate time series analysisredundancy and synergyvector autoregressive modelsInformation dynamicVector autoregressive modelSettore ING-INF/06 - Bioingegneria Elettronica E InformaticaTransfer entropylcsh:Qlcsh:PhysicsEntropy
researchProduct

CLEAR: Covariant LEAst-Square Refitting with Applications to Image Restoration

2017

International audience; In this paper, we propose a new framework to remove parts of the systematic errors affecting popular restoration algorithms, with a special focus for image processing tasks. Generalizing ideas that emerged for $\ell_1$ regularization, we develop an approach re-fitting the results of standard methods towards the input data. Total variation regularizations and non-local means are special cases of interest. We identify important covariant information that should be preserved by the re-fitting method, and emphasize the importance of preserving the Jacobian (w.r.t. the observed signal) of the original estimator. Then, we provide an approach that has a ``twicing'' flavor a…

FOS: Computer and information sciencesInverse problemsMathematical optimization[ INFO.INFO-TS ] Computer Science [cs]/Signal and Image ProcessingComputer Vision and Pattern Recognition (cs.CV)General MathematicsComputer Science - Computer Vision and Pattern RecognitionMachine Learning (stat.ML)Mathematics - Statistics TheoryImage processingStatistics Theory (math.ST)02 engineering and technologyDebiasing[ INFO.INFO-CV ] Computer Science [cs]/Computer Vision and Pattern Recognition [cs.CV]01 natural sciencesRegularization (mathematics)Boosting010104 statistics & probabilitysymbols.namesake[INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing[STAT.ML]Statistics [stat]/Machine Learning [stat.ML]Variational methods[MATH.MATH-ST]Mathematics [math]/Statistics [math.ST]Statistics - Machine LearningRefittingMSC: 49N45 65K10 68U10[ INFO.INFO-TI ] Computer Science [cs]/Image ProcessingFOS: Mathematics0202 electrical engineering electronic engineering information engineeringCovariant transformation[ MATH.MATH-ST ] Mathematics [math]/Statistics [math.ST]0101 mathematicsImage restoration[ STAT.ML ] Statistics [stat]/Machine Learning [stat.ML]MathematicsApplied Mathematics[INFO.INFO-CV]Computer Science [cs]/Computer Vision and Pattern Recognition [cs.CV]EstimatorInverse problem[INFO.INFO-TI]Computer Science [cs]/Image Processing [eess.IV]Jacobian matrix and determinantsymbolsTwicing020201 artificial intelligence & image processingAffine transformationAlgorithm
researchProduct

Order-distance and other metric-like functions on jointly distributed random variables

2013

We construct a class of real-valued nonnegative binary functions on a set of jointly distributed random variables, which satisfy the triangle inequality and vanish at identical arguments (pseudo-quasi-metrics). These functions are useful in dealing with the problem of selective probabilistic causality encountered in behavioral sciences and in quantum physics. The problem reduces to that of ascertaining the existence of a joint distribution for a set of variables with known distributions of certain subsets of this set. Any violation of the triangle inequality or its consequences by one of our functions when applied to such a set rules out the existence of this joint distribution. We focus on…

FOS: Computer and information sciencesMeasurable functionComputer Science - Artificial IntelligenceGeneral MathematicsMathematics - Statistics TheoryStatistics Theory (math.ST)Quantitative Biology - Quantitative Methods01 natural sciences050105 experimental psychologyJoint probability distribution0103 physical sciencesFOS: Mathematics0501 psychology and cognitive sciences010306 general physicsQuantitative Methods (q-bio.QM)60B99 (Primary) 81Q99 91E45 (Secondary)Probability measureMathematicsDiscrete mathematicsTriangle inequalityApplied MathematicsProbability (math.PR)05 social sciencesFunction (mathematics)Artificial Intelligence (cs.AI)Distribution (mathematics)FOS: Biological sciencesSample spaceRandom variableMathematics - ProbabilityProceedings of the American Mathematical Society
researchProduct

Pattern Recovery in Penalized and Thresholded Estimation and its Geometry

2023

We consider the framework of penalized estimation where the penalty term is given by a real-valued polyhedral gauge, which encompasses methods such as LASSO (and many variants thereof such as the generalized LASSO), SLOPE, OSCAR, PACS and others. Each of these estimators can uncover a different structure or ``pattern'' of the unknown parameter vector. We define a general notion of patterns based on subdifferentials and formalize an approach to measure their complexity. For pattern recovery, we provide a minimal condition for a particular pattern to be detected by the procedure with positive probability, the so-called accessibility condition. Using our approach, we also introduce the stronge…

FOS: Computer and information sciencesStatistics - Machine LearningFOS: MathematicsMathematics - Statistics TheoryMachine Learning (stat.ML)[MATH] Mathematics [math]Statistics Theory (math.ST)
researchProduct

Sparse and Smooth: improved guarantees for Spectral Clustering in the Dynamic Stochastic Block Model

2020

In this paper, we analyse classical variants of the Spectral Clustering (SC) algorithm in the Dynamic Stochastic Block Model (DSBM). Existing results show that, in the relatively sparse case where the expected degree grows logarithmically with the number of nodes, guarantees in the static case can be extended to the dynamic case and yield improved error bounds when the DSBM is sufficiently smooth in time, that is, the communities do not change too much between two time steps. We improve over these results by drawing a new link between the sparsity and the smoothness of the DSBM: the more regular the DSBM is, the more sparse it can be, while still guaranteeing consistent recovery. In particu…

FOS: Computer and information sciencesStatistics and ProbabilityComputer Science - Machine Learning[STAT.ML]Statistics [stat]/Machine Learning [stat.ML]Statistics - Machine LearningFOS: MathematicsMachine Learning (stat.ML)Mathematics - Statistics TheoryStatistics Theory (math.ST)Statistics Probability and Uncertainty[STAT.ML] Statistics [stat]/Machine Learning [stat.ML]Machine Learning (cs.LG)
researchProduct

Thresholding projection estimators in functional linear models

2008

We consider the problem of estimating the regression function in functional linear regression models by proposing a new type of projection estimators which combine dimension reduction and thresholding. The introduction of a threshold rule allows to get consistency under broad assumptions as well as minimax rates of convergence under additional regularity hypotheses. We also consider the particular case of Sobolev spaces generated by the trigonometric basis which permits to get easily mean squared error of prediction as well as estimators of the derivatives of the regression function. We prove these estimators are minimax and rates of convergence are given for some particular cases.

FOS: Computer and information sciencesStatistics and ProbabilityMathematical optimizationStatistics::TheoryMean squared error of predictionMean squared errorMathematics - Statistics TheoryStatistics Theory (math.ST)Projection (linear algebra)Methodology (stat.ME)FOS: MathematicsApplied mathematicsStatistics - MethodologyMathematicsLinear inverse problemNumerical AnalysisLinear modelEstimatorRegression analysisMinimaxSobolev spaceThresholdingOptimal rate of convergenceDerivatives estimationRate of convergenceHilbert scaleStatistics Probability and UncertaintyGalerkin methodJournal of Multivariate Analysis
researchProduct

Asymptotic and bootstrap tests for subspace dimension

2022

Most linear dimension reduction methods proposed in the literature can be formulated using an appropriate pair of scatter matrices, see e.g. Ye and Weiss (2003), Tyler et al. (2009), Bura and Yang (2011), Liski et al. (2014) and Luo and Li (2016). The eigen-decomposition of one scatter matrix with respect to another is then often used to determine the dimension of the signal subspace and to separate signal and noise parts of the data. Three popular dimension reduction methods, namely principal component analysis (PCA), fourth order blind identification (FOBI) and sliced inverse regression (SIR) are considered in detail and the first two moments of subsets of the eigenvalues are used to test…

FOS: Computer and information sciencesStatistics and ProbabilityPrincipal component analysisMathematics - Statistics TheoryStatistics Theory (math.ST)01 natural sciencesMethodology (stat.ME)010104 statistics & probabilityDimension (vector space)Scatter matrixSliced inverse regression0502 economics and businessFOS: MathematicsSliced inverse regressionApplied mathematics0101 mathematicsEigenvalues and eigenvectorsStatistics - Methodology050205 econometrics MathematicsestimointiNumerical AnalysisOrder determinationDimensionality reduction05 social sciencesriippumattomien komponenttien analyysimonimuuttujamenetelmätPrincipal component analysisStatistics Probability and UncertaintySubspace topologySignal subspace
researchProduct

LAMN in a class of parametric models for null recurrent diffusion

2017

We study statistical models for one-dimensional diffusions which are recurrent null. A first parameter in the drift is the principal one, and determines regular varying rates of convergence for the score and the information process. A finite number of other parameters, of secondary importance, introduces additional flexibility for the modelization of the drift, and does not perturb the null recurrent behaviour. Under time-continuous observation we obtain local asymptotic mixed normality (LAMN), state a local asymptotic minimax bound, and specify asymptotically optimal estimators.

FOS: MathematicsMathematics - Statistics TheoryStatistics Theory (math.ST)62 F 12 62 M 05 60 J 6
researchProduct