Search results for "markov chain"

showing 10 items of 288 documents

Establishing some order amongst exact approximations of MCMCs

2016

Exact approximations of Markov chain Monte Carlo (MCMC) algorithms are a general emerging class of sampling algorithms. One of the main ideas behind exact approximations consists of replacing intractable quantities required to run standard MCMC algorithms, such as the target probability density in a Metropolis-Hastings algorithm, with estimators. Perhaps surprisingly, such approximations lead to powerful algorithms which are exact in the sense that they are guaranteed to have correct limiting distributions. In this paper we discover a general framework which allows one to compare, or order, performance measures of two implementations of such algorithms. In particular, we establish an order …

Statistics and ProbabilityFOS: Computer and information sciences65C05Mathematical optimizationMonotonic function01 natural sciencesStatistics - ComputationPseudo-marginal algorithm010104 statistics & probabilitysymbols.namesake60J05martingale couplingalgoritmitFOS: MathematicsApplied mathematics60J220101 mathematicsComputation (stat.CO)Mathematics65C40 (Primary) 60J05 65C05 (Secondary)Martingale couplingMarkov chainmatematiikkapseudo-marginal algorithm010102 general mathematicsProbability (math.PR)EstimatorMarkov chain Monte Carloconvex orderDelta methodMarkov chain Monte CarloOrder conditionsymbolsStatistics Probability and UncertaintyAsymptotic variance60E15Martingale (probability theory)Convex orderMathematics - ProbabilityGibbs sampling
researchProduct

Can the Adaptive Metropolis Algorithm Collapse Without the Covariance Lower Bound?

2011

The Adaptive Metropolis (AM) algorithm is based on the symmetric random-walk Metropolis algorithm. The proposal distribution has the following time-dependent covariance matrix at step $n+1$ \[ S_n = Cov(X_1,...,X_n) + \epsilon I, \] that is, the sample covariance matrix of the history of the chain plus a (small) constant $\epsilon>0$ multiple of the identity matrix $I$. The lower bound on the eigenvalues of $S_n$ induced by the factor $\epsilon I$ is theoretically convenient, but practically cumbersome, as a good value for the parameter $\epsilon$ may not always be easy to choose. This article considers variants of the AM algorithm that do not explicitly bound the eigenvalues of $S_n$ away …

Statistics and ProbabilityFOS: Computer and information sciencesIdentity matrixMathematics - Statistics TheoryStatistics Theory (math.ST)Upper and lower boundsStatistics - Computation93E3593E15Combinatorics60J27Mathematics::ProbabilityLaw of large numbers65C40 60J27 93E15 93E35stochastic approximationFOS: MathematicsEigenvalues and eigenvectorsComputation (stat.CO)Metropolis algorithmMathematicsProbability (math.PR)Zero (complex analysis)CovariancestabilityUniform continuityBounded function65C40Statistics Probability and Uncertaintyadaptive Markov chain Monte CarloMathematics - Probability
researchProduct

Importance sampling correction versus standard averages of reversible MCMCs in terms of the asymptotic variance

2017

We establish an ordering criterion for the asymptotic variances of two consistent Markov chain Monte Carlo (MCMC) estimators: an importance sampling (IS) estimator, based on an approximate reversible chain and subsequent IS weighting, and a standard MCMC estimator, based on an exact reversible chain. Essentially, we relax the criterion of the Peskun type covariance ordering by considering two different invariant probabilities, and obtain, in place of a strict ordering of asymptotic variances, a bound of the asymptotic variance of IS by that of the direct MCMC. Simple examples show that IS can have arbitrarily better or worse asymptotic variance than Metropolis-Hastings and delayed-acceptanc…

Statistics and ProbabilityFOS: Computer and information sciencesdelayed-acceptanceMarkovin ketjut01 natural sciencesStatistics - Computationasymptotic variance010104 statistics & probabilitysymbols.namesake60J22 65C05unbiased estimatorFOS: MathematicsApplied mathematics0101 mathematicsComputation (stat.CO)stokastiset prosessitestimointiMathematicsnumeeriset menetelmätpseudo-marginal algorithmApplied Mathematics010102 general mathematicsProbability (math.PR)EstimatorMarkov chain Monte CarloCovarianceInfimum and supremumWeightingMarkov chain Monte CarloMonte Carlo -menetelmätDelta methodimportance samplingModeling and SimulationBounded functionsymbolsImportance samplingMathematics - Probability
researchProduct

Importance sampling type estimators based on approximate marginal Markov chain Monte Carlo

2020

We consider importance sampling (IS) type weighted estimators based on Markov chain Monte Carlo (MCMC) targeting an approximate marginal of the target distribution. In the context of Bayesian latent variable models, the MCMC typically operates on the hyperparameters, and the subsequent weighting may be based on IS or sequential Monte Carlo (SMC), but allows for multilevel techniques as well. The IS approach provides a natural alternative to delayed acceptance (DA) pseudo-marginal/particle MCMC, and has many advantages over DA, including a straightforward parallelisation and additional flexibility in MCMC implementation. We detail minimal conditions which ensure strong consistency of the sug…

Statistics and ProbabilityHyperparameter05 social sciencesBayesian probabilityStrong consistencyEstimatorContext (language use)Markov chain Monte Carlo01 natural sciencesStatistics::Computation010104 statistics & probabilitysymbols.namesake0502 economics and businesssymbols0101 mathematicsStatistics Probability and UncertaintyParticle filterAlgorithmImportance sampling050205 econometrics MathematicsScandinavian Journal of Statistics
researchProduct

Bayesian assessment of times to diagnosis in breast cancer screening

2008

Breast cancer is one of the diseases with the most profound impact on health in developed countries and mammography is the most popular method for detecting breast cancer at a very early stage. This paper focuses on the waiting period from a positive mammogram until a confirmatory diagnosis is carried out in hospital. Generalized linear mixed models are used to perform the statistical analysis, always within the Bayesian reasoning. Markov chain Monte Carlo algorithms are applied for estimation by simulating the posterior distribution of the parameters and hyperparameters of the model through the free software WinBUGS.

Statistics and ProbabilityHyperparametermedicine.diagnostic_testbusiness.industryComputer scienceMarkov chain Monte CarloMachine learningcomputer.software_genreBayesian inferencemedicine.diseaseGeneralized linear mixed modelBayesian statisticsBreast cancer screeningsymbols.namesakeBreast cancerStatisticsmedicinesymbolsMammographyArtificial intelligenceStatistics Probability and UncertaintybusinesscomputerJournal of Applied Statistics
researchProduct

Local bandwidth selection for kernel density estimation in a bifurcating Markov chain model

2020

International audience; We propose an adaptive estimator for the stationary distribution of a bifurcating Markov Chain onRd. Bifurcating Markov chains (BMC for short) are a class of stochastic processes indexed by regular binary trees. A kernel estimator is proposed whose bandwidths are selected by a method inspired by the works of Goldenshluger and Lepski [(2011), 'Bandwidth Selection in Kernel Density Estimation: Oracle Inequalities and Adaptive Minimax Optimality',The Annals of Statistics3: 1608-1632). Drawing inspiration from dimension jump methods for model selection, we also provide an algorithm to select the best constant in the penalty. Finally, we investigate the performance of the…

Statistics and ProbabilityKernel density estimationadaptive estimationNonparametric kernel estimation01 natural sciences010104 statistics & probability[MATH.MATH-ST]Mathematics [math]/Statistics [math.ST]0502 economics and businessbinary treesApplied mathematicsbifurcating autoregressive processes0101 mathematics[MATH]Mathematics [math]050205 econometrics MathematicsBinary treeStationary distributionMarkov chainStochastic processModel selection05 social sciencesEstimator[MATH.MATH-PR]Mathematics [math]/Probability [math.PR]Adaptive estimatorStatistics Probability and UncertaintyGoldenshluger-Lepski methodology
researchProduct

Generalization of Jeffreys Divergence-Based Priors for Bayesian Hypothesis Testing

2008

Summary We introduce objective proper prior distributions for hypothesis testing and model selection based on measures of divergence between the competing models; we call them divergence-based (DB) priors. DB priors have simple forms and desirable properties like information (finite sample) consistency and are often similar to other existing proposals like intrinsic priors. Moreover, in normal linear model scenarios, they reproduce the Jeffreys–Zellner–Siow priors exactly. Most importantly, in challenging scenarios such as irregular models and mixture models, DB priors are well defined and very reasonable, whereas alternative proposals are not. We derive approximations to the DB priors as w…

Statistics and ProbabilityKullback–Leibler divergenceMarkov chainMarkov chain Monte CarloBayes factorMixture modelsymbols.namesakePrior probabilityEconometricssymbolsApplied mathematicsStatistics Probability and UncertaintyDivergence (statistics)Statistical hypothesis testingMathematicsJournal of the Royal Statistical Society Series B: Statistical Methodology
researchProduct

Bayesian analysis of a disability model for lung cancer survival

2016

Bayesian reasoning, survival analysis and multi-state models are used to assess survival times for Stage IV non-small-cell lung cancer patients and the evolution of the disease over time. Bayesian estimation is done using minimum informative priors for the Weibull regression survival model, leading to an automatic inferential procedure. Markov chain Monte Carlo methods have been used for approximating posterior distributions and the Bayesian information criterion has been considered for covariate selection. In particular, the posterior distribution of the transition probabilities, resulting from the multi-state model, constitutes a very interesting tool which could be useful to help oncolog…

Statistics and ProbabilityLung NeoplasmsEpidemiologyComputer scienceMatemáticasPosterior probabilityBayesian probabilityEstadísticaBiostatisticsAccelerated failure time modelsBayesian inference01 natural sciences010104 statistics & probability03 medical and health sciencesBayes' theoremsymbols.namesake0302 clinical medicineHealth Information ManagementBayesian information criterionCarcinoma Non-Small-Cell LungStatisticsPrior probabilityHumans0101 mathematicsBiología y BiomedicinaNeoplasm StagingInformáticaBayes estimatorBayes TheoremMarkov chain Monte CarloSurvival AnalysisBayesian information criterionMarkov Chains030220 oncology & carcinogenesisMinimum informative priorsymbolsMulti-state modelsRegression AnalysisWeibull distributionMonte Carlo Method
researchProduct

Evaluating currency crises: the case of the European monetary system

2007

In this paper we examine the nature of currency crises. We ascertain whether the currency crises of the European Monetary System (EMS) were based either on fundamentals, or on self-fulfilling market expectations driven by extrinsic uncertainty. In particular, we extend previous work of Jeanne and Masson (J Int Econ 50:327–350, 2000) regarding the evaluation of currency crisis. We contribute to the existing literature proposing the use of Markov regime-switching with time-varying transition probability model. Our empirical results suggest that the currency crises of the EMS were not due only to market expectations driven by external uncertainty, or ‘sunspots’, but also to fundamental variabl…

Statistics and ProbabilityMacroeconomicsEconomics and EconometricsMarkov chainDevaluationEuropean Monetary SystemMonetary economicsCurrency crisisProbability modelnon linear time seriesMathematics (miscellaneous)Currencynon linear time series; currency crisescurrency crisesEconomicsMarket expectationsCurrency crises Multiple equilibria Markov-switchingForeign exchange riskSocial Sciences (miscellaneous)
researchProduct

A hierarchical Bayesian birth cohort analysis from incomplete registry data: evaluating the trends in the age of onset of insulin-dependent diabetes …

2005

Childhood diabetes is one of the major non-communicable diseases in children under 15 years of age. It requires a life-long insulin treatment and may lead to serious complications. Along with the worldwide increase in the incidence several countries have recently reported a decreasing trend in the age of onset of the disease. The aim of this study is to analyse long-term data on the incidence of the childhood diabetes in Finland from the birth cohorts perspective. The annual incidence data were available for the period 1965--1996 which translates into 1951--1996 birth cohorts. Hence the data consist of completely and partially observed cohorts. Bayesian modelling was employed in the analysi…

Statistics and ProbabilityMaleAdolescentEpidemiologymedicine.medical_treatmentDiseaseCohort StudiesDiabetes mellitusMedicineHumansAge of OnsetChildFinlandModels Statisticalbusiness.industryInsulinIncidence (epidemiology)Bayes Theoremmedicine.diseaseMissing dataMarkov ChainsDiabetes Mellitus Type 1Child PreschoolCohortFemaleAge of onsetbusinessMonte Carlo MethodCohort studyDemographyStatistics in medicine
researchProduct