Search results for "Markov Chain Monte Carlo"

showing 10 items of 79 documents

Importance sampling type estimators based on approximate marginal Markov chain Monte Carlo

2020

We consider importance sampling (IS) type weighted estimators based on Markov chain Monte Carlo (MCMC) targeting an approximate marginal of the target distribution. In the context of Bayesian latent variable models, the MCMC typically operates on the hyperparameters, and the subsequent weighting may be based on IS or sequential Monte Carlo (SMC), but allows for multilevel techniques as well. The IS approach provides a natural alternative to delayed acceptance (DA) pseudo-marginal/particle MCMC, and has many advantages over DA, including a straightforward parallelisation and additional flexibility in MCMC implementation. We detail minimal conditions which ensure strong consistency of the sug…

Statistics and ProbabilityHyperparameter05 social sciencesBayesian probabilityStrong consistencyEstimatorContext (language use)Markov chain Monte Carlo01 natural sciencesStatistics::Computation010104 statistics & probabilitysymbols.namesake0502 economics and businesssymbols0101 mathematicsStatistics Probability and UncertaintyParticle filterAlgorithmImportance sampling050205 econometrics MathematicsScandinavian Journal of Statistics
researchProduct

Bayesian assessment of times to diagnosis in breast cancer screening

2008

Breast cancer is one of the diseases with the most profound impact on health in developed countries and mammography is the most popular method for detecting breast cancer at a very early stage. This paper focuses on the waiting period from a positive mammogram until a confirmatory diagnosis is carried out in hospital. Generalized linear mixed models are used to perform the statistical analysis, always within the Bayesian reasoning. Markov chain Monte Carlo algorithms are applied for estimation by simulating the posterior distribution of the parameters and hyperparameters of the model through the free software WinBUGS.

Statistics and ProbabilityHyperparametermedicine.diagnostic_testbusiness.industryComputer scienceMarkov chain Monte CarloMachine learningcomputer.software_genreBayesian inferencemedicine.diseaseGeneralized linear mixed modelBayesian statisticsBreast cancer screeningsymbols.namesakeBreast cancerStatisticsmedicinesymbolsMammographyArtificial intelligenceStatistics Probability and UncertaintybusinesscomputerJournal of Applied Statistics
researchProduct

Generalization of Jeffreys Divergence-Based Priors for Bayesian Hypothesis Testing

2008

Summary We introduce objective proper prior distributions for hypothesis testing and model selection based on measures of divergence between the competing models; we call them divergence-based (DB) priors. DB priors have simple forms and desirable properties like information (finite sample) consistency and are often similar to other existing proposals like intrinsic priors. Moreover, in normal linear model scenarios, they reproduce the Jeffreys–Zellner–Siow priors exactly. Most importantly, in challenging scenarios such as irregular models and mixture models, DB priors are well defined and very reasonable, whereas alternative proposals are not. We derive approximations to the DB priors as w…

Statistics and ProbabilityKullback–Leibler divergenceMarkov chainMarkov chain Monte CarloBayes factorMixture modelsymbols.namesakePrior probabilityEconometricssymbolsApplied mathematicsStatistics Probability and UncertaintyDivergence (statistics)Statistical hypothesis testingMathematicsJournal of the Royal Statistical Society Series B: Statistical Methodology
researchProduct

Bayesian analysis of a disability model for lung cancer survival

2016

Bayesian reasoning, survival analysis and multi-state models are used to assess survival times for Stage IV non-small-cell lung cancer patients and the evolution of the disease over time. Bayesian estimation is done using minimum informative priors for the Weibull regression survival model, leading to an automatic inferential procedure. Markov chain Monte Carlo methods have been used for approximating posterior distributions and the Bayesian information criterion has been considered for covariate selection. In particular, the posterior distribution of the transition probabilities, resulting from the multi-state model, constitutes a very interesting tool which could be useful to help oncolog…

Statistics and ProbabilityLung NeoplasmsEpidemiologyComputer scienceMatemáticasPosterior probabilityBayesian probabilityEstadísticaBiostatisticsAccelerated failure time modelsBayesian inference01 natural sciences010104 statistics & probability03 medical and health sciencesBayes' theoremsymbols.namesake0302 clinical medicineHealth Information ManagementBayesian information criterionCarcinoma Non-Small-Cell LungStatisticsPrior probabilityHumans0101 mathematicsBiología y BiomedicinaNeoplasm StagingInformáticaBayes estimatorBayes TheoremMarkov chain Monte CarloSurvival AnalysisBayesian information criterionMarkov Chains030220 oncology & carcinogenesisMinimum informative priorsymbolsMulti-state modelsRegression AnalysisWeibull distributionMonte Carlo Method
researchProduct

MCMC methods to approximate conditional predictive distributions

2006

Sampling from conditional distributions is a problem often encountered in statistics when inferences are based on conditional distributions which are not of closed-form. Several Markov chain Monte Carlo (MCMC) algorithms to simulate from them are proposed. Potential problems are pointed out and some suitable modifications are suggested. Approximations based on conditioning sets are also explored. The issues are illustrated within a specific statistical tool for Bayesian model checking, and compared in an example. An example in frequentist conditional testing is also given.

Statistics and ProbabilityMarkov chainApplied MathematicsMarkov chain Monte CarloConditional probability distributionBayesian inferenceComputational Mathematicssymbols.namesakeMetropolis–Hastings algorithmComputational Theory and MathematicsSampling distributionFrequentist inferencesymbolsEconometricsAlgorithmMathematicsGibbs samplingComputational Statistics & Data Analysis
researchProduct

Bayesian Mapping of Lichens Growing on Trees

2001

Suitability of trees as hosts for epiphytic lichens are studied in a forest stand of size 25 ha. Suitability is measured as occupation probabilites which are modelled using hierarchical Bayesian approach. These probabilities are useful for an ecologist. They give smoothed spatial distribution map of suitability for each of the species and can be used in detecting high- and low-probability areas. In addition, suitability is explained by tree-level covariates. Spatial dependence, which is due to unobserved spatially structured covariates, is modelled through an unobserved Markov random field. Markov chain Monte Carlo method has been applied in Bayesian computation. The extensive spatial data …

Statistics and ProbabilityMarkov chainbiologyBayesian probabilityDiameter at breast heightMarkov chain Monte CarloGeneral Medicinebiology.organism_classificationsymbols.namesakeStatisticsCovariatesymbolsStatistics Probability and UncertaintySpatial dependenceSpatial analysisMathematicsLobaria pulmonariaBiometrical Journal
researchProduct

Componentwise adaptation for high dimensional MCMC

2005

We introduce a new adaptive MCMC algorithm, based on the traditional single component Metropolis-Hastings algorithm and on our earlier adaptive Metropolis algorithm (AM). In the new algorithm the adaption is performed component by component. The chain is no more Markovian, but it remains ergodic. The algorithm is demonstrated to work well in varying test cases up to 1000 dimensions.

Statistics and ProbabilityMathematical optimization010504 meteorology & atmospheric sciencesMonte Carlo methodMarkov processMarkov chain Monte Carlo01 natural sciencesStatistics::Computation010104 statistics & probabilityComputational Mathematicssymbols.namesakeMetropolis–Hastings algorithmTest caseChain (algebraic topology)Component (UML)symbolsStatistics::MethodologyErgodic theory0101 mathematicsStatistics Probability and Uncertainty0105 earth and related environmental sciencesMathematicsComputational Statistics
researchProduct

Adaptive Metropolis algorithm using variational Bayesian adaptive Kalman filter

2013

Markov chain Monte Carlo (MCMC) methods are powerful computational tools for analysis of complex statistical problems. However, their computational efficiency is highly dependent on the chosen proposal distribution, which is generally difficult to find. One way to solve this problem is to use adaptive MCMC algorithms which automatically tune the statistics of a proposal distribution during the MCMC run. A new adaptive MCMC algorithm, called the variational Bayesian adaptive Metropolis (VBAM) algorithm, is developed. The VBAM algorithm updates the proposal covariance matrix using the variational Bayesian adaptive Kalman filter (VB-AKF). A strong law of large numbers for the VBAM algorithm is…

Statistics and ProbabilityMathematical optimizationCovariance matrixApplied MathematicsBayesian probabilityRejection samplingMathematics - Statistics TheoryMarkov chain Monte CarloStatistics Theory (math.ST)Kalman filterStatistics::ComputationComputational Mathematicssymbols.namesakeComputingMethodologies_PATTERNRECOGNITIONMetropolis–Hastings algorithmComputational Theory and MathematicsConvergence (routing)FOS: MathematicsKernel adaptive filtersymbolsMathematicsComputational Statistics & Data Analysis
researchProduct

Bayesian Smoothing in the Estimation of the Pair Potential Function of Gibbs Point Processes

1999

A flexible Bayesian method is suggested for the pair potential estimation with a high-dimensional parameter space. The method is based on a Bayesian smoothing technique, commonly applied in statistical image analysis. For the calculation of the posterior mode estimator a new Monte Carlo algorithm is developed. The method is illustrated through examples with both real and simulated data, and its extension into truly nonparametric pair potential estimation is discussed.

Statistics and ProbabilityMathematical optimizationposterior mode estimatorMarkov chain Monte Carlo methodsMonte Carlo methodBayesian probabilityRejection samplingEstimatorMarkov chain Monte CarloBayesian smoothingGibbs processesHybrid Monte Carlosymbols.namesakeMarquardt algorithmsymbolspair potential functionPair potentialAlgorithmMathematicsGibbs samplingBernoulli
researchProduct

Uniform ergodicity of the iterated conditional SMC and geometric ergodicity of particle Gibbs samplers

2018

We establish quantitative bounds for rates of convergence and asymptotic variances for iterated conditional sequential Monte Carlo (i-cSMC) Markov chains and associated particle Gibbs samplers. Our main findings are that the essential boundedness of potential functions associated with the i-cSMC algorithm provide necessary and sufficient conditions for the uniform ergodicity of the i-cSMC Markov chain, as well as quantitative bounds on its (uniformly geometric) rate of convergence. Furthermore, we show that the i-cSMC Markov chain cannot even be geometrically ergodic if this essential boundedness does not hold in many applications of interest. Our sufficiency and quantitative bounds rely on…

Statistics and ProbabilityMetropoliswithin-Gibbsgeometric ergodicity01 natural sciencesCombinatorics010104 statistics & probabilitysymbols.namesakeFOS: MathematicsMetropolis-within-GibbsApplied mathematicsErgodic theory0101 mathematicsGibbs measureQAMathematics65C40 (Primary) 60J05 65C05 (Secondary)Particle GibbsMarkov chainGeometric ergodicity010102 general mathematicsErgodicityuniform ergodicityProbability (math.PR)iterated conditional sequential Monte CarloMarkov chain Monte CarloIterated conditional sequential Monte CarloRate of convergencesymbolsUniform ergodicityparticle GibbsParticle filterMathematics - ProbabilityGibbs sampling
researchProduct