Search results for "Markov chain"

showing 10 items of 288 documents

Random time-changes and asymptotic results for a class of continuous-time Markov chains on integers with alternating rates

2021

We consider continuous-time Markov chains on integers which allow transitions to adjacent states only, with alternating rates. We give explicit formulas for probability generating functions, and also for means, variances and state probabilities of the random variables of the process. Moreover we study independent random time-changes with the inverse of the stable subordinator, the stable subordinator and the tempered stable subodinator. We also present some asymptotic results in the fashion of large deviations. These results give some generalizations of those presented in Di Crescenzo A., Macci C., Martinucci B. (2014).

Statistics and ProbabilityPure mathematicsSubordinatormoderate deviationsInversefractional processfractional process; large deviations; moderate deviations; tempered stable subordinatorlarge deviationsChain (algebraic topology)FOS: MathematicsProbability-generating function60F10 60J27 60G22 60G52MathematicsMarkov chainlcsh:T57-57.97lcsh:MathematicsProbability (math.PR)State (functional analysis)tempered stable subordinatorlcsh:QA1-939Modeling and SimulationSettore MAT/06lcsh:Applied mathematics. Quantitative methodsLarge deviations theoryStatistics Probability and UncertaintyRandom variableMathematics - Probability
researchProduct

Bayesian hierarchical models in manufacturing bulk service queues

2006

In this paper, Queueing Theory and Bayesian statistical tools are used to analyze the congestion of various manufacturing bulk service queues with the same characteristics that are working independently of one another and in equilibrium. Hierarchical models are discussed in order to develop the whole inferential process for the parameters governing the system. Markov Chain Monte Carlo methods and numerical inversion of transforms are addressed to compute the posterior predictive distributions of the usual measures of performance in practice.

Statistics and ProbabilityQueueing theoryMathematical optimizationApplied MathematicsBayesian probabilityPosterior probabilityInversion (meteorology)Markov chain Monte CarloHierarchical database modelsymbols.namesakesymbolsEconometricsStatistics Probability and UncertaintyQueueMcmc algorithmMathematicsJournal of Statistical Planning and Inference
researchProduct

On the stability and ergodicity of adaptive scaling Metropolis algorithms

2011

The stability and ergodicity properties of two adaptive random walk Metropolis algorithms are considered. The both algorithms adjust the scaling of the proposal distribution continuously based on the observed acceptance probability. Unlike the previously proposed forms of the algorithms, the adapted scaling parameter is not constrained within a predefined compact interval. The first algorithm is based on scale adaptation only, while the second one incorporates also covariance adaptation. A strong law of large numbers is shown to hold assuming that the target density is smooth enough and has either compact support or super-exponentially decaying tails.

Statistics and ProbabilityStochastic approximationMathematics - Statistics TheoryStatistics Theory (math.ST)Law of large numbersMultiple-try Metropolis01 natural sciencesStability (probability)010104 statistics & probabilityModelling and Simulation65C40 60J27 93E15 93E35Adaptive Markov chain Monte CarloFOS: Mathematics0101 mathematicsScalingMetropolis algorithmMathematicsta112Applied Mathematics010102 general mathematicsRejection samplingErgodicityProbability (math.PR)ta111CovarianceRandom walkMetropolis–Hastings algorithmModeling and SimulationAlgorithmStabilityMathematics - ProbabilityStochastic Processes and their Applications
researchProduct

A PHASE TRANSITION FOR LARGE VALUES OF BIFURCATING AUTOREGRESSIVE MODELS

2019

We describe the asymptotic behavior of the number $$Z_n[a_n,\infty )$$ of individuals with a large value in a stable bifurcating autoregressive process, where $$a_n\rightarrow \infty $$ . The study of the associated first moment is equivalent to the annealed large deviation problem of an autoregressive process in a random environment. The trajectorial behavior of $$Z_n[a_n,\infty )$$ is obtained by the study of the ancestral paths corresponding to the large deviation event together with the environment of the process. This study of large deviations of autoregressive processes in random environment is of independent interest and achieved first. The estimates for bifurcating autoregressive pr…

Statistics and Probability[MATH.MATH-PR] Mathematics [math]/Probability [math.PR]Phase transitionrandom environmentGeneral Mathematicsmedia_common.quotation_subjectmoderate deviationslimit-theoremsmarkov-chainsStatistics::Other StatisticsBranching processdeviation inequalities92D2501 natural sciencesAsymmetry010104 statistics & probability[MATH.MATH-ST]Mathematics [math]/Statistics [math.ST]Convergence (routing)[MATH.MATH-CO]Mathematics [math]/Combinatorics [math.CO]Applied mathematics60C05[MATH]Mathematics [math]0101 mathematicsautoregressive process60J20lawMathematicsBranching processmedia_commonEvent (probability theory)parametersconvergenceMarkov chain010102 general mathematics[MATH.MATH-CO] Mathematics [math]/Combinatorics [math.CO][MATH.MATH-PR]Mathematics [math]/Probability [math.PR]Large deviationslarge deviations Mathematics Subject Classification (2010): 60J8060K37Autoregressive modelcellsLarge deviations theoryStatistics Probability and Uncertaintyasymmetry60F10
researchProduct

MODERATE DEVIATION PRINCIPLES FOR BIFURCATING MARKOV CHAINS: CASE OF FUNCTIONS DEPENDENT OF ONE VARIABLE

2021

The main purpose of this article is to establish moderate deviation principles for additive functionals of bifurcating Markov chains. Bifurcating Markov chains are a class of processes which are indexed by a regular binary tree. They can be seen as the models which represent the evolution of a trait along a population where each individual has two offsprings. Unlike the previous results of Bitseki, Djellout \& Guillin (2014), we consider here the case of functions which depend only on one variable. So, mainly inspired by the recent works of Bitseki \& Delmas (2020) about the central limit theorem for general additive functionals of bifurcating Markov chains, we give here a moderate deviatio…

Statistics and Probability[MATH.MATH-PR]Mathematics [math]/Probability [math.PR][MATH.MATH-PR] Mathematics [math]/Probability [math.PR]60J80Bifurcating Markov chainsbinary trees[MATH]Mathematics [math]binary trees Mathematics Subject Classification (2020): 60F10deviation inequalitiesMathematics - Probabilitymoderate deviation principles
researchProduct

Contributed discussion on article by Pratola

2016

The author should be commended for his outstanding contribution to the literature on Bayesian regression tree models. The author introduces three innovative sampling approaches which allow for efficient traversal of the model space. In this response, we add a fourth alternative.

Statistics and Probabilitymodel selectionMarkov Chain Monte Carlo (MCMC)Bayesian regression treeComputer scienceBig dataBayesian regression tree (BRT) modelsComputingMilieux_LEGALASPECTSOFCOMPUTINGbirth–death processMachine learningcomputer.software_genreSequential Monte Carlo methods01 natural sciencespopulation Markov chain Monte Carlo010104 statistics & probabilitysymbols.namesakebig data0502 economics and businessBayesian Regression Trees (BART)0101 mathematics050205 econometrics Bayesian treed regressionMultiple Try Metropolis algorithmsINFERÊNCIA ESTATÍSTICAbusiness.industryApplied MathematicsModel selection05 social sciencesRejection samplingData scienceVariable-order Bayesian networkTree (data structure)Tree traversalMarkov chain Monte Carlocontinuous time Markov processsymbolsArtificial intelligencebusinessBayesian linear regressioncommunication-freecomputerGibbs samplingBayesian Analysis
researchProduct

European Option Pricing and Hedging with Both Fixed and Proportional Transaction Costs

2003

Abstract In this paper we provide a systematic treatment of the utility based option pricing and hedging approach in markets with both fixed and proportional transaction costs: we extend the framework developed by Davis et al. (SIAM J. Control Optim., 31 (1993) 470) and formulate the option pricing and hedging problem. We propose and implement a numerical procedure for computing option prices and corresponding optimal hedging strategies. We present a careful analysis of the optimal hedging strategy and elaborate on important differences between the exact hedging strategy and the asymptotic hedging strategy of Whalley and Wilmott (RISK 7 (1994) 82). We provide a simulation analysis in order …

Stochastic controlTransaction costEconomics and EconometricsMathematical optimizationControl and OptimizationApplied MathematicsMonte Carlo methods for option pricingjel:C61Implied volatilityjel:G13jel:G11option pricing transaction costs stochastic control Markov chain approximationMicroeconomicsVariable pricingOrder (business)Valuation of optionsEconomicsAsian optionFinite difference methods for option pricingSSRN Electronic Journal
researchProduct

Stochastic Control Problems

2003

The general theory of stochastic processes originated in the fundamental works of A. N. Kolmogorov and A. Ya. Khincin at the beginning of the 1930s. Kolmogorov, 1938 gave a systematic and rigorous construction of the theory of stochastic processes without aftereffects or, as it is customary to say nowadays, Markov processes. In a number of works, Khincin created the principles of the theory of so-called stationary processes.

Stochastic controlsymbols.namesakeMarkov chainWiener processComputer scienceStochastic processsymbolsStochastic matrixApplied mathematicsMarkov processStochastic optimizationStochastic programming
researchProduct

An empirical analysis of growth volatility: A Markov chain approach

2005

This paper studies the determinants of growth rate volatility, focusing on the effect of level of GDP, structural change and the size of economy. First we provide a graphical analysis based on nonparametric techniques, then a quantitative analysis which follows the distribution dynamics approach. Growth volatility appears to (i) decrease with per capita GDP, (ii) increase with the share of the agricultural sector on GDP and, (iii) decrease with the size of the economy, measured by a combination of total GDP and trade openness. However, we show that the explanatory power of per capita GDP tends to vanish when we control for the size of the economy. © 2005 Springer-Verlag Berlin Heidelberg.

Stochastic volatilityMarkov chainMarkov transition matrixGross domestic productStructural changeNonparametric methodEconometricsEconomicsOpenness to experienceStructural changeGrowth rateVolatility (finance)Explanatory powerGrowth volatility
researchProduct

A Dominance Variant Under the Multi-Unidimensional Pairwise-Preference Framework: Model Formulation and Markov Chain Monte Carlo Estimation.

2018

Forced-choice questionnaires have been proposed as a way to control some response biases associated with traditional questionnaire formats (e.g., Likert-type scales). Whereas classical scoring methods have issues of ipsativity, item response theory (IRT) methods have been claimed to accurately account for the latent trait structure of these instruments. In this article, the authors propose the multi-unidimensional pairwise preference two-parameter logistic (MUPP-2PL) model, a variant within Stark, Chernyshenko, and Drasgow’s MUPP framework for items that are assumed to fit a dominance model. They also introduce a Markov Chain Monte Carlo (MCMC) procedure for estimating the model’s paramete…

Structure (mathematical logic)Bayes estimator05 social sciences050401 social sciences methodsMarkov chain Monte CarloArticlesData setsymbols.namesake0504 sociology0502 economics and businessItem response theoryConvergence (routing)StatisticsEconometricssymbolsPairwise comparisonPsychology (miscellaneous)PsychologyPreference (economics)050203 business & managementSocial Sciences (miscellaneous)Applied psychological measurement
researchProduct