6533b851fe1ef96bd12a9a6e

RESEARCH PRODUCT

Convergence of Markov Chains

Achim Klenke

subject

CombinatoricsMarkov chain mixing timeMarkov chainChain (algebraic topology)Markov renewal processBalance equationAdditive Markov chainMarkov propertyExamples of Markov chainsMathematics

description

We consider a Markov chain X with invariant distribution π and investigate conditions under which the distribution of X n converges to π as n→∞. Essentially it is necessary and sufficient that the state space of the chain cannot be decomposed into subspaces that the chain does not leave, or that are visited by the chain periodically; e.g., only for odd n or only for even n.

https://doi.org/10.1007/978-3-030-56402-5_18