6533b871fe1ef96bd12d2387

RESEARCH PRODUCT

Markov Chain and Stationary Distribution

Lei Jiao

subject

Queueing theoryStationary distributionComputer performanceMarkov chainComputer scienceStochastic processApplied mathematics

description

MC has been a valuable tool for analyzing the performance of complex stochastic systems since it was introduced by the Russian mathematician A. A. Markov (1856–1922) in the early 1900s. More and more system analyses have been carried out by using MC, including the analysis on CA and CF. In this chapter, we will briefly review the essential ingredients of MC that are necessary for the performance analysis presented in this book. A more comprehensive introduction of MC and its applications can be found in Nelson (2013, Probability, stochastic processes, and queueing theory: the mathematics of computer performance modeling).

yearjournalcountryeditionlanguage
2019-11-26
https://doi.org/10.1007/978-3-030-33080-4_2