An algorithm for computing the stationary distribution of finite state discrete time Markov Chains is provided in the paper.
论文提出了一种计算有限状态离散时间马尔科夫链平稳分布的算法。
The purpose of this paper is to give a strong law of large numbers for occupation time of finite non-homogeneous Markov chains, which is an extension of the one of the homogeneous Markov chains.
本文的目的是给出有限非齐次马氏链占据时间的一个强大数定律，其结果是齐次马氏链情形的推广。
应用推荐