In order to plan ahead for multiple moves, an algorithm known as a markov decision process is commonly used when there are only a reasonably small group of possible world states.

为了计划后面多个步骤，当可能的世界状态数目不算太多时，通常用到一种被称作马尔科夫决策过程的算法。

youdao

This paper presents an adaptive prediction coding scheme for the image signals regarded as a high order nonstationary Markov process.

本文把图象信号作为一个高阶非稳马尔柯夫过程，提出一种自适应预测编码方案。

youdao