MARKOV DECISION PROCESS

Markov decision process - A stochastic dynamic program , whereby for each policy the resulting state variables comprise a Markov process (a stochastic process with the property that the conditional probability of a transition to any state depends only on the current state, and not on previous states). Here is a biography of Markov .