STOCHASTIC MATRIX

Stochastic matrix - A non-negative matrix whose row sums are each 1. (A column stochastic matrix is one whose column sums are 1.) This arises in dynamic programs whose state transition is desribed by a stochastic matrix containing the probabilities of each transition.