I've heard of Markov Chains, but I didn't understand them until I visited this site that explains them with simple ...

Introduction. Markov Models for disease progression are common in medical decision making (see references below). The parameters in a Markov model can be estimated by observing the time it takes ...

The second ingredient for a Markov chain is a probability transition function. These tell us how likely the knight is to jump from one square, or state, in the language of Markov chains, to another.