Discrete Markov chains

Use transition matrices and communicating classes.

One step at a time. Answers stay hidden until you have had a go.