← 1 Discrete-time Markov chains