Chapter 1 Markov Chains