FINITE-STATE MARKOV CHAINS - ocw.mit.edu