Markov Decision Processes and Exact Solution Methods