Problems in Markov chains - ku