An introduction to Markov chains

models for random events namely the class of Markov chains on a finite or countable state space. The state space is the set of possible values for the observations. Thus, for the example above the state space consists of two states: ill and ok. Below you will find an ex-ample of a Markov chain on a countably infinite state space, but first

  States, Chain, Countable, Markov, Markov chain, Countable state