PDF4PRO ⚡AMP

Modern search engine that looking for books and documents around the web

Example: biology

1 Limiting distribution for a Markov chain

Copyrightc 2009 by Karl Sigman1 Limiting distribution for a Markov chainIn these Lecture Notes, we shall study the Limiting behavior of Markov chains as timen .In particular, under suitable easy-to-check conditions, we will see that a Markov chain possessesa Limiting probability distribution , = ( j)j S, and that the chain , if started off initially withsuch a distribution will be a stationary stochastic process. We will also see that we can find by merely solving a set of linear Communication classes and irreducibility for Markov chainsFor a Markov chain with state spaceS, consider a pair of states (i,j). We say thatjis reachablefromi, denoted byi j, if there exists an integern 0 such thatPnij>0. This means thatstarting in statei, there is a positive probability (but not necessarily equal to 1) that the chainwill be in statejat timen(that is,nsteps later);P(Xn=j|X0=i)>0.

such a distribution will be a stationary stochastic process. We will also see that we can nd ˇ by merely solving a set of linear equations. 1.1 Communication classes and irreducibility for Markov chains For a Markov chain with state space S, consider a pair of …

Loading..

Tags:

  Stationary

Information

Domain:

Source:

Link to this page:

Please notify us if you found a problem with this document:

Spam in document Broken preview Other abuse

Transcription of 1 Limiting distribution for a Markov chain

Related search queries