Discrete Stochastic Processes, Chapter 7: Random Walks ...

Chapter 7 Random Walks , LARGE DEVIATIONS, AND MARTINGALES Introduction Definition Let {Xi; i 1} be a sequence of IID Random variables, and let Sn = X1 + X2 ++ Xn. The integer-time Stochastic process {Sn; n 1} is called a Random walk, or, more precisely, the one-dimensional Random walk based on {Xi; i 1}. For any given n, Sn is simply a sum of IID Random variables, but here the behavior of the entire Random walk process, {Sn; n 1}, is of interest. Thus, for a given real number > 0, we might want to find the probability that the sequence {Sn; n 1} contains any term for which Sn ( , that a threshold at is crossed) or to find the distribution of the smallest n for which Sn . We know that Sn/n essentially tends to E [X] = X as n 1. Thus if X< 0, Sn will tend to drift downward and if X > 0, Sn will tend to drift upward.

a tool that provides additional insight Rdensage into random walks, laws of large numbers, and other basic topics in probability and stochastic processes. 7.1.1 Simple random walks Suppose X 1,X 2,... are IID binary random variables, each taking on the value 1 with probability p and −1 with probability q = 1 − p. Letting S n = X 1 +··· + X

Loading..

Tags:

  Variable, Probability, Random, Random variables, Stochastic, Probability and stochastic

Information

Related search queries