Probabilityand RandomProcesses - Math

1 Ramon van HandelProbability andRandom ProcessesORF 309/MAT 380 Lecture NotesPrinceton UniversityThis version: February 22, 2016 PrefaceThese lecture notes are intended for a one-semester undergraduate course inapplied probability. Such a course has been taught at Princeton for many yearsby Erhan inlar. The choice of material in these notes was greatly inspired by inlar s course, though my own biases regarding the material and presentationare inevitably reflected in the present always, some choices had to be made regarding what to present: It should be emphasized that this course isnotintended for a pure math-ematics audience, for whom an entirely different approach would be in-dicated.

2 The course is taken by a diverse range of undergraduates in thesciences, engineering, and applied mathematics. For this reason, the focusis on probabilistic intuition rather than rigorous proofs, and the choice ofmaterial emphasizes exact computations rather than inequalities or asymp-totics. The main aim is to introduce an applied audience to a range of basicprobabilistic notions and to quantitative probabilistic reasoning. A principle I have tried to follow as much as possible is not to introduceany concept out of the blue, but rather to have a natural progression oftopics.

3 For example, every new distribution that is encountered is derivednaturally from a probabilistic model, rather than being defined hope is that this helps students develop a feeling for the big pictureand for the connections between the different topics. The range of topics is quite large for a first course on probability, and thepace is rapid. The main missing topic is an introduction to martingales; Ihope to add a chapter on this at the end at some point in the is a fact of life that lecture notes are a perpetual construction zone.

4 Surelyerrors remain to be fixed and presentation remains to be improved. Manythanks are due to all students who provided me with corrections in the past,and I will be grateful to continue to receive such feedback in the ,January 2016 Contents0 Introduction.. What is probability? .. Why do we need a mathematical theory? .. This course .. 41 Basic Principles of Probability.. Sample space .. Events .. Probability measure .. Probabilistic modelling .. Conditional probability.. Independent events.

5 Random variables .. Expectation and distributions .. Independence and conditioning .. 312 Bernoulli Processes.. Counting successes and binomial distribution .. Arrival times and geometric distribution .. The law of large numbers .. From discrete to continuous arrivals.. 563 Continuous Random Variables.. Expectation and integrals .. Joint and conditional densities .. Independence .. 744 Lifetimes and Reliability.. Lifetimes .. Minima and maxima .. * Reliability .. * A random process perspective.

6 895 Poisson Processes.. Counting processes and Poisson processes.. Superposition and thinning .. Nonhomogeneous Poisson processes .. 1106 Random Walks.. What is a random walk? .. Hitting times .. Gambler s ruin .. Biased random walks .. 1277 Brownian Motion.. The continuous time limit of a random walk .. Brownian motion and Gaussian distribution .. The central limit theorem .. Jointly Gaussian variables .. Sample paths of Brownian motion .. 1558 Branching Processes.. The Galton-Watson process.

7 Extinction probability .. 1639 Markov Chains.. Markov chains and transition probabilities .. Classification of states .. First step analysis .. Steady-state behavior .. The law of large numbers revisited .. What is probability?Most simply stated, probability is the study of randomness. Randomness isof course everywhere around us this statement surely needs no justification!One of the remarkable aspects of this subject is that it touches almost ev-ery area of the natural sciences, engineering, social sciences, and even puremathematics.

8 The following random examples are only a drop in the bucket. Physics: quantities such as temperature and pressure arise as a direct con-sequence of the random motion of atoms and molecules. Quantum me-chanics tells us that the world is random at an even more basic level. Biology and medicine: random mutations are the key driving force behindevolution, which has led to the amazing diversity of life that we see models are essential in understanding the spread of disease, bothin a population (epidemics) or in the human body (cancer).

9 Chemistry: chemical reactions happen when molecules randomly models of chemical kinetics are particularly important in systemswith very low concentrations, such as biochemical reactions in a single cell. Electrical engineering: noise is the universal bane of accurate transmissionof information. The effect of random noise must be well understood inorder to design reliable communication protocols that you use on a dailybasis in your cell phones. The modelling of data, such as English text, usingrandom models is a key ingredient in many data compression schemes.

10 Computer science: randomness is an important resource in the design ofalgorithms. In many situations, randomized algorithms provide the bestknown methods to solve hard problems. Civil engineering: the design of buildings and structures that can reliablywithstand unpredictable effects, such as vibrations, variable rainfall andwind, etc., requires one to take randomness into Introduction Finance and economics: stock and bond prices are inherently unpre-dictable; as such, random models form the basis for almost all work in thefinancial industry.