A Short Introduction to Probability - University of Queensland

1 A Short Introduction toProbabilityProf. Dirk P. KroeseSchool of Mathematics and PhysicsThe University of Queenslandc 2018 Kroese. These notes can be used for educational purposes, pro-vided they are kept in their original form, including this title 2018 KroeseContents1 Random Experiments and Probability Random Experiments .. Sample Space .. Events .. Probability .. Counting .. Conditional Probability and independence .. Rule .. of Total Probability and Bayes Rule .. 272 Random Variables and Probability Random Variables .. Probability Distribution .. Distributions .. Distributions.

2 Expectation .. Transforms .. Some Important Discrete Distributions .. Distribution .. Distribution .. distribution .. Distribution .. Distribution .. Some Important continuous Distributions .. Distribution .. Distribution .. , or Gaussian, Distribution .. and 2-distribution .. 523 Generating Random Variables on a Introduction .. Random Number Generation .. The Inverse-Transform Method .. Generating From Commonly Used Distributions .. 59 Copyrightc 2018 Kroese2 Contents4 Joint Joint Distribution and Independence .. Joint Distributions.

3 Joint Distributions .. Expectation .. Conditional Distribution .. 795 Functions of Random Variables and Limit Jointly Normal Random Variables .. Limit Theorems .. 89A Exercises and Problem Set 1 .. Answer Set 1 .. Problem Set 2 .. Answer Set 2 .. Problem Set 3 .. Answer Set 3 .. 105B Sample Exam 1 .. Exam 2 .. 110C Summary of Formulas113D Statistical Tables119 Copyrightc 2018 KroesePrefaceThese notes form a Short , but comprehensive, second-year Introduction to prob-ability. You might find these notes useful as a source of reference and an aid toself-learning for courses such as STAT2202, STAT2003, and STAT2004.

4 A morepolished version, with additional material, but without appendix A (Exercisesand Solutions) and appendix B (Sample Exams), forms Part I of the Kroese and Chan (2014).Statistical Modeling and Computation,Springer, New can be downloaded (free) completely master the material, it is important that you1. visit the lectures, where many extra examples will be provided;2. do the tutorial exercises and the exercises in the appendix, which arethere to help you with the technical side of things; you will learn hereto apply the concepts learned at the lectures,3. carry out random experiments on the computer. This will give you abetter intuition about how randomness of these will be essential if you wish to understand Probability beyond fillingin the formulas.

5 Notation and ConventionsThroughout these notes I try to use a uniform notation in which, as a rule, thenumber of symbols is kept to a minimum. For example, I preferqijtoq(i,j),XttoX(t), andEXtoE[X].The symbol := denotes is defined as . We will also use the forrandom variableand (or iid) forindependent and identically 2018 Kroese4 PrefaceI will use thesans seriffont to denote Probability distributions. For exampleBindenotes the binomial distribution, andExpthe exponential references to Examples, Theorems, etc. are of the same form. For example,Theorem refers to the second theorem of Chapter 1. References to formula sappear between brackets. For example, ( ) refers to formula 4 of Chapter Hsu, H.

6 (1997). Probability , Random Variables & Random s Outline Series, McGraw-Hill, New York. Ross, S. M. (2005).A First Course in Probability , 7th ed., Prentice-Hall,Englewood Cliffs, NJ. Kroese, P, Chan, (2014).Statistical Modeling and Computa-tion, Springer, New York. Feller, W. (1970).An Introduction to Probability Theory and Its Applica-tions, Volume I., 2nd ed., Wiley & Sons, New 2018 KroeseChapter 1 Random Experiments andProbability Random ExperimentsThe basic notion in Probability is that of arandom experiment: an experi-ment whose outcome cannot be determined in advance, but is nevertheless stillsubject to of random experiments are:1. tossing a die,2.

7 Measuring the amount of rainfall in Brisbane in January,3. counting the number of calls arriving at a telephone exchange during afixed time period,4. selecting a random sample of fifty people and observing the number ofleft-handers,5. choosing at random ten people and measuring their (Coin Tossing)The mostfundamentalstochastic experimentis the experiment where a coin is tossed a number of times, sayntimes. Indeed,much of Probability theory can be based on this simple experiment, as we shallsee in subsequent chapters. To better understand how this experiment behaves,we can carry it out on a digital computer, for example in Matlab. The followingsimple Matlab program, simulates a sequence of 100 tosses with a fair coin(thatis, heads and tails are equally likely), and plots the results in a bar = (rand(1,100) < 1/2)bar(x)Copyrightc 2018 Kroese6 Random Experiments and Probability ModelsHerexis a vector with 1s and 0s, indicating Heads and Tails, say.

8 Typicaloutcomes for three such experiments are given in Figure : Three experiments where a fair coin is tossed 100 times. The darkbars indicate when Heads (=1) can also plot the average number of Heads against the number of the same Matlab program, this is done in two extra lines of code:y = cumsum(x)./[1:100]plot(y)The result of three such experiments is depicted in Figure Notice that theaverage number of Heads seems to converge to 1/2, but there is a lot of 2018 Random : The average number of heads inntosses, wheren= 1,.., (Control Chart)Control charts, see Figure , are frequentlyused in manufacturing as a method forquality control.

9 Each hour the averageoutput of the process is measured for example, the average weight of 10bags of sugar to assess if the process is still in control , for example, if themachine still puts on average the correct amount of sugar in the bags. Whenthe process>Upper Control Limitor<Lower Control Limitand an alarm israised that the process is out of control, , the machine needs to be adjusted,because it either puts too much or not enough sugar in the bags. The questionis how to set the control limits, since the random process naturally fluctuatesaround its centre or target c23569101112487 Center lineUCLLCL + c1 Figure : Control ChartCopyrightc 2018 Kroese8 Random Experiments and Probability ModelsExample (Machine Lifetime)Suppose 1000 identical components aremonitored for failure, up to 50,000 hours.

10 The outcome of such a randomexperiment is typically summarised via the cumulative lifetime table and plot, asgiven in Table and Figure , respectively. Here F(t) denotes the proportionof components that have failed at timet. One question is how F(t) can bemodelled via a continuous functionF, representing the lifetime distribution ofa typical (h)failed F(t) (h)failed F(t) : The cumulative lifetime tabletF(t) (est.) : The cumulative lifetime tableCopyrightc 2018 Random Experiments9 Example 4-engine aeroplane is able to fly on just one engine on eachwing. All engines are : A aeroplane with 4 unreliable enginesNumber the engines: 1,2 (left wing) and 3,4 (right wing).