CH.1 - Athena Scientific

1 Introduction to ProbabilityDimitri P. bertsekas and John N. TsitsiklisMassachusetts Institute of TechnologyWWW site for book information and Scientific , Belmont, MassachusettsAthena ScientificPost Office Box 391 Belmont, Mass. : Design:AnnGallagerc 2002 Dimitri P. bertsekas and John N. TsitsiklisAll rights reserved. No part of this book may be reproduced in any form by anyelectronic or mechanical means (including photocopying, recording, or informa-tion storage and retrieval) without permission in writing from the s Cataloging-in-Publication DataBertsekas, Dimitri P., Tsitsiklis, John to ProbabilityIncludes bibliographical references and index1.

2 Probabilities. 2. Stochastic Processes. I. 21 Library of Congress Control Number: 2002092167 ISBN 1-886529-40-XTothe memory ofPantelis bertsekas and Nikos TsitsiklisContents1. Sample Space and Probabilistic Conditional Total Probability Theorem and Bayes Summary and Discrete Random Basic Probability Mass Functions of Random Expectation, Mean, and Joint PMFs of Multiple Random Summary and General Random Continuous Random Variables and Cumulative Distribution Functions .. Normal Random Conditioning on an Multiple Continuous Random Variables .. Derived Summary and Further Topics on Random Sums of Independent Random Variables - More on Conditional Expectation and Sum of a Random Number of Independent Random Variables.

3 P. Covariance and Least Squares The Bivariate Normal Distribution .. Summary and The Bernoulli and Poisson The Bernoulli The Poisson Summary and Markov Discrete-Time Markov Classification of Steady-State Absorption Probabilities and Expected Time to Absorption .. p. Continuous-Time Markov Summary and Limit Markov and Chebyshev Inequalities .. The Weak Law of Large Convergence in The Central Limit The Strong Law of Large Numbers .. Summary and .. is common sense reduced to calculationLaplaceThis book is an outgrowth of our involvement in teaching an introductory prob-ability course ( Probabilistic Systems Analysis ) at the Massachusetts Instituteof course is attended by a large number of students with diverse back-grounds, and a broad range of interests.

4 They span the entire spectrum fromfreshmen to beginning graduate students, and from the engineering school to theschool of management. Accordingly, we have tried to strike a balance betweensimplicity in exposition and sophistication in analytical reasoning. Our key aimhas been to develop the ability to construct and analyze probabilistic models inamanner that combines intuitive understanding and mathematical this spirit, some of the more mathematically rigorous analysis has beenjust sketched or intuitively explained in the text, so that complex proofs do notstand in the way of an otherwise simple exposition. At the same time, some ofthis analysis is developed (at the level of advanced calculus) in theoretical prob-lems, that are included at the end of the corresponding chapter.

5 Furthermore,some of the subtler mathematical issues are hinted at in footnotes addressed tothe more attentive book covers the fundamentals of probability theory (probabilistic mod-els, discrete and continuous random variables, multiple random variables, andlimit theorems), which are typically part of a first course on the subject. Italso contains, in Chapters 4-6 a number of more advanced topics, from which aninstructor can choose to match the goals of a particular course. In particular, inChapter 4, we develop transforms, a more advanced view of conditioning, sumsof random variables, least squares estimation, and the bivariate normal distribu-viiviiiPrefacetion.

6 Furthermore, in Chapters 5 and 6, we provide a fairly detailed introductionto Bernoulli, Poisson, and Markov course covers all seven chapters in a single semester, with the ex-ception of the material on the bivariate normal (Section ), and on continuous-time Markov chains (Section ). However, in an alternative course, the materialon stochastic processes could be omitted, thereby allowing additional emphasison foundational material, or coverage of other topics of the instructor s most notable omission in coverage is an introduction to we develop all the basic elements of Bayesian statistics, in the form ofBayes rule for discrete and continuous models, and least squares estimation, wedo not enter the subjects of parameter estimation, or non-Bayesian problems that supplement the main text are divided in three categories:(a)Theoretical problems.

7 The theoretical problems (marked by *) constitutean important component of the text, and ensure that the mathematicallyoriented reader will find here a smooth development without major solutions are given in the text, but an ambitious reader may be ableto solve many of them, especially in earlier chapters, before looking at thesolutions.(b)Problems in the text:Besides theoretical problems, the text contains severalproblems, of various levels of difficulty. These are representative of theproblems that are usually covered in recitation and tutorial sessions , and are a primary mechanism through which many of our studentslearn the material.

8 Our hope is that students elsewhere will attempt tosolve these problems, and then refer to their solutions to calibrate andenhance their understanding of the material. The solutions are posted onthe book s www (c)Supplementary problems:There is a large (and growing) collection of ad-ditional problems, which is not included in the book, but is made availableat the book s www site. Many of these problems have been assigned ashomework or exam problems at , and we expect that instructorselsewhere will use them for a similar purpose. While the statements ofthese additional problems are publicly accessible, the solutions are madeavailable from the authors only to course like to acknowledge our debt to several people who contributedin various ways to the book.

9 Our writing project began when we assumed re-sponsibility for a popular probability class at that our colleague Al Drakehad taught for several decades. We were thus fortunate to start with an organi-zation of the subject that had stood the test of time, a lively presentation of thevarious topics in Al s classic textbook, and a rich set of material that had beenused in recitation sessions and for homework. We are thus indebted to Al DrakePrefaceixfor providing a very favorable set of initial thankful to the several colleagues who have either taught from thedraft of the book at various universities or have read it, and have provided uswith valuable feedback.

10 In particular, we thank Ibrahim Abou Faycal, Gustavode Veciana, Eugene Feinberg, Bob Gray, Muriel M edard, Jason Papastavrou,Ilya Pollak, David Tse, and Terry teaching assistants for the class have been very helpful. Theypointed out corrections to various drafts, they developed problems and solutionssuitable for the class, and through their direct interaction with the student body,they provided a robust mechanism for calibrating the level of the thousands of bright students at at an early stage in theirstudies was a great source of satisfaction for us. We thank them for their valu-able feedback and for being patient while they were taught from a but not least, we are grateful to our families for their support through-out the course of this long P.