Probability, Statistics, and Random Processes for ...

1 probability , statistics , and Random Processes for Electrical Engineering Third Edition Alberto Leon-Garcia University of Toronto Upper Saddle River, NJ 07458. Library of Congress Cataloging-in-Publication Data Leon-Garcia, Alberto. probability , statistics , and Random Processes for electrical engineering / Alberto Leon-Garcia. -- 3rd ed. p. cm. Includes bibliographical references and index. ISBN-13: 978-0-13-147122-1 (alk. paper). 1. Electric engineering--Mathematics. 2. Probabilities. 3. Stochastic Processes . I. Leon-Garcia, Alberto. probability and Random Processes for electrical engineering.

2 II. Title. 2007. '46213--dc22. 2007046492. Vice President and Editorial Director, ECS: Marcia J. Horton Associate Editor: Alice Dworkin Editorial Assistant: William Opaluch Senior Managing Editor: Scott Disanno Production Editor: Craig Little Art Director: Jayen Conte Cover Designer: Bruce Kenselaar Art Editor: Greg Dulles Manufacturing Manager: Alan Fischer Manufacturing Buyer: Lisa McDowell Marketing Manager: Tim Galligan 2008 Pearson Education, Inc. Pearson Prentice Hall Pearson Education, Inc. Upper Saddle River, NJ 07458. All rights reserved.

3 No part of this book may be reproduced, in any form or by any means, without permission in writing from the publisher. Pearson Prentice HallTM is a trademark of Pearson Education, Inc. MATLAB is a registered trademark of The Math Works, Inc. All other product or brand names are trademarks or registered trademarks of their respective holders. The author and publisher of this book have used their best efforts in preparing this book. These efforts include the development, research, and testing of the theories and programs to determine their effectiveness.

4 The author and publisher make no warranty of any kind, expressed or implied, with regard to the material contained in this book. The author and publisher shall not be liable in any event for incidental or consequential damages in connection with, or arising out of, the furnishing, performance, or use of this material. Printed in the United States of America 10 9 8 7 6 5 4 3 2 1. ISBN 0-13-147122-8. 978-0-13-147122-1. Pearson Education Ltd., London Pearson Education Australia Pty. Ltd., Sydney Pearson Education Singapore, Pte. Ltd. Pearson Education North Asia Ltd.

5 , Hong Kong Pearson Education Canada, Inc., Toronto Pearson Educaci n de Mexico, de Pearson Education Japan, Tokyo Pearson Education Malaysia, Pte. Ltd. Pearson Education, Upper Saddle River, New Jersey TO KAREN, CARLOS, MARISA, AND MICHAEL. This page intentionally left blank Contents Preface ix CHAPTER 1 probability Models in Electrical and Computer Engineering 1. Mathematical Models as Tools in Analysis and Design 2. Deterministic Models 4. probability Models 4. A Detailed Example: A Packet Voice Transmission System 9. Other Examples 11. Overview of Book 16.

6 Summary 17. Problems 18. CHAPTER 2 Basic Concepts of probability Theory 21. Specifying Random Experiments 21. The Axioms of probability 30. * Computing Probabilities Using Counting Methods 41. Conditional probability 47. Independence of Events 53. Sequential Experiments 59. * Synthesizing Randomness: Random Number Generators 67. * Fine Points: Event Classes 70. * Fine Points: Probabilities of Sequences of Events 75. Summary 79. Problems 80. CHAPTER 3 Discrete Random Variables 96. The Notion of a Random Variable 96. Discrete Random Variables and probability Mass Function 99.

7 Expected Value and Moments of Discrete Random Variable 104. Conditional probability Mass Function 111. Important Discrete Random Variables 115. Generation of Discrete Random Variables 127. Summary 129. Problems 130. v vi Contents CHAPTER 4 One Random Variable 141. The Cumulative Distribution Function 141. The probability Density Function 148. The Expected Value of X 155. Important Continuous Random Variables 163. Functions of a Random Variable 174. The Markov and Chebyshev Inequalities 181. Transform Methods 184. Basic Reliability Calculations 189.

8 Computer Methods for Generating Random Variables 194. * Entropy 202. Summary 213. Problems 215. CHAPTER 5 Pairs of Random Variables 233. Two Random Variables 233. Pairs of Discrete Random Variables 236. The Joint cdf of X and Y 242. The Joint pdf of Two Continuous Random Variables 248. Independence of Two Random Variables 254. Joint Moments and Expected Values of a Function of Two Random Variables 257. Conditional probability and Conditional Expectation 261. Functions of Two Random Variables 271. Pairs of Jointly Gaussian Random Variables 278. Generating Independent Gaussian Random Variables 284.

9 Summary 286. Problems 288. CHAPTER 6 Vector Random Variables 303. Vector Random Variables 303. Functions of Several Random Variables 309. Expected Values of Vector Random Variables 318. Jointly Gaussian Random Vectors 325. Estimation of Random Variables 332. Generating Correlated Vector Random Variables 342. Summary 346. Problems 348. Contents vii CHAPTER 7 Sums of Random Variables and Long-Term Averages 359. Sums of Random Variables 360. The Sample Mean and the Laws of Large Numbers 365. Weak Law of Large Numbers 367. Strong Law of Large Numbers 368.

10 The Central Limit Theorem 369. Central Limit Theorem 370. * Convergence of Sequences of Random Variables 378. * Long-Term Arrival Rates and Associated Averages 387. Calculating Distribution's Using the Discrete Fourier Transform 392. Summary 400. Problems 402. CHAPTER 8 statistics 411. Samples and Sampling Distributions 411. Parameter Estimation 415. Maximum Likelihood Estimation 419. Confidence Intervals 430. Hypothesis Testing 441. Bayesian Decision Methods 455. Testing the Fit of a Distribution to Data 462. Summary 469. Problems 471. CHAPTER 9 Random Processes 487.