Transcription of Chapter 2 The Maximum Likelihood Estimator
{{id}} {{{paragraph}}}
Chapter 2. The Maximum Likelihood Estimator We start this Chapter with a few quirky examples , based on estimators we are already familiar with and then we consider classical Maximum Likelihood estimation. Some examples of estimators Example 1. Let us suppose that {Xi }ni=1 are iid normal random variables with mean and variance 2 . P. The best estimators unbiased estimators of the mean and variance are X = n1 ni=1 Xi P P P 2. and s2 = n 1 1 ni=1 (Xi X )2 respectively. To see why recall that i X i and i Xi P P 2. are the sufficient statistics of the normal distribution and that i Xi and i Xi are complete minimal sufficient statistics. Therefore, since X and s2 are functions of these minimally sufficient statistics, by the Lehmann-Sche e Lemma, these estimators have minimal variance.
Example 2.2.1 (The uniform distribution) Consider the uniform distribution, which has the density f(x; )= 1I [0, ](x). Given the iid uniform random variables {X i} the likelihood (it is easier to study the likelihood rather than the log-likelihood) is L n(X n; )= 1 n Yn i=1 I [0, ](X i). Using L n(X n
Domain:
Source:
Link to this page:
Please notify us if you found a problem with this document:
{{id}} {{{paragraph}}}