+ Reply to Thread
Results 1 to 2 of 2

Thread: Maximum Likelihood estimator question

  1. #1
    Points: 1,538, Level: 22
    Level completed: 38%, Points required for next Level: 62

    Posts
    4
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Maximum Likelihood estimator question



    Hi,

    I'm stuck on this question...
    I think I've got part a) and part b) I'm just struggling on how to justify it...
    It's mainly parts c) and d) that I can't do as I don't really know how I'd go about finding the variance of an estimator, and then I don't fully understand what a sampling distribution is so any help would be much appreciated...

    Thanks
    Attached Images  

  2. #2
    TS Contributor
    Points: 14,811, Level: 78
    Level completed: 91%, Points required for next Level: 39

    Posts
    2,295
    Thanks
    8
    Thanked 371 Times in 351 Posts

    First note that X is exponentially distributed with mean \mu
    Then we immediately have E[X] = \mu and Var[X] = \mu^2
    (or you can prove it easily by integration)

    a) For the M.L.E. part, I guess it is a standard work.
    First write down the joint log-likelihood function:
    L(\mu; x_1, ..., x_n) = -n\ln \mu - \frac {\sum_{i=1}^n x_i} {\mu}
    Differentiate it with respect to the parameter \mu and set it equal to 0:
    \left. \frac {\partial L} {\partial \mu} \right|_{\mu = \hat{\mu}} = 
-\frac {n} {\hat{\mu}} + \frac {\sum_{i=1}^n x_i} {\hat{\mu}^2} = 0
    \Rightarrow \hat{\mu} = \frac {\sum_{i=1}^n x_i} {n}

    b) To check the estimator is unbiased or not, you need to check the equality
    E[\hat{\mu}] = \mu
    which is obviously true in this case, because the sample mean is always an
    unbiased estimator of the mean.
    E[\hat{\mu}] = E\left[\frac {\sum_{i=1}^n X_i} {n}\right]
= \frac {\sum_{i=1}^n E[X_i]} {n} = \frac {n\mu} {n} = \mu

    c) Again, by using the i.i.d. property of the random sample,
    Var[\hat{\mu}] = Var\left[\frac {\sum_{i=1}^n X_i} {n}\right]
= \frac {\sum_{i=1}^n Var[X_i]} {n^2}
= \frac {n\mu^2} {n^2} = \frac {\mu^2} {n}

    d) You should be able to prove that
    \sum_{i=1}^n X_i \sim Gamma(n, \mu)
    either by moment generating function, or convolution and induction
    Then you can do a simple transformation to obtain the p.d.f. of
    \hat {\mu} =  \frac {\sum_{i=1}^n X_i} {n}

    Sorry if I give too detailed hints.

+ Reply to Thread

Similar Threads

  1. Maximum Likelihood Question
    By languagelearner23 in forum Probability
    Replies: 2
    Last Post: 04-03-2011, 10:42 AM
  2. Maximum Likelihood Estimator question with binomial distribution
    By languagelearner23 in forum Probability
    Replies: 3
    Last Post: 03-06-2011, 12:21 PM
  3. Replies: 9
    Last Post: 03-06-2011, 12:15 PM
  4. Question on maximum likelihood
    By satya88 in forum Statistics
    Replies: 2
    Last Post: 06-21-2009, 11:53 AM
  5. Need help ! Maximum Likelihood Estimator
    By salk87 in forum Statistics
    Replies: 4
    Last Post: 05-02-2008, 09:31 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts








Advertise on Talk Stats