Skip to content
Part BCSIR NET December 2023

Sufficiency, completeness, UMVUE, Cramér–Rao

For n ≥ 2, let X1,…,XnX_{1}, \dots, X_{n} be a random sample with density f(x|θ)=\theta) = θxθ−1\theta{}x^{\theta-1} on 0<x<1,θ>00 < x < 1, \theta > 0 unknown. Which of the following is the UMVUE for 1/θ1/\theta?

  1. A.−(1/n)∑ln⁡Xi-(1/n) \sum \ln X_{i}✓ Correct
  2. B.−n/∑ln⁡Xi-n/\sum \ln X_{i}
  3. C.−(n−1)/∑ln⁡Xi-(n - 1)/\sum \ln X_{i}
  4. D.−(2/n)∑ln⁡Xi-(2/n) \sum \ln X_{i}

The idea, in plain words

Take the negative logarithm of each observation and this awkward family turns into the standard waiting-time family, whose average is one over the parameter. From there everything is a familiar computation.

Solution

−ln⁡Xi-\ln X_{i} ~ Exp(θ)(\theta) with mean 1/θ1/\theta, and ∑ln⁡Xi\sum \ln X_{i} is complete sufficient; the sample mean of −ln⁡Xi-\ln X_{i} is unbiased for 1/θ1/\theta.

Why each option is right or wrong

Checked against 3 symbolic computations
  • A.Correct

    True.

    Transform: P(−ln X > t) = P(X < e−t)e^{-t}) = e−θte^{-\theta{}t}

    which SymPy confirms at θ=3\theta = 3

    so −ln X ~ Exp(θ)(\theta) with mean 1/θ(1/\theta (verified as 1/2 at θ=2\theta = 2 and 1/4 at θ=4)\theta = 4).

    The sample mean of the −ln⁡Xi-\ln X_{i} is therefore unbiased for 1/θ1/\theta, and ∑ln⁡Xi\sum \ln X_{i} is complete sufficient

    so Lehmann–Scheffé makes −(1/n)∑ln⁡Xi-(1/n)\sum \ln X_{i} the UMVUE.

    The trigger: a density of the form θxθ−1\theta{}x^{\theta-1} is an exponential family in −ln x — transform first.

  • False — this estimates θ\theta, not 1/θ1/\theta.

    −n/∑ln⁡Xi-n/\sum \ln X_{i} is the reciprocal of the correct estimator and is in fact the MLE of θ\theta.

    Reciprocals do not commute with expectation

    so an unbiased estimator of 1/θ1/\theta cannot simply be inverted to give one for θ\theta.

  • False — this is the UMVUE of θ\theta itself, with the (n − 1) correcting the bias of the MLE.

    It is the right estimator for the wrong quantity.

    Read which of θ\theta and 1/θ1/\theta the question asks for before choosing.

  • False.

    This is twice the correct estimator

    so its expectation is 2/θ2/\theta rather than 1/θ1/\theta — it is biased by a factor of 2 and cannot be a UMVUE.

3 of these 3 wrong options correspond to a named reasoning error — the same errors recur across subjects.

Related counterexample: A sufficient statistic is complete

More on this topic

The chapter behind this: Sufficiency, completeness and the UMVUE machine — free to read

From Estimation › Sufficiency, completeness, UMVUE, Cramér–Rao

Last revised . Found a mistake? Tell us — corrections are the fastest thing we act on.

ShareWhatsAppTelegram