[Math] Use Rao-Blackwell Theorem to find the UMVUE

normal distributionparameter estimationprobabilitystatistical-inferencestatistics

Suppose that $X_1,X_2,…,X_n$ is a random sample from a normal distribution, $X_i\sim N(\mu,9)$.

Find the UMVUE (uniformly minimum variance unbiased estimator) of $P(X\le c)$ where $c$ is a known constant. Do this by finding the conditional distribution of $X_1$ given $\bar{X}={\bar{x}}$ and apply the Rao-Blackwell theorem with $T=u(X_1)$, where $u(x_1)=1$ if $x\le c$ and zero otherwise.

So clearly the parameter that we're trying to estimate given the problem description can be written as $\Phi\left( \frac{c-\mu}{3} \right)$ where $\Phi$ represents the CDF of the standard normal distribution. However, I get stuck when I need to try and find the conditional distribution. Without knowing the joint distribution or the other conditional distribution, how can I possibly find the conditional distribution of $X_1$ given $\bar{X}={\bar{x}}$?

Best Answer

A complete sufficient statistic for $\mu$ is $\overline X$, or equivalently $S=\sum\limits_{i=1}^n X_i$.

Now $(X_1,S)$ has a bivariate normal distribution (can be verified quickly using moment generating functions), more specifically $(X_1,S)\sim N_2\left(\mu\begin{pmatrix}1\\n\end{pmatrix},9\begin{pmatrix}1&1\\1& n\end{pmatrix}\right)$.

This gives the conditional distribution of $X_1$ given $S=s$ as a univariate normal $N\left(\frac sn,9\left(1-\frac1n\right)\right)$.

Hence the UMVUE of $P(X_1\le c)$ is

\begin{align} E_{\mu}\left[I_{X_1\le c}\mid S\right]&=P_{\mu}(X_1\le c\mid S) \\&=\Phi\left(\frac{c-S/n}{3\sqrt{1-1/n}}\right) \\&=\Phi\left(\frac{c-\overline X}{3\sqrt{1-1/n}}\right) \end{align}

Related Question