[Math] MLE for a uniform distribution.

maximum likelihoodparameter estimationstatisticsuniform distribution

Let $X_1,\dots,X_n$ be a sample of independent random variables with uniform distribution $(0,\theta)$. Find a $\hat{\theta}$ as an estimator for $\theta$ using the maximum likelihood method. the pdf is $\dfrac 1 \theta$ for $\theta \le x \le 2\theta$.

I've had a go and found that the likelihood function is $θ^{-n}$, taken the log and differentiated it to find the max and got to $-\dfrac {n}{\theta}$. I've seen a similar answer posted here: maximum estimator method more known as MLE of a uniform distribution, but I don't understand what the order statistics reasoning is, and what bounds to impose (if any). I was also wondering how to check its a max when we look at the second order derivative?

Best Answer

The likelihood function is $$L(\theta|\mathbb x)=\begin{cases}\dfrac{1}{\theta ^n},\,\,\,\theta \le x_i \le 2\theta ,\forall i\\0,\,\,\,\,\,\,\,\,\text{otherwise}\end{cases}$$ $$=\begin{cases}\dfrac{1}{\theta ^n},\,\,\,\theta \le x_{(1)} \le x_{(n)} \le2\theta \\0,\,\,\,\,\,\,\,\,\text{otherwise}\end{cases}$$ For $\theta \ge \dfrac {x_{(n)}}{2},L(\theta|\mathbb x)=\dfrac{1}{\theta ^n}$ is a decreasing function in $\theta$. Hence MLE of $\theta$ is $\color{blue}{\hat\theta=\dfrac{X_{(n)}}{2}}$.

Related Question