I'm trying to use some code that includes Gamma priors for Poisson (rate) and Exponential (rate) distributions. I want to make the priors noninformative. I read that using a Gamma(0,0) is equivalent to the Jeffreys prior, which is noninformative. Is this true? Can anyone suggest any references for this? I thought the shape and scale parameters of a Gamma distribution had to be positive. Thanks.
Solved – Why is Gamma(0,0) equivalent to the Jeffreys prior
bayesiangamma distributionjeffreys-prior
Related Question
- R – How to Use the SD of a Normal Sampling Distribution to Specify the Gamma Prior?
- Solved – P.d.f for Gamma posterior with Exponential data
- Solved – Updating Gamma conjugate prior
- Bayesian – Choosing Prior for ?² in Normal Regression Model with MCMC
- Solved – Survival time problem exponential with gamma prior
- Solved – Understanding definition of informative and uninformative prior distribution
Best Answer
No, a Gamma(0,0) is not equivalent to the Jeffreys prior of the Poisson and Exponential rates (it is not even well defined). By Gammao(0,0) people usually mean a $Gamma(\epsilon,\epsilon)$ with $\epsilon\approx 0$. Its use became popular since the people from WINBUGS claimed that it "resembles" the shape of the Jeffreys prior for the variance parameters in certain hierarchical models. However, it has many detractors.
See also: Exponential Distribution - Rate - Bayesian Prior?
Although the Gamma prior is decreasing, the tails of this and the Jeffreys priors are different. Moreover, the Jeffreys prior of the Exponential is $1/\lambda$, while in the Poisson case is $\lambda^{-1/2}$, then, the claimed resemblance is not theoretically justified. In practice, however, with large or moderate samples, the influence of the prior is usually negligible. For these simple models, you can simply use the exact expression of the Jeffreys priors since they produce proper posteriors and they are easy to sample from using basic MCMC algorithms.